IIT Kanpur · Engineering

Applied Linear Algebra for Signal Processing, Data Analytics and Machine Learning

Prof. Aditya K. Jagannatham · 70 free video lectures

This course aims to introduce students to all the basic and advanced concepts in Linear Algebra with a strong focus on applications. Linear Algebra is one of the fundamental tools that has applications in diverse fields such as Machine Learning, Data Analytics, Signal Processing, Wireless…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lec 01- Vector Properties: Addition, Linear Combination, Inner Product, Orthogonality, Norm
  2. Lec 02- Vectors: Unit Norm Vector, Cauchy-Schwarz inequality, Radar Application
  3. Lec 03- Inner Product Application: Beamforming in Wireless Communication Systems
  4. Lec 04- Matrices, Definition, Addition and Multiplication of Matrices
  5. Lec 05- Matrix: Column Space, Linear Independence, Rank of Matrix, Gaussian Elimination
  6. Lec 06- Matrix: Determinant, Inverse Computation, Adjoint, Cofactor Concepts
  7. Lec 07- Applications of Matrices: Solution of System of Linear equations, MIMO Wireless Technology
  8. Lec 08- Applications of Matrices: Electric Circuits, Traffic flows
  9. Lec 09- Applications of Matrices: Graph Theory, Social Networks, Dominance Directed Graph, Influential Node
  10. Lec 10- Null Space of Matrix: Definition, Rank-Nullity Theorem, Application in Electric Circuits
  11. Lec 11- Gram-Schmidt Orthogonalization
  12. Lec 12- Gaussian Random Variable: Definition, Mean, Variance, Multivariate Gaussian, Covariance Matrix
  13. Lec 13- Linear Transformation of Gaussian Random Vectors
  14. Lec 14- Machine Learning Application: Gaussian Classification
  15. Lec 15- Eigenvalue: Definition, Characteristic Equation, Eigenvalue Decomposition
  16. Lec 16- Special Matrices: Rotation and Unitary Matrices, Application: Alamouti Code
  17. Lec 17- Positive Semi-definite (PSD) Matrices: Definition, Properties, Eigenvalue Decomposition
  18. Lec 18- Positive Semidefinite Matrix: Example and Illustration of Eigenvalue Decomposition
  19. Lec 19- Machine Learning Application: Principal Component Analysis (PCA)
  20. Lec 20- Computer Vision Application: Face Recognition, Eigenfaces
  21. Lec 21- Least Squares (LS) Solution, Pseudo-Inverse Concept
  22. Lec 22- Least Squares (LS) via Principle of Orthogonality, Projection Matrix, Properties
  23. Lec 23- Application: Pseudo-Inverse and MIMO Zero Forcing (ZF) Receiver
  24. Lec 24- Wireless Application: Multi-Antenna Channel Estimation
  25. Lec 25- Machine Learning Application: Linear Regression
  26. Lec 26- Computation Mathematics Application: Polynomial Fitting
  27. Lec 27- Least Norm Solution
  28. Lec 28- Wireless Application: Multi-user Beamforming
  29. Lec 29- Singular Value Decomposition (SVD): Definition, Properties, Example
  30. Lec 30- SVD Application in MIMO Wireless Technology: Spatial-Multiplexing and High Data Rates
  31. Lec 31- SVD for MIMO wireless optimization, water-filling algorithm, optimal power allocation
  32. Lec 32- SVD application for Machine Learning: Principal component analysis (PCA)
  33. Lec 33- Multiple signal classification (MUSIC) algorithm: system model
  34. Lec 34- MUSIC algorithm for Direction of Arrival (DoA) estimation
  35. Lec 35- Linear minimum mean square error (LMMSE) principle
  36. Lec 36- LMMSE estimate and error covariance matrix
  37. Lec 37- LMMSE estimation in linear systems
  38. Lec 38- LMMSE application: Wireless channel estimation and example
  39. Lec 39- Time-series prediction via auto-regressive (AR) model
  40. Lec 40- Recommender system: design and rating prediction
  41. Lec 41- Recommender system: Illustration via movie rating prediction example
  42. Lec 42- Fast Fourier transform (FFT) and Inverse fast Fourier transform (IFFT)
  43. Lec 43- IFFT/ FFT application in Orthogonal Frequency Division Multiplexing (OFDM) wireless technology
  44. Lec 44- OFDM system: Circulant matrices and properties
  45. Lec 45- OFDM system model: Transmitter and receiver processing
  46. Lec 46- Single-carrier frequency division for multiple access (SC-FDMA) technology
  47. Lec 47- Linear dynamical systems: definition and solution via matrix exponential
  48. Lec 48- Linear dynamical systems: matrix exponential via SVD
  49. Lec 49- Machine Learning application: Support Vector Machines (SVM)
  50. Lec 50- Support Vector Machines (SVM): Problem formulation via maximum hyperplane separation
  51. Lec 51- Sparse regression: problem formulation and relation to Compressive Sensing (CS)
  52. Lec 52- Sparse regression: solution via the Orthogonal Matching Pursuit (OMP) algorithm
  53. Lec 53- OMP Example for Sparse Regression
  54. Lec 54- Machine Learning Application: Clustering
  55. Lec 55- K-Means Clustering algorithm
  56. Lec 56- Introduction to Stochastic Processes and Markov Chains
  57. Lec 57- Discrete Time Markov Chains and Transition Probability Matrix
  58. Lec 58- Discrete Time Markov Chain Examples
  59. Lec 59- m-STEP Transition Probabilities for Discrete Time Markov Chains
  60. Lec 60- Limiting Behavior of Discrete Time Markov Chains
  61. Lec 61- Least Squares Revisited: Rank Deficient Matrix
  62. Lec 62- Least Squares using SVD
  63. Lec 63- Weighted Least Squares
  64. Lec 64- Weighted Least Squares Example
  65. Lec 65- Woodbury Matrix Identity – Matrix Inversion Lemma
  66. Lec 66- Woodbury Matrix Identity – Proof
  67. Lec 67- Conditional Gaussian Density - Mean
  68. Lec 68- Conditional Gaussian Density - Covariance
  69. Lec 69- Scalar Linear Model for Gaussian Estimation
  70. Lec 70- MMSE Estimate and Covariance for the Scalar Linear Model

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Kanpur.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights