MIT · Mathematics & Statistics
18.065 Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
Gilbert Strang · 2018 · 34 free video lectures
Linear algebra concepts are key for understanding and creating machine learning algorithms, especially as applied to deep learning and neural networks. This course reviews linear algebra with applications to probability and statistics and optimization–and above all a full explanation of deep…
▶ Play on Open Lecture HallCourse page ↗
Lectures
- Lecture 1: the column space of a contains all vectors ax
- Lecture 2: multiplying and factoring matrices
- Lecture 3: orthonormal columns in q give q2019q i
- Lecture 4: eigenvalues and eigenvectors
- Lecture 5: positive definite and semidefinite matrices
- Lecture 6: singular value decomposition svd
- Lecture 7: eckart young the closest rank k matrix to a
- Lecture 8: norms of vectors and matrices
- Lecture 9: four ways to solve least squares problems
- Lecture 10: survey of difficulties with ax b
- Lecture 11: minimizing 2016x2016 subject to ax b
- Lecture 12: computing eigenvalues and singular values
- Lecture 13: randomized matrix multiplication
- Lecture 14: low rank changes in a and its inverse
- Lecture 15: matrices a t depending on t derivative da dt
- Lecture 16: derivatives of inverse and singular values
- Lecture 17: rapidly decreasing singular values
- Lecture 18: counting parameters in svd lu qr saddle points
- Lecture 19: saddle points continued maxmin principle
- Lecture 20: definitions and inequalities
- Lecture 21: minimizing a function step by step
- Lecture 22: gradient descent downhill to a minimum
- Lecture 23: accelerating gradient descent use momentum
- Lecture 24: linear programming and two person games
- Lecture 25: stochastic gradient descent
- Lecture 26: structure of neural nets for deep learning
- Lecture 27: backpropagation find partial derivatives
- Lecture 30: completing a rank one matrix circulants
- Lecture 31: eigenvectors of circulant matrices fourier matrix
- Lecture 32: imagenet is a cnn the convolution rule
- Lecture 33: neural nets and the learning function
- Lecture 34: distance matrices procrustes problem first project
- Lecture 35: finding clusters in graphs second project handwriting
- Lecture 36: third project alan edelman and julia language
From MIT OpenCourseWare · CC BY-NC-SA 4.0. More from MIT.
Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights