IISc Bangalore · Computer Science

Mathematical Foundations for Machine Learning

Prof. Arulalan Rajan, Prof. Ashok Rao · 70 free video lectures

This course will provide a holistic approach to the mathematical foundations for Machine Learning. The course is focussed on developing mathematical ideas, necessary for machine learning applications, through intuitions and visualizations.The course primarily focuses on three important mathematical…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Why this course?
  2. Fields and Their Properties – Algebraic Tools for ML
  3. Fields, Vector Spaces
  4. Vector Spaces and Subspaces
  5. Combining Vectors and Linear Independence
  6. Basis and Dimension
  7. Linear Transformation - Intuition
  8. Subspaces associated with Linear Transformations
  9. Matrix representation of Linear Transformation
  10. Examples of Linear Transformation
  11. Eigenvalues and Eigenvectors
  12. Multiplicity of Eigen Values
  13. Diagonalization of Matrix
  14. Diagonalizability, Invariant subspaces
  15. Dot Product on Vector Space
  16. Orthogonality on Vector Space
  17. Orthonormal Basis
  18. Orthogonal Projections
  19. Construction of Orthogonal Basis
  20. Approximating a vector in any given subspace
  21. Real Symmetric Matrices
  22. Least Square Fitting and Pseudo Inverse - 1
  23. Least Square Fitting and Pseudo Inverse - 2
  24. Principal Component Analysis (PCA)
  25. Singular Value Decomposition (SVD)
  26. Singular Value Decomposition (SVD) Interpretation
  27. Support Vector Machine (SVM)
  28. Consolidating Week1 to Week 4
  29. Introduction to Probability - 1
  30. Introduction to Probability - 2
  31. Mutually Exclusive Events, Independent Events and Conditional Probability
  32. Total Probability Theorem and Bayes' Theorem
  33. Probability - A Measure Theoretic Insight
  34. Random Experiment and Random Variables
  35. Discrete Random Variables and Probability Mass Function (PMF)
  36. Types of Discrete Random Variables and Their Probability Distributions
  37. Continuous Random Variables
  38. Expected Value of Random Variable
  39. Moments and Variance
  40. Joint Distributions and Marginals
  41. Joint Moments of Random Variables
  42. Independence and Correlation
  43. Correlation and Covariance
  44. Joint Moments of Continuous random Variables and Conditioning of Random Variables
  45. Markov Inequality
  46. Chebychev Inequality
  47. Central Limit Theorem
  48. Sample Geometry
  49. Covariance Matrix & its properties
  50. Functions, Derivatives, Infinite Series
  51. Differentiation Rules
  52. Multivariate functions
  53. Gradient and Directional Derivatives
  54. Rules for Partial Derivatives, Jacobian and Hessian
  55. Matrix derivatives
  56. Optimization Overview
  57. Constrained Optimization, Optimal solutions, Saddle point
  58. Constrained optimization, Lagrange Multiplier
  59. Revisiting Least squares, Principal Component Analysis
  60. Minimizing the Cost Function: Gradent Descent Algorithm
  61. Variants of the Gradient Descent Algorithm
  62. Neural Networks , Perceptron
  63. Multilayer Layer Perceptron
  64. Back Propogation Algorithm
  65. Data and Patterns
  66. Classification and a simple binary classifier
  67. Classification, Clustering Techniques
  68. Linear Regression : Line of best fit
  69. Logistic Regression
  70. Course Summary, Credits & Acknowledgments

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IISc Bangalore.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights