IISc Bangalore · Computer Science

Mathematical Foundations of Machine Learning

Prof. Prathosh A P · 85 free video lectures

85 video lectures. Topics: Overview of Function Approximation; Recap of Probability Theory - 1, Part 1; Recap of Probability Theory - 1, Part 2; Recap of Probability Theory - 1, Part 3; Recap of Probability Theory Part 2; Understanding a Chest X-Ray as Sample from Distribution; IID Assumption…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Overview of Function Approximation
  2. Recap of Probability Theory - 1, Part 1
  3. Recap of Probability Theory - 1, Part 2
  4. Recap of Probability Theory - 1, Part 3
  5. Recap of Probability Theory Part 2
  6. Understanding a Chest X-Ray as Sample from Distribution
  7. IID Assumption
  8. Distribution Estimation
  9. Density Function
  10. Challenge With ML
  11. Tutorial 1 : Introduction to Python Basics
  12. Tutorial 2 : Simple Problem solving in Probability Theory
  13. Entropy
  14. Kullback-Leibler (KL) Divergence
  15. Minimization of KL Divergence
  16. Example of ML Estimate
  17. Risk Minimization Framework
  18. Bayes Classifier
  19. Tutorial 3 : Risk Minimization Framework
  20. MLE for Gaussian Distribution
  21. MLE for Generalized Discrete Random Variable
  22. Density Estimation for Mixed Distribution
  23. Latent Variable Models
  24. MLE for Latent Variable Models
  25. Expectation Maximization Algorithm
  26. Tutorial 4 : Minmax Classifier
  27. Tutorial 5 : Neyman Pearson Classifier
  28. Tutorial 6 : Example of NP Classifier, ROC Curve
  29. Tutorial 7A : MLE for Gaussian Distribution
  30. Tutorial 7B : MLE for Generalized Discrete Distribution
  31. Convergence of EM
  32. EM for GMMs
  33. MAP Estimate
  34. Parzen Window
  35. Nearest Neighbor Classifier
  36. Tutorial 8 : Computation of EM for GMMs
  37. Tutorial 9 : MAP Estimate
  38. Ordinary Least Squares (OLS)
  39. Generalized Least Squares (GLS)
  40. Linear Models for Classification
  41. Bias - Variance Decomposition and Analysis
  42. Bias & Variance in Practice
  43. Tutorial 10 Part A : Numerical Example on Bayes Classifier
  44. Tutorial 10 Part B : Numerical Example on MLE and MAP Estimate
  45. Regularization
  46. Regularized ERM and MAP Estimate
  47. Stochastic Gradient Descent as a Regularizer
  48. Max-Margin Classifier and SVM
  49. SVM Formulation
  50. Dual Function in SVM
  51. SVM for Non-Linear Seperable Case
  52. SVM with Kernel Function
  53. Neural Networks and Universal Approximation Theorem
  54. ERM on Neural Networks and Error Backpropagation
  55. Local Receptive Field and Parameter Sharing
  56. Convolutional Neural Networks(CNNs) as Regularized MLP
  57. Recurrent Neural Networks(RNNs)
  58. Back Prapogation in RNNs and Vanishing Gradients Problem
  59. LSTMs and GRUs
  60. Tutorial 11 : Pytorch - Tensors and Data Loaders
  61. Tutorial 12 : Pytorch - Building MLP and Auto Grad
  62. Tutorial 13 : Pytorch - Training the Model
  63. Attention Part1
  64. Attention Part2
  65. Multi-Head Attention and Transformer Architecture
  66. Positional Embeddings
  67. Transfer Learning and Knowledge Distilation
  68. SGD, RMS Prop, ADAM : Optimizers
  69. Tutorial 14 Part 1 : CNNs
  70. Tutorial 14 Part 2 : Transfer Learning using CNNs
  71. Tutorial 15 Part 1 : RNNs, LSTMs and GRUs
  72. Tutorial 15 Part 2 : Deep RNNs, LSTMs and GRUs
  73. Decision Trees and Impurity Measures
  74. Regression Trees
  75. Ensemble Methods, Bagging and Boosting
  76. Gradient Boosting Algorithm
  77. Ada-Boosting
  78. Cross Validation
  79. Un-Supervised Learning
  80. K-Means Clustering
  81. PCA - Principal Component Analysis
  82. NCE - Noise Contrastive Estimation
  83. NCE, Info-NCE, SimCLR, JEPA
  84. Introduction to Generative Models
  85. GAN - Generative Adversarial Networks

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IISc Bangalore.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights