IIT (BHU) Varanasi · Mathematics & Statistics

A Primer to Mathematical Optimization

Prof. Debdas Ghosh · 42 free video lectures

In this era of Machine Learning and Data Science, students often crave for learning the basic tools of optimization theory because machine learning ideas essentially exploit the power of Numerical Linear Algebra, Optimization, and Statistics. The primary aim of this course is to hand over a…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lecture 01: Introduction and Histroy on the Development of Optimization Theory
  2. Lecture 02: Tools from Linear Algebra
  3. Lecture 03: Tools from Linear Algebra
  4. Lecture 04 : Tools for calculus of several variables
  5. Lecture 05 : Tools from calculus of several variables
  6. Lecture 6: Order of Convergence
  7. Lecture 7: Continuity
  8. Lecture 8 & 9 : Partial and Directional Derivatives and Differentiability
  9. Lecture - 10 : Taylor's Theorem
  10. Lecture - 11 : Convex Sets & Convexity Preserving Operations
  11. Lecture - 12 : Separation Result
  12. Lecture - 13 & 14 : Theorems of Alternatives
  13. Lecture - 15 : Convex Functions
  14. Lecture -16 : Properties and Zeroth Order Characterization of Convex Functions
  15. Lecture - 17 : First-Order and Second-Order Characterization of Convex Functions
  16. Lecture - 18 : Convexity Preserving Operations
  17. Lecture - 19 : Optimality and Coerciveness
  18. Lecture 20 part 1: First Order Optimality Condition
  19. Lecture 20 part 2: Second Order Optimality Conditions
  20. Lecture 21: General Structure of Unconstrained Optimization Algorithms
  21. Lecture 22: Inexact Line Search
  22. Lecture 23 & 24: Global Convergence of Descent Methods
  23. Lecture 25: Where do Descent Methods Converge?
  24. Lecture - 26 : Scaling Of Variables
  25. Lecture - 27 : Practical Stopping Criteria
  26. Lecture - 28 & 29 : Steepest Descent Method
  27. Lecture - 30, 31 & 32 : Newton's Method
  28. Lecture - 33, 34 & 35
  29. Lecture - 36 & 37
  30. Lecture - 38 Part 1
  31. Lecture - 38 Part 2
  32. Lecture - 39 : A Revisit to Lagrange Multipliears Method
  33. Lecture - 40 : Special Cones for Contrained Optimization
  34. Lecture - 41 : Tangent Cone
  35. Lecture - 42 & 43 : First-Order KKT Optimality Conditions
  36. Lecture 44 : Second-Order KKT Optimality Conditions
  37. Lecture 45 : Constraint Qualifications
  38. Lecture 46, 47, 48, 49 & 50 : Lagrangian Duality Theory
  39. Lecture 51, 52 & 53 : Methods for Linearly Constrained Problems
  40. Lecture 54 : Interior-Point Method for QPP
  41. Lecture 55 : Penalty Methods
  42. Lecture 56 : Sequential Quadratic Programming Method

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT (BHU) Varanasi.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights