IIT Gadhinagar , IIT Kharagpur · Computer Science

Scalable Data Science

Prof. Anirban Dasgupta, Prof. Sourangshu Bhattacharya · 2019 · 40 free video lectures

Consider the following example problems: One is interested in computing summary statistics (word count distributions) for a set of words which occur in the same document in entire Wikipedia collection (5 million documents). Naive techniques, will run out of main memory on most computers. One needs…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lecture 1 : Background: Introduction
  2. Lecture 2 : Probability: Concentration inequalities
  3. Lecture 3 : Linear algebra: PCA, SVD
  4. Lecture 4 : Optimization: Basics, Convex, GD
  5. Lecture 5 : Machine Learning: Supervised, generalization, feature learning, clustering.
  6. Lecture 6 : Memory-efficient data structures: Hash functions, universal / perfect hash families
  7. Lecture 7 : Bloom filters
  8. Lecture 8 : Sketches for distinct count
  9. Lecture 9 : Sketches for distinct count (Contd.)
  10. Lecture 10 : Misra-Gries sketch
  11. Lecture 11 : Frequent Element: Space Saving and Count Min.
  12. Lecture 12 : Frequent Element: Count Sketch
  13. Lecture 13 : Near Neighbors
  14. Lecture 14 : Locality Sensitive Hashing.
  15. Lecture 15 : Building LSH Tables.
  16. Lecture 16 : Approximate near neighbors search: Extensions e.g. multi-probe, b-bit hashing, Data dependent variants
  17. Lecture 17 : Approximate near neighbors search: Extensions e.g. multi-probe, b-bit hashing, Data dependent variants (Contd.)
  18. Lecture 18 : Approximate near neighbors search: Extensions e.g. multi-probe, b-bit hashing, Data dependent variants (Contd.)
  19. Lecture 19 : Randomized Numerical Linear Algebra: Random projection
  20. Lecture 20 : Randomized Numerical Linear Algebra: Random projection (Contd.)
  21. Lecture 21 : Randomized Numerical Linear Algebra:a) Matrix multiplication + QB decomposition
  22. Lecture 22 : Randomized Numerical Linear Algebra:b) CUR+CX
  23. Lecture 23 : Randomized Numerical Linear Algebra:a) L2 regression using RP
  24. Lecture 24 : Randomized Numerical Linear Algebra:b) Leverage scores
  25. Lecture 25 : Randomized Numerical Linear Algebra:c) Hash Kernels + Kitchen Sink
  26. Lecture 26 : Map-reduce and Hadoop
  27. Lecture 27 : Hadoop System
  28. Lecture 28 : Hadoop System(Contd.)
  29. Lecture 29 : Hadoop System(Contd.)
  30. Lecture 30 : Spark
  31. Lecture 31 : Spark(Contd.)
  32. Lecture 32 : Spark(Contd.)
  33. Lecture 33 : Distributed Machine Learning and Optimization: Introduction
  34. Lecture 34 : SGD+Proof
  35. Lecture 35 : SGD+Proof(Contd.)
  36. Lecture 36 : Distributed Machine Learning and Optimization: ADMM + applications
  37. Lecture 37 : Distributed Machine Learning and Optimization: ADMM + applications(Contd.)
  38. Lecture 38 : Clustering
  39. Lecture 39 : Clustering(Contd.)
  40. Lecture 40 : Conclusion

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Gadhinagar , IIT Kharagpur.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights