IIT Delhi , IIT Bombay · Computer Science

Introduction to Large Language Models (LLMs)

Prof. Soumen Chakraborti, Prof. Tanmoy Chakraborty · 2026 · 37 free video lectures

This course introduces the fundamental concepts underlying Large Language Models (LLMs). It starts with an introduction to the various problems in NLP, and discusses how to approach the problem of language modeling using deep learning. It describes the architectural intricacies of Transformers and…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lec 01 : Introduction and Recent Advances
  2. Lec 02 : Introduction to Natural Language Processing
  3. Lec 03 : Introduction to Statistical Language Models
  4. Lec 04 : Statistical LM: Advanced Smoothing and Evaluation
  5. Lec 05 : Introduction to Deep Learning
  6. Lec 06 : Introduction to PyTorch
  7. Lec 07 : Word Representation: Word2Vec & fastText
  8. Lec 08 : Word Representation: GloVe
  9. Lec 09 : Tokenization Strategies
  10. Lec 10 : Neural Language Models: CNN & RNN
  11. Lec 11 : Neural Language Models: LSTM & GRU
  12. Lec 12 : Sequence-to-Sequence Models
  13. Lec 13 : Decoding Strategies
  14. Lec 14 : Attention in Sequence-to-Sequence Models
  15. Lec 15 : Introduction to Transformer: Self & Multi-Head Attention
  16. Lec 16 : Introduction to Transformer: Positional Encoding and Layer Normalization
  17. Lec 17 : Implementation of Transformer using PyTorch
  18. Lec 18 : Pre-Training Strategies: ELMo, BERT
  19. Lec 19 : Pre-Training Strategies: Encoder-decoder and Decoder-only Models
  20. Lec 20 : Introduction to HuggingFace
  21. Lec 21 : Instruction Tuning
  22. Lec 22 : Prompt-based Learning
  23. Lec 23 : Advanced Prompting and Prompt Sensitivity
  24. Lec 24 : Alignment of Language Models-I
  25. Lec 25 : Alignment of Language Models-II
  26. Lec 26 : Knowledge and Retrieval: Knowledge Graph
  27. Lec 27 : Knowledge and Retrieval: Knowledge Graph Completion and Evaluation
  28. Lec 28 : Knowledge and Retrieval: Translation and Rotation Models
  29. Lec 29 : Parameter Efficient Fine-Tuning (PEFT)
  30. Lec 30 : Quantization, Pruning & Distillation
  31. Lec 31 : An Alternate Formulation of Transformers: Residual Stream Perspective
  32. Lec 32 : Interpretability Techniques
  33. Lec 33 : Knowledge and Retrieval: Multiplicative models
  34. Lec 34 : Knowledge and Retrieval: Modeling Hierarchies
  35. Lec 35 : Knowledge and Retrieval: Temporal Knowledge Graphs
  36. Lec 36 : Responsible LLMs
  37. Lec 37 : Conclusion: Expert Panel Discussion

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Delhi , IIT Bombay.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights