IIT Guwahati · Mathematics & Statistics

Discrete-time Markov Chains and Poisson Processes

Prof. Ayon Ganguly , Prof. Subhamay Saha · 2026 · 35 free video lectures

35 video lectures. Topics: Review of Basic Probability I; Review of Basic Probability II; Review of Basic Probability III; Stochastic Processes; Definition of Markov Chain and Transition Probabilities; Markov Property and Chapman-Kolmogorov Equations; Chapman-Kolmogorov Equations: Examples…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lec 1: Review of Basic Probability I
  2. Lec 2: Review of Basic Probability II
  3. Lec 3: Review of Basic Probability III
  4. Lec 4: Stochastic Processes
  5. Lec 5: Definition of Markov Chain and Transition Probabilities
  6. Lec 6: Markov Property and Chapman-Kolmogorov Equations
  7. Lec 7: Chapman-Kolmogorov Equations: Examples
  8. Lec 8: Accessibility and Communication of States
  9. Lec 9: Hitting Time I
  10. Lec 10: Hitting Time II
  11. Lec 11: Hitting Time III
  12. Lec 12: Strong Markov Property
  13. Lec 13: Passage Time and Excursion
  14. Lec 14: Number of Visits
  15. Lec 15: Class Property
  16. Lec 16: Transience and Recurrence of Random Walks
  17. Lec 17: Stationary Distribution I
  18. Lec 18: Stationary Distribution II
  19. Lec 19: Stationary Distribution III
  20. Lec 20: Limit Theorems I
  21. Lec 21: Limit Theorems II
  22. Lec 22: Some Problems I
  23. Lec 23: Some Problems II
  24. Lec 24: Time Reversibility
  25. Lec 25: Properties of Exponential Distribution
  26. Lec 26: Some Problems
  27. Lec 27: Order Statistics
  28. Lec 28: Poisson Processes
  29. Lec 29: Poisson Thinning I
  30. Lec 30: Poisson Thinning II
  31. Lec 31: Conditional Arrival Times
  32. Lec 32: Independent Poisson Processes
  33. Lec 33: Some Problems
  34. Lec 34: Compound Poisson Processes
  35. Live Session 15-03-2022

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Guwahati.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights