IIT Guwahati · Mathematics & Statistics
Discrete-time Markov Chains and Poisson Processes
Prof. Ayon Ganguly , Prof. Subhamay Saha · 2026 · 35 free video lectures
35 video lectures. Topics: Review of Basic Probability I; Review of Basic Probability II; Review of Basic Probability III; Stochastic Processes; Definition of Markov Chain and Transition Probabilities; Markov Property and Chapman-Kolmogorov Equations; Chapman-Kolmogorov Equations: Examples…
▶ Play on Open Lecture HallCourse page ↗
Lectures
- Lec 1: Review of Basic Probability I
- Lec 2: Review of Basic Probability II
- Lec 3: Review of Basic Probability III
- Lec 4: Stochastic Processes
- Lec 5: Definition of Markov Chain and Transition Probabilities
- Lec 6: Markov Property and Chapman-Kolmogorov Equations
- Lec 7: Chapman-Kolmogorov Equations: Examples
- Lec 8: Accessibility and Communication of States
- Lec 9: Hitting Time I
- Lec 10: Hitting Time II
- Lec 11: Hitting Time III
- Lec 12: Strong Markov Property
- Lec 13: Passage Time and Excursion
- Lec 14: Number of Visits
- Lec 15: Class Property
- Lec 16: Transience and Recurrence of Random Walks
- Lec 17: Stationary Distribution I
- Lec 18: Stationary Distribution II
- Lec 19: Stationary Distribution III
- Lec 20: Limit Theorems I
- Lec 21: Limit Theorems II
- Lec 22: Some Problems I
- Lec 23: Some Problems II
- Lec 24: Time Reversibility
- Lec 25: Properties of Exponential Distribution
- Lec 26: Some Problems
- Lec 27: Order Statistics
- Lec 28: Poisson Processes
- Lec 29: Poisson Thinning I
- Lec 30: Poisson Thinning II
- Lec 31: Conditional Arrival Times
- Lec 32: Independent Poisson Processes
- Lec 33: Some Problems
- Lec 34: Compound Poisson Processes
- Live Session 15-03-2022
From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Guwahati.
Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights