IIT Kharagpur · Mathematics & Statistics

Applied Stochastic Processes

Prof. Amitalok Jayant Budkuley, Prof. Swanand Ravindra Khare · 60 free video lectures

60 video lectures. Topics: Introduction to Probability; Conditional Probability; Total Probability and Bayes’ Rule; Random Variables (Discrete); Discrete Random Variables & Special Distributions; Continuous Random Variables; Expectation, Variance and Joint Distributions; Conditional pmfs and pdfs…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Lecture 01 : Introduction to Probability
  2. Lecture 02 : Conditional Probability
  3. Lecture 03 : Total Probability and Bayes’ Rule
  4. Lecture 04 : Random Variables (Discrete)
  5. Lecture 05 : Discrete Random Variables & Special Distributions
  6. Lecture 6 : Continuous Random Variables
  7. Lecture 7 : Expectation, Variance and Joint Distributions
  8. Lecture 8 : Conditional pmfs and pdfs, Independence
  9. Lecture 9 : Conditional Expectation and Conditional Variance
  10. Lecture 10 : Functions of random variable, sampling, limit theorems
  11. Lecture 11 : Introduction to Stochastic Processes, Hitting Time
  12. Lecture 12 : Markov Chains
  13. Lecture 13 : Chapman–Kolmogorov Equations
  14. Lecture 14 : Classification of States
  15. Lecture 15 : Limiting and Stationary Distributions
  16. Lecture 16 : Existence and Uniqueness of Stationary Distributions
  17. Lecture 17 : Positive and Null Recurrence
  18. Lecture 18 : Computation of Stationary Distribution and Gambler's Ruin
  19. Lecture 19 : Mean Time in Transient States and Branching Processes
  20. Lecture 20 : Hidden Markov Models
  21. Lecture 21 : Introduction to counting processes and Bernoulli random processes
  22. Lecture 22 : Foundations of discrete-time Bernoulli random processes
  23. Lecture 23 : Bernoulli random processes: Alternate synthesis approaches
  24. Lecture 24 : Counting function of Bernoulli random processes
  25. Lecture 25 : Operations on Bernoulli random processes, and summary
  26. Lecture 26 : Foundations of continuous-time Poisson random processes
  27. Lecture 27 : Poisson counting processes: Dynamical system approach, counting function
  28. Lecture 28 : Bernoulli approximation of Poisson processes, Key properties and illustrations via counting functions of Poisson counting proc…
  29. Lecture 29 : Operations on Poisson counting processes, Illustrative examples
  30. Lecture 30 : Illustrative examples involving Poisson counting processes, summary, and comparison of Bernoulli and Poisson counting processe…
  31. Lecture 31 : Continuous-time Markov Chains (CTMCs): Introduction
  32. Lecture 32 : CTMCs Foundations 1: Formal definitions of important quantities associated with CTMCs
  33. Lecture 33 : CTMCs Foundations 2: Transition rates, Generator, Embedded chains
  34. Lecture 34 : CTMCs via a sequence of DTMCs
  35. Lecture 35 : Birth-Death CTMCs: Foundations
  36. Lecture 36 : Birth-Death CTMCs: Illustrations
  37. Lecture 37 : CTMCs: A re-look using first principles approach (I)
  38. Lecture 38 : CTMCs: A re-look using first principles approach (II)
  39. Lecture 39 : Transient analysis of CTMCs
  40. Lecture 40 : Steady state analysis of CTMCs, Reversibility, birth-death chains and reversibility
  41. Lecture 41 : Renewal process: Foundations, examples, applications
  42. Lecture 42 : Counting function of Renewal processes
  43. Lecture 43 : Renewal function and Elementary renewal theorem
  44. Lecture 44 : CLT for Renewal processes, Renewal reward theorem, Illustration via age of renewal
  45. Lecture 45 : Renewal process: Illustrations and extensions
  46. Lecture 46 : Queuing theory: Foundations, applications, Illustrative example via timing diagram
  47. Lecture 47 : Discrete-time Queues: Geo/Geo/1 queues
  48. Lecture 48 : Continuous-time Queues: M/M/* queues
  49. Lecture 49 : Delay models and delay analysis in Queueing theory
  50. Lecture 50 : Queueing Theory: General queues, Burke's theorem, Tandem queues, examples
  51. Lecture 51 : Introduction to Brownian Motion and Random Walks
  52. Lecture 52 : Properties and Joint Distributions of Brownian Motion
  53. Lecture 53 : White Noise and Stochastic Integrals
  54. Lecture 54 : Gaussian Processes and Brownian Bridge
  55. Lecture 55 : Stationary Processes and Random Telegraph Signal
  56. Lecture 56 : Second-Order Stationarity and Auto-Regressive Processes
  57. Lecture 57 : Linear Systems and Spectral Density
  58. Lecture 58 : Pricing Stock Options & Arbitrage Theorem
  59. Lecture 59 : Martingales and Geometric Brownian Motion
  60. Lecture 60 : Black-Scholes Formula & Jump Processes

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Kharagpur.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights