IIT Madras · Computer Science
Reinforcement Learning
Prof. Balaraman Ravindran · 2024 · 60 free video lectures
Reinforcement learning is a paradigm that aims to model the trial-and-error learning process that is needed in many problem situations where explicit instructive signals are not available. It has roots in operations research, behavioral psychology and AI. The goal of the course is to introduce the…
▶ Play on Open Lecture HallCourse page ↗
Lectures
- Introduction to RL
- RL Framework and Applications
- Introduction to Immediate RL
- Bandit Optimalities
- Value Function Based Methods
- UCB 1
- Concentration Bounds
- UCB 1 Theorem
- PAC Bounds
- Median Elimination
- Thompson Sampling
- Policy Search
- REINFORCE
- Contextual Bandits
- Full RL Introduction
- Returns, Value Functions and MDPs
- MDP Modelling
- Bellman Equation
- Bellman Optimality Equation
- Cauchy Sequence and Green's Equation
- Banach Fixed Point Theorem
- Convergence Proof
- Lpi Convergence
- Value Iteration
- Policy Iteration
- Dynamic Programming
- Monte Carlo
- Control in Monte Carlo
- Off Policy MC
- UCT
- TD(0)
- TD(0) Control
- Q-Learning
- Afterstate
- Eligibility Traces
- Backward View of Eligibility Traces
- Eligibility Trace Control
- Thompson Sampling Recap
- Function Approximation
- Linear Parameterization
- State Aggregation Methods
- Function Approximation and Eligibility Traces
- LSTD and LSTDQ
- LSPI and Fitted Q
- DQN and Fitted Q-Iteration
- Policy Gradient Approach
- Actor Critic and REINFORCE
- REINFORCE (cont'd)
- Policy Gradient with Function Approximation
- Hierarchical Reinforcement Learning
- Types of Optimality
- Semi Markov Decision Processes
- Options
- Learning with Options
- Hierarchical Abstract Machines
- MAXQ
- MAXQ Value Function Decomposition
- Option Discovery
- POMDP Introduction
- Solving POMDP
From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Madras.
Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights