Policy Gradient Methods | Reinforcement Learning Part 6
The machine learning consultancy: https://truetheta.io Join my email list to get educational and useful articles (and nothing else!): https://mailchi.mp/truetheta/true-the... Want to work together? See here: https://truetheta.io/about/#want-to-w... Policy Gradient Methods are among the most effective techniques in Reinforcement Learning. In this video, we'll motivate their design, observe their behavior and understand their background theory. SOCIAL MEDIA LinkedIn : / dj-rich-90b91753 Twitter : / duanejrich Github: https://github.com/Duane321 Enjoy learning this way? Want me to make more videos? Consider supporting me on Patreon: / mutualinformation SOURCES FOR THE FULL SERIES [1] R. Sutton and A. Barto. Reinforcement learning: An Introduction (2nd Ed). MIT Press, 2018. [2] H. Hasselt, et al. RL Lecture Series, Deepmind and UCL, 2021, • DeepMind x UCL RL Lecture Series - Introdu... [3] J. Achiam. Spinning Up in Deep Reinforcement Learning, OpenAI, 2018 ADDITIONAL SOURCES FOR THIS VIDEO [4] J. Achiam, Spinning Up in Deep Reinforcement Learning: Intro to Policy Optimization, OpenAI, 2018, https://spinningup.openai.com/en/late... [5] D. Silver, Lecture 7: Policy Gradient Methods, Deepmind, 2015, • RL Course by David Silver - Lecture 7: Pol... TIMESTAMPS 0:00 Introduction 0:50 Basic Idea of Policy Gradient Methods 2:30 A Familiar Shape 4:23 Motivating the Update Rule 10:51 Fixing the Update Rule 12:55 Example: Windy Highway 16:47 A Problem with Naive PGMs 19:43 Reinforce with Baseline 21:42 The Policy Gradient Theorem 25:20 General Comments 28:02 Thanking The Sources LINKS Windy Highway: https://github.com/Duane321/mutual_in... NOTES [1] When motivating the update rule with an animation protopoints and theta bars, I don't specify alpha. That's because the lengths of the gradient arrows can only be interpretted on a relative basis. Their absolute numeric values can't be deduced from the animation because there was some unmentioned scaling done to make the animation look natural. Mentioning alpha would have make this calculation possible to attempt, so I avoided it.
Proximal Policy Optimization (PPO) - How to train Large Language Models
The FASTEST introduction to Reinforcement Learning on the internet
Policy Gradient in 30 min
Policy Gradient Theorem Explained - Reinforcement Learning
Gaussian Processes
Bellman Equations, Dynamic Programming, Generalized Policy Iteration | Reinforcement Learning Part 2
The PROBLEM with Capitalism - Smarter Every Day 316
Importance Sampling
Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 3: Policy Gradients
The Most Powerful Manifestation Technique ... It Works So Fast It's Scary.
But what is quantum computing? (Grover's Algorithm)
Proximal Policy Optimization (PPO) for LLMs Explained Intuitively
Instant Focus Mode – 40Hz Gamma Brainwave Music for Deep Focus & Productivity
Function Approximation | Reinforcement Learning Part 5
![DeepMind x UCL RL Lecture Series - Policy-Gradient and Actor-Critic methods [9/13]](https://i.ytimg.com/vi/y3oqOjHilio/hqdefault.jpg?sqp=-oaymwEmCNACELwBSFryq4qpAxgIARUAAAAAGAElAADIQj0AgKJDeAG4Ahc=&rs=AOn4CLDZ3CzLTNU7rZcWaZzuMUFcKy74Gg&usqp=CBc)
DeepMind x UCL RL Lecture Series - Policy-Gradient and Actor-Critic methods [9/13]
Reinforcement Learning: A (practical) introduction
Temporal Difference Learning (including Q-Learning) | Reinforcement Learning Part 4
Simply Explaining Proximal Policy Optimization (PPO) | Deep Reinforcement Learning
Monte Carlo And Off-Policy Methods | Reinforcement Learning Part 3
