How DeepSeek Scaled Mathematical Reasoning: GRPO Paper Breakdown [Road to Reasoning #9]

In this video, we read DeepSeekMath, a foundational paper that introduces Group Relative Policy Optimization (GRPO), a PPO variant that fully removes the Value model (as to save memory), while resulting in incredible performance in mathematical reasoning. View my implementation code and the official papers: GitHub: https://github.com/thealepo/llm-reaso... Research Paper(s): https://arxiv.org/abs/2402.03300 LLM REASONING & RL FROM SCRATCH: COMPLETE ROADMAP This video is part of an ongoing, first-principles curriculum tracking the progression of reinforcement learning and alignment for modern reasoning models. Bookmark the playlist to follow the journey from zero to hero! Full Playlist:    • Road to Reasoning: A Journey Through LLM P...