Engineering DeepSeek's GRPO: End-to-End Implementation in JAX [Road to Reasoning #10]

Follow along as we implement GRPO from scratch, using Flax NNX. This is an incredible project to fully grasp one of the most revolutionary RL algorithms for post-training and reasoning, introduced by DeepSeek. View my implementation code and the official papers: GitHub: https://github.com/thealepo/llm-reaso... Research Paper(s): https://arxiv.org/abs/2402.03300 LLM REASONING & RL FROM SCRATCH: COMPLETE ROADMAP This video is part of an ongoing, first-principles curriculum tracking the progression of reinforcement learning and alignment for modern reasoning models. Bookmark the playlist to follow the journey from zero to hero! Full Playlist:    • Road to Reasoning: A Journey Through LLM P...  

Join Today
Place your brain in the frequency of wealth, prosperity and total abundance - Attraction Law
▶︎

Place your brain in the frequency of wealth, prosperity and total abundance - Attraction Law

Engineering an RLHF Pipeline: End-to-End Implementation in JAX [Road to Reasoning #7]
▶︎

Engineering an RLHF Pipeline: End-to-End Implementation in JAX [Road to Reasoning #7]

I Wrote a JSON Serializer in Pure Bash
▶︎

I Wrote a JSON Serializer in Pure Bash

Paper Dives: Verbalizable Representations Form a Global Workspace in Language Models
▶︎

Paper Dives: Verbalizable Representations Form a Global Workspace in Language Models

Before ChatGPT: Understanding the Core Papers of RLHF [Road to Reasoning #6]
▶︎

Before ChatGPT: Understanding the Core Papers of RLHF [Road to Reasoning #6]

Yann LeCun: World Models: Enabling the next AI revolution
▶︎

Yann LeCun: World Models: Enabling the next AI revolution

How Massive LLMs Actually Fit on GPUs (Tensor Parallelism Explained)
▶︎

How Massive LLMs Actually Fit on GPUs (Tensor Parallelism Explained)

Keynote: After the AI Hype – What’s Real, and What’s Next - Richard Campbell - 2026
▶︎

Keynote: After the AI Hype – What’s Real, and What’s Next - Richard Campbell - 2026

What is SonarQube | Introduction SonarQube | SonarQube Tutorial | SonarQube Basics | Intellipaat
▶︎

What is SonarQube | Introduction SonarQube | SonarQube Tutorial | SonarQube Basics | Intellipaat

From Child Prodigy to Winning Fields Medal, Nobel of Math
▶︎

From Child Prodigy to Winning Fields Medal, Nobel of Math

We're 99.9% sure this pattern is true, but no one can prove it
▶︎

We're 99.9% sure this pattern is true, but no one can prove it

The World's Most Important Machine
▶︎

The World's Most Important Machine

Violence Expert: Real Self-Defense Is TERRIFYING
▶︎

Violence Expert: Real Self-Defense Is TERRIFYING

But what is quantum computing? (Grover's Algorithm)
▶︎

But what is quantum computing? (Grover's Algorithm)

Building the PERFECT Linux PC with Linus Torvalds
▶︎

Building the PERFECT Linux PC with Linus Torvalds

Is AI Hiding Its Full Power? With Geoffrey Hinton
▶︎

Is AI Hiding Its Full Power? With Geoffrey Hinton

How to Build Systems to Actually Achieve Your Goals
▶︎

How to Build Systems to Actually Achieve Your Goals

Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
▶︎

Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI

China Is About To Pop The AI Bubble
▶︎

China Is About To Pop The AI Bubble