Pi0 - generalist Vision Language Action policy for robots (VLA Series Ep.2)

šŸ¤– The second video in the series about Visual Language Action policies for robotics! This time, I will focus on one of the most notable open-source VLA models, Pi0 from Physical Intelligence. šŸŽÆ What You'll Learn in This Episode: āœ… The model architecture and the overview āœ… Fine-tuning on your own robot āœ… FAST tokenization vs. Flow Matching āœ… LoRA vs Full fine-tuning āœ… Practical demo with LeKiwi and LeRobot šŸ”„ Coming Up in This Series: Pi-0.5 - the more advanced version of Pi 0 SmolVLA from HuggingFace LeRobot Gr00t N1.5 from NVIDIA And other related topics 0:00 Intro 3:44 Model Architecture 8:21 Action Expert Details 22:30 Fine-tuning with OpenPI 52:01 Experiments with My Robot 1:14:12 Outro šŸŽ¬ Series Playlist:    • VLAĀ policiesĀ inĀ roboticsĀ Ā  šŸ”— Resources & Code: Pi-0 Blog post: https://www.physicalintelligence.comp... Pi-0 Paper: https://www.physicalintelligence.comp... OpenPi Github: https://github.com/Physical-Intellige... My repository with configs and code for finetuning: https://github.com/IliaLarchenko/lero... My Dataset: https://huggingface.co/datasets/IliaL... LeKiwi Robot: https://github.com/SIGRobotics-UIUC/L... SO-ARM Kit: https://github.com/TheRobotStudio/SO-... LeRobot Library: https://github.com/huggingface/lerobot šŸŽ¬ Other related videos: Introduction to VLAs:    • LLMsĀ MeetĀ Robotics:Ā WhatĀ AreĀ Vision-Langua...Ā Ā  Short intro about SO-ARM:    • 3D-PrintableĀ Open-SourceĀ RoboticĀ ArmĀ withĀ AIĀ Ā  Big video about SO-ARM and LeRobot:    • RunningĀ AIĀ roboticsĀ experimentsĀ atĀ homeĀ wi...Ā Ā  Intro into LeKiwi:    • LeKiwi:Ā 3D-PrintedĀ MobileĀ ManipulatorĀ Robo...Ā Ā  Multimodality in robotics:    • MultimodalityĀ inĀ Robotics.Ā HowĀ toĀ predictĀ ...Ā Ā  Robot MCP project:    • MCPĀ serverĀ toĀ letĀ anyĀ LLMĀ controlĀ yourĀ rob...Ā Ā  šŸ’¬ Join the Discussion: What VLA-related topics do you want me to cover next? Drop your ideas below! I read every comment and often feature community suggestions in future videos. šŸ”” Don't miss the next episode! Hit the bell icon - this series releases every few weeks with hands-on tutorials, code walkthroughs, and real robot experiments. ⭐ Found this helpful? Like, subscribe, and share with anyone building the future of robotics! #Pi0 #Pi05 #VLA #Robotics #AI #ArtificialIntelligence #MachineLearning #LLM #VLM #transformers #PhysicalIntelligence #HuggingFace #LeRobot #EmbodiedAI #RobotLearning

Controlling the robot with VLA policy: Pi0.5 explained (FAST, System 1/2, KI, RTC) (VLA Series Ep.3)
ā–¶ļøŽ

Controlling the robot with VLA policy: Pi0.5 explained (FAST, System 1/2, KI, RTC) (VLA Series Ep.3)

LLMs Meet Robotics: What Are Vision-Language-Action Models? (VLA Series Ep.1)
ā–¶ļøŽ

LLMs Meet Robotics: What Are Vision-Language-Action Models? (VLA Series Ep.1)

Running AI robotics experiments at home with LeRobot and SO-ARM100
ā–¶ļøŽ

Running AI robotics experiments at home with LeRobot and SO-ARM100

How We Trained a Robot to Do 50 Household Tasks in Simulation (BEHAVIOR Challenge 1st place)
ā–¶ļøŽ

How We Trained a Robot to Do 50 Household Tasks in Simulation (BEHAVIOR Challenge 1st place)

I tested 3 different VLA models. Choose this one.
ā–¶ļøŽ

I tested 3 different VLA models. Choose this one.

šŸ¤– VLA Series Ep. 4: Gr00t - NVIDIA's Flagman VLA policy for robots
ā–¶ļøŽ

šŸ¤– VLA Series Ep. 4: Gr00t - NVIDIA's Flagman VLA policy for robots

LeRobot – Lowering the entry barrier to AI for robotics
ā–¶ļøŽ

LeRobot – Lowering the entry barrier to AI for robotics

The Craziest Mapping Breakthrough Since Google Maps
ā–¶ļøŽ

The Craziest Mapping Breakthrough Since Google Maps

Flow-Matching vs Diffusion Models explained side by side
ā–¶ļøŽ

Flow-Matching vs Diffusion Models explained side by side

ALOHA and ACT: LeRobot Research Presentation #1 by Alexander Soare
ā–¶ļøŽ

ALOHA and ACT: LeRobot Research Presentation #1 by Alexander Soare

Google DeepMind robotics lab tour with Hannah Fry
ā–¶ļøŽ

Google DeepMind robotics lab tour with Hannah Fry

Inside the World's Smartest Robot Brain [VLA]
ā–¶ļøŽ

Inside the World's Smartest Robot Brain [VLA]

Sergey Levine (UC Berkeley): Robot Foundation Models
ā–¶ļøŽ

Sergey Levine (UC Berkeley): Robot Foundation Models

Secrets of Walking Robot (NVIDIA Isaac Lab and Isaac Lab Arena)
ā–¶ļøŽ

Secrets of Walking Robot (NVIDIA Isaac Lab and Isaac Lab Arena)

OpenVLA: LeRobot Research Presentation #5 by Moo Jin Kim
ā–¶ļøŽ

OpenVLA: LeRobot Research Presentation #5 by Moo Jin Kim

MCP server to let any LLM control your robot #ai #robotics #mcp #claude #gemini #gpt
ā–¶ļøŽ

MCP server to let any LLM control your robot #ai #robotics #mcp #claude #gemini #gpt

How To Build End‑To‑End Physical AI Systems for Robots
ā–¶ļøŽ

How To Build End‑To‑End Physical AI Systems for Robots

Chelsea Finn: Building Robots That Can Do Anything
ā–¶ļøŽ

Chelsea Finn: Building Robots That Can Do Anything

AI Agent Drives my Household Robot
ā–¶ļøŽ

AI Agent Drives my Household Robot

Ļ€0: A Foundation Model for Robotics with Sergey Levine - 719
ā–¶ļøŽ

Ļ€0: A Foundation Model for Robotics with Sergey Levine - 719