Inside the World's Smartest Robot Brain [VLA]

Welch Labs Book: https://www.welchlabs.com/resources/a... Book & VLA Poster Bundle: https://www.welchlabs.com/resources/s... VLA Poster: https://www.welchlabs.com/resources/s... VLA Poster Digital Version: https://www.welchlabs.com/resources/v... Sections: 0:00 - Intro 1:40 - SayCan 2:59 - RT-1 4:35 - Palm-E 6:42 - RT-2 9:03 - The Welch Labs Illustrated Guide to AI 9:52 - Pi0 Overview 11:47 - PaliGemma 12:16 - Action Expert Overview 13:39 - PaliGemma Deep Dives 20:44 - Action Expert Deep Dive 29:19 - Just a Demo? 29:42 - World Models & Yann Lecun 30:26 - VLA Poster 31:00 - International Book Shipping! 31:12 - Book Updates 34:26 - Thank You To Readers Special thanks to: Pranav Atreya for very helpful RoboArena insight: https://robo-arena.github.io/ Tony Wang for helpful pointers on Pi0. ****https://penn-pal-lab.github.io/Pi0-Ex... Yevgen Chebotar for helping with questions about robotics development at Google Fabian Lübbe for kindly volunteering data. Robert Blumofe for helping find book errors. Check out his perceptron build guide! https://github.com/rdb64-hobbies/Perc...    • Demystifying Deep Learning: Illustrated Pe...   Supporting code: https://github.com/WelchLabs/videos References Karol Hausman “This was going to work” quote: https://unsupervised-learning.simplec... Pen uncap dataset: https://huggingface.co/datasets/physi... Note that pi0 is not controlling the robot in this episode, but is being run on captured data offline. https://saycan-corl.github.io/ https://robotics-transformer1.github.io/ https://palm-e.github.io/ https://robotics-transformer2.github.io/ https://www.pi.website/ Image Credits: Taylor Swift: By Cosmopolitan UK, CC BY 3.0, https://commons.wikimedia.org/w/index... Snoop Dogg: © Glenn Francis, [www.PacificProDigital.com](http://www.pacificprodigital.com/) Tom Cruise: Gage Skidmore Aloha Arm: trossenrobotics.com RALPH    • Navlab on CNN   PATRONS Juan Benet, Ross Hanson, Yan Babitski, AJ Englehardt, Alvin Khaled, Eduardo Barraza, Hitoshi Yamauchi, Jaewon Jung, Mrgoodlight, Shinichi Hayashi, Sid Sarasvati, Dominic Beaumont, Shannon Prater, Ubiquity Ventures, Matias Forti, Brian Henry, Tim Palade, Petar Vecutin, Nicolas baumann, Jason Singh, Robert Riley, vornska, Barry Silverman, Jake Ehrlich, Mitch Jacobs, Lauren Steely, Jeff Eastman, Rodolfo Ibarra, Clark Barrus, Rob Napier, Andrew White, Richard B Johnston, abhiteja mandava, Burt Humburg, Kevin Mitchell, Daniel Sanchez, Ferdie Wang, Tripp Hill, Richard Harbaugh Jr, Prasad Raje, Kalle Aaltonen, Midori Switch Hound, Zach Wilson, Chris Seltzer, Ven Popov, Hunter Nelson, Amit Bueno, Scott Olsen, Johan Rimez, Shehryar Saroya, Tyler Christensen, Beckett Madden-Woods, Darrell Thomas, Javier Soto, U007D, Caleb Begly, Rick Rubenstein, Brent Hunsaker, Dan Patterson, Tchsurvives, Alex Adai, Walter Reade, Zyansheep, Walter Reade, Duncan Stannett, Reginald Carey, Jean-Manuel Izaret, dh71633, Adrian Rodriguez, Dimitar Stojanovski, Michael Harder, Peter Maldonado, Emily Pesce, David Johnston, Insang Song, FaeTheWolf, Stephen Taylor, KittenKaboodle, EMatter, PATRICKMCCORMACK, John Beahan, Cameron, Cole Jones, Garrett Thornburg, Jeroen W, Rohit Sharma, GlennB, Emmanuel Cortes, Katie Quinn, Karina C, Cakra WW, Mike Ton, Eric Gometz, MacCallister Higgins, Niko Drossos, David Eraso, Tom Zehle, Steve, Brian Lineburg, rjbl, Michael Loh, Perry Vais, Bengal0, Farhad Manjoo, Sara Chipps, Ellis Driscoll, William Taysom, Will Harmon, CK, Abdullah, Peter Cho, Leo Nikora, Griffin Smith, Ash Katnoria, Alex, Markus Hays Nielsen, Catherine H., Vi, David Dobáš, Peter Wang, Sina Sohangir, Danny Thomas, Julian Francis, Hans Adler, Jiayu Peng, Weston M, Youssouf da Silva, John Thomas, Samuel Costello, Sam Adams, Bryan Liles, Malaya Zemlya, Karl, Vahe Andonians, Mike Doughty, Larry Novelo, Jonas Acres, Ludicrum Rex, Robert Blumofe, Anthony Z, Alex Zhao Created by: Sam Baskin, Pranav Gundu, and Stephen Welch Content ID: CFAQJOTYQHT7JYIT