Google on 5th Epoch of Distributed Computing: Advanced Insights S1E4
Amin Vahdat, Engineering Fellow and VP of Machine Learning, Systems and Cloud AI at Google, and I delve into the transformative era of distributed computing. We explore the key characteristics, challenges and opportunities, as well as the future landscape. 0:00 – 0:30 Introduction 0:30 – 1:47 Amin’s Bio 1:48 – 2:53 Shared experience 2:53 – 3:34 Leapfrogging Innovation 3:35 – 4:59 1970 Blank Canvas 4:59 – 5:52 Innovation Impact and challenges 5:52 – 6:58 Supercomputing and Connecting People 6:58 – 7:33 Moore’s Law and the Personal Computing Era 7:33 – 7:47 Connected Computers 7:47 – 8:31 More Powerful PCs 8:31 – 9:07 2000s and Doubling Slows 9:07 – 11:14 Scale Out Takes Hold and Cluster-based Computing 11:14 – 12:28 Totality of Human Knowledge 12:28 – 13:37 Demand for More Computing 13:37 – 14:22 New Types of Accelerators 14:22 – 15:17 30 Seconds/Day = 10 Googles 15:17 – 15:50 5th Generation TPUs 15:50 – 16:17 Transformers Organizing Information 16:17 – 16:58 Model Growth 10X Annually 16:58 – 19:45 Specialized Accelerators for the Win? 19:45 – 20:55 Flavors of General Purpose 20:55 – 22:36 Power Challenge and Google’s 2030 power goals 22:36 – 25:13 Power Provisioning 25:13 – 26:52 Open Source vs Proprietary 26:52 – 27:58 Societal Infrastructure 27:58 – 29:21 Importance of Team Culture 29:22 – 30:30 Growth Mindset vs Static Thinking 30:31 – 31:55 Dangers of Village Mentality 31:56 – 32:34 Communicating Culture 32:35 – 33:45 Thank You Amin 33:46 – 34:29 Episode Wrap Up *** Subscribe: https://bit.ly/Subscribe_to_AMD Join the AMD Red Team Community: https://www.amd.com/en/gaming/community Join the AMD Red Team Discord Server: / discord Like us on Facebook: https://bit.ly/AMD_on_Facebook Follow us on Twitter: https://bit.ly/AMD_On_Twitter Follow us on Twitch: / amd Follow us on LinkedIn: https://bit.ly/AMD_on_Linkedin Follow us on Instagram: https://bit.ly/AMD_on_Instagram ©2024 Advanced Micro Devices, Inc. AMD, the AMD Arrow Logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and other jurisdictions. Other names are for informational purposes only and may be trademarks of their respective owners.

Natcast on U.S. Semiconductor Innovation: Advanced Insights S1E5

Distinguished Lecture: Amin Vahdat (Jan 12, 2023)

A Path Towards Autonomous Machine Intelligence with Dr. Yann LeCun

They can't hide SpaceX losses

AMD on Modular Design: Advanced Insights S1E2

How Nvidia GPUs Compare To Google’s And Amazon’s AI Chips

What runs ChatGPT? Inside Microsoft's AI supercomputer | Featuring Mark Russinovich

AMD on Exascale Computing: Advanced Insights S2E1

AWS re:Invent 2024 - Dive deep into the AWS Nitro System (CMP301)

How GPT, Claude, and Gemini are actually trained and served – Reiner Pope

GDC 2024 - GPU Work Graphs: Welcome to the Future of GPU Programming

Future of Networks - Amin Vahdat (Google)

Inside Anthropic, the $965 Billion AI Juggernaut | The Circuit

The World's Most Important Machine

How To Think SO CLEARLY People Assume You're A Genius

Bill Dally | Directions in Deep Learning Hardware

AMD on Disrupting Markets: Advanced Insights S1E1

3 New PCs, One Giant AI Model… This Shouldn’t Work

Oligarchy is worse than you think

