I built an 8x NVIDIA GB10 cluster for massive Local AI

We built a "massive" 8x NVIDIA GB10 cluster with 1TB of memory, 160 Arm cores, eight Blackwell GPUs, many TBs of storage, and around 1.7Tbps of networking. Thank you to Micro Center for sponsoring this video. What is fun, you do not even need to set it up yourself anymore as we had AI agents handle all of the configuration after we got the initial username and password on each system. STH Main Site Article: https://www.servethehome.com/big-clus... Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel:    / @servethehomevideo   Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Links to Micro Center Advertisement ---------------------------------------------------------------------- Shop Micro Center’s Desktop deals: https://micro.center/2e788f Sign up for a FREE 128gig Flash Drive at Micro Center’s Austin Location: https://micro.center/114615 Sign up for a FREE 128gig Flash Drive at Micro Center’s New Jersey Store: https://micro.center/524449 Visit Micro Center News: https://micro.center/507a9c ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter:   / servethehome   Follow on LinkedIn:   / servethehome-com   Follow on Facebook:   / servethehome   Follow on Instagram:   / servethehome   ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- I let OpenClaw set up this homelab:    • I Let OpenClaw Have Its Way With a 56TB Mi...   Dell Pro Max with GB10:    • This Dell Pro Max with GB10 is Already Pay...   NAS for NVIDIA GB10 cluster:    • SUPER Studio NAS with 360TB of SSD Storage...   Touring MikroTik in Latvia:    • Touring the COOLEST Networking Company   MikroTik CRS812 DDQ:    • 400GbE is CHEAP Now MikroTik CRS812 DDQ Re...   Dell Pro Max with GB10 overview: https://www.servethehome.com/dell-pro... Unboxing short:    • The HOTTEST NVIDIA AI Workstation Dell Pro...   NVIDIA ConnectX-8 review: https://www.servethehome.com/nvidia-c... NVIDIA GB10 Networking Deep-Dive: https://www.servethehome.com/the-nvid... NVIDIA DGX Spark:    • 128GB with 200GbE NVIDIA DGX Spark is GREA...   Lenovo PGX: https://www.servethehome.com/lenovo-t... Gigabyte AI TOP: https://www.servethehome.com/gigabyte... ASUS GX10: https://www.servethehome.com/asus-asc... ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 02:49 Hardware Overview 04:09 200GbE RDMA Networking with MikroTik CRS804 DDQ 07:53 Micro Center Ad 08:56 10GbE Network Setup 09:28 Power Consumption 11:45 NVIDIA GB10 Cluster Setup 15:38 Performance Kimi K2.5, Kimi K2.6, Qwen3.5-397B, GPT-OSS-120B 22:14 Key Lessons Learned