Three months wrong about why my 4-node AMD cluster was slow

Three months on a 4-node Minisforum MS-S1 Max Strix Halo cluster, and the one assumption that was quietly killing my inference speed. Try out ChatLLM - http://chatllm.abacus.ai/ltf and Abacus AI DeepAgent - http://deepagent.abacus.ai/ltf šŸ›’ Gear Links šŸ›’ šŸ‘€ 2 400Gbps switch: https://bhpho.to/4r9vJi1 šŸ‘€šŸ‘€ 4 400Gbps switch: https://bhpho.to/4qQqOlI šŸ’»ā˜• Thunderbolt 5 external SSD: https://amzn.to/3XqetZO šŸ’»ā˜• Favorite 15" display with magnet: https://amzn.to/3zD1DhQ šŸŽ§āš” Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW šŸ› ļøšŸš€ My nvme ssd: https://amzn.to/3YLEySo šŸ“¦šŸŽ® My gear: https://www.amazon.com/shop/alexziskind šŸŽ„ Related Videos šŸŽ„ šŸ† Skip M3 Ultra & RTX 5090 for LLMs | NEW 96GB KING -    • SkipĀ M3Ā UltraĀ &Ā RTXĀ 5090Ā forĀ LLMsĀ |Ā NEWĀ 96...Ā Ā  šŸ’» Smallest RTX Pro 6000 rig | OVERKILL -    • GoingĀ upĀ againstĀ Apple'sĀ UltraĀ Ā  šŸ”§ Cheap mini runs a 70B LLM 🤯 -    • CheapĀ miniĀ runsĀ aĀ 70BĀ LLM 🤯   šŸŒ™ RAM torture test on Mac -    • TRUTHĀ aboutĀ RAMĀ vsĀ SSDĀ UPGRADESĀ forĀ MacBookĀ Ā  šŸš€ FREE Local LLMs on Apple Silicon | FAST! -    • FREEĀ LocalĀ LLMsĀ onĀ AppleĀ SiliconĀ |Ā FAST!Ā Ā  šŸŖž REALITY vs Apple’s Memory Claims | vs RTX4090m -    • REALITYĀ vsĀ Apple’sĀ MemoryĀ ClaimsĀ |Ā vsĀ RTX4...Ā Ā  šŸ“¦ Set up Conda -    • pythonĀ environmentĀ setupĀ onĀ AppleĀ SiliconĀ ...Ā Ā  šŸ¤– INSANE Machine Learning on Neural Engine -    • INSANEĀ MachineĀ LearningĀ onĀ NeuralĀ EngineĀ |...Ā Ā  šŸ› ļø Developer productivity Playlist -    • DeveloperĀ ProductivityĀ Ā  šŸ”— AI for Coding Playlist: šŸ“š -    • AIĀ Ā  — — — — — — — — — ā¤ļø SUBSCRIBE TO MY YOUTUBE CHANNEL šŸ“ŗ Click here to subscribe: Ā Ā Ā /Ā @aziskĀ Ā  — — — — — — — — — Join this channel to get access to perks: Ā Ā Ā /Ā @aziskĀ Ā  — — — — — — — — — šŸ“± ALEX ON X: Ā Ā /Ā digitalixĀ Ā  Donato's channel: Ā Ā Ā /Ā @donatocapitellaĀ Ā  #macmini #llm #nvidia