Stop Guessing! I Built an LLM Hardware Calculator
I Built an LLM Hardware Calculator. Thanks to Sevalla for sponsoring and hosting it! Check them out at: https://sevalla.com/?utm_source=youtu... š Gear Links š š»ā Thunderbolt 5 external SSD: https://amzn.to/3XqetZO š»ā Favorite 15" display with magnet: https://amzn.to/3zD1DhQ š§ā” Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW š ļøš My nvme ssd: https://amzn.to/3YLEySo š¦š® My gear: https://www.amazon.com/shop/alexziskind š ļø Mini PC portable setup - Ā Ā Ā ā¢Ā itĀ begins...Ā theĀ DEATHĀ ofĀ theĀ DESKTOPĀ Ā š ļø Dev setup on Mac - Ā Ā Ā ā¢Ā SettingĀ upĀ newĀ M2Ā MacĀ MiniĀ forĀ softwareĀ de...Ā Ā š ļø Cheap mini runs a 70B LLM 𤯠- Ā Ā Ā ā¢Ā CheapĀ miniĀ runsĀ aĀ 70BĀ LLMĀ š¤ÆĀ Ā š RAM torture test on Mac - Ā Ā Ā ā¢Ā TRUTHĀ aboutĀ RAMĀ vsĀ SSDĀ UPGRADESĀ forĀ MacBookĀ Ā š ļø FREE Local LLMs on Apple Silicon | FAST! - Ā Ā Ā ā¢Ā FREEĀ LocalĀ LLMsĀ onĀ AppleĀ SiliconĀ |Ā FAST!Ā Ā š REALITY vs Appleās Memory Claims | vs RTX4090m - Ā Ā Ā ā¢Ā REALITYĀ vsĀ AppleāsĀ MemoryĀ ClaimsĀ |Ā vsĀ RTX4...Ā Ā š ļø Set up Conda - Ā Ā Ā ā¢Ā pythonĀ environmentĀ setupĀ onĀ AppleĀ SiliconĀ ...Ā Ā š¤ INSANE Machine Learning on Neural Engine - Ā Ā Ā ā¢Ā INSANEĀ MachineĀ LearningĀ onĀ NeuralĀ EngineĀ |...Ā Ā š ļø Developer productivity Playlist - Ā Ā Ā ā¢Ā DeveloperĀ ProductivityĀ Ā š AI for Coding Playlist: š - Ā Ā Ā ā¢Ā AIĀ Ā My Calculator here: https://llm-inference-calculator-rki0... GitHub: https://github.com/alexziskind1/llm-i... Other's calcs https://llm-dev-tools.streamlit.app/M... https://llm-calc.rayfernando.ai/ https://rahulschand.github.io/gpu_poor/ https://huggingface.co/spaces/NyxKrag... https://vram.asmirnov.xyz/ ā ā ā ā ā ā ā ā ā ā¤ļø SUBSCRIBE TO MY YOUTUBE CHANNEL šŗ Click here to subscribe: Ā Ā Ā /Ā @aziskĀ Ā ā ā ā ā ā ā ā ā ā Join this channel to get access to perks: Ā Ā Ā /Ā @aziskĀ Ā ā ā ā ā ā ā ā ā ā š± ALEX ON X: Ā Ā /Ā digitalixĀ Ā #macstudio #macmini #m3ultra

Your Local LLM Is 3x Slower Than It Should Be

The Local AI Hardware Mistake Everyone Makes

RTX spark : Hype vs Reality | Documentry |

God Says:"I JUST CONFIRMED ā ONLY YOU CAN SEE THIS LETTER"/God Message Now/God Message

Ethernet is DEAD?? Mac Studio is 100x FASTER!!

Running AI Offline from a USB

China Just Built What TSMC Said Was Impossible

NVIDIA didn't want me to do this

This Is What Happens When You CRUSH An AI Video Model

This Shouldnāt Be Able to Run 120B Locally

I Hacked This Temu Router. What I Found Should Be Illegal.

The RAM Crisis just got so much worse for them... they lied

This Local LLM Looked Smart Until I Saw What It Made Up

4 levels of LLMs (on the go)

$10,000 Mac Studio vs. $10 AI Agent

Everything looks fine at 4-bit

NVIDIA Begs China to Buy Vera AI CPU's - USA Thinks China is Dumb

Feed Your OWN Documents to a Local Large Language Model!

Forget Strix Point... This One Catches the M4 Pro

