Run AI Models Locally with Ollama on Proxmox — No GPU, No Subscription
In this one I show you how to get Ollama up and running on a dedicated Ubuntu VM in Proxmox, so you can run AI models locally on your own hardware, completely offline, no API keys or subscriptions needed. By the end you'll have your first model pulled down and be able to query it from the command line and from other machines via Tailscale. In the next video, we'll put a web interface on top of it so you can chat with your models from the browser — but for now, let's get the foundations right. ✅ What Ollama is and why it's great for home labs ✅ Creating a dedicated Ubuntu 26.04 VM on Proxmox for Ollama ✅ Installing Ollama from the command line ✅ Configuring Ollama to accept connections from other machines on your network ✅ Installing Tailscale to access Ollama securely across your devices ✅ Pulling down your first LLM and querying it from the command line ✅ What to expect running LLMs on CPU-only hardware This guide is aimed at beginners and home lab enthusiasts — no GPU required and no prior AI or LLM experience needed. Links mentioned in the video: 🔗 Ollama: https://ollama.com 🔗 Tailscale: https://tailscale.com 🔗 How to Install Proxmox VE: https://ithomelab.online/proxmox-ve-h... 🔗 How to Install Ubuntu 26.04 on Proxmox: • Install Ubuntu 26.04 Desktop on Proxmox + ... My hardware specs: Dell Latitude 5411: Core i7 CPU (12 cores) | 32GB RAM | 512GB NVMe 👉 Don't forget to like 👍, subscribe 🔔, and check out the full write-up on the blog: https://ithomelab.online/ollama-proxm... ———— Socials Twitter: / ithomelabonline Instagram: / ithomelabonline Facebook: / ithomelab.online 📌 More IT Homelab videos: / @ithomelabonline More at 👉 https://ithomelab.online If you find this useful and want to support the channel, you can buy me a coffee ☕ https://buymeacoffee.com/ithomelab.on... — I drink way too much of it 😄

The Best Local Agentic Coding Workflow (Complete Guide)

Android 17 sucks. So I put Linux on a phone.

Installing TrueNAS Scale on My DIY 56TB NAS | Burn-In Testing & Lessons Learned

Are Local Models Finally Good Enough?

3 New PCs, One Giant AI Model… This Shouldn’t Work

Proxmox VE Home Lab Setup – Step-by-Step Installation Guide

If you don’t run Pi locally you’re falling behind…

MIT Just Revealed the AI Bubble's Fatal Flaw

Linux and AWS for Beginners | Nano, Packages, UFW, EC2 & FTP

Run Ollama with NVIDIA GPU Acceleration on Proxmox LXC (2026)

The Best LOCAL Agentic Coding Workflow (Complete Guide)

Your local LLM is 10x slower than it should be

Host a Private AI Server at Home with Proxmox Ollama and OpenWebUI

Beginners Guide To Homelabbing: How To Mount A Drive On Ubuntu Server

Local Ai Server Setup Guides Proxmox 9 - OpenWEBUI Ollama in LXC w/ GPU Passthrough

Anthropic is Completely F*cked.

NVIDIA Monopoly is DEAD | OPEN-SOURCE Chips Are HERE!

Ollama + Claude Code = 99% CHEAPER

What’s Actually Running in My Homelab? (50+ Self-Hosted Services)

