QLoRA—How to Fine-tune an LLM on a Single GPU (w/ Python Code)
🤝 Your team not maximizing Claude? I run 1:1 and team AI workshops for companies doing $10M+ per year: https://aibuilder.academy/yt/XpoKB3usmKc In this video, I discuss fine-tuning an LLM using QLoRA (i.e. Quantized Low-rank Adaptation). Example code is provided for training a custom YouTube comment responder using Mistral-7b-Instruct. More Resources: ▶️ Series Playlist: • Large Language Models (LLMs) 🎥 Fine-tuning with OpenAI: • 3 Ways to Make a Custom AI Assistant | RAG... 📰 Read more: https://medium.com/towards-data-scien... 💻 Colab: https://colab.research.google.com/dri... 💻 GitHub: https://github.com/ShawhinT/YouTube-B... 🤗 Model: https://huggingface.co/shawhin/shawgp... 🤗 Dataset: https://huggingface.co/datasets/shawh... [1] Fine-tuning LLMs: • Fine-tuning Large Language Models (LLMs) |... [2] ZeRO paper: https://arxiv.org/abs/1910.02054 [3] QLoRA paper: https://arxiv.org/abs/2305.14314 [4] Phi-1 paper: https://arxiv.org/abs/2306.11644 [5] LoRA paper: https://arxiv.org/abs/2106.09685 Intro - 0:00 Fine-tuning (recap) - 0:45 LLMs are (computationally) expensive - 1:22 What is Quantization? - 4:49 4 Ingredients of QLoRA - 7:10 Ingredient 1: 4-bit NormalFloat - 7:28 Ingredient 2: Double Quantization - 9:54 Ingredient 3: Paged Optimizer - 13:45 Ingredient 4: LoRA - 15:40 Bringing it all together - 18:24 Example code: Fine-tuning Mistral-7b-Instruct for YT Comments - 20:35 What's Next? - 35:22
Fine-Tuning BERT for Text Classification (w/ Example Code)
Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA
LoRA: The Hack That Solved AI's Biggest Problem
RAG & MCP Fundamentals – A Hands-On Crash Course
Fine-tuning Large Language Models (LLMs) | w/ Example Code
Everything You Need to Know About Machine Learning Explained ♟️ ML Full Course | Lernoora Lexicons.
![[Full Workshop] Reinforcement Learning, Kernels, Reasoning, Quantization & Agents — Daniel Han](https://i.ytimg.com/vi/OkEGJ5G3foU/hqdefault.jpg?sqp=-oaymwEjCNACELwBSFryq4qpAxUIARUAAAAAGAElAADIQj0AgKJDeAE=&rs=AOn4CLDALOTyyIB7iZX9LiUj82NSPuT6Hw)
[Full Workshop] Reinforcement Learning, Kernels, Reasoning, Quantization & Agents — Daniel Han
Text Embeddings, Classification, and Semantic Search (w/ Python Code)
Everything about LoRA and QLoRA EXPLAINED | PEFT Techniques | Fine Tuning
Fine-Tuning Local Models with LoRA in Python (Theory & Code)
How to Improve LLMs with RAG (Overview + Python Code)
The Most Important Conversation in AI Right Now
CHOSEN ONE!! YOUR IDENTITY REVEAL JUST SHOOK THE INTERNET... AND THEIR MINDS
Ian Proud: Anti-russische Sanktionen wirken nicht – Wie der Ukraine-Krieg endet
Teach LLM Something New 💡 LoRA Fine Tuning on Custom Data
Learn Fine Tuning LLMs in 2 hours | RAGs vs Fine Tuning | Quantization | PEFT Techniques
What Nobody Tells You About Being a Quant
Fine-Tuning Text Embeddings For Domain-specific Search (w/ Python)
Kimi 3: AI still isn’t profitable | David Gerard
