EfficientML.ai Lecture 9 - Knowledge Distillation (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 9 - Knowledge Distillation (MIT 6.5940, Fall 2023) Instructor: Prof. Song Han Slides: https://efficientml.ai
▶︎
EfficientML.ai Lecture 9 - Knowledge Distillation (MIT 6.5940, Fall 2023, Zoom)
▶︎
MIT 6.S191: AI for Science
▶︎
Webinar on Augmented RCBD Theory, Analysis and Layout
▶︎
How to Speak
▶︎
EfficientML.ai Lecture 14 - Vision Transformer (MIT 6.5940, Fall 2023)
▶︎
Knowledge Distillation: How LLMs train each other
▶︎
MIT 6.S184: Flow Matching and Diffusion Models - Lecture 03B - Classifier-free Guidance (2026)
▶︎
EfficientML.ai Lecture 11 - TinyEngine and Parallel Processing (MIT 6.5940, Fall 2023)
▶︎
How DeepSeek “Stole” Claude – Real Distillation Attack Demo
▶︎
The Magic of LLM Distillation — Rishabh Agarwal, Google DeepMind
▶︎
AWS AI and Data Conference 2025 – Knowledge Distillation: Build Smaller, Faster AI Models
▶︎
MIT 6.S191: Deep Generative Modeling
▶︎
How DeepSeek changes the LLM story
▶︎
1. Introduction and Scope
▶︎
MIT 6.S184: Flow Matching and Diffusion Models - Lecture 05 - Discrete Diffusion Models (2026)
▶︎
EfficientML.ai Lecture 3 - Pruning and Sparsity (Part I) (MIT 6.5940, Fall 2023)
▶︎
11: Generative AI – Text-to-Image Models
▶︎
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
▶︎
MedAI #88: Distilling Step-by-Step! Outperforming LLMs with Smaller Model Sizes | Cheng-Yu Hsieh
▶︎