Lecture 11: Self Attention

Intro to Modern AI online course. For more information and to enroll, please visit https://modernaicourse.org.

Join Today
Lecture 12: Transformers
▶︎

Lecture 12: Transformers

Lecture 13: Efficient LLM Inference
▶︎

Lecture 13: Efficient LLM Inference

Attention in transformers, step-by-step | Deep Learning Chapter 6
▶︎

Attention in transformers, step-by-step | Deep Learning Chapter 6

China Just Built What TSMC Said Was Impossible
▶︎

China Just Built What TSMC Said Was Impossible

Lecture 14: Tokenization
▶︎

Lecture 14: Tokenization

Yann LeCun's $1B Bet Against LLMs [Part 1]
▶︎

Yann LeCun's $1B Bet Against LLMs [Part 1]

RL for Agents Workshop - Deep Dive on Training Agents with RL and Open Source
▶︎

RL for Agents Workshop - Deep Dive on Training Agents with RL and Open Source

mugrade introduction
▶︎

mugrade introduction

Visualizing transformers and attention | Talk for TNG Big Tech Day '24
▶︎

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan
▶︎

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan

Self-Attention Explained: How Transformers Actually Work (Full Visual Breakdown)
▶︎

Self-Attention Explained: How Transformers Actually Work (Full Visual Breakdown)

Lecture 10: Structured input models
▶︎

Lecture 10: Structured input models

Lecture 16: Introduction to post-training
▶︎

Lecture 16: Introduction to post-training

ML Foundations for AI Engineers (in 34 Minutes)
▶︎

ML Foundations for AI Engineers (in 34 Minutes)

The LLM Interview Series #1: What exactly is the KV Cache?
▶︎

The LLM Interview Series #1: What exactly is the KV Cache?

At 37 He Worked At Subway. At 58, He Solved An "Impossible" Problem
▶︎

At 37 He Worked At Subway. At 58, He Solved An "Impossible" Problem

Zig says NO to AI
▶︎

Zig says NO to AI

Reinforcement Learning Series: Overview of Methods
▶︎

Reinforcement Learning Series: Overview of Methods

Transformers, the tech behind LLMs | Deep Learning Chapter 5
▶︎

Transformers, the tech behind LLMs | Deep Learning Chapter 5

Lecture 9: Neural Network Implementation
▶︎

Lecture 9: Neural Network Implementation