Unadjusted Langevin Algorithm | Generative AI Animated

To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/Deepia . You’ll also get 20% off an annual premium subscription. In this video you'll learn about the Unadjusted Langevin Algorithm, and how it can be used to sample new data. This method was a precursor to what we now call "Diffusion models", which are just an annealed version of this algorithm. Here is all the code used to produce the video, including the code of the "Implementation" chapter: https://github.com/ytdeepia/Unadjuste... Shout out to the viewers who contributed to the subtitles: Chinese: Sakura ([email protected]), MouRen Sun If you want to dive deeper you should read these papers: "A Connection Between Score Matching and Denoising Autoencoders" by Pascal Vincent https://www.iro.umontreal.ca/~vincent... "Generative Modeling by Estimating Gradients of the Data Distribution" by Yang Song Generative Modeling by Estimating Gradients of the Data Distribution "Estimation of Non-Normalized Statistical Models byScore Matching" by AapoHyv arinen https://jmlr.org/papers/volume6/hyvar... "Solving Linear Inverse Problems Using the Prior Implicit in a Denoiser" by Zahra Kadkhodaie https://arxiv.org/abs/2007.13640 00:00 Intro 00:35 Sponsor 01:34 The Denoiser approximates the Posterior Mean 05:43 Tweedie's formula 10:23 Score Matching 12:39 Langevin Algorithm 14:47 Implementation and Examples 17:50 Limitations 19:18 Outro This video features animations created with Manim, inspired by Grant Sanderson's work at @3blue1brown. This video was sponsored by Brilliant. If you enjoyed the content, please like, comment, and subscribe to support the channel!