MOMENTUM Gradient Descent (in 3 minutes)

Learn how to use the idea of Momentum to accelerate Gradient Descent. ---------------- References: Lectures on Convex Optimization by Yuri Nesterov: https://link.springer.com/book/10.100... Convex Optimization: Algorithms and Complexity by Sébastien Bubeck: https://arxiv.org/pdf/1405.4980.pdf MIT Lecture by Gilbert Strang:    • 23. Accelerating Gradient Descent (Use Mom...   -------------- Timestamps: 0:00 Intro 1:00 Momentum Gradient Descent 1:44 Nesterov's Accelerated Gradient Descent 2:23 First Interpretation 2:35 Second Interpretation --------------- Credit: 🐍 Manim and Python : https://github.com/3b1b/manim 🐵 Blender3D: https://www.blender.org/ 🗒️ Emacs: https://www.gnu.org/software/emacs/ Music: www.bensound.com This video would not have been possible without the help of Gökçe Dayanıklı.