Understanding scipy.minimize part 2: Line search
A visualization of how the line search algorithm from scipy.minimize works. Animations are made with the manimce library. Part 1 is here: • Understanding scipy.minimize part 1: The B... 00:00 Introduction 0:50 Line Search 2:22 Wolfe Conditions 4:35 Line Search Algorithm 6:38 Zoom Step 9:43 Second Example 10:20 Putting it all together Sources: Code from scipy.optimize.line_search Nocedal & Wright: Numerical Optimization, Ch. 3.

▶︎
Understanding scipy.minimize part 1: The BFGS algorithm

▶︎
Applied Optimization - Steepest Descent

▶︎
Line Search 2

▶︎
Intro to Scipy Optimization: Minimize Method

▶︎
Descent methods and line search: first Wolfe condition

▶︎
Conceptualizing the Christoffel Symbols: An Adventure in Curvilinear Coordinates

▶︎
Who's Adam and What's He Optimizing? | Deep Dive into Optimizers for Machine Learning!

▶︎
23. Accelerating Gradient Descent (Use Momentum)

▶︎
Is the Future of Linear Algebra.. Random?

▶︎
Search Direction 1

▶︎
God Says:"TAKE THIS MESSAGE SERIOUSLY, BECAUSE ONLY YOU ARE SEEING IT"/God Message Now/God Message

▶︎
8.1 Quasi Newton Methods Part I

▶︎
Intro to Gradient Descent || Optimizing High-Dimensional Equations

▶︎
books i want to read this summer | classics, fantasy, summerween!!!

▶︎
8.2 Quasi Newton and BFGS

▶︎
CS885 Lecture 14c: Trust Region Methods

▶︎
Descent methods and line search: validity of the Wolfe conditions

▶︎
Constrained Optimization: Intuition behind the Lagrangian

▶︎
Visually Explained: Newton's Method in Optimization

▶︎
