7. Lasso, Ridge, and Elastic Net

We continue our discussion of ridge and lasso regression by focusing on the case of correlated features, which is a common occurrence in machine learning practice. We will see that ridge solutions tend to spread weight equally among highly correlated features, while lasso solutions may be unstable in the case of highly correlated features. Finally, we introduce the "elastic net", a combination of L1 and L2 regularization, which ameliorates the instability while maintaining some of the properties of lasso. (Credit to Brett Bernstein for the excellent graphics.) Access the full course at https://bloom.bg/2ui2T4q