Module 3- Part 2- ML boosting algorithms XGBoost, CatBoost and LightGBM
Relevant playlists: Machine Learning Concepts, simply explained: • Machine Learning Concepts (shorter videos) Deep Learning Concepts, simply explained: • Deep Learning Codes and Concepts (Simply E... Instructor: Pedram Jahangiry All of the slides and notebooks used in this series are available on my GitHub page, so you can follow along and experiment with the code on your own. https://github.com/PJalgotrader Lecture Outline: 0:00 Roadmap 2:12 What are the four fundamental questions in decision tree based models? 5:22 What features and cut off to start with? 10:12 How to split the samples (pre-sorted and histogram, GOSS, Greedy) 15:22 How to grow a tree? (Depth-wise, Leaf-wise, Symmetric) 19:52 How to combine trees (Bagging vs Boosting) 24:55 Evolution of XGBoost 34:48 XGBoost details 40:25 LightGBM details 41:15 CatBoost details 43:00 Comparing XGBoost, LightGBM and CatBoost
Module 3- Part 3- Time series challenges in machine learning. Cross validation and bootstrapping
Module 5- part 2- Decision Tree based ML models for Time Series: A Visual Deep Dive with Python
XGBoost ❌ LightGBM ❌ CatBoost ❌ Scikit-Learn GRADIENT BOOSTING Performance Compared
771: Gradient Boosting: XGBoost, LightGBM and CatBoost — with Kirill Eremenko
![How Gradient Boost Works [Implement the algorithm from scratch in Python]](https://i.ytimg.com/vi/bnsyquP9w-k/hqdefault.jpg?sqp=-oaymwEjCNACELwBSFryq4qpAxUIARUAAAAAGAElAADIQj0AgKJDeAE=&rs=AOn4CLAM8uef0Rx0LPr4nGCdTjNjfvpW2g)
How Gradient Boost Works [Implement the algorithm from scratch in Python]
Pedro Tabacof - Unlocking the Power of Gradient-Boosted Trees (using LightGBM) | PyData London 2022
Gradient Boosting : Data Science's Silver Bullet
Anna Veronika Dorogush: Mastering gradient boosting with CatBoost | PyData London 2019
Module 8- Part 2- Time Series Forecasting with NeuralProphet: Full Theory + FB Prophet Comparison
Model Complexity and VC Dimension
LightGBM 101: Faster Gradient Boosting for Large-Scale ML
681: XGBoost: The Ultimate Classifier — with Matt Harrison
CatBoost Part 1: Ordered Target Encoding
Jaroslaw Szymczak - Gradient Boosting in Practice: a deep dive into xgboost
Understanding XGBoost From A to Z!
Anna Veronika Dorogush - CatBoost - the new generation of Gradient Boosting
Machine Learning Lecture 32 "Boosting" -Cornell CS4780 SP17
XGBoost Made Easy | Extreme Gradient Boosting | AWS SageMaker
Advanced time series forecasting with PyCaret- Is stock price really predictable?
