A Visual Introduction to Hoeffding's Inequality - Statistical Learning Theory

This video is based on the following series of lectures: Learning from data. Professor Yaser Abu-Mostafa, Caltech: https://tinyurl.com/4wkr7prx Machine learning Theory. Professor Shai Ben-David and Shai Shalev-Shwartz: https://tinyurl.com/26v5btve In this video we take a look at the strict Statistical Learning Theory framework for Supervised Classification. We take a quick look at Hoeffding's inequality, PAC Learning, the bias-complexity tradeoff and the feasibility of learning. Timestamps : 0:00 – Intro 0:15 – Law of Large numbers 2:47 – Hoeffding’s Inequality 5:46 – Feasibility of Learning for Finite Hypothesis Classes 10:32 –The bias-complexity tradeoff 11:18 – Need for a better measure of complexity? 11:46 – The same is true for stochastic distributions as well! _______________________________________ References: Books: Understanding Machine Learning: From Theory to Algorithms | Shai Shalev-Shwartz and Shai Ben-David Learning From Data | Yaser Abu-Mostafa ,Malik Magdon-Ismail , Hsuan-Tien Lin Foundations of Machine Learning | Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar Blogs: https://thirdorderscientist.org/homoc... https://scottaaronson.blog/?p=3712 https://oneraynyday.github.io/ml/2017... https://jeremykun.com/2014/01/02/prob... https://web.stanford.edu/class/cs229t... http://www.learningtheory.org/learnin... http://www.offconvex.org/2017/12/08/g... https://cs.stackexchange.com/question... https://hunch.net/?p=496 https://hunch.net/?p=224 https://hunch.net/?cat=37&paged=2 Videos:    • 9.520/6.860: Statistical Learning Theory a...      • Varun Kanade: Statistical Learning Theory I      • Statistical Learning I Robert Schapire Mic...      • Sanjeev Arora: Toward Theoretical Understa...      • AMMI Course "Geometric Deep Learning" - Le...   What to watch if you find this too easy?    • AMMI Course "Geometric Deep Learning" - Le...   __________________________________________________ Social Media: Kartik Chincholikar Website: https://kartikchincholikar.github.io/ Github: https://github.com/kartikchincholikar Twitter:   / kartikc14   _______________________________________________ I love coffee! Help fund future projects: https://www.buymeacoffee.com/karti _______________________________________________ Music: Track: Such Memories Music composed and recorded by Oak Studios Creative Commons - Attribution ND 4.0    • [No Copyright Music] Such Memories - Soft ...