All Hyperparameters of a Neural Network Explained
Neural Networks have a lot of knobs and buttons you have to set correctly to get the best possible performance out of it. Although some of them are self-explanatory and easy to understand (like the number of neurons in the input layer) and choose, there are many hyperparameters that are a bit more complex in terms of how they affect the outcome of the model (e.g. number of layers, the batch size or weight initialization). In this lesson, we will take an overall look at all possible hyperparameters and understand on a high level what they mean and how they affect the performance of the network. In the coming lessons, we will dive deeper into the details of these hyperparameters. Previous lesson: • How to Evaluate Neural Network Performance Next lesson: • How Many Hidden Layers and Neurons does a ... 📙 Here is a lesson notes booklet that summarizes everything you learn in this course in diagrams and visualizations. You can get it here 👉 https://misraturp.gumroad.com/l/fdl 👩💻 You can get access to all the code I develop in this course here: https://github.com/misraturp/Deep-lea... ❓To get the most out of the course, don't forget to answer the end of module questions: https://fishy-dessert-4fc.notion.site... 👉 You can find the answers here: https://fishy-dessert-4fc.notion.site... RESOURCES: 🏃♀️ Data Science Kick-starter mini-course: https://misraturp.gumroad.com/l/kick-... 🐼 Pandas cheat sheet: https://misraturp.gumroad.com/l/pandascs 📙 Fundamentals of Deep Learning in 25 pages: https://misraturp.gumroad.com/l/fdl 🌎 Website - https://misraturp.com/ 🐥 Twitter - / misraturp
How Many Hidden Layers and Neurons does a Neural Network Need
Backward Propagation in Neural Networks explained
Which Loss Function, Optimizer and LR to Choose for Neural Networks
Hyperparameter Tuning Explained in 14 Minutes
Fool-proof RNN explanation | What are RNNs, how do they work?
But what is a neural network? | Deep learning chapter 1
Parameters vs Hyperparameters (C1W4L07)
Feed-Forward Neural Networks (DL 07)
Regularization in a Neural Network | Dealing with overfitting
The Most Important Algorithm in Machine Learning
All Machine Learning Models Clearly Explained!
Attention in transformers, step-by-step | Deep Learning Chapter 6
The Essential Main Ideas of Neural Networks
Weight Initialization | Xavier | He | Zero | Symmetry Problem | Deep Learning Part 7
Neural Networks Summary: All hyperparameters
Optimization for Deep Learning (Momentum, RMSprop, AdaGrad, Adam)
Why Regularization Lowers Overfitting
Neural Networks and Deep Learning: Crash Course AI #3
Hidden Symmetry: Why Deep Learning is Possible
