Residual Networks (ResNet) [Physics Informed Machine Learning]

This video discusses Residual Networks, one of the most popular machine learning architectures that has enabled considerably deeper neural networks through jump/skip connections. This architecture mimics many of the aspects of a numerical integrator. This video was produced at the University of Washington, and we acknowledge funding support from the Boeing Company %%% CHAPTERS %%% 00:00 Intro 01:09 Concept: Modeling the Residual 03:26 Building Blocks 05:59 Motivation: Deep Network Signal Loss 07:43 Extending to Classification 09:00 Extending to DiffEqs 10:16 Impact of CVPR and Resnet 12:17 Resnets and Euler Integrators 13:34 Neural ODEs and Improved Integrators 16:07 Outro

Join Today
Fourier Neural Operator (FNO) [Physics Informed Machine Learning]
▶︎

Fourier Neural Operator (FNO) [Physics Informed Machine Learning]

Residual Networks and Skip Connections (DL 15)
▶︎

Residual Networks and Skip Connections (DL 15)

AI/ML+Physics Part 1: Choosing what to model [Physics Informed Machine Learning]
▶︎

AI/ML+Physics Part 1: Choosing what to model [Physics Informed Machine Learning]

TypeScript in Express – TypeScript Tutorial
▶︎

TypeScript in Express – TypeScript Tutorial

Neural ODEs (NODEs) [Physics Informed Machine Learning]
▶︎

Neural ODEs (NODEs) [Physics Informed Machine Learning]

Intuition behind Mamba and State Space Models | Enhancing LLMs!
▶︎

Intuition behind Mamba and State Space Models | Enhancing LLMs!

Generative Model That Won 2024 Nobel Prize
▶︎

Generative Model That Won 2024 Nobel Prize

But what is a convolution?
▶︎

But what is a convolution?

MAMBA from Scratch: Neural Nets Better and Faster than Transformers
▶︎

MAMBA from Scratch: Neural Nets Better and Faster than Transformers

Physics-Informed Neural Networks (PINNs) - An Introduction - Ben Moseley | Jousef Murad
▶︎

Physics-Informed Neural Networks (PINNs) - An Introduction - Ben Moseley | Jousef Murad

The Most Important Algorithm in Machine Learning
▶︎

The Most Important Algorithm in Machine Learning

Recurrent Neural Networks (RNNs), Clearly Explained!!!
▶︎

Recurrent Neural Networks (RNNs), Clearly Explained!!!

Python Symbolic Regression (PySR) [Physics Informed Machine Learning]
▶︎

Python Symbolic Regression (PySR) [Physics Informed Machine Learning]

Physics Informed Neural Networks (PINNs) [Physics Informed Machine Learning]
▶︎

Physics Informed Neural Networks (PINNs) [Physics Informed Machine Learning]

[Classic] Deep Residual Learning for Image Recognition (Paper Explained)
▶︎

[Classic] Deep Residual Learning for Image Recognition (Paper Explained)

But what is a neural network? | Deep learning chapter 1
▶︎

But what is a neural network? | Deep learning chapter 1

AI/ML+Physics: Recap and Summary [Physics Informed Machine Learning]
▶︎

AI/ML+Physics: Recap and Summary [Physics Informed Machine Learning]

Deep Learning to Discover Coordinates for Dynamics: Autoencoders & Physics Informed Machine Learning
▶︎

Deep Learning to Discover Coordinates for Dynamics: Autoencoders & Physics Informed Machine Learning

ResNet - Explained!
▶︎

ResNet - Explained!

Lagrangian Neural Network (LNN) [Physics Informed Machine Learning]
▶︎

Lagrangian Neural Network (LNN) [Physics Informed Machine Learning]