ETH Zürich AISE: Symbolic Regression and Model Discovery

↓↓↓ LECTURE OVERVIEW BELOW ↓↓↓ ETH Zürich AI in the Sciences and Engineering 2024 Course Website (links to slides and tutorials): https://www.camlab.ethz.ch/teaching/a... Lecturers: Dr. Ben Moseley and Prof. Siddhartha Mishra ▬ Lecture Content ▬▬▬ 0:00 - Introduction 1:41 - Can AI discover the laws of physics? 5:52 - Model discovery 7:00 - Function discovery 8:58 - Challenge: guess the function 12:44 - Symbolic regression (SR) vs function fitting 14:28 - Challenges of SR 19:11 - Mathematical expressions as trees 21:27 - The search space 22:53 - Pruning 25:07 - Requirements for solving SR 26:11 - Recap: so far 31:43 - AI Feynman 44:10 - Full workflow 49:09 - Better search algorithms 50:40 - Genetic algorithms 58:16 - Example: PySR library 1:00:33 - Other search algorithms 1:02:40 - Model discovery 1:03:48 - Sparse identification of nonlinear dynamics 1:08:41 - Summary 1:09:18 - Course summary 1:11:24 - Impactful research directions in SciML ▬ Course Overview ▬▬▬ Lecture 1: Course Introduction    • ETH Zürich AISE: Course Introduction   Lecture 2: Introduction to Deep Learning Part 1    • ETH Zürich AISE: Introduction to Deep Lear...   Lecture 3: Introduction to Deep Learning Part 2    • ETH Zürich AISE: Introduction to Deep Lear...   Lecture 4: Importance of PDEs in Science    • ETH Zürich AISE: Importance of PDEs in Sci...   Lecture 5: Physics-Informed Neural Networks – Introduction    • ETH Zürich AISE: Physics-Informed Neural N...   Lecture 6: Physics-Informed Neural Networks – Limitations and Extensions Part 1    • ETH Zürich AISE: Physics-Informed Neural N...   Lecture 7: Physics-Informed Neural Networks – Limitations and Extensions Part 2    • ETH Zürich AISE: Physics-Informed Neural N...   Lecture 8: Physics-Informed Neural Networks – Theory Part 1    • ETH Zürich AISE: Physics-Informed Neural N...   Lecture 9: Physics-Informed Neural Networks – Theory Part 2    • ETH Zürich AISE: Physics-Informed Neural N...   Lecture 10: Introduction to Operator Learning Part 1    • ETH Zürich AISE: Introduction to Operator ...   Lecture 11: Introduction to Operator Learning Part 2    • ETH Zürich AISE: Introduction to Operator ...   Lecture 12: Fourier Neural Operators    • ETH Zürich AISE: Fourier Neural Operators   Lecture 13: Spectral Neural Operators and Deep Operator Networks    • ETH Zürich AISE: Spectral Neural Operators...   Lecture 14: Convolutional Neural Operators    • ETH Zürich AISE: Convolutional Neural Oper...   Lecture 15: Time-Dependent Neural Operators    • ETH Zürich AISE: Time-Dependent Neural Ope...   Lecture 16: Large-Scale Neural Operators    • ETH Zürich AISE: Large-Scale Neural Operators   Lecture 17: Attention as a Neural Operator    • ETH Zürich AISE: Attention as a Neural Ope...   Lecture 18: Windowed Attention and Scaling Laws    • ETH Zürich AISE: Windowed Attention and Sc...   Lecture 19: Introduction to Hybrid Workflows Part 1    • ETH Zürich AISE: Introduction to Hybrid Wo...   Lecture 20: Introduction to Hybrid Workflows Part 2    • ETH Zürich AISE: Introduction to Hybrid Wo...   Lecture 21: Neural Differential Equations    • ETH Zürich AISE: Neural Differential Equat...   Lecture 22: Introduction to Diffusion Models    • ETH Zürich AISE: Introduction to Diffusion...   Lecture 23: Introduction to JAX    • ETH Zürich AISE: Introduction to JAX   Lecture 24: Symbolic Regression and Model Discovery    • ETH Zürich AISE: Symbolic Regression and M...   Lecture 25: Applications of AI in Chemistry and Biology Part 1    • ETH Zürich AISE: Applications of AI in Che...   Lecture 26: Applications of AI in Chemistry and Biology Part 2    • ETH Zürich AISE: Applications of AI in Che...   ▬ Course Description ▬▬▬ AI is having a profound impact on science by accelerating discoveries across physics, chemistry, biology, and engineering. This course presents a highly topical selection of AI applications across these fields. Emphasis is placed on using AI, particularly deep learning, to understand systems modelled by PDEs, and key scientific machine learning concepts and themes are discussed. ▬ Course Learning Objectives ▬▬▬ Aware of advanced applications of AI in the sciences and engineering Familiar with the design, implementation, and theory of these algorithms Understand the pros/cons of using AI and deep learning for science Understand key scientific machine learning concepts and themes