ЮФУ -- 2026.02.12 -- Что такое нейронные сети

This lecture is from the course "Introduction to Deep Learning," taught at Southern Federal University in the spring of 2026. All materials for this and other lectures in the course (slides, whiteboard, notebooks with code) are available at: https://www.sergeynikolenko.ru/course... Follow my Telegram channel "Sinekura": https://t.me/sinecor Sections: 00:00 Introduction: How a Biological Neuron Works 13:53 The Brain as a Parallel Computer 17:49 The Single Neuron Model: McCulloch-Pitts 29:55 Activation Functions: Sigmoid, ReLU, Swish 54:40 Connectionism and the Network as a Computational Graph 01:10:52 The Idea of ​​Gradient Descent 01:22:50 Why Not Second-Order Methods? Quasi-Newton Methods? 01:29:46 Stochastic Gradient Descent