Transformers - Part 1 - Self-attention: an introduction

In this video, we briefly introduce transformers and provide an introduction to the intuition behind self-attention. The video is part of a series of videos on the transformer architecture, https://arxiv.org/abs/1706.03762. You can find the complete series and a longer motivation here:    • A series of videos on the transformer   Slides are available here: https://drive.google.com/file/d/1uCAw...