A Very Simple Transformer Encoder for Time Series Forecasting in PyTorch

The purpose of this video is to dissect and learn about the Attention Is All You Need transformer model by using bare-bones PyTorch classes to forecast time series data. Code Repo: https://github.com/BrandenKeck/pytorc... Very helpful: https://github.com/oliverguhr/transfo... https://github.com/ctxj/Time-Series-T... https://github.com/huggingface/transf... Attention Is All You Need: https://arxiv.org/pdf/1706.03762.pdf