📚 Data Sampling with a Sliding Window – Live Coding with Sebastian Raschka (Chapter 2.6)

Check out Sebastian Raschka's book 📖 Build a Large Language Model (From Scratch) | https://hubs.la/Q03l0mSf0 📖 In this hands-on coding session, AI & LLM engineer ‪@SebastianRaschka‬ dives into Chapter 2.6: Data Sampling with a Sliding Window from his book Build a Large Language Model (From Scratch). This chapter introduces a key data preprocessing technique used to prepare long text sequences for training transformer-based LLMs efficiently. 0:00 - Introduction to Data Sampling with Sliding Window 2:24 - Implementing Data Chunks for LLM 6:40 - Setting up PyTorch Environment 10:28 - Getting up to speed with PyTorch 11:59 - Data Sampling Techniques with Sliding Windows 18:42 - Data Sampling in Action 📘 About the Book Build a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you’ll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you’ll really understand it because you built it yourself! 👨‍💻 Ideal for ML developers, data scientists, and NLP researchers eager to understand the mechanics behind modern language models. 🔗 Get the Book: https://hubs.la/Q03l0mSf0 ✅ Subscribe to the Manning channel for more deep learning tutorials, chapter walkthroughs, and expert advice from top authors. #SebastianRaschka #LLM #SlidingWindow #DataSampling #DeepLearning #PyTorch #Transformers #MachineLearning #NLP #ManningPublications #LiveCoding