Generative AI: Input & Pre-training

Learn how large language models go through a pre-training process to begin understanding language, then break up it's input into smaller bite-sized pieces. This video is a part of the Exploring Generative AI curriculum - learn more at https://code.org/ai Stay in touch with us on social media: • Twitter:   / codeorg   • Facebook:   / code.org   • Instagram:   / codeorg   • TikTok:   / code.org   • LinkedIn:   / code-org   • Medium:   / codeorg   Help make our work possible with a donation at http://code.org/donate!