Uploaded October 2024 | Updated September 2026, 2 weeks ago

---

Learn how large language models go through a pre-training process to begin understanding language, then break up it's input into smaller bite-sized pieces.

This video is a part of the Exploring Generative AI curriculum - learn more at code.org/ai

Stay in touch with us on social media:
• Twitter: twitter.com/codeorg
• Facebook: facebook.com/Code.org
• Instagram: instagram.com/codeorg
• TikTok: tiktok.com/@code.org
• LinkedIn: linkedin.com/company/code-org
• Medium: medium.com/@codeorg

Help make our work possible with a donation at code.org/donate!