What does a larger vocabulary enable in Llama 3? #llama3 @AIatMeta
What does a larger vocabulary enable in Llama 3? #llama3  @AIatMeta
Uploaded July 2024 | Updated September 2026, 1 day ago
The smallest Llama 3 model increased to 8B parameters vs the 7B parameters with Llama 2. Aston Zhang, author of D2L and researcher on the Llama team at Meta shared a little bit more on one of the factors that led to this and how it's enabling stronger performance on some tasks with Llama 3.

--

Subscribe: youtube.com/facebookai?sub_confirmation=1

Learn more about our work: ai.meta.com

Follow us on Twitter: twitter.com/aiatmeta
Follow us on Facebook: facebook.com/aiatmeta
Connect with us on LinkedIn: linkedin.com/showcase/aiatmeta

Meta focuses on bringing the world together by advancing AI, powering meaningful and safe experiences, and conducting open research.
What does a larger vocabulary enable in Llama 3? #llama3MTIA - Metas First-Generation AI Inference Accelerator | AI at MetaAI Infra @Scale | AI at MetaInside the Lab: Building for the metaverse with AI (2022) | AI at MetaDetectron2: A PyTorch-based modular object detection libraryBuilder Bot demoThe first AI-powered speech translation system for a primarily oral language | AI at MetaAI now enables robots to adapt rapidly to changing real world conditionsNew Research: Molecular Property Prediction, Language Processing, and Neuroscience | AI at MetaHow can we teach AI skills using visual demos? Model-based Inverse Reinforcement LearningCICERO as a Diplomacy partner | Meta AIFacebook AI Research | Openness
AI at Meta |

What does a larger vocabulary enable in Llama 3? #llama3

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER