Day 13: Open NLLB - Aya, dedup sharding analysis, analyzing training (Pt 2.) @TheAIEpiphany
Day 13: Open NLLB - Aya, dedup sharding analysis, analyzing training (Pt 2.)  @TheAIEpiphany
Uploaded September 2023 | Updated September 2026, 1 week ago
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦
discord.gg/peBrCpheKE

Let's go through Cohere's Aya effort as it seems similar to what we're doing, and more.

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° BECOME A PATREON OF THE AI EPIPHANY ❀️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#opensource #meta #nolanguageleftbehind
Day 13: Open NLLB - Aya, dedup sharding analysis, analyzing training (Pt 2.)BigScience BLOOM | 3D Parallelism Explained | Large Language Models | ML Coding SeriesOpenAI DALL-E 3 with James Betker (1st author)Day 10: Open NLLB - evaluation data, filtering (Pt 3.)Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.)Day 8: Meta NLLB - analyzing the training script, Jais paper (Pt. 1)Channel Update: vacation, leaving Microsoft, approaching 10k subs and more!Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper ExplainedDay 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 3)Day 2: Replicating Metas NLLB - primary & mined dataDo Vision Transformers See Like Convolutional Neural Networks? | Paper ExplainedDay 11: Open NLLB - Apex, mined data, etc.
Aleksa Gordić - The AI Epiphany |

Day 13: Open NLLB - Aya, dedup sharding analysis, analyzing training (Pt 2.)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER