Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.) @TheAIEpiphany
Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.)  @TheAIEpiphany
Uploaded September 2023 | Updated September 2026, 1 week ago
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦
discord.gg/peBrCpheKE

Let's quickly go through the new FSDP in PyTorch paper (we previously read the blog) and kick off the first run.

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° BECOME A PATREON OF THE AI EPIPHANY ❀️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#opensource #meta #nolanguageleftbehind
Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.)Day 8: Meta NLLB - analyzing the training script, Jais paper (Pt. 1)Channel Update: vacation, leaving Microsoft, approaching 10k subs and more!Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Paper ExplainedDay 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 3)Day 2: Replicating Metas NLLB - primary & mined dataDo Vision Transformers See Like Convolutional Neural Networks? | Paper ExplainedDay 11: Open NLLB - Apex, mined data, etc.Tanishq Abraham (PhD at 19) - MedARCDay 6: Meta NLLB - data filtering (Pt. 1)How To Install CUDA, cuDNN, Ubuntu, Miniconda | ML Software Stack | Part 3/3Day 17: Open NLLB - community tasks, dataset sharding, eos token (Pt 3)
Aleksa Gordić - The AI Epiphany |

Day 13: Open NLLB - FSDP paper, kicking off the 1st run (Pt 1.)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER