Day 15: Open NLLB - sharding, paper reading (hallucinations) (Pt 1) @TheAIEpiphany
Day 15: Open NLLB - sharding, paper reading (hallucinations) (Pt 1)  @TheAIEpiphany
Uploaded September 2023 | Updated September 2026, 1 week ago
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦
discord.gg/peBrCpheKE

Let's see how to shard model in fairseq and 2 papers:
- arxiv.org/pdf/2205.11631.pdf ← interpretability, ALTI metric, Meta
- arxiv.org/abs/2212.08597 ← hallucinations in MT, Meta

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° BECOME A PATREON OF THE AI EPIPHANY ❀️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#opensource #meta #nolanguageleftbehind
Day 15: Open NLLB - sharding, paper reading (hallucinations) (Pt 1)Day 17: Open NLLB - eval on 2 GPUs all-gather, fairseq data loading debugging session (Pt 1)Day 16: Open NLLB - text sampling and sacrebleu eval during training (Pt 1)10k subscribers | joining Google DeepMind, updates, AMADay 4: GPT-NeoX walk-through (Pt. 1)Jeremy Howard - answer.ai, what is wrong with the academia and industryInstructPix2Pix (w/ OpenAIs Tim Brooks)NeurIPS 2022 - interviews with AI experts and conference walk-throughDay 7: Meta NLLB - data sharding, binarization, etc. (Pt. 3)Day 1: Replicating Metas NLLB - fairseq2, SeamlessM4T code, licenses (Pt. 3)Day 3: Polyglot-Ko, Japanese LLM, GPT-NeoX (Pt. 4)AudioGen: Textually Guided Audio Generation | Text To Audio | Paper Explained
Aleksa Gordić - The AI Epiphany |

Day 15: Open NLLB - sharding, paper reading (hallucinations) (Pt 1)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER