LLaMA 2 w/ Thomas Scialom (LLaMA 2 lead) @TheAIEpiphany
LLaMA 2 w/ Thomas Scialom (LLaMA 2 lead)  @TheAIEpiphany
Uploaded December 2023 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community: discord.gg/peBrCpheKE

Thomas from Meta joined us to talk about his story, his work on various Meta projects including Galactica, LLaMA 2, BLOOM, etc.

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
Thomas's G Scholar: https://scholar.google.fr/citations?user=qou4P-kAAAAJ&hl=en
β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

⌚️ Timetable:
00:00 Thomas''s story
12:45 The Sci-Fi moment
16:30 Large is all you need
23:37 Supervised fine-tuning
24:25 Human Preference
43:25 What happens next?
46:45 Q&A

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° SPONSOR

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
David Hood
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#llama2 #meta #llama #thomasscialom #galactica
LLaMA 2 w/ Thomas Scialom (LLaMA 2 lead)Day 24: Open NLLB - back from China, fuzzy dedup, preparing HBS run (Pt 1)Day 12: Open NLLB - on-boarding doc for new-joiners, eval (Pt 2.)Day 22: Open NLLB - HBS data analysis, split into Cyrillic & Latin (Pt 2)Day 4: Training 600M NLLB - data preps (Pt. 2)Day 4: Training 600M NLLB - data preps (Pt. 3)Day 15: Open NLLB - wrapping up detecting hallucinations paper (Pt 3)OpenAI GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion ModelsHigh Fidelity Neural Audio Compression | Paper & Code ExplainedDay 24: Open NLLB - back from China, filtering HBS data (Pt 3)When Vision Transformers Outperform ResNets without Pretraining | Paper ExplainedDeepMind DetCon: Efficient Visual Pretraining with Contrastive Detection | Paper Explained
Aleksa Gordić - The AI Epiphany |

LLaMA 2 w/ Thomas Scialom (LLaMA 2 lead)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER