building the best RLHF (TRLX) library w/ Louis Castricato @TheAIEpiphany
building the best RLHF (TRLX) library w/ Louis Castricato  @TheAIEpiphany
Uploaded November 2023 | Updated September 2026, 1 week ago
❀️ Become The AI Epiphany Patreon ❀️
patreon.com/theaiepiphany

πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦
discord.gg/peBrCpheKE

Louis walks us through his journey of building CarperAI.

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
βœ… github.com/CarperAI/trlx
β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

⌚️ Timetable:
00:00 A bit about Louis himself
02:20 Start of Carper
07:00 Start of trlx
09:25 Growing Carper & OSS
32:30 Q&A

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° BECOME A PATREON OF THE AI EPIPHANY ❀️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
David Hood
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#rlhf #carperai #stabilityai #opensource #trlx
building the best RLHF (TRLX) library w/ Louis CastricatoALiBi | Train Short, Test Long: Attention With Linear Biases Enables Input Length ExtrapolationDay 23: Open NLLB - day before China trip! Refactoring & pushing  changes (Pt 1 cont.)Hyperbolic Graph Convolutional Networks | Geometric ML Paper ExplainedDiffusion Models Beat GANs on Image Synthesis | ML Coding Series | Part 2Facebook AIs DINO | PyTorch Code ExplainedUltimate Guide To Scaling ML Models - Megatron-LM | ZeRO | DeepSpeed | Mixed PrecisionT0: Multitask Prompted Training Enables Zero-Shot Task Generalization | Paper ExplainedDay 17: Open NLLB - analyzing batch iterators (Pt 2)State Space Models w/ Albert Gu & Karan Goel (Cartesia AI)ConvNeXt: A ConvNet for the 2020s | Paper ExplainedVQ-GAN: Taming Transformers for High-Resolution Image Synthesis | Paper Explained
Aleksa Gordić - The AI Epiphany |

building the best RLHF (TRLX) library w/ Louis Castricato

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER