Uploaded September 2024 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Bowei joined us from Imbue to talk about Imbue's latest endeavor: building the infra to support a 70B model training! They wrote up an amazing blog post with a lot of details describing the grind that was needed to set everything up from scratch. :)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
Blog post: imbue.com/research/70b-infrastructure (From bare metal to a 70B model: infrastructure set-up and scripts)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00 - 00:45 Intro
00:45 - 02:25 Hyperstack GPUs (sponsored)
02:25 - 11:30 Bowei's background
11:30 - 18:30 More on Imbue, their research, their focus
18:30 - 26:20 Training a 70B model
26:20 - 45:40 Building a cluster from scratch
45:40 - 59:25 Anecdotes, Q&A
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#imbue #infra #70b #llm
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Bowei joined us from Imbue to talk about Imbue's latest endeavor: building the infra to support a 70B model training! They wrote up an amazing blog post with a lot of details describing the grind that was needed to set everything up from scratch. :)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
Blog post: imbue.com/research/70b-infrastructure (From bare metal to a 70B model: infrastructure set-up and scripts)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00 - 00:45 Intro
00:45 - 02:25 Hyperstack GPUs (sponsored)
02:25 - 11:30 Bowei's background
11:30 - 18:30 More on Imbue, their research, their focus
18:30 - 26:20 Training a 70B model
26:20 - 45:40 Building a cluster from scratch
45:40 - 59:25 Anecdotes, Q&A
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#imbue #infra #70b #llm
