Uploaded February 2024 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
I invited head of silicon at Groq, Igor Arsovski, to share the nitty-gritty details behind Groq's LPUs! LPU or language processing units showed promising results (understatement of the year) on inference benchmarks compared to NVIDIA GPUs.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:00:42 Intro
00:00:42 - 00:02:23 Hyperstack GPU cloud (sponsored)
00:02:23 - 00:12:18 What does Groq do?
00:12:18 - 00:26:40 Hardware
00:26:40 - 00:37:52 Software
00:37:52 - 00:45:09 Power control
00:45:09 - 00:54:22 Networking
00:54:22 - 00:59:30 AllReduce comparison between GPUs and LPUs
00:59:30 - 01:04:10 GPU vs LPU
01:04:10 - 01:11:45 Outro
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#groq #lpu #aichip #ai
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
I invited head of silicon at Groq, Igor Arsovski, to share the nitty-gritty details behind Groq's LPUs! LPU or language processing units showed promising results (understatement of the year) on inference benchmarks compared to NVIDIA GPUs.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:00:42 Intro
00:00:42 - 00:02:23 Hyperstack GPU cloud (sponsored)
00:02:23 - 00:12:18 What does Groq do?
00:12:18 - 00:26:40 Hardware
00:26:40 - 00:37:52 Software
00:37:52 - 00:45:09 Power control
00:45:09 - 00:54:22 Networking
00:54:22 - 00:59:30 AllReduce comparison between GPUs and LPUs
00:59:30 - 01:04:10 GPU vs LPU
01:04:10 - 01:11:45 Outro
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#groq #lpu #aichip #ai
