Uploaded June 2024 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Daniel Han from Unsloth AI joined us to walk us through his bug-hunting process and how to make LLM fine-tuning 30x faster. :)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
check out unsloth ai: unsloth.ai
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:01:40 Intro
00:01:40 - 00:03:21 Hyperstack GPUs! (sponsored)
00:03:21 - 00:06:30 About Daniel, getting started with ML
00:06:30 - 00:11:00 Using Desmos to check grads
00:11:00 - 00:38:00 Deep dive into Gemma bugs
00:38:00 - 00:50:00 approximate GELU bug
00:50:00 - 00:54:15 What are the bottlenecks to speeding up the runtime?
00:54:15 - 00:58:30 comparison with llm.c?
00:58:30 - 01:00:00 Is multi-GPU coming to Unsloth? :)
01:00:00 - 01:05:19 Reproducibility in ML research
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#unslothai #llms #finetuning #ml
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Daniel Han from Unsloth AI joined us to walk us through his bug-hunting process and how to make LLM fine-tuning 30x faster. :)
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
check out unsloth ai: unsloth.ai
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:01:40 Intro
00:01:40 - 00:03:21 Hyperstack GPUs! (sponsored)
00:03:21 - 00:06:30 About Daniel, getting started with ML
00:06:30 - 00:11:00 Using Desmos to check grads
00:11:00 - 00:38:00 Deep dive into Gemma bugs
00:38:00 - 00:50:00 approximate GELU bug
00:50:00 - 00:54:15 What are the bottlenecks to speeding up the runtime?
00:54:15 - 00:58:30 comparison with llm.c?
00:58:30 - 01:00:00 Is multi-GPU coming to Unsloth? :)
01:00:00 - 01:05:19 Reproducibility in ML research
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#unslothai #llms #finetuning #ml
