Uploaded July 2024 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Junyang joined us to talk about the recently annonced Qwen2 LLM!
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
qwenlm.github.io/blog/qwen2
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:00:32 Intro
00:00:32 - 00:02:13 Hyperstack GPUs (sponsored)
00:02:13 - 00:07:05 Junyang & Qwen team at Alibaba
00:07:05 - 00:13:05 Qwen2
00:13:05 - 00:15:55 Tokenizer
00:15:55 - 00:23:30 Training Qwen2
00:23:30 - 00:30:50 Pretraining data
00:30:50 - 00:37:35 Model Architecture (changes?)
00:37:35 - 00:50:00 Context length
00:50:00 - 00:57:50 Post-training
00:57:50 - 00:59:20 Benchmarks/safety
00:59:20 - 01:03:32 Future work
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#qwen2 #alibaba #llms
Become a Patreon: patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community: discord.gg/peBrCpheKE
Junyang joined us to talk about the recently annonced Qwen2 LLM!
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
qwenlm.github.io/blog/qwen2
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 - 00:00:32 Intro
00:00:32 - 00:02:13 Hyperstack GPUs (sponsored)
00:02:13 - 00:07:05 Junyang & Qwen team at Alibaba
00:07:05 - 00:13:05 Qwen2
00:13:05 - 00:15:55 Tokenizer
00:15:55 - 00:23:30 Training Qwen2
00:23:30 - 00:30:50 Pretraining data
00:30:50 - 00:37:35 Model Architecture (changes?)
00:37:35 - 00:50:00 Context length
00:50:00 - 00:57:50 Post-training
00:57:50 - 00:59:20 Benchmarks/safety
00:59:20 - 01:03:32 Future work
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° SPONSOR
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#qwen2 #alibaba #llms
