Uploaded July 2025 | Updated September 2026, 1 week ago
Check out Runpod's Hub and Serverless to make deploying AI models even easier! https://runpod.io?ref=h9oj1vbp
ByteDance Seed Proposed PMA which is a model merging technique for pre-training models to project your annealed performance without the need to go through annealing. This can save up to millions in big model training runs.
My Newsletter
mail.bycloud.ai
my project: find, discover & explain AI research semantically
findmypapers.ai
My Patreon
patreon.com/c/bycloud
Model Merging in Pre-training of Large Language Models
[Paper] alphaxiv.org/abs/2505.12082
Other "model merging" techniques I mentioned (but are used in completely different scenarios)
alphaxiv.org/abs/2410.03617
alphaxiv.org/abs/2410.15661
alphaxiv.org/abs/2403.07816
Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N' Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Constantinos Charilaou, Abay Bektursun
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Abhay
[Ko-fi] ko-fi.com/bycloudai
Check out Runpod's Hub and Serverless to make deploying AI models even easier! https://runpod.io?ref=h9oj1vbp
ByteDance Seed Proposed PMA which is a model merging technique for pre-training models to project your annealed performance without the need to go through annealing. This can save up to millions in big model training runs.
My Newsletter
mail.bycloud.ai
my project: find, discover & explain AI research semantically
findmypapers.ai
My Patreon
patreon.com/c/bycloud
Model Merging in Pre-training of Large Language Models
[Paper] alphaxiv.org/abs/2505.12082
Other "model merging" techniques I mentioned (but are used in completely different scenarios)
alphaxiv.org/abs/2410.03617
alphaxiv.org/abs/2410.15661
alphaxiv.org/abs/2403.07816
Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N' Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Constantinos Charilaou, Abay Bektursun
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Abhay
[Ko-fi] ko-fi.com/bycloudai
![Stable Diffusion SDXL 0.9, Text To Video Zeroscope v2 & More [The AI Timeline #7]](https://i.ytimg.com/vi/dusMxQoXkMg/mqdefault.jpg "Stable Diffusion SDXL 0.9, Text To Video Zeroscope v2 & More [The AI Timeline #7]
Welcome to my 7th episode of the weekly AI news series The AI Timeline, where I go through the AI news in the past week with the most distilled information and memes!
zeroscope v2
[30fps] https://huggingface.co/cerspense/zeroscope_v2_dark_30x448x256
[576w] https://huggingface.co/cerspense/zeroscope_v2_576w
[XL] https://huggingface.co/cerspense/zeroscope_v2_XL
[HuggingFace Demo] https://huggingface.co/spaces/hysts/zeroscope-v2
[Modelscope] https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis
SDXL 0.9
[Blog] https://stability.ai/blog/sdxl-09-stable-diffusion?utm_source=Website&utm_medium=Twitter&utm_campaign=SDXL.9
[ClipDrop] https://clipdrop.co/
Textbooks Are All You Need
[Paper] https://arxiv.org/pdf/2306.11644.pdf
Kosmos-2
[Paper] https://arxiv.org/pdf/2306.14824.pdf
MPT-30B-Chat
[Demo] https://huggingface.co/spaces/mosaicml/mpt-30b-chat
[HuggingFace Card] https://huggingface.co/mosaicml/mpt-30b-chat
AudioPaLM
[Paper] https://arxiv.org/abs/2306.12925
[Project Page] https://google-research.github.io/seanet/audiopalm/examples/#s2tt-section
Faith and Fate: Limits of Transformers on Compositionality
[Paper] https://arxiv.org/pdf/2305.18654.pdf
MotionGPT
[Paper] https://arxiv.org/pdf/2306.14795.pdf
[Project Page] https://motion-gpt.github.io/
[Code] https://github.com/OpenMotionLab/MotionGPT
AiBreakfast
[TW] https://twitter.com/AiBreakfast/status/1673350504162955266?s=20
Unity Muse & Unity Sentis
[Article] https://blog.unity.com/engine-platform/introducing-unity-muse-and-unity-sentis-ai
PanoHead
[Paper] https://arxiv.org/abs/2303.13071
[Project Page] https://sizhean.github.io/panohead
[Code] https://github.com/SizheAn/PanoHead
Drag Diffusion
[Paper] https://arxiv.org/pdf/2306.14435.pdf
[DragGAN] https://vcai.mpi-inf.mpg.de/projects/DragGAN/
Dream Editor
[Paper] https://arxiv.org/pdf/2306.13455.pdf
WALDO v2
[TW] https://twitter.com/StephanSturges/status/1674050823062536192?s=20
[TW] https://twitter.com/StephanSturges/status/1673036804352618496?s=20
[website] https://aircortex.com/
CS50 at Harvard
[article] https://www.thecrimson.com/article/2023/6/21/cs50-artificial-intelligence/
Japanese Upper Body Motion Tracking Software
[Webpage] https://webcammotioncapture.info/#accordion
[TW] https://twitter.com/webcammocap/status/1672865027827847169?s=20
Doraemon Comic Panel
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/14k33wa/doraemon_predicted_ai_image_generation/?utm_source=share&utm_medium=web2x&context=3
1923 Comic
[Google Books] https://imgur.com/a/uccITRa
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Alex J, Chris LeDoux, Alex Maurice, Deagan, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Profile & Banner Art] https://twitter.com/pygm7
Headlines of The Week 0:00
Weekly Dose of LLM 2:50
Rapid Fire News & FFA 8:11")
![[VOD] First Look At Claude 3 - Can It Beat GPT-4?](https://i.ytimg.com/vi/g8t3WUBXBPM/mqdefault.jpg "[VOD] First Look At Claude 3 - Can It Beat GPT-4?
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
My Patreon goats:
Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon")
