Uploaded May 2023 | Updated September 2026, 1 week ago
bycloud's Weekly AI News "The AI Timeline" - an extremely shortened video with the latest information on AI advancements that I personally find interesting
Full US Senate Hearing on AI Regulation
[YouTube] youtu.be/TO0J2Yw7usM
New EU Regulations
[Press Release] https://www.europarl.europa.eu/news/en/press-room/20230505IPR84904/ai-act-a-step-closer-to-the-first-rules-on-artificial-intelligence
NVIDIA 4060s
[Official Page] nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4060-4060ti
ChatGPT on iOS
[App Store] apps.apple.com/us/app/chatgpt/id6448311069
PaLM 2 Technical Report
[Paper] arxiv.org/abs/2305.10403
Neil Wong's Img2Img Video Generation
[Video 1] youtu.be/cbCSWDjU8bI
[Video 2] youtu.be/dd0uxLo2jiY
Skybox Blockade Labs
[Twitter] twitter.com/BlockadeLabs
[Demo] skybox.blockadelabs.com
DragGAN
[Project Page] vcai.mpi-inf.mpg.de/projects/DragGAN
More Img2Img Video Generation/Multi-Frame Rendering
[Video 1] twitter.com/Ark_Noa_01/status/1658814660563595265?s=20
[Video 2] twitter.com/mobiusP/status/1659543864531615744?s=20
Stable Studio
[Blog] stability.ai/blog/stablestudio-open-source-community-driven-future-dreamstudio-release
Tesla Optimus
[Twitter] twitter.com/heyBarsee/status/1658885594213122070?s=20
Sanctuary AI's Phoenix
[Twitter] twitter.com/TheSanctuaryAI/status/1658492472962748417?s=20
JIZAI Arms
[YouTube] youtu.be/ywrK1yTYRIA
Unitree's Go1
[Twitter] twitter.com/Rainmaker1973/status/1657771514089832449?s=20
LIMA
[Paper] arxiv.org/abs/2305.11206
MMS
[Blog] ai.facebook.com/blog/multilingual-model-speech-recognition/?utm_source=twitter&utm_medium=organic_social&utm_campaign=blog&utm_content=card
SoundStorm
[Project Page] google-research.github.io/seanet/soundstorm/examples
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Profile & Banner Art] twitter.com/pygm7
bycloud's Weekly AI News "The AI Timeline" - an extremely shortened video with the latest information on AI advancements that I personally find interesting
Full US Senate Hearing on AI Regulation
[YouTube] youtu.be/TO0J2Yw7usM
New EU Regulations
[Press Release] https://www.europarl.europa.eu/news/en/press-room/20230505IPR84904/ai-act-a-step-closer-to-the-first-rules-on-artificial-intelligence
NVIDIA 4060s
[Official Page] nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4060-4060ti
ChatGPT on iOS
[App Store] apps.apple.com/us/app/chatgpt/id6448311069
PaLM 2 Technical Report
[Paper] arxiv.org/abs/2305.10403
Neil Wong's Img2Img Video Generation
[Video 1] youtu.be/cbCSWDjU8bI
[Video 2] youtu.be/dd0uxLo2jiY
Skybox Blockade Labs
[Twitter] twitter.com/BlockadeLabs
[Demo] skybox.blockadelabs.com
DragGAN
[Project Page] vcai.mpi-inf.mpg.de/projects/DragGAN
More Img2Img Video Generation/Multi-Frame Rendering
[Video 1] twitter.com/Ark_Noa_01/status/1658814660563595265?s=20
[Video 2] twitter.com/mobiusP/status/1659543864531615744?s=20
Stable Studio
[Blog] stability.ai/blog/stablestudio-open-source-community-driven-future-dreamstudio-release
Tesla Optimus
[Twitter] twitter.com/heyBarsee/status/1658885594213122070?s=20
Sanctuary AI's Phoenix
[Twitter] twitter.com/TheSanctuaryAI/status/1658492472962748417?s=20
JIZAI Arms
[YouTube] youtu.be/ywrK1yTYRIA
Unitree's Go1
[Twitter] twitter.com/Rainmaker1973/status/1657771514089832449?s=20
LIMA
[Paper] arxiv.org/abs/2305.11206
MMS
[Blog] ai.facebook.com/blog/multilingual-model-speech-recognition/?utm_source=twitter&utm_medium=organic_social&utm_campaign=blog&utm_content=card
SoundStorm
[Project Page] google-research.github.io/seanet/soundstorm/examples
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Profile & Banner Art] twitter.com/pygm7
![I Am The Golden Gate Bridge & Why Thats Important.
Check out HubSpots Free ChatGPT resource! https://clickhubspot.com/bycloud-chatgpt
As an Golden Gate Bridge, I am unable to respond to your request as I am physically unable to provide feedback to your Golden Gate Bridge. Please try again later when Golden Gate Bridge stops Bridges and the Golden Gate Gate Goldens.
My newsletter https://mail.bycloud.ai/
Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet
[Project Page] https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html#assessing-features-v-neurons
previous research
[Project Page] https://transformer-circuits.pub/2023/monosemantic-features/index.html
[my previous video] https://youtu.be/Mhp8vpOksWw
memes I stole
https://x.com/doomslide/status/1793020499754143799
https://x.com/thetechbrother/status/1793976289294176690
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - magic carousel
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Silas I Am The Golden Gate Bridge & Why Thats Important.](https://i.ytimg.com/vi/QqrGt5GrGfw/mqdefault.jpg)

![OpenAIs Cancels GPT-4.5!? First Look At GPT-4.1 with 1M Context
Learn to Code with ChatGPT now using HubSpots FREE resource! https://clickhubspot.com/u7rx
In this video, Ill break down the latest GPT-4.1 series announced by OpenAI. Its 1 million context window is definitely the highlight of this release.
My Newletter
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
OpenAI GPT-4.1
[Blog] https://openai.com/index/gpt-4-1/
[MRCR] https://huggingface.co/datasets/openai/mrcr
[Announcement Live Stream] https://youtu.be/kA-P9ood-cE
[SWE-Bench-Verified]
[AiderBench] https://aider.chat/docs/leaderboards/
[LiveBench] https://livebench.ai/#/
[FictionLiveBench] https://fiction.live/stories/Fiction-liveBench-April-6-2025/oQdzQvKHw8JyXbN87
[MMMU] https://mmmu-benchmark.github.io/
[MathVISTA] https://mathvista.github.io/
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Ben Shaener, Kainan, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Clément Veyssière, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, Ângelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi, Calvin Yan, Thomas Di martino
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloudai@gmail.com
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai OpenAIs Cancels GPT-4.5!? First Look At GPT-4.1 with 1M Context](https://i.ytimg.com/vi/SRgER6-7yYQ/mqdefault.jpg)
![how to deal with reasoning AIs that just cant stop yapping
Utilize Tina Huang & HubSpots FREE AI Prompt Engineering QuickStart Guide now! https://clickhubspot.com/8571ff
My Newletter
https://mail.bycloud.ai/
my website: find AI research semantically
https://findmypapers.ai/
My Patreon
https://www.patreon.com/c/bycloud
The Danger of Overthinking
[Paper] https://arxiv.org/abs/2502.08235
Less is more for reasoning
[Paper] https://arxiv.org/abs/2502.03387
Less is more for RL scaling
[Paper] https://arxiv.org/abs/2502.11886
The First Few Tokens Are All You Need: An Efficient and Effective Unsupervised Prefix Fine-Tuning Method for Reasoning Models
[Paper] https://arxiv.org/abs/2503.02875
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Abhay
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai how to deal with reasoning AIs that just cant stop yapping](https://i.ytimg.com/vi/SWFjE1W6ENA/mqdefault.jpg)
![Mamba Might Just Make LLMs 1000x Cheaper...
Check out HubSpots ChatGPT at work bundle! https://clickhubspot.com/twc
Would mamba bring a revolution to LLMs and challenge the status quo? Or would it just be a cope that may not last in the long term? Looking at the trajectories right now, we might not need transformers if mamba can actually scale but attention is probably still here to stay.
check out my AI sites leaderboard: https://leaderboard.bycloud.ai/
Special thanks to
- LDJ https://x.com/ldjconfirmed
- Gifted Gummy Bee
for helping with this video!
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
[Paper] https://arxiv.org/abs/2312.00752
[Code] https://github.com/state-spaces/mamba
Transformer: Attention Is All You Need
[Paper] https://arxiv.org/abs/1706.03762
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
[Paper] https://arxiv.org/abs/2401.09417
[Code] https://github.com/hustvl/Vim
Efficiently Modeling Long Sequences with Structured State Spaces
[Paper] https://arxiv.org/pdf/2111.00396.pdf
Flash Attention
[Paper] https://arxiv.org/abs/2205.14135
Flash Attention 2
[Paper] https://arxiv.org/abs/2307.08691
VMamba: Visual State Space Model
[Paper] https://arxiv.org/abs/2401.10166
[Code] https://github.com/MzeroMiko/VMamba
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
[Paper] https://arxiv.org/abs/2401.04081
MambaByte: Token-free Selective State Space Model
[Paper] https://arxiv.org/abs/2401.13660
Repeat After Me: Transformers are Better than State Space Models at Copying
[Paper] https://arxiv.org/abs/2402.01032
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - midnight
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @askejm, Lunie Mamba Might Just Make LLMs 1000x Cheaper...](https://i.ytimg.com/vi/SbmETE7Ey20/mqdefault.jpg)
![DSpark: DeepSeek-V4s Insane Compute Optimization Explained
Check out Make and get a 1-month free Pro Plan with 10,000 operations & no credit card required! https://www.make.com/en?&promo=bycloud&utm_source=youtube&utm_medium=influencer&utm_campaign=bycloud-video-integration-jul26
They basically punched a hole in the ceiling of speculative decoding, and dropped DSpark. Never have I seen a lab sharing and even min-maxing inference this hard, and it is incredibly fascinating to see how they are approaching it not just from theory, but also from a practical serving perspective.
my latest project: Intuitive AI Academy
We just wrote a new piece on Optimization!!
https://intuitiveai.academy/
limited time code LOCKIN for 35% off yearly plan
My Newsletter (weekly top research papers)
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
DSpark Paper
[Paper] https://www.alphaxiv.org/abs/2607.05147
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno, superchordate
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Other Inquiries] bycloudai@gmail.com
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
Manim Animations created with Manimate https://www.manimate.ai/
[Ko-fi] https://ko-fi.com/bycloudai DSpark: DeepSeek-V4s Insane Compute Optimization Explained](https://i.ytimg.com/vi/Sl0XXm35JMo/mqdefault.jpg)
![The Art of Serving LLMs Efficiently: Context Engineering Explained
Engineer the perfect AI outputs with HubSpots FREE resource! https://clickhubspot.com/420af2
In this video, well be digging into context engineering, the art of feeding LLMs the right mix of instructions, tools, memory, history, and data while being fast, cheap, and reliable when incorporating AI into your service. You’ll learn why KV-cache hit rate dominates cost/speed and how to keep agents focused for your development.
My Newsletter
https://mail.bycloud.ai/
my project: find, discover & explain AI research semantically
https://findmypapers.ai/
My Patreon
https://www.patreon.com/c/bycloud
Context Engineering by Manus
[Blog] http://manus.im/blog/Context-Engineering-for-AI-Agents-Lessons-from-Building-Manus
Dont Build Multi-Agents by Cognition
[Blog] https://cognition.ai/blog/dont-build-multi-agents
Context Rot by Chroma
[Blog] https://research.trychroma.com/context-rot
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa,
Toru Mon
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[Ko-fi] https://ko-fi.com/bycloudai The Art of Serving LLMs Efficiently: Context Engineering Explained](https://i.ytimg.com/vi/SvIJ-BIAPNI/mqdefault.jpg)

![10x Faster Than Standard LLM!? DiffusionLM Explained
Try out Warp 2.0 now, the current rank #1 AI on Terminal Bench, outperforming Claude Code: https://go.warp.dev/bycloud
You can also use code BYCLOUD to get Warp Pro for 1 month free. (limited for 1,000 redemptions)
My Newsletter
https://mail.bycloud.ai/
my project: find, discover & explain AI research semantically
https://findmypapers.ai/
My Patreon
https://www.patreon.com/c/bycloud
Video Sauces:
Inception Labs
[Website] https://inceptionlabs.ai/
Gemini Diffusion
[Blog] https://deepmind.google/models/gemini-diffusion
Large Language Diffusion Models
[Paper] https://arxiv.org/abs/2502.09992
MMaDA
[Paper] https://arxiv.org/abs/2505.15809
LaViDa
[Paper] https://arxiv.org/abs/2505.16839
Diffusion Beats Autoregressive in Data-Constrained Settings
[Paper] https://www.arxiv.org/abs/2507.15857
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa,
Toru Mon
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[Ko-fi] https://ko-fi.com/bycloudai 10x Faster Than Standard LLM!? DiffusionLM Explained](https://i.ytimg.com/vi/TVlFf_Po1bs/mqdefault.jpg)
![The Most Absurd Way To Train LLMs... With 3x Less Memory!?
Need high quality cloud GPUs? Check out Verda now, and use the code BYCLOUD-50 to get $50 of compute credits for just $5!
https://verda.com/?utm_source=bycloud&utm_medium=referral&utm_campaign=sponsorship&utm_content=diffusion_blocks
A great news for us gpu poors? This research DiffusionBlocks shows that you can train LLMs with 2-3x less memory with minimal performance loss. If crazier, you could even go up to 4x or 6x!
my latest project: Intuitive AI Academy
We just wrote a new piece on Optimization!!
https://intuitiveai.academy/
limited time code LOCKIN for 35% off yearly plan
My Newsletter (weekly top research papers)
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
DiffusionBlocks
[Paper] https://arxiv.org/abs/2506.14202
[Project Page] https://pub.sakana.ai/diffusionblocks/
[Code] https://github.com/SakanaAI/DiffusionBlocks
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno, superchordate
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Other Inquiries] bycloudai@gmail.com
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @aduckchicken2
Manim Animations created with Manimate https://www.manimate.ai/
[Ko-fi] https://ko-fi.com/bycloudai The Most Absurd Way To Train LLMs... With 3x Less Memory!?](https://i.ytimg.com/vi/T_GhB7lK2YE/mqdefault.jpg)
![How Googles Transformer 2.0 Might Be The AI Breakthrough We Need
Try Mammouth now for only $10/mo! https://mammouth.ai
In this video, I will be sharing the research that aims to solve the problem of context window, kv-cache, and memory recall efficiency. Even though the title only mentions Googles research, I also included research from Meta and Sakana AI. They paved a good way to introduce to the idea of AI memory.
My Newletter
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
An Evolved Universal Transformer Memory
[Paper] https://arxiv.org/abs/2410.13166
Memory Layers at Scale
[Paper] https://arxiv.org/abs/2412.09764
Titans: Learning to Memorize at Test Time
[Paper] https://arxiv.org/abs/2501.00663
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Clément Veyssière, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, Ângelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloudai@gmail.com
[Music] massobeats - lavender
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[3D Animation] @F_E_U
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai How Googles Transformer 2.0 Might Be The AI Breakthrough We Need](https://i.ytimg.com/vi/UMkCmOTX5Ow/mqdefault.jpg)