Uploaded August 2024 | Updated September 2026, 1 week ago
Check out HubSpot's Free ChatGPT resource to power up your work efficiency🔥: clickhubspot.com/hyx
Check out my newsletter:
mail.bycloud.ai
Are We Done With MMLU?
[Paper] arxiv.org/abs/2406.04127
Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
[Paper] arxiv.org/abs/2406.02061
Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
[Paper] arxiv.org/abs/2405.15071
Grokfast: Accelerated Grokking by Amplifying Slow Gradients
[Paper] arxiv.org/abs/2405.20233
[Code] github.com/ironjr/grokfast
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Music] massobeats - noon
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Silas
Check out HubSpot's Free ChatGPT resource to power up your work efficiency🔥: clickhubspot.com/hyx
Check out my newsletter:
mail.bycloud.ai
Are We Done With MMLU?
[Paper] arxiv.org/abs/2406.04127
Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
[Paper] arxiv.org/abs/2406.02061
Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
[Paper] arxiv.org/abs/2405.15071
Grokfast: Accelerated Grokking by Amplifying Slow Gradients
[Paper] arxiv.org/abs/2405.20233
[Code] github.com/ironjr/grokfast
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Music] massobeats - noon
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Silas
![AI Automated Scientific Discovery Is Way Too Cheap...
Check out OnDemand now: https://app.on-demand.io/auth/signup?refCode=bycloud
My newsletter:
https://mail.bycloud.ai
The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
[Paper] https://arxiv.org/abs/2408.06292
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - lush
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Silas AI Automated Scientific Discovery Is Way Too Cheap...](https://i.ytimg.com/vi/O-VDYl5lrIE/mqdefault.jpg)
![DiT: The Secret Sauce of OpenAIs Sora & Stable Diffusion 3
Dont miss out on these exciting upgrades designed to elevate your content creation experience with DomoAI! Go try out: discord.gg/sPEqFUTn7n
Diffusion Transformers might be the next meta in media synthesis. It not only excels at text-to-image, but also text-to-video shown by OpenAIs Sora. The results that have came out which uses it are mindblowingly good. If we can obtain more information about it though:( They are both currently close sourced.
DiT: Diffusion Transformers
[Paper] https://arxiv.org/abs/2212.09748
Sora
[Blog] https://openai.com/sora
[Technical report] https://openai.com/research/video-generation-models-as-world-simulators
Stable Diffusion 3
[announcement] https://stability.ai/news/stable-diffusion-3
[Waitlist] https://stability.ai/stablediffusion3
[Paper] https://arxiv.org/pdf/2403.03206.pdf
DiffiT
[Paper] https://arxiv.org/abs/2312.02139
HDiT
[Paper] https://arxiv.org/abs/2401.11605
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[BGM] massobeats - glisten
[Profile & Banner Art] https://twitter.com/pygm7 DiT: The Secret Sauce of OpenAIs Sora & Stable Diffusion 3](https://i.ytimg.com/vi/OPqFpm3wksY/mqdefault.jpg)
![Why can’t LLMs just LEARN the context window?
Check out HubSpots FREE 2026 Guide to AI Agents: https://clickhubspot.com/3972be
In this video, Ill be breaking down a new approach to long-context LLMs called test-time training (TTT-E2E), where models store past context directly in their weights instead of relying on attention or KV caches. Kind of like meta learning, but with gradient descent.
my latest project: Intuitive AI Academy
We just wrote a new piece on MoE!
https://intuitiveai.academy/
limited time code EARLY for 40% off yearly plan!
TTT-E2E
[Paper] https://arxiv.org/abs/2512.23675
Appeared papers
[Titans] https://arxiv.org/abs/2501.00663
[Kimi Linear] https://arxiv.org/abs/2510.26692
My Newsletter
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, Zyansheep
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[Ko-fi] https://ko-fi.com/bycloudai Why can’t LLMs just LEARN the context window?](https://i.ytimg.com/vi/P9uNy71YukQ/mqdefault.jpg)
![How Did Open Source Catch Up To OpenAI? [Mixtral-8x7B]
Sign-up for GTC24 now using this link!
https://nvda.ws/48s4tmc
For the giveaway of the RTX4080 Super, the full detailed plans are still being developed. However, itll be along the line of you taking a photo of yourself attending a GTC virtual session, so you can sign-up to the conference now to set an early reminder!
What is Mixtral8-7B? The secret Mixture of Experts (MoE) technique that has beaten OpenAIs GPT-3.5 which was published around a year ago? In this video, you will learn what is Mixtral8x7B and how Mixture of Experts work which made them the new rising standard of LLM format.
Mixture of Experts
[Paper] https://arxiv.org/abs/2401.04088
[Project Page] https://mistral.ai/news/mixtral-of-experts/
[Huggingface Doc] https://huggingface.co/docs/transformers/en/model_doc/mixtral
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - waiting
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @askejm How Did Open Source Catch Up To OpenAI? [Mixtral-8x7B]](https://i.ytimg.com/vi/PYZIOMvkUF8/mqdefault.jpg)
![NeRF Is Gonna Be The Future of Google Earth
As you can see, Earth sized NeRF is pretty much possible now. Few more papers down the line, this can be some revolutionary technology.
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering
[Paper] https://arxiv.org/abs/2112.05504
[Project Page] https://city-super.github.io/citynerf/
[Code] https://github.com/city-super/BungeeNeRF
[GitHub Tutorial] https://github.com/bycloudai/BungeeNeRF-Windows
Instant-NGP
[Paper] https://nvlabs.github.io/instant-ngp/assets/mueller2022instant.pdf
[Project Page] https://nvlabs.github.io/instant-ngp/
[Code] https://github.com/NVlabs/instant-ngp
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Chris LeDoux, Dan Kennedy, Shawn77134, Panther Modern, Jake Disco, Demilson Quintao, Tony Jimenez, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[PayPal] https://paypal.me/bycloudai
[Music 1] https://youtu.be/kXxg1AN1gzE
[Music 2] https://youtu.be/VKG2sAVQrg4
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] https://twitter.com/MishnImpossible NeRF Is Gonna Be The Future of Google Earth](https://i.ytimg.com/vi/Pn9ia2fsiwY/mqdefault.jpg)
![Weve Had Our Priorities Wrong [The AI Timeline #2]
byclouds Weekly AI News The AI Timeline - an extremely shortened video with the latest information on AI advancements that I personally find interesting
Full US Senate Hearing on AI Regulation
[YouTube] https://youtu.be/TO0J2Yw7usM
New EU Regulations
[Press Release] https://www.europarl.europa.eu/news/en/press-room/20230505IPR84904/ai-act-a-step-closer-to-the-first-rules-on-artificial-intelligence
NVIDIA 4060s
[Official Page] https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4060-4060ti/
ChatGPT on iOS
[App Store] https://apps.apple.com/us/app/chatgpt/id6448311069
PaLM 2 Technical Report
[Paper] https://arxiv.org/abs/2305.10403
Neil Wongs Img2Img Video Generation
[Video 1] https://youtu.be/cbCSWDjU8bI
[Video 2] https://youtu.be/dd0uxLo2jiY
Skybox Blockade Labs
[Twitter] https://twitter.com/BlockadeLabs
[Demo] https://skybox.blockadelabs.com/
DragGAN
[Project Page] https://vcai.mpi-inf.mpg.de/projects/DragGAN/
More Img2Img Video Generation/Multi-Frame Rendering
[Video 1] https://twitter.com/Ark_Noa_01/status/1658814660563595265?s=20
[Video 2] https://twitter.com/mobiusP/status/1659543864531615744?s=20
Stable Studio
[Blog] https://stability.ai/blog/stablestudio-open-source-community-driven-future-dreamstudio-release
Tesla Optimus
[Twitter] https://twitter.com/heyBarsee/status/1658885594213122070?s=20
Sanctuary AIs Phoenix
[Twitter] https://twitter.com/TheSanctuaryAI/status/1658492472962748417?s=20
JIZAI Arms
[YouTube] https://youtu.be/ywrK1yTYRIA
Unitrees Go1
[Twitter] https://twitter.com/Rainmaker1973/status/1657771514089832449?s=20
LIMA
[Paper] https://arxiv.org/abs/2305.11206
MMS
[Blog] https://ai.facebook.com/blog/multilingual-model-speech-recognition/?utm_source=twitter&utm_medium=organic_social&utm_campaign=blog&utm_content=card
SoundStorm
[Project Page] https://google-research.github.io/seanet/soundstorm/examples/
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Profile & Banner Art] https://twitter.com/pygm7 Weve Had Our Priorities Wrong [The AI Timeline #2]](https://i.ytimg.com/vi/QU_HUDuCGu8/mqdefault.jpg)
![I Am The Golden Gate Bridge & Why Thats Important.
Check out HubSpots Free ChatGPT resource! https://clickhubspot.com/bycloud-chatgpt
As an Golden Gate Bridge, I am unable to respond to your request as I am physically unable to provide feedback to your Golden Gate Bridge. Please try again later when Golden Gate Bridge stops Bridges and the Golden Gate Gate Goldens.
My newsletter https://mail.bycloud.ai/
Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet
[Project Page] https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html#assessing-features-v-neurons
previous research
[Project Page] https://transformer-circuits.pub/2023/monosemantic-features/index.html
[my previous video] https://youtu.be/Mhp8vpOksWw
memes I stole
https://x.com/doomslide/status/1793020499754143799
https://x.com/thetechbrother/status/1793976289294176690
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - magic carousel
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Silas I Am The Golden Gate Bridge & Why Thats Important.](https://i.ytimg.com/vi/QqrGt5GrGfw/mqdefault.jpg)

![OpenAIs Cancels GPT-4.5!? First Look At GPT-4.1 with 1M Context
Learn to Code with ChatGPT now using HubSpots FREE resource! https://clickhubspot.com/u7rx
In this video, Ill break down the latest GPT-4.1 series announced by OpenAI. Its 1 million context window is definitely the highlight of this release.
My Newletter
https://mail.bycloud.ai/
My Patreon
https://www.patreon.com/c/bycloud
OpenAI GPT-4.1
[Blog] https://openai.com/index/gpt-4-1/
[MRCR] https://huggingface.co/datasets/openai/mrcr
[Announcement Live Stream] https://youtu.be/kA-P9ood-cE
[SWE-Bench-Verified]
[AiderBench] https://aider.chat/docs/leaderboards/
[LiveBench] https://livebench.ai/#/
[FictionLiveBench] https://fiction.live/stories/Fiction-liveBench-April-6-2025/oQdzQvKHw8JyXbN87
[MMMU] https://mmmu-benchmark.github.io/
[MathVISTA] https://mathvista.github.io/
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Ben Shaener, Kainan, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Clément Veyssière, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, Ângelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi, Calvin Yan, Thomas Di martino
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloudai@gmail.com
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @Booga04
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai OpenAIs Cancels GPT-4.5!? First Look At GPT-4.1 with 1M Context](https://i.ytimg.com/vi/SRgER6-7yYQ/mqdefault.jpg)
![how to deal with reasoning AIs that just cant stop yapping
Utilize Tina Huang & HubSpots FREE AI Prompt Engineering QuickStart Guide now! https://clickhubspot.com/8571ff
My Newletter
https://mail.bycloud.ai/
my website: find AI research semantically
https://findmypapers.ai/
My Patreon
https://www.patreon.com/c/bycloud
The Danger of Overthinking
[Paper] https://arxiv.org/abs/2502.08235
Less is more for reasoning
[Paper] https://arxiv.org/abs/2502.03387
Less is more for RL scaling
[Paper] https://arxiv.org/abs/2502.11886
The First Few Tokens Are All You Need: An Efficient and Effective Unsupervised Prefix Fine-Tuning Method for Reasoning Models
[Paper] https://arxiv.org/abs/2503.02875
Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Nous Research, Chris LeDoux, Ben Shaener, DX Research Group, Poof N Inu, Andrew Lescelius, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Abhay
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] https://ko-fi.com/bycloudai how to deal with reasoning AIs that just cant stop yapping](https://i.ytimg.com/vi/SWFjE1W6ENA/mqdefault.jpg)
![Mamba Might Just Make LLMs 1000x Cheaper...
Check out HubSpots ChatGPT at work bundle! https://clickhubspot.com/twc
Would mamba bring a revolution to LLMs and challenge the status quo? Or would it just be a cope that may not last in the long term? Looking at the trajectories right now, we might not need transformers if mamba can actually scale but attention is probably still here to stay.
check out my AI sites leaderboard: https://leaderboard.bycloud.ai/
Special thanks to
- LDJ https://x.com/ldjconfirmed
- Gifted Gummy Bee
for helping with this video!
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
[Paper] https://arxiv.org/abs/2312.00752
[Code] https://github.com/state-spaces/mamba
Transformer: Attention Is All You Need
[Paper] https://arxiv.org/abs/1706.03762
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
[Paper] https://arxiv.org/abs/2401.09417
[Code] https://github.com/hustvl/Vim
Efficiently Modeling Long Sequences with Structured State Spaces
[Paper] https://arxiv.org/pdf/2111.00396.pdf
Flash Attention
[Paper] https://arxiv.org/abs/2205.14135
Flash Attention 2
[Paper] https://arxiv.org/abs/2307.08691
VMamba: Visual State Space Model
[Paper] https://arxiv.org/abs/2401.10166
[Code] https://github.com/MzeroMiko/VMamba
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
[Paper] https://arxiv.org/abs/2401.04081
MambaByte: Token-free Selective State Space Model
[Paper] https://arxiv.org/abs/2401.13660
Repeat After Me: Transformers are Better than State Space Models at Copying
[Paper] https://arxiv.org/abs/2402.01032
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] massobeats - midnight
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] @askejm, Lunie Mamba Might Just Make LLMs 1000x Cheaper...](https://i.ytimg.com/vi/SbmETE7Ey20/mqdefault.jpg)