Why can’t LLMs just LEARN the context window? @bycloudAI
Why can’t LLMs just LEARN the context window?  @bycloudAI
Uploaded March 2026 | Updated September 2026, 2 weeks ago
Check out HubSpot's FREE 2026 Guide to AI Agents: clickhubspot.com/3972be

In this video, I'll be breaking down a new approach to long-context LLMs called test-time training (TTT-E2E), where models store past context directly in their weights instead of relying on attention or KV caches. Kind of like meta learning, but with gradient descent.

my latest project: Intuitive AI Academy
We just wrote a new piece on MoE!
https://intuitiveai.academy/
limited time code "EARLY" for 40% off yearly plan!


TTT-E2E
[Paper] arxiv.org/abs/2512.23675

Appeared papers
[Titans] arxiv.org/abs/2501.00663
[Kimi Linear] arxiv.org/abs/2510.26692


My Newsletter
mail.bycloud.ai

My Patreon
patreon.com/c/bycloud


Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI

This video is supported by the kind Patrons & YouTube Members:
🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, Zyansheep


[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] @Booga04
[Ko-fi] ko-fi.com/bycloudai
Why can’t LLMs just LEARN the context window?How Did Open Source Catch Up To OpenAI? [Mixtral-8x7B]NeRF Is Gonna Be The Future of Google EarthWeve Had Our Priorities Wrong [The AI Timeline #2]I Am The Golden Gate Bridge & Why Thats Important.OpenAIs Sora: Text-to-Video Is Getting Way Too RealOpenAIs Cancels GPT-4.5!? First Look At GPT-4.1 with 1M Contexthow to deal with reasoning AIs that just cant stop yappingMamba Might Just Make LLMs 1000x Cheaper...DSpark: DeepSeek-V4s Insane Compute Optimization ExplainedThe Art of Serving LLMs Efficiently: Context Engineering ExplainedCan coding agents really maintain software over time? #ai #coding #claudecode
bycloud |

Why can’t LLMs just LEARN the context window?

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER