LLM Attention That Expands At Inference? Test Time Training Explained @bycloudAI
LLM Attention That Expands At Inference? Test Time Training Explained  @bycloudAI
Uploaded July 2024 | Updated September 2026, 2 weeks ago
Take your personal data back with Incogni! Use code bycloud at the link below and get 60% off an annual plan: incogni.com/bycloud

RNN's hidden states be like: "You know, I am something of an ML model myself"

check out my newsletter:
mail.bycloud.ai

Learning to (Learn at Test Time): RNNs with Expressive Hidden States
[Paper] arxiv.org/abs/2407.04620
[Code PyTorch] github.com/test-time-training/ttt-lm-pytorch
[Code JAX] github.com/test-time-training/ttt-lm-jax


This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth

[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud

[Music] Massobeats - Noon
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Silas
LLM Attention That Expands At Inference? Test Time Training ExplainedWhen AI Tries To Reason With Itself [AutoGPT & More]A new way to fine-tune LLMs just droppedFREE Text Generated Music Is Getting Too Good... [Metas MusicGen]How AI Photogrammetry Is Changing 3D ForeverAnthropic found a terrifying consequence of adding reasoning to AIFirst Look At GPT-4 With VisionAbsurd GPT-4 Applications: CEOs Are Now Replaceable?Kimi K2 Technical Breakdown: How It Challenged AI’s 7-Year Status Quo2023 AI in a nutshellWhen Claude 3.5 Sonnet Became The Better ChatbotLLM that loops instead of Doing Chain-of-Thought
bycloud |

LLM Attention That Expands At Inference? Test Time Training Explained

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER