The biggest Mystery of LLMs have just been solved @bycloudAI
The biggest Mystery of LLMs have just been solved  @bycloudAI
Uploaded November 2025 | Updated September 2026, 1 week ago
Ready to build a site that looks hand-coded—without needing a developer? Launch your site for free at framer.link/bycloud, and use code BYCLOUD for a free month on Framer Pro. #FramerPartner

Why do LLMs sometimes give different answers even with the same prompt, temperature 0, and seed? In this video, we break down one of the most confusing “mysteries” of modern LLMs and walk through Thinking Machines's first ever blog: Defeating Nondeterminism in LLM Inference, the coolest (imo) LLM "debugging" ever.


Blog of this video
[Paper] thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference

Special thanks to @CalebWritesCode for helping out with this video!

My Newsletter
mail.bycloud.ai

my project: find, discover & explain AI research semantically
findmypapers.ai

My Patreon
patreon.com/c/bycloud


Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI

This video is supported by the kind Patrons & YouTube Members:
🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon


[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] @Booga04
[Ko-fi] ko-fi.com/bycloudai
The biggest Mystery of LLMs have just been solvedWhat is DeepSeek Engram...?3D Gaussian Splatting: Hows This The Future of 3D AI?Next Gen Catfishing? [The AI Timeline #3]A Slightly Technical Breakdown of DeepSeek-R1Is Elons AI Really That Good? First Look At Grok-3The Rise of Anime Generating AIDeepSeeks Deleted Vision Paper Is Nuts...The Biggest Lie in AI? LLM doesnt think step-by-step1 Million Tiny Experts in an AI? Fine-Grained MoE Explainedbyclouds 100k Subscribers Q&A SpecialWhat If We Remove Tokenization In LLMs?
bycloud |

The biggest Mystery of LLMs have just been solved

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER