Uploaded March 2025 | Updated September 2026, 2 weeks ago
Sign up for NVIDIA GTC2025 here!
nvda.ws/48s4tmc
Join The RTX4080 SUPER Giveaway (enter between March 17-21st)
https://forms.gle/TbGgoD5obn1zRz5r7
In this video, you will learn about the fascinating ways of how AI companies can rig LLM benchmarks, for educational purposes of course... Plus the reason why people don’t trust “chatbot arena” as much as more.
My Newletter
mail.bycloud.ai
My Patreon
patreon.com/c/bycloud
I was really vague about the sources in this video to fit it in the narrative, but most facts presented are backed by the following papers
Changing Answer Order Can Decrease MMLU Accuracy
[Paper] arxiv.org/abs/2406.19470
Catch me if you can! How to beat GPT-4 with a 13B model
[Blog] lmsys.org/blog/2023-11-14-llm-decontaminator
Idiosyncrasies in Large Language Models
[Paper] arxiv.org/abs/2502.12150
Improving Your Model Ranking on Chatbot Arena by Vote Rigging
[Paper] arxiv.org/abs/2501.17858
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Clément Veyssière, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, Ângelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloudai@gmail.com
[Music] Massobeats - Glimmer
[Music] Massobeats - Honey jam
[Music] Massobeats - Lush
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] @Booga04
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] ko-fi.com/bycloudai
Sign up for NVIDIA GTC2025 here!
nvda.ws/48s4tmc
Join The RTX4080 SUPER Giveaway (enter between March 17-21st)
https://forms.gle/TbGgoD5obn1zRz5r7
In this video, you will learn about the fascinating ways of how AI companies can rig LLM benchmarks, for educational purposes of course... Plus the reason why people don’t trust “chatbot arena” as much as more.
My Newletter
mail.bycloud.ai
My Patreon
patreon.com/c/bycloud
I was really vague about the sources in this video to fit it in the narrative, but most facts presented are backed by the following papers
Changing Answer Order Can Decrease MMLU Accuracy
[Paper] arxiv.org/abs/2406.19470
Catch me if you can! How to beat GPT-4 with a 13B model
[Blog] lmsys.org/blog/2023-11-14-llm-decontaminator
Idiosyncrasies in Large Language Models
[Paper] arxiv.org/abs/2502.12150
Improving Your Model Ranking on Chatbot Arena by Vote Rigging
[Paper] arxiv.org/abs/2501.17858
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian Aßmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Clément Veyssière, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, Ângelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloudai@gmail.com
[Music] Massobeats - Glimmer
[Music] Massobeats - Honey jam
[Music] Massobeats - Lush
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] @Booga04
[Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx
[Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190
[Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7
[Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9
[Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN
[Ko-fi] ko-fi.com/bycloudai
![These TikTokers Are AI Generated [SD Multi-Frame Rendering]](https://i.ytimg.com/vi/Lx5Hy9YfZLs/mqdefault.jpg "These TikTokers Are AI Generated [SD Multi-Frame Rendering]
🕹 Get a browser that’s literally better at everything: https://operagx.gg/bycloud2 Sponsored by Opera GX!
When AI Influencers & Img2Img Video Generation meets each other... Literally everyone can run an model influencer account or even business in the near future.
National Geographic: How can you tell if a photo is AI generated?
[Article] https://www.nationalgeographic.com/science/article/how-can-you-tell-if-a-photo-is-ai-generated-here-are-some-tips
TemporalKit
[GitHub] https://github.com/CiaraStrawberry/TemporalKit
Hatsune Miku Workflow
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/12xhd2t/experimental_ai_anime_w_cnet_11_groundingdino_sam/?utm_source=share&utm_medium=web2x&context=3
Multi-frame rendering
[GitHub] https://github.com/OedoSoldier/sd-webui-image-sequence-toolkit
[A random tutorial] https://youtu.be/kmT-z2lqEPQ
Mov2mov
[GitHub] https://github.com/Scholar01/sd-webui-mov2mov
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Music] SlipStream
[Profile & Banner Art] https://twitter.com/pygm7
0:00 Intro
0:49 Ad
2:15 img2img t2v")
![[VOD] Picking RTX4080 Super Giveaway Winner & Chill](https://i.ytimg.com/vi/MINFqiXyueM/mqdefault.jpg "[VOD] Picking RTX4080 Super Giveaway Winner & Chill
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
My Patreon goats:
Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon")
![Sam Altman Sells Crypto, SDXL 1.0 Release, ChatGPT Custom Instructions & More [The AI Timeline #11]](https://i.ytimg.com/vi/MZsc0PuYhAE/mqdefault.jpg "Sam Altman Sells Crypto, SDXL 1.0 Release, ChatGPT Custom Instructions & More [The AI Timeline #11]
Sup guys! Welcome to the 11th episode of The AI Timeline, where things have gotten pretty chaotic and interesting. SDXL is going to be so hyped and I am so excited to see what direction itll head in. Subscribe to stay tuned to my SDXL 1.0 video!
WorldCoin
[SDK] https://docs.worldcoin.org/
[Website] https://worldcoin.org/
[Code] https://github.com/worldcoin
SDXL 1.0
[Blog] https://stability.ai/blog/stable-diffusion-sdxl-1-announcement
[Base Model] https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
[Refiner Model] https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0
ChatGPT Custom Instructions
[Blog] https://openai.com/blog/custom-instructions-for-chatgpt
[Nick Dobos TW] https://twitter.com/NickADobos/status/1682138883222544384?s=20
[ChatGPT] https://chat.openai.com/
How Is ChatGPT’s Behavior Changing over Time?
[Paper] https://arxiv.org/pdf/2307.09009.pdf
On the Origin of LLMs
[Paper] https://arxiv.org/ftp/arxiv/papers/2307/2307.09793.pdf
[Constalletion Interactive Tree] https://huggingface.co/spaces/gaodrew/constellation
FreeWilly (Beluga now)
[FreeWilly 2] https://huggingface.co/stabilityai/StableBeluga2
[FreeWilly 1] https://huggingface.co/stabilityai/StableBeluga1-Delta
Challenges and Applications of LLMs
[Paper] https://arxiv.org/pdf/2307.10169.pdf
(Ab)using Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMs
[Paper] https://arxiv.org/pdf/2307.10490.pdf
PaLM-E Generalist
[Blog] https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html
Llama C Inference Code by Andrej Karpathy
[Code] https://github.com/karpathy/llama2.c
Runway ML
[Website] https://runwayml.com/
Interpolating between Images with Diffusion Models
[Paper] https://arxiv.org/abs/2307.12560
[Project Page] https://clintonjwang.github.io/interpolation
[Code] https://github.com/clintonjwang/ControlNet
TokenFlow
[Paper] https://diffusion-tokenflow.github.io/TokenFlow_Arxiv.pdf
[Project Page] https://diffusion-tokenflow.github.io/
[Code] https://github.com/omerbt/TokenFlow
FABRIC
[Paper] https://arxiv.org/pdf/2307.10159.pdf
Brain2Music
[Paper] https://arxiv.org/abs/2307.11078
[Project Page & Official Results] https://google-research.github.io/seanet/brain2music/
NeuralHaircut
[Paper] https://arxiv.org/abs/2306.05872
[Project Page] https://samsunglabs.github.io/NeuralHaircut/
[Code] https://github.com/SamsungLabs/NeuralHaircut
Wide Screen Seinfeld
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/156l5ma/43_seinfeld_to_widescreen_rough_proof_of_concept/?utm_source=share&utm_medium=web2x&context=3
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Profile & Banner Art] https://twitter.com/pygm7
0:00 Headline of the Week
3:53 Weekly Dose of LLM
10:51 FFA News")
