Uploaded May 2025 | Updated September 2026, 1 week ago
Get started now with privacy focused VPN by Proton! proton.me/pass/bycloudai
My Newletter
mail.bycloud.ai
My Patreon
patreon.com/c/bycloud
Efficient Streaming Language Models with Attention Sinks
[Paper] arxiv.org/abs/2309.17453
Why do LLMs attend to the first token?
[Paper] arxiv.org/abs/2504.02732
Softmax Attention is a Fluke
[Blog] ethansmith2000.com/post/softmax-attention-is-a-fluke
If you want to learn more about Attention Sink, check out my latest project
findmypapers.ai
Where you can ask, find & have it explain AI research that also discuss about Attention Sink!
Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Abhay
[Ko-fi] ko-fi.com/bycloudai
Get started now with privacy focused VPN by Proton! proton.me/pass/bycloudai
My Newletter
mail.bycloud.ai
My Patreon
patreon.com/c/bycloud
Efficient Streaming Language Models with Attention Sinks
[Paper] arxiv.org/abs/2309.17453
Why do LLMs attend to the first token?
[Paper] arxiv.org/abs/2504.02732
Softmax Attention is a Fluke
[Blog] ethansmith2000.com/post/softmax-attention-is-a-fluke
If you want to learn more about Attention Sink, check out my latest project
findmypapers.ai
Where you can ask, find & have it explain AI research that also discuss about Attention Sink!
Try out my new fav place to learn how to code scrimba.com/?via=bycloudAI
This video is supported by the kind Patrons & YouTube Members:
🙏Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] patreon.com/bycloud
[Business Inquiries] bycloud@smoothmedia.co
[Profile & Banner Art] twitter.com/pygm7
[Video Editor] Abhay
[Ko-fi] ko-fi.com/bycloudai
![1,000,000,000 Tokens LLM, SDXL Leaked, Midjourney WEIRD & More [The AI Timeline #8]](https://i.ytimg.com/vi/Z_ybdIYHwPY/mqdefault.jpg "1,000,000,000 Tokens LLM, SDXL Leaked, Midjourney WEIRD & More [The AI Timeline #8]
Get started now with Imagine.Art at https://www.imagine.art/ !
Welcome to my 8th episode of the weekly AI news series The AI Timeline, where I go through the AI news in the past week with the most distilled information and memes!
Midjourney
[Website] https://midjourney.com/
[Discord] https://discord.gg/midjourney
Classifier-Free Guidance in LLM
[Paper] https://arxiv.org/pdf/2306.17806.pdf
Extending Context Window of Large Language Models via Positional Interpolation
[Paper] https://arxiv.org/abs//2306.15595
OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
[Paper] https://arxiv.org/abs//2306.16527
LENS
[Paper] https://arxiv.org/abs//2306.16410
Personality Traits in Large Language Models
[Paper] https://arxiv.org/abs//2307.00184
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit
[Paper] https://arxiv.org/pdf/2306.17759.pdf
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors.
[Paper] https://arxiv.org/abs//2306.17156
BatGPT
[Paper] https://arxiv.org/abs/2307.00360
SDXL Technical Report
[Paper] https://github.com/Stability-AI/generative-models/blob/main/assets/sdxl_report.pdf
[Leak Base Model] https://huggingface.co/nichijoufan777/stable-diffusion-xl-base-0.9
[Leak Refiner Model] https://huggingface.co/nichijoufan777/stable-diffusion-xl-refiner-0.9
DreamDiffusion
[Paper] https://arxiv.org/pdf/2306.16934.pdf
MV Diffusion
[Project Page] https://mvdiffusion.github.io/
[Code] https://github.com/Tangshitao/MVDiffusion
[Paper] https://arxiv.org/abs/2307.01097
[360 Lora] https://civitai.com/models/10753/latentlabs360
Magic123
[Project Page] https://guochengqian.github.io/project/magic123/
[Paper] https://arxiv.org/abs/2306.17843
[Code] https://github.com/guochengqian/Magic123
One-2-3-45
[Project Page] https://one-2-3-45.github.io/
[Paper] https://arxiv.org/pdf/2306.16928.pdf
[Code] https://github.com/One-2-3-45/One-2-3-45
Any Image to 3D
[Project Page] https://www.csm.ai/any-image-to-3d
michelangelo
[Project Page] https://neuralcarver.github.io/michelangelo/
[Paper] https://arxiv.org/abs/2306.17115
[Code] https://github.com/NeuralCarver/Michelangelo
DisCo
[Project Page] https://disco-dance.github.io/
[Paper] https://arxiv.org/abs/2307.00040
[Code] https://github.com/Wangt-CN/DisCo
SAM-PT
[Project Page] https://www.vis.xyz/pub/sam-pt/
[Paper] https://arxiv.org/abs/2307.01197
[Code] https://github.com/SysCV/sam-pt
StyleDrop Unofficial Implementation
[Code] https://github.com/zideliu/StyleDrop-PyTorch
[Paper] https://arxiv.org/abs/2306.00983
Wonder Dynamics
[Website] https://wonderdynamics.com/
PACGen
[Project Page] https://yuheng-li.github.io/PACGen/
[Code] https://github.com/Yuheng-Li/PACGen
[Paper] https://arxiv.org/abs/2306.17154
Harry Potter Anime
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/14qcnto/harry_potter_anime/
Anime Figure IRL
[Instagram] https://www.instagram.com/reel/CuQ5TSkOrfP/?utm_source=ig_web_button_share_sheet
Tokyo Jab Temporal Consistency at High res
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/14mrjqa/temporal_consistency_at_higher_resolution/
Towel Girl
[Reddit] https://www.reddit.com/r/StableDiffusion/comments/14nmkvs/using_the_stablediffusion_algorithm_it_is/
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, Alex J, Chris LeDoux, Alex Maurice, Miguilim, Deagan, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Profile & Banner Art] https://twitter.com/pygm7
[Thumbnail] Taken from TW @LinuxEkenstam
Headlines of The Week 0:00
Weekly Dose of LLM 1:58
Rapid Fire News & FFA 12:03")
![7 Popular LLM Benchmarks Explained [OpenLLM Leaderboard & Chatbot Arena]](https://i.ytimg.com/vi/aOjgPJ94-aM/mqdefault.jpg "7 Popular LLM Benchmarks Explained [OpenLLM Leaderboard & Chatbot Arena]
Check out my website here! https://leaderboard.bycloud.ai/
In this video, I will be going through and explain the benchmarks for Chatbot Arena & Open LLM leaderboard. These are more general benchmarks for text-based LLMs, so HumanEval is not here. Let me know any other benchmarks you want me to explain in the future!
[Chatbot Arena] https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard
[Open LLM Leaderboard] https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
[MMLU] https://huggingface.co/datasets/cais/mmlu
[ARC] https://huggingface.co/datasets/ai2_arc
[Winogrande] https://huggingface.co/datasets/winogrande
[TruthfulQA] https://huggingface.co/datasets/truthful_qa
[GSM8K] https://huggingface.co/datasets/gsm8k
[MT-Bench] https://huggingface.co/datasets/HuggingFaceH4/mt_bench_prompts
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi
[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Silas
0:00 Intro
0:57 MMLU
1:41 ARC
2:10 HELLASWAG
2:57 Winograde
3:27 TruthfulQA
3:52 GSM8K
4:26 MT-Bench
5:05 Outro")
