[ML News] Metas OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice @YannicKilcher
[ML News] Metas OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice  @YannicKilcher
Uploaded May 2022 | Updated September 2026, 2 weeks ago
#mlnews #dalle #gpt3

An inside look of what's happening in the ML world!

Sponsor: Weights & Biases
wandb.me/yannic

OUTLINE:
0:00 - Intro
0:20 - Sponsor: Weights & Biases
1:40 - Meta AI releases OPT-175B
4:55 - CoCa: New CLIP-Competitor
8:15 - DALL-E Mega is training
10:05 - TorToiSe TTS is amazing!
11:50 - Investigating Vision Transformers
12:50 - Hugging Face Deep RL class launched
13:40 - Helpful Things
17:00 - John Deere's driverless tractors

References:
Meta AI releases OPT-175B
ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b
arxiv.org/abs/2205.01068
arxiv.org/pdf/2205.01068.pdf
github.com/facebookresearch/metaseq/tree/main/projects/OPT
github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf
github.com/facebookresearch/metaseq/tree/main/projects/OPT/chronicles
twitter.com/yoavgo/status/1522150063815987201

CoCa: New CLIP-Competitor
arxiv.org/abs/2205.01917
arxiv.org/pdf/2205.01917.pdf

DALL-E Mega is training
twitter.com/borisdayma
twitter.com/borisdayma/status/1521891895001112577
wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-Mega--VmlldzoxODMxMDI2

TorToiSe TTS is amazing!
github.com/neonbjb/tortoise-tts
nonint.com/static/tortoise_v2_examples.html
colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR
github.com/neonbjb

Investigating Vision Transformers
github.com/sayakpaul/probing-vits/?utm_source=pocket_mylist
twitter.com/RisingSayak/status/1515918406171914240?utm_source=pocket_mylist
keras.io/examples/vision/probing_vits
github.com/sayakpaul/probing-vits/tree/main/notebooks?utm_source=pocket_mylist

Hugging Face Deep RL class launched
github.com/huggingface/deep-rl-class

Helpful Things
merantix-momentum.com/technology/squirrel/?utm_source=pocket_mylist
github.com/merantix-momentum/squirrel-core?utm_source=pocket_mylist
pyscript.net/?utm_source=pocket_mylist
github.com/google-research/big_vision
deepsportradar.github.io/challenge.html
github.com/DeepSportRadar/camera-calibration-challenge
twitter.com/alekseykorshuk/status/1515989357961920514?utm_source=pocket_mylist
github.com/AlekseyKorshuk/huggingnft

John Deere's driverless tractors
thenextweb.com/news/john-deere-slowly-becoming-one-worlds-most-important-ai-companies
tractorhacking.github.io

Links:
Merch: ykilcher.com/merch
TabNine Code Completion (Referral): bit.ly/tabnine-yannick
YouTube: youtube.com/c/yannickilcher
Twitter: twitter.com/ykilcher
Discord: ykilcher.com/discord
BitChute: bitchute.com/channel/yannic-kilcher
LinkedIn: linkedin.com/in/ykilcher
BiliBili: space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: subscribestar.com/yannickilcher
Patreon: patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
[ML News] Metas OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice[ML News] Devin AI Software Engineer | GPT-4.5-Turbo LEAKED | US Govt Report: Total ExtinctionCM3: A Causal Masked Multimodal Model of the Internet (Paper Explained w/ Author Interview)Parti - Scaling Autoregressive Models for Content-Rich Text-to-Image Generation (Paper Explained)Transformer Memory as a Differentiable Search Index (Machine Learning Research Paper Explained)[ML News] GPT-4 Rumors | AI Mind Reading | Neuron Interaction Solved | AI Theorem ProvingI built the most expensive CPU ever! (Every instruction is a prompt)Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionFull Self-Driving is HARD! Analyzing Elon Musk re: Tesla Autopilot on Lex Fridmans PodcastCompetition-Level Code Generation with AlphaCode (Paper Review)[ML News] DeepMinds Flamingo Image-Text model | Locked-Image Tuning | Jurassic X & MRKLActive Dendrites avoid catastrophic forgetting - Interview with the Authors
Yannic Kilcher |

[ML News] Meta's OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER