Lucas Beyer (Google DeepMind) - Convergence of Vision & Language @TheAIEpiphany
Lucas Beyer (Google DeepMind) - Convergence of Vision & Language  @TheAIEpiphany
Uploaded December 2023 | Updated September 2026, 1 week ago
Become a Patreon: patreon.com/theaiepiphany
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Join our Discord community: discord.gg/peBrCpheKE

Lucas from G DeepMind joined us to talk about the recent convergence of vision & language and various projects he was a part of (PaLI, ViT, etc.).

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
Lucas Beyer website: lucasb.eyer.be
β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

⌚️ Timetable:
00:00 Lucas's story
10:45 Motivation
26:00 Language as API for vision
34:00 LiT tuning
40:00 Convergence of architectures
48:40 PaLI (vision language model)

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬
πŸ’° SPONSOR

The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany

Huge thank you to these AI Epiphany patreons:
Eli Mahler
David Hood
Petar VeličkoviΔ‡

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

πŸ’Ό LinkedIn - linkedin.com/in/aleksagordic
🐦 Twitter - twitter.com/gordic_aleksa
πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ Discord - discord.gg/peBrCpheKE

πŸ“Ί YouTube - youtube.com/c/TheAIEpiphany
πŸ“š Medium - gordicaleksa.medium.com
πŸ’» GitHub - github.com/gordicaleksa
πŸ“’ AI Newsletter - aiepiphany.substack.com

β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬β–¬

#visiontransformer #lucasbeyer #deepmind #google
Lucas Beyer (Google DeepMind) - Convergence of Vision & LanguageGet Started With Stable Diffusion! (Code, HF Spaces, Diffusers Notebooks)Stable Diffusion: High-Resolution Image Synthesis with Latent Diffusion Models | ML Coding SeriesDay 12: Open NLLB - on-boarding doc for new-joiners, eval (Pt 2.)Channel update: moving to London in 2 days, new MLOps seriesBuild AI Agents using Integrail (Halloween special)building the best RLHF (TRLX) library w/ Louis CastricatoALiBi | Train Short, Test Long: Attention With Linear Biases Enables Input Length ExtrapolationDay 23: Open NLLB - day before China trip! Refactoring & pushing  changes (Pt 1 cont.)Hyperbolic Graph Convolutional Networks | Geometric ML Paper ExplainedDiffusion Models Beat GANs on Image Synthesis | ML Coding Series | Part 2Facebook AIs DINO | PyTorch Code Explained
Aleksa Gordić - The AI Epiphany |

Lucas Beyer (Google DeepMind) - Convergence of Vision & Language

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER