On the Symbiosis of Generative Models and Representation Learning @allenai
On the Symbiosis of Generative Models and Representation Learning  @allenai
Uploaded May 2025 | Updated September 2026, 6 hours ago
Abstract: Generative modeling and representation learning are fundamental to modern machine learning and computer vision. A high-quality generative model that produces realistic images and videos must capture complex visual structures and patterns. This necessity establishes an intrinsic connection between generative modeling and representation learning: generative models develop rich internal representations to capture high-dimensional data distributions effectively. Conversely, understanding the internal mechanisms of generative models through representation learning provides insights into improving them. This talk will focus on the bidirectional connection. Specifically, I will explore two core questions: (1) How can we improve the representation learning capabilities of generative models? (2) Can we leverage representations to enhance generative modeling? By addressing these questions, I aim to highlight the necessity of designing, analyzing, and advancing generative models through the lens of representation learning.

Bio: Xiao Zhang is a final-year CS Ph.D student at the University of Chicago, where he primarily works with Michael Maire. His research focuses on computer vision, with an emphasis on unsupervised representation learning and generative models. He aims to design scalable algorithms for representation learning that can be applied to real-world tasks and complex image and video generation.
On the Symbiosis of Generative Models and Representation LearningThe BigScience WorkshopThe Pre-trainers toolkit: From dataset construction to model scalingFrom Compression to Convection: A Latent Variable PerspectiveMovement Primitives as Action Sequence Models for Efficient Robot LearningRobot learning and perception for contact-rich manipulationAppWorld: Reliable Evaluation of Interactive Agents in a Controllable World of Apps and PeopleYou Cant Have AI Safety Without InclusionUsing MolmoWeb as a Claude Code SkillAutomated Scientific Discovery of Mind and BehaviorText Modular Networks: Learning to Decompose Tasks in the Language of Existing ModelsBeyond Test Accuracies for Studying Deep Neural Networks
Ai2 |

On the Symbiosis of Generative Models and Representation Learning

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER