TUM AI Lecture Series - The multimodal future: Why visual representation still matters (Saining Xie) @MatthiasNiessner
TUM AI Lecture Series - The multimodal future: Why visual representation still matters (Saining Xie)  @MatthiasNiessner
Uploaded March 2025 | Updated November 2026, 3 days ago
Abstract: In this talk, we’ll look at how visual representation continues to play a key role in shaping the multimodal future. I’ll share some of our recent work on vision-centric generative AI and how it’s helping us better understand and create visual content, like images and videos. We’ll dive into the latest advancements, such as multimodal large language models for visual understanding and diffusion transformers for visual generation, and explore how these areas are deeply connected. By tackling the challenges and opportunities in building and evaluating these capabilities, we’ll highlight why visual representation learning is still an unsolved and critical problem. Finally, we’ll discuss why these developments are so important—not just for practical applications but also as essential steps toward building robust visual intelligence that can truly engage with the sensory-rich world we live in.
TUM AI Lecture Series - The multimodal future: Why visual representation still matters (Saining Xie)3D Scanning & Motion Capture: 6. Non-Rigid DeformationDeleted video3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation (CVPR 2020)FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual RealityDeleted videoIntroduction to Deep Learning - 10. Convolutional Neural Networks Part 2 (Summer 2020)High-Res Facial Appearance Capture from Polarized Smartphone Images (CVPR2023)Introduction to Deep Learning - 3. Neural Networks (Summer 2020)3D Scanning & Motion Capture: 10. Bodies and HandsObjectMatch: Robust Registration using Canonical Object Correspondences (CVPR2023)GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Matthias Niessner |

TUM AI Lecture Series - The multimodal future: Why visual representation still matters (Saining Xie)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER