TUM AI Lecture Series - Complete Codec Telepresence (Michael Zollhoefer) @MatthiasNiessner
TUM AI Lecture Series - Complete Codec Telepresence (Michael Zollhoefer)  @MatthiasNiessner
Uploaded August 2022 | Updated November 2026, 3 days ago
Abstract:
Imagine two people, each of them within their own home, being able to communicate and interact virtually with each other as if they are both present in the same shared physical space. Enabling such an experience, i.e., building a telepresence system that is indistinguishable from reality, is one of the goals of Reality Labs Research (RLR) in Pittsburgh. To this end, we develop key technology that combines fundamental computer vision, machine learning, and graphics techniques based on a novel neural reconstruction and rendering paradigm. In this talk, I will cover our advances towards a neural rendering approach for complete codec telepresence that includes metric avatars, binaural audio, photorealistic spaces, as well as their interactions in terms of light and sound transport. In the future, this approach will bring the world closer together by enabling anybody to communicate and interact with anyone, anywhere, at any time, as if everyone would be sharing the same physical space.
TUM AI Lecture Series - Complete Codec Telepresence (Michael Zollhoefer)TUM AI Lecture Series - Building generative world models: progress and challenges (Ruiqi Gao)Deleted video3D Scanning & Motion Capture: 3. Reconstruction OverviewTUM AI Lecture Series - The 3D Gaussian Splatting Adventure: Past, Present, Futur (George Drettakis)Introduction to Deep Learning (I2DL 2023) - 12. Advanced DL TopicsPolyDiff: Generating 3D Polygonal Meshes with Diffusion ModelsDeleted videoSceneCAD: Predicting Object Alignmentsand Layouts in RGB-D Scans (ECCV 2020)Deleted videoDeleted videoDeleted video
Matthias Niessner |

TUM AI Lecture Series - Complete Codec Telepresence (Michael Zollhoefer)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER