Uploaded June 2019 | Updated September 2026, 56 minutes ago
The Reality Lab Lectures - Tuesday, May 7, 2019
TALK TITLE: Photorealistic Telepresence
SPEAKER: Yaser Sheikh (Professor, Carnegie Mellon University. Director, Facebook Reality Labs, Pittsburgh)
TALK ABSTRACT: In this talk, I will describe early steps taken at FRL Pittsburgh in achieving photorealistic telepresence: realtime social interactions in AR/VR with avatars that look like you, move like you, and sound like you.
Telepresence is, perhaps, the only application that has the potential to bring billions of people into VR. It is the next step along the evolution from telegraphy to telephony to videoconferencing. Just like telephony and video-conferencing, the key attribute of success will be “authenticity”: users' trust that received signals (e.g., audio for the telephone and video/audio for VC) are truly those transmitted by their friends, colleagues, or family. The challenge arises from this seeming contradiction: how do we enable authentic interactions in artificial environments?
Our approach to this problem centers around codec avatars: the use of neural networks to address the computer vision (encoding) and computer graphics (decoding) problems in signal transmission and reception. The creation of codec avatars require capture systems of unprecedented 3D sensing resolution, which I will also describe.
Event held on the UW-Seattle Campus and recorded by UW CSE Production Team
© UW Reality Lab, 2019
http://realitylab.uw.edu
The Reality Lab Lectures - Tuesday, May 7, 2019
TALK TITLE: Photorealistic Telepresence
SPEAKER: Yaser Sheikh (Professor, Carnegie Mellon University. Director, Facebook Reality Labs, Pittsburgh)
TALK ABSTRACT: In this talk, I will describe early steps taken at FRL Pittsburgh in achieving photorealistic telepresence: realtime social interactions in AR/VR with avatars that look like you, move like you, and sound like you.
Telepresence is, perhaps, the only application that has the potential to bring billions of people into VR. It is the next step along the evolution from telegraphy to telephony to videoconferencing. Just like telephony and video-conferencing, the key attribute of success will be “authenticity”: users' trust that received signals (e.g., audio for the telephone and video/audio for VC) are truly those transmitted by their friends, colleagues, or family. The challenge arises from this seeming contradiction: how do we enable authentic interactions in artificial environments?
Our approach to this problem centers around codec avatars: the use of neural networks to address the computer vision (encoding) and computer graphics (decoding) problems in signal transmission and reception. The creation of codec avatars require capture systems of unprecedented 3D sensing resolution, which I will also describe.
Event held on the UW-Seattle Campus and recorded by UW CSE Production Team
© UW Reality Lab, 2019
http://realitylab.uw.edu
