Uploaded January 2023 | Updated September 2026, 1 hour ago

---

🥽 New passthrough features have now made the dream of bridging physical and virtual worlds possible. Learn from devs on how to use passthrough

🔘Why Passthrough?
Passthrough can be helpful for various purposes, such as helping users maintain a sense of spatial awareness and avoiding collisions or other hazards while using VR.
The improved passthrough feature of next-generation headsets, such as Meta Quest Pro, Pico 4, and Vive XR Elite, has finally made the dream of seamlessly bridging the physical and virtual worlds possible. Passthrough creates new potential in gameplay design and improves the UX of productivity and creative XR apps. In combination with scene understanding, passthrough has expanded the role of VR headsets into AR glasses, allowing them to transit anywhere between AR and VR in the same experience.

However, working with passthrough technology can present challenges for VR developers, such as latency, limited field of view, and interference from real-world objects.


💻Overview of presentation:
In this workshop, we will talk about examples of passthrough interactions, including configurable passthrough, responsive passthrough, and context-aware passthrough, and how they can be used to create enriched XR experiences. In addition, we will share resources to help you find inspirations and supporting tools needed for integrating passthrough into XR prototypes.

1) Current and future states of passthrough
Passthrough creates a paradigm shift in XR design. Learn what passthrough-related features popular headsets support and what will soon be possible in the coming months.

2) Different blending and interaction patterns for passthrough
Passthrough is more than simply displaying a live camera stream. Learn what blending is possible with passthrough and what interactions can be used to control the blending.

3) Uses cases in XR Games and Applications
The use cases of passthrough go beyond safety and convenience. Learn how passthrough may be utilized in different games and applications.

4) Developing for passthrough
Passthrough works differently from traditional virtual materials and textures. Learn how passthrough can be implemented using Unity's compositing and shading methods.

5) Resources
People have started creating excellent tools and demos for passthrough. Learn where you can find more inspiration and tooling support.

💡Takeaways for the audience:
►Learn about different design patterns for passthrough interactions
►Get inspired by different use cases and demos of passthrough
►Get tips on designing XR experiences for passthrough
►Learn about the resources available for creating passthrough experiences

📣Speakers:
Daisy Chen is a UX and XR designer and HCI researcher focusing on collaboration tools, the future of work, and inclusive design. She has years of experience in XR as a designer and researcher, including VR film, VR collaboration tools, and novel interactions between XR and tangible interfaces. Her most recent project, Limino, proposes and investigates the different interaction patterns and use cases of passthrough XR.

Billy Kwok is a creative technologist and product designer specializing in prototyping new experiences with emerging technologies. His work in XR spans different platforms, including OpenXR, WebXR, WebGL, Vulforia, and SparkAR. His most recent project, Limino, proposes and investigates the different interaction patterns and use cases of passthrough XR.

🥽 XR Pro Open Lecture Series
Subscribe to get invited to the following lectures featuring speakers from Tilt Five, Cubism, Owlchemy Labs, MelonLoader, Schell Games, Vertigo Games, and many more.

XR Pro Lecture 1: Do’s and Don’ts: Eye Tracking for VR (UX) youtu.be/CPd5jZlu7Io
XR Pro Lecture 2: Creating XR Experiences with Passthrough
XR Pro Lecture 3: Achieving PCVR quality on a Mobile Headset - register link youtube.com/watch?v=k7XyEYot_Ks
XR Pro Lecture 4: Unity and ChatGPT - for XR Developers and Artists eventbrite.com/e/unity-and-chatgpt-for-xr-developers-and-artists-tickets-528502604517?aff=youtube

👉 About XR Bootcamp:
XR Bootcamp is a global online academy, offering beginner to advanced-level VR/AR Master Classes and Bootcamps.
xrbootcamp.com

👋Join the XR Creators Discord discord.gg/38THNzEh4P
If you have questions, feel free to join the server and connect with the community. Or, if you feel like you're able to mentor young talents, show your skills and answer questions! We welcome everyone, beginner and advanced-level VR developers!!

⌚ Timestamps
0:00 XR Bootcamp Introduction
11:01 Creating XR Experiences with Passthrough
45:50 Panelist Fireside Chat and Q&A