Uploaded July 2026 | Updated September 2026, 45 minutes ago
Learn how to add intelligence to your 3D Gaussian Splats (3DGS) using Splat Analyzer and perform zero-shot 3D object detection without collecting or labeling custom datasets.
In this session, you'll discover how AI can automatically identify and localize objects inside Gaussian Splat scenes, enabling interactive XR experiences, digital twins, robotics, and spatial AI applications.
In this lesson you'll learn:
🎯 Perform zero-shot 3D object detection on Gaussian Splats
🧠 Automatically recognize objects without custom training data
📦 Generate accurate 3D bounding boxes in under a minute
⚡ Turn static Gaussian Splats into interactive spatial experiences
🚀 Integrate detected objects into Unity, Unreal Engine, and WebXR workflows
This workflow is ideal for developers building digital twins, industrial XR applications, robotics, simulation, and spatial computing solutions where intelligent scene understanding is essential.
Topics Covered
Splat Analyzer
Zero-Shot Object Detection
3D Gaussian Splats (3DGS)
3D Bounding Boxes
Computer Vision
Spatial AI
Digital Twins
Unity
Unreal Engine
WebXR
XR Development
AI Scene Understanding
Interactive 3D Scenes
Learn how to add intelligence to your 3D Gaussian Splats (3DGS) using Splat Analyzer and perform zero-shot 3D object detection without collecting or labeling custom datasets.
In this session, you'll discover how AI can automatically identify and localize objects inside Gaussian Splat scenes, enabling interactive XR experiences, digital twins, robotics, and spatial AI applications.
In this lesson you'll learn:
🎯 Perform zero-shot 3D object detection on Gaussian Splats
🧠 Automatically recognize objects without custom training data
📦 Generate accurate 3D bounding boxes in under a minute
⚡ Turn static Gaussian Splats into interactive spatial experiences
🚀 Integrate detected objects into Unity, Unreal Engine, and WebXR workflows
This workflow is ideal for developers building digital twins, industrial XR applications, robotics, simulation, and spatial computing solutions where intelligent scene understanding is essential.
Topics Covered
Splat Analyzer
Zero-Shot Object Detection
3D Gaussian Splats (3DGS)
3D Bounding Boxes
Computer Vision
Spatial AI
Digital Twins
Unity
Unreal Engine
WebXR
XR Development
AI Scene Understanding
Interactive 3D Scenes



![Turn Your Living Room into a Mixed Reality Experience with Meta
🚀 Are you keen to expand your skillset to include Meta’s Presence Platform features so you can create engaging MR games and experiences?
Then this open lecture is for you!
In this session we invite top engineers and product manager from #Meta to talk about its new Presence Platform features on Quest 3. The creator of GorillaZilla game, Stephen Rogers explains how he used the features into his game mechanics, and Sean Ong will guide you through with certified learning system.
👉 To enroll Mixed Reality Udemy course to Build Your Mixed Reality Game & Publish it on Metas App Lab:
https://www.udemy.com/course/mixedreality/
The first 100 who finishes the course and publish on AppLab can get a chance to win the new Quest 3 Headset! 🙆♀️
🎁 Use this promo code to enroll in the course for FREE!
https://bit.ly/482URy8
💡 XR Pro Open Lecture Session with the Meta team and the creator of GorillaZilla:
►Topic 1: The Meta team explains the Meta’s Presence Platform features on Quest 3
►Topic 2: How the Presence Platform is implemented into GorillaZilla game mechanics
►Topic 3: The learning journey shaped based on Presence Platform
Are you keen to expand your skillset to include Meta’s Presence Platform features so you can create engaging MR games and experiences?
Then this open lecture is for you!
In this session, Meta Engineers share their perspectives on the most successful MR Games and creator Stephen Rogers will explain how he built the game GorillaZilla (free on App Lab) with Meta’s Presence Platform using:
- Passthrough
- Scene Understanding
- Smart Object Positioning
- Hand Tracking
- Controller Support
- Interactions
- Movement
- Body Tracking
- Eye Tracking
- Face Tracking
- Voice and Audio Detection
to create successful, engaging, and immersive MR experiences.
📣 Speakers
Winston Esposito is a Product Manager at Meta Reality Labs, specializing in XR Tech and Presence Platform. He spent several years in XR strategy at Meta before Product Management, and his expertise extends to VR/AR platforms and Experiences.
Tim Mowrer is a lead engineer at Meta for Presence Platform, and serves as the tech lead for their Anchor technology in Mixed Reality.
About Meta: Meta, formerly known as Facebook, is an American multinational technology conglomerate based in Menlo Park, California. The company owns and operates Facebook, Instagram, Threads, and WhatsApp, among other products and services.
Steve Rogers is a developer & innovator in the VR/AR space, with a passion for creating fun and exciting XR prototypes. Stephen stands out as a winner of the Meta Presence Platform Hackathon with his title “Submersed” and has earned recognition as one of the Top XR Enablers.
About 4th Wall Breakers: 4th Wall Breakers LLC is a self-owned video game studio that primarily focuses on developing VR titles.
👉 About XR Bootcamp:
XR Bootcamp is a global online academy, offering beginner to advanced-level VR/AR Master Classes and Bootcamps.
www.xrbootcamp.com
👋Join the XR Creators Discord https://discord.gg/38THNzEh4P
If you have questions, feel free to join the server and connect with the community. Or, if you feel like youre able to mentor young talents, show your skills and answer questions! We welcome everyone, beginner and advanced-level VR developers!
⌚ Timestamps
0:00 Introduction
1:41 GorillaZilla Trailer
3:23 Introducing Meta team: Winston Esposito, Laurent Becherel, Tim Mowrer
6:30 About Meta Quest 3, what is different from Quest 2? [with Winston Esposito]
7:43 Meta Presence Platform, what is possible with it?
11:50 Helping you get started with MR Motifs
16:40 Overview of specific capabilities that enable mixed reality [with Tim Mowrer]
26:16 Game Design behind GorillaZilla and steps to create it [with Stephen Rogers]
28:54 Why GorillaZilla?
30:16 Early Prototype of GorillaZilla
32:28 Using the Room- Scene Understanding
34:25 Using the Room- Mesh API
35:39 The Power of Hands - Interaction SDK
37:36 Utilizing the Voice SDK
42:32 Udemy Course Learning Journey and Preview [with Sean Ong]
46:40 What you will learn in the course
49:30 Q&A with Meta Team
1:13:39 Q&A with XR Pro Collective [Stephen Rogers, Sean Ong, Jared Bienz] Turn Your Living Room into a Mixed Reality Experience with Meta](https://i.ytimg.com/vi/CuJsiuA5mcE/mqdefault.jpg)






