Apple visionOS Object Tracking Is Here! BUT DOES It Work Well? @dilmerv
Apple visionOS Object Tracking Is Here! BUT DOES It Work Well?  @dilmerv
Uploaded July 2024 | Updated November 2026, 6 hours ago
Today, I would like to share what I’ve learned about Apple’s Object Tracking features, recently announced as part of visionOS 2.0 Preview.

❀️ Support on Patreon: patreon.com/dilmerv
πŸ”” Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
πŸ‘₯ Discord : discord.gg/dNMHBc8KdP
πŸ“Έ Instagram : tiktok.com/@dilmerval

This video will walk you through the entire workflow: image capturing/scanning, object reconstruction, machine learning training with spatial object tracking, and integrating trained objects into Xcode.

πŸ“š Vision Pro Object Tracking Chapters:
00:00 - Apple visionOS Object Tracking Introduction & Questions
00:29 - visionOS Object Tracking Requirements
01:17 - Preparing Physical Objects For Object Reconstruction
02:12 - Generating USDZ Files (3D Models) With Reality Composer Pro
03:10 - Training Models With Create ML Object Tracking Features
08:27 - Integrating Trained Object Tracking Models With Xcode
19:05 - Running Object Tracking Demo With The Apple Vision Pro
20:27 - Adding Reference Object USDZ Model For Additional Visualizations
21:02 - Object Tracking Demo With Reference Object Model Rendering
21:57 - Outro (Final Thoughts)

πŸ’» You can also find the demo shown on today’s video via GitHub from github.com/dilmerv/VisionOSObjectTrackingDemo

πŸ“Œ Helpful Object Tracking Resources:
- Apple Object Capture docs: developer.apple.com/augmented-reality/object-capture
- macOS Reconstruction app for Photogrammetry: developer.apple.com/documentation/realitykit/building-an-object-reconstruction-app
- Guided Capture iOS / Scanning objects using Object Capture Example: developer.apple.com/documentation/realitykit/scanning-objects-using-object-capture
- Object Capture API or Command Line Utility: developer.apple.com/documentation/realitykit/creating_a_photogrammetry_command-line_app
- Object Tracking for VisionOS: developer.apple.com/documentation/visionOS/exploring_object_tracking_with_arkit

πŸ₯½ Learn & Get my XR Courses from:
learnxr.io

πŸ‘‰ My Blog / πŸ”₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io

#AppleVisionPro #VisionPro #Apple
Apple visionOS Object Tracking Is Here! BUT DOES It Work Well?Step-By-Step Guide: Mapping My YouTube Studio With Immersal ARHow to Track QR Codes & Keyboards In Your VR/MR Game or App?visionOS Development Fundamentals - RealityView Attachments, Systems, & More!Oculus Hand Pose Recorder Is Here (Full Unity VR Tutorial)Meta Interaction SDK Hand Grab Pose LIVE Recorder Sneak Peek !How To Use ChatGPT With Unity During Runtime | My Early PrototypeUltraleap Hand Tracking With META QUEST 2 And Unity Requirements !Meta Quest Pro With 4 Monitors In Mixed Reality (MacOS Ventura & Windows 11)Brilliant Labs Monocle: The Worlds Smallest AR Glass Is Here!How to Add LLMs to VR Apps with AI Building BlocksMagic Leap 2 AR Glasses Final Box And Hardware #Shorts
Dilmer Valecillos |

Apple visionOS Object Tracking Is Here! BUT DOES It Work Well?

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER