Uploaded July 2024 | Updated November 2026, 6 hours ago
Today, I would like to share what Iβve learned about Appleβs Object Tracking features, recently announced as part of visionOS 2.0 Preview.
β€οΈ Support on Patreon: patreon.com/dilmerv
π Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
π¦ Twitter X: twitter.com/dilmerv
π₯ Discord : discord.gg/dNMHBc8KdP
πΈ Instagram : tiktok.com/@dilmerval
This video will walk you through the entire workflow: image capturing/scanning, object reconstruction, machine learning training with spatial object tracking, and integrating trained objects into Xcode.
π Vision Pro Object Tracking Chapters:
00:00 - Apple visionOS Object Tracking Introduction & Questions
00:29 - visionOS Object Tracking Requirements
01:17 - Preparing Physical Objects For Object Reconstruction
02:12 - Generating USDZ Files (3D Models) With Reality Composer Pro
03:10 - Training Models With Create ML Object Tracking Features
08:27 - Integrating Trained Object Tracking Models With Xcode
19:05 - Running Object Tracking Demo With The Apple Vision Pro
20:27 - Adding Reference Object USDZ Model For Additional Visualizations
21:02 - Object Tracking Demo With Reference Object Model Rendering
21:57 - Outro (Final Thoughts)
π» You can also find the demo shown on todayβs video via GitHub from github.com/dilmerv/VisionOSObjectTrackingDemo
π Helpful Object Tracking Resources:
- Apple Object Capture docs: developer.apple.com/augmented-reality/object-capture
- macOS Reconstruction app for Photogrammetry: developer.apple.com/documentation/realitykit/building-an-object-reconstruction-app
- Guided Capture iOS / Scanning objects using Object Capture Example: developer.apple.com/documentation/realitykit/scanning-objects-using-object-capture
- Object Capture API or Command Line Utility: developer.apple.com/documentation/realitykit/creating_a_photogrammetry_command-line_app
- Object Tracking for VisionOS: developer.apple.com/documentation/visionOS/exploring_object_tracking_with_arkit
π₯½ Learn & Get my XR Courses from:
learnxr.io
π My Blog / π₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #Apple
Today, I would like to share what Iβve learned about Appleβs Object Tracking features, recently announced as part of visionOS 2.0 Preview.
β€οΈ Support on Patreon: patreon.com/dilmerv
π Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
π¦ Twitter X: twitter.com/dilmerv
π₯ Discord : discord.gg/dNMHBc8KdP
πΈ Instagram : tiktok.com/@dilmerval
This video will walk you through the entire workflow: image capturing/scanning, object reconstruction, machine learning training with spatial object tracking, and integrating trained objects into Xcode.
π Vision Pro Object Tracking Chapters:
00:00 - Apple visionOS Object Tracking Introduction & Questions
00:29 - visionOS Object Tracking Requirements
01:17 - Preparing Physical Objects For Object Reconstruction
02:12 - Generating USDZ Files (3D Models) With Reality Composer Pro
03:10 - Training Models With Create ML Object Tracking Features
08:27 - Integrating Trained Object Tracking Models With Xcode
19:05 - Running Object Tracking Demo With The Apple Vision Pro
20:27 - Adding Reference Object USDZ Model For Additional Visualizations
21:02 - Object Tracking Demo With Reference Object Model Rendering
21:57 - Outro (Final Thoughts)
π» You can also find the demo shown on todayβs video via GitHub from github.com/dilmerv/VisionOSObjectTrackingDemo
π Helpful Object Tracking Resources:
- Apple Object Capture docs: developer.apple.com/augmented-reality/object-capture
- macOS Reconstruction app for Photogrammetry: developer.apple.com/documentation/realitykit/building-an-object-reconstruction-app
- Guided Capture iOS / Scanning objects using Object Capture Example: developer.apple.com/documentation/realitykit/scanning-objects-using-object-capture
- Object Capture API or Command Line Utility: developer.apple.com/documentation/realitykit/creating_a_photogrammetry_command-line_app
- Object Tracking for VisionOS: developer.apple.com/documentation/visionOS/exploring_object_tracking_with_arkit
π₯½ Learn & Get my XR Courses from:
learnxr.io
π My Blog / π₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #Apple










