Dilmer Valecillos
Using The Power Of Unreal 5 With Magic Leap 2 Remote Rendering!
updated
📌 More information about SenseGlove Nova 2 can be found here: senseglove.com/product/nova-2
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#virtualreality #mixedreality #shorts
These AR Glasses are not your typical smart glasses that simply mirror your display. Instead, they provide a full understanding of the real world, allowing you to place virtual objects in precise locations, effectively using the world as your canvas. You can interact with holograms using hand tracking, voice control, or even your mobile device as a controller-what Snap calls multi-modal input.
In any case, they're pretty cool and super lightweight (226 grams). The Spectacles price is currently $99 USD per month, with a 12-month commitment.
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#spectacles #augmentedreality #tech #shorts
Today, I also cover a lot of cool things, including specs, unboxing, setup, SnapOS apps, building a Spectacles app from the ground up, and finally, my developer take on these AR glasses.
00:00 Intro To Snap Spectacles
01:14 Spectacles Specs
02:09 Spectacles Unboxing
02:26 Spectacles Setup
03:04 Spectacles Hand Interactions Tutorial
03:55 Spectacles Mirror, Spectator, and Controller Toggle
04:40 Showcasing A Few Spectacles Games And Apps
05:18 Creating A Lens Studio Spectacles App
07:43 Installing Spectacles Interaction Kit (SIK)
13:58 Creating A New TypeScript Component (For Planet Details)
20:59 Extending SIK With A Custom Interactable Rotator Component
23:07 Sending Lens to Spectacles & Testing in AR
23:44 My Dev Take (Takeaways)
24:51 Outro
📢 Huge thanks to @SnapAR and @OfficialSnapchat for sponsoring this video!
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#snap #spectacles #augmentedreality
Thanks everyone and have an amazing new week!
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/dilmerv
📌 Support me in Patreon so I can keep doing stuff like this for free!
patreon.com/dilmerv
📌 Get XR & game development tips from me in Twitter
https://x.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#pico4ultra #quest3 #shorts #metaverse
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/dilmerv
📌 Support me in Patreon so I can keep doing stuff like this for free!
patreon.com/dilmerv
📌 Get XR & game development tips from me in Twitter
https://x.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#quest3s #mixedreality #virtualreality
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
- XREAL Beam Pro+XREAL Air 2 Pro Bundle:
amzn.to/3ATFj48
- XREAL Beam Pro:
amzn.to/3AP0DaJ
- XREAL Air 2 Pro:
amzn.to/4dOq6Q6
📣 Use discount code Dilmer20 to get $20 off towards your XREAL Air 2 Pro purchase from the official XREAL website: bit.ly/4gmNHt8
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #metaverse #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
ℹ️ For more information about PICO 4 Ultra including specs and availability check out: picoxr.com/global/products/pico4-ultra
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#pico #pico4ultra #mixedreality
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
- XREAL Beam Pro+XREAL Air 2 Pro Bundle:
amzn.to/3ATFj48
- XREAL Beam Pro:
amzn.to/3AP0DaJ
- XREAL Air 2 Pro:
amzn.to/4dOq6Q6
📣 Use discount code Dilmer20 to get $20 off towards your XREAL Air 2 Pro purchase from the official XREAL website: bit.ly/4gmNHt8
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#XREAL #XREALAir2Pro #XREALBeamPro
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📌 Unity Tutorial Requirements: (affiliate links)
- Unity 2022.3 LTS or greater
- Meta XR All-in-One SDK:
assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657?aid=1101l7LXo
- Meta XR Core SDK:
assetstore.unity.com/packages/tools/integration/meta-xr-core-sdk-269169?aid=1101l7LXo
💡 For more information about Meta's Immersive Debugger check out: developer.oculus.com/documentation/unity/immersivedebugger-overview
ℹ️ The Unity project showcased in this video using The Immersive Debugger was tested on both a Quest 3 and a Quest Pro device.
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #tutorial #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📚 This video covers the following:
- Introduction to MRUK
- How to setup and use MRUK features from a C# standpoint
- Using Unity play mode & Meta XR Simulator to test scene understanding with MRUK
- MRUK Android permissions & deploying to a Quest 3 device
📌 Requirements: (affiliate links)
- Meta XR All-in-One SDK: assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657?aid=1101l7LXo
- Or Meta MR Utility Kit: assetstore.unity.com/packages/tools/integration/meta-mr-utility-kit-272450?aid=1101l7LXo
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #mixedreality #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📚 Here is the summary:
- Creating a GitHub repository to store your custom packages
- Custom packages structure and explanations
- Consuming and Updating Unity custom packages
- Adding Unity samples to custom packages
📌 Learn more about creating custom unity packages and samples from:
docs.unity3d.com/Manual/CustomPackages.html
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #unitytips #gamedev
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe: youtube.com/@dilmerv
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📌 Requirements:
- Meta XR All-in-One SDK: (Affiliate Link) assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657?aid=1101l7LXo
- Unity 2022 LTS With Android Build Support:
unity.com/products/unity-engine
📌 Here's a summary of today's Unity Mixed Reality Quest 3 video:
- Unity Mixed Reality project setup and configuration (Project Setup Tool & Building Blocks)
- Creating a Measuring Tape feature (C# MonoBehaviour with input handling, line generation, and measurement label placement)
- Creating a Level Tool feature (grab interactions + C# MonoBehaviour)
- Creating a simple UI with buttons (poke interactions + C# MonoBehaviour)
- Demos showing the finished prototype, as well as an extended prototype I submitted to Meta as part of a new program.
💡Get Started With Meta Presence Platform & Building Blocks:
ocul.us/3Vadlsx
📌 Few Important resources to get to follow along:
- Learn XR Core package: github.com/dilmerv/com.learnxr.core
- Menu prefab & icons: github.com/dilmerv/MetaXRProductivityApp/tree/master/GettingStarted
- Full Unity project: github.com/dilmerv/MetaXRProductivityApp
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#meta #unity #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📢 Huge thanks to @unity for sponsoring this new XR development video!
📌 Recommended Unity Assets: (Affiliate Links)
- Hurricane VR - Physics Interaction Toolkit:
assetstore.unity.com/packages/tools/physics/hurricane-vr-physics-interaction-toolkit-177300?aid=1101l7LXo
- Odin Inspector and Serializer:
assetstore.unity.com/packages/tools/utilities/odin-inspector-and-serializer-89041?aid=1101l7LXo
- Easy Save - The Complete Save Data & Serializer System:
assetstore.unity.com/packages/tools/utilities/easy-save-the-complete-save-data-serializer-system-768?aid=1101l7LXo
- DOTween Pro:
assetstore.unity.com/packages/tools/visual-scripting/dotween-pro-32416?aid=1101l7LXo
- Mesh Effects:
assetstore.unity.com/packages/vfx/particles/spells/mesh-effects-67803?aid=1101l7LXo
- Pro Sound Collection
assetstore.unity.com/packages/audio/sound-fx/pro-sound-collection-50235?aid=1101l7LXo
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#madewithunity #mixedreality #extendedreality
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📌 Requirements:
- Meta XR All-in-One SDK: (Affiliate Link) assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657?aid=1101l7LXo
- Unity 2022 LTS With Android Build Support:
unity.com/products/unity-engine
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #tutorial #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
This video will walk you through the entire workflow: image capturing/scanning, object reconstruction, machine learning training with spatial object tracking, and integrating trained objects into Xcode.
📚 Vision Pro Object Tracking Chapters:
00:00 - Apple visionOS Object Tracking Introduction & Questions
00:29 - visionOS Object Tracking Requirements
01:17 - Preparing Physical Objects For Object Reconstruction
02:12 - Generating USDZ Files (3D Models) With Reality Composer Pro
03:10 - Training Models With Create ML Object Tracking Features
08:27 - Integrating Trained Object Tracking Models With Xcode
19:05 - Running Object Tracking Demo With The Apple Vision Pro
20:27 - Adding Reference Object USDZ Model For Additional Visualizations
21:02 - Object Tracking Demo With Reference Object Model Rendering
21:57 - Outro (Final Thoughts)
💻 You can also find the demo shown on today’s video via GitHub from github.com/dilmerv/VisionOSObjectTrackingDemo
📌 Helpful Object Tracking Resources:
- Apple Object Capture docs: developer.apple.com/augmented-reality/object-capture
- macOS Reconstruction app for Photogrammetry: developer.apple.com/documentation/realitykit/building-an-object-reconstruction-app
- Guided Capture iOS / Scanning objects using Object Capture Example: developer.apple.com/documentation/realitykit/scanning-objects-using-object-capture
- Object Capture API or Command Line Utility: developer.apple.com/documentation/realitykit/creating_a_photogrammetry_command-line_app
- Object Tracking for VisionOS: developer.apple.com/documentation/visionOS/exploring_object_tracking_with_arkit
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #Apple
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📚 Video Chapters:
00:00 - Intro to Meta XR Simulator
00:36 - Benefits of using Meta XR Simulator with Unity Mixed Reality Projects
00:56 - Intro to LightSaber prototype which we'll integrate to learn about Meta XR Simulator
01:11 - Setting Up Meta XR Simulator Demos Project Template & Resources
01:55 - Adding Building Blocks & LightSaber prefabs
02:16 - Launching Meta XR Simulator (Virtual Reality Testing & Inputs)
04:33 - Adding Grab Interaction Building Block & Testing With Keyboard, Mouse, & Xbox Controller
06:56 - Data Forwarding Setup To Enable Physical Controller(s) In Meta XR Simulator
09:26 - Adding Empire Crates & LightSaber Slicing Features (With Ezy-Slice)
12:33 - Meta XR Simulator Support for MAC
13:56 - Adding MR Features: Passthrough & Synthetic Environment Testing
17:05 - Adding MR Features: MRUK, Effect Mesh, and Find Spawn Positions
22:50 - Outro
📌 Requirements:
- Unity 2022 LTS
- Meta XR All-In-One SDK: assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657?aid=1101l7LXo (Affiliate Link)
💻 GitHub repositories are available with templates to get started, resources, and a completed project if you prefer to review the final version rather than following step by step:
👉 Full Project: github.com/dilmerv/MetaXRSimulatorDemos_FullProject
👉 Resources: github.com/dilmerv/MetaXRSimulatorDemos_Resources
👉 Template: github.com/dilmerv/MetaXRSimulatorDemos
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #meta #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : tiktok.com/@dilmerval
📚 Video Chapters:
00:00 - Introduction To Spatial Anchors API & Spatial Anchors Storage API
02:13 - Unity Project Setup And Resources
02:26 - Camera Near Clipping Configuration & Spatial Anchor Permission
03:17 - AR Foundation (AR Anchor Manager Setup)
04:26 - C# Script With Spatial Anchors API (Anchor Creator Component)
17:05 - Anchor Creator Component Demo From The Headset
18:17 - Getting Additional Anchor Info From ML XR Anchor Subsystem
20:42 - ML XR Anchor Subsystem Demo
21:11 - Adding Spatial Anchors Storage API Capabilities
50:24 - Spatial Anchors Storage API Demo
51:00 - Adding Restore of Anchors From Storage With New UI
55:53 - Restoring of Anchors With UI Demo
56:52 - Outro
Spatial Anchors are fully compatible and built on top of Unity's AR Foundation. These new API additions allow you to perform asynchronous calls for publishing, creating, and deleting anchors, as well as updating anchors expiration dates for those stored with the Spatial Anchor Storage API.
Thanks to @MagicLeap @MagicLeapDevs for sponsoring this video.
🥽 Learn & Get my XR Courses from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#openxr #unity #ml2 #programming
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Mattercraft allows us to maintain a single codebase and run the same MR experience on Apple Vision Pro, Meta Quest 3, Zapbox + iPhone, and Magic Leap 2. We'll begin by experimenting with the new WebXR physics, which will enable us to create a fun slingshot mechanic and a target for our mini game.
📌 In this second Mattercraft video, we'll be working on the following areas:
- Creating the WebXR Project by using the Headsets & VR Templates
- Creating A Slingshot Mechanic (SlingshotGrabber.ts typescript behavior)
- Creating A Ball Factory / or in other words A Ball Spawner (BallSpawner.ts typescript component)
- Creating Target (SlingshotTarget.ts typescript behavior)
- Creating A Simple Score System (GlobalContext.ts typescript context)
- Creating A Simple Environment & various physical objects (Havok Physics)
📚 Video Chapters:
00:00 - Intro To Mixed Reality Project WebXR Tools
00:44 - Overview of WebXR New Features Covered Today With Mattercraft
01:00 - Creating A New WebXR Project & Setup Of Physics Dependency
03:41 - Setting Up Controllers / Hands With Grab Interactions
06:11 - Adding Shapes, Setting Up Shapes Rigidbodies, And Colliders
12:16 - Setting Up Slingshot Ball Component
17:34 - Setting Up Ball Factory
38:01 - Testing Ball Factory Physics Within Mattercraft Viewer And Apple Vision Pro
38:30 - Setting Up Slingshot Component And Slingshot Grabber Behavior
50:20 - Testing Slingshot Mechanic With Meta Quest 3 And Zapbox
51:03 - Setting Up Target And Slingshot Target Behavior
53:44 - Creating A UIVisualizer To Bind UI And Audio Manager
54:25 - Testing Our Final WebXR Mixed Reality Project
56:08 - Outro
💻 Full Project Source Code And Docs Available From GitHub: github.com/dilmerv/SlingshotMRGame
📢 Recommended:
👉 If you missed the previous Mattercraft WebXR video then be sure to watch it from: youtu.be/1y40Y3wdpCY
👉 Get started with Mattercraft IDE by signing-up at: bit.ly/3VSmruD
👉 Get Started With AR/VR By Using 🕶️ Zapbox: zapbox.io/?via=dilmer (affiliate link)
ℹ️ Resources:
👉 Mattercraft WebXR Developer Docs: docs.zap.works/mattercraft/getting-started
👉 Mattercraft WebXR Animation System Docs: docs.zap.works/mattercraft/animation-system
👉 Mattercraft WebXR Scripting (very helpful): docs.zap.works/mattercraft/scripting
Huge thanks to @ZapparApp for sponsoring this WebXR video.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#webxr #applevisionpro #quest3
As far as pros and cons of using this laptop for XR development, here's what I’ve experienced in these last 2 weeks:
Pros 👍:
- It is portable. I can now take it anywhere, unlike my previous main machine, which was a desktop. It was hard to work on XR projects unless I was using a powerful desktop.
- It allows me to run Meta Link incredibly fast compared to my older desktop running a Titan GPU + 64GB + i9 versus the i9 Ultra + 4090 GPU + 32 GB on this laptop.
- Large Unity projects open incredibly fast, I would say 50% faster than on my MacBook Pro (Apple M1 Pro 2021).
- The keyboard feels like a full-size mechanical keyboard and is very responsive.
- It has the ability to change between performance modes (battery, quiet, balanced, or performance for more high-resource experiences).
- Customer service from @Dell @AlienwareChannel is amazing; they’re very responsive and willing to help right away.
Cons 👎:
- Although it is portable, it doesn’t fit in a regular-sized backpack. You need a larger backpack or an Alienware Backpack, which works very well with this laptop. This is a con, but the Horizon Slim Backpack is awesome and very affordable at $38.99 USD.
- It is a bit loud, but honestly, I wouldn’t expect less since it is portable.
- The price is pretty high. I can justify it due to its portability and the ability to use it during conferences and trips, but for the average XR developer, this may be too expensive.
- When I initially received this machine, there was screen light bleeding. However, I was able to get an exchange right away, which was delivered within 3-4 days from my initial request.
Overall, I am pretty happy with this purchase. I had a Razor Blade prior to this (with very low specs), and it became outdated too fast. For that reason, when Meta Link (aka Oculus Link) got an update, I couldn’t use that feature after one year of purchasing the laptop. This is the main reason why I decided to get the highest spec version of the Alienware x16 R2.
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #metaverse #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
💡To Get Started With The Presence Platform & Building Blocks check out the docs at: ocul.us/3Vadlsx
In the first video, we will cover:
- How to set up a Unity project with Meta XR components using the project setup tool.
- Using core building blocks such as the camera rig building block, passthrough building block, controller tracking, hand tracking, visualizers, room mesh, and interactions.
- How to build a mixed reality tabletop bowling game from the ground up.
- Step-by-step instructions on how to set up and use the Meta XR Simulator with data forwarding features, allowing you to use physical controllers with the simulator.
- How to use synthetic environments with Meta XR Simulator for testing passthrough via sim.
📚 Video Chapters:
00:00 - Intro to Meta Presence Platform video series and prototypes.
01:03 - Reviewing the tabletop bowling game we'll build today.
01:29 - Creating a new Unity Project with Meta XR components & the project setup tool
02:48 - Intro to Building Blocks.
05:06 - Adding additional Building Blocks: passthrough, controller tracking, hand tracking, virtual hands, and grab interactions.
06:39 - Intro to Meta XR Simulator & synthetic environments.
08:15 - Data forwarding feature overview.
09:44 - Building a mixed reality tabletop game.
23:54 - Demos showing our mixed reality bowling game completed.
📌 Unity project and video resources shown today are available on GitHub:
👉 Resources ONLY: github.com/dilmerv/MetaXRTableTopGames_Resources
👉 Full Unity Project: github.com/dilmerv/MetaXRTableTopGames
Huge thanks @meta @MetaDevelopers for sponsoring this new Meta Presence video series.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#meta #unity #quest3
📢 Full video available at 👉 youtu.be/1y40Y3wdpCY
💡Also, feel free to let me know if you’ve any questions below. Thanks everyone!
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#webxr #visionpro #quest3 #shorts
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
📢 To register for FREE for 14 days and follow along, go to: bit.ly/3VSmruD
📌 Get Started With AR/VR By Using Zapbox (A Very Low Cost XR Device): zapbox.io/?via=dilmer (affiliate link)
📚 This video also covers the following areas:
00:00 - Intro To Major Mattercraft WebXR Tools
01:38 - Creating An Account And Logging Into Mattercraft
02:34 - Creating A WebXR Mattercraft Project
05:05 - Selecting A WebXR Controller (For instance: Quest 3, ML2, Hands, etc)
05:39 - Adding glTF / GLB 3D Models
07:56 - WebXR One-Click Publishing and Testing With Quest 3 & Apple Vision Pro
09:23 - Adding A NoSkyOnAR Custom Behavior With TypeScript
12:05 - Adding A Legend And Implementing The LineLegend Custom Behavior With TypeScript
16:30 - Adding Animations (States And Timelines)
20:58 - Adding Billboard Components To All Legends
23:28 - Adding UI Interactions With 3D Models And Event Bindings
26:42 - Final Demo of Our "SpaceX Fan Project" Running On Multiple Headsets
28:51 - Outro
ℹ️ Recommended Resources:
👉 Mattercraft WebXR Developer Docs: docs.zap.works/mattercraft/getting-started
👉 Mattercraft WebXR Animation System Docs: docs.zap.works/mattercraft/animation-system
👉 Mattercraft WebXR Scripting (very helpful): docs.zap.works/mattercraft/scripting
👉 To Optimize / Compresss GLB Files take a look at: optimizeglb.com
Huge thanks to @ZapparApp for sponsoring this WebXR video.
🙏 Big THANKS to the following artists for providing the following 3D models:
- Earth Planet 3D Model By "Denis Cliofas": sketchfab.com/3d-models/earth-3684eb40fb7e42208089874e6286b9e9
- Mars Terrain 3D Model By "Sebastian Sosnowski": sketchfab.com/3d-models/mars-aram-chaos-region-5c9b99de0405465f81ff0ba244ef69e2
- Mars Planet 3D Model By "Akshat": sketchfab.com/3d-models/mars-9c7bbc64d8c74acfa9ec344c0fc10e1a
- Starship 3D Model By "MartianDays": sketchfab.com/3d-models/spacex-starship-a8a0b69f776841a1a465cd9fb3762fd2
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#webxr #applevisionpro #quest3
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Additionally, I will go over creating an Input Actions mapping file to bind various input events used with 2D Windowed apps and Fully Immersive VR, including utilizing the new VisionOS Spatial Pointer.
💡 A small fix is shown on this video to allow for proportionally scaling 2D windows and 3D content for the generated Unity Builds.
💻 Unity project available from GitHub:
github.com/dilmerv/UnityVisionOS2DAndVR
🎮 Unity Asset used today for grid prototypes:
assetstore.unity.com/packages/2d/textures-materials/grid-prototype-materials-214264?aid=1101l7LXo
ℹ️ Recommended resources:
👉 Unity visionOS Discussion about 2D Windowed scaling problem: discussions.unity.com/t/window-aspect-ratio/321865/2
👉 Unity visionOS Platform Docs:
docs.unity3d.com/Packages/com.unity.polyspatial.visionos@1.1/manual/visionOSPlatformOverview.html
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#applevisionpro #unity #visionos
ℹ️ This BETA version supports:
- Up to 5 displays
- Standing vs Sitting mode (this means there's a slight Y-axis change when going from sitting to standing--a pretty cool feature)
- Basic spatial window transformations (movement, scaling, and adding curvature)
- Audio is also sent from your OS to the Vision Pro headset
- Support for PC/MAC/Linux
I only tested it with MAC, and I found a few issues during the setup, but to be fair, they're early in BETA, so I am sure it will be fixed soon. On the other hand, the screens look amazing, and it was great to be able to move/scale/add curvature to windows in my working area.
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#applevisionpro #shorts #apple
ℹ️ Download this Mixed Reality Spectator app for FREE from the iOS App Store at: apps.apple.com/us/app/magic-leap-spectator/id6479166032
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#mixedreality #spatialcomputing #shorts
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We will cover the gaze interaction profile setup, requesting eye tracking permissions through C#, and creating a prototype that makes use of eye tracking data to interact with virtual content.
📌 The Unity Project shown today w/ OpenXR & Gaze Features can be cloned from GitHub: github.com/dilmerv/MagicLeapEyeTracking
ℹ️ Recommended resources:
👉 Magic Leap OpenXR Development Docs: https://developer-docs.magicleap.cloud/docs/guides/unity-openxr/getting-started/openxr-unity-getting-started
👉 Eye Gaze Overview: https://developer-docs.magicleap.cloud/docs/guides/unity-openxr/eye-gaze/eye-tracking-overview
Huge thanks to @MagicLeap @MagicLeapDevs for sponsoring this ML2 video.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #openxr #magicleap
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
The visualizations offered by Cognitive3D are something else and I would love to show you a few interesting demos as well as how to integrate their SDK into a Unity project.
📌 In addition to what was mentioned, I will also cover:
- How you can use Scene Explorer to view your player(s) recorded sessions: including showing HMDs, Controllers, Gaze Generated Heatmaps, and additional stats.
- How to track specific object behaviors associated through the use of Dynamic Objects + Custom Events.
- How to customize your Cognitive3D session info for authentication purposes.
ℹ️ Recommended Cognitive3D resources:
👉 Cognitive3D Developer Docs: docs.cognitive3d.com
👉 Cognitive3D GIT package: github.com/CognitiveVR/cvr-sdk-unity.git
Also Big thanks to @cognitive3d for sponsoring this XR video!
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #spatialcomputing #cognitive3d
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
This is a very good move because it now allows you to use a common set of APIs available with other XR devices due to the OpenXR runtime, in addition to using Unity AR Foundation & XR components which you may already be familiar with.
I’m also sharing a step-by-step process which includes: setting up an OpenXR Unity project, setting up a rig and controller, adding plane detection, and lastly adding plane classifications.
📌 The OpenXR ML2 Unity Project shown today can be cloned from GitHub: github.com/dilmerv/MagicLeapPlaneDetection
ℹ️ Recommended resources:
👉 Magic Leap OpenXR Development Docs: https://developer-docs.magicleap.cloud/docs/guides/unity-openxr/getting-started/openxr-unity-getting-started
👉 Plane Classification docs: https://developer-docs.magicleap.cloud/docs/guides/unity-openxr/plane-detection/openxr-unity-plane-classification
👉 Display Zone (Camera Clipping Plane Docs): https://developer-docs.magicleap.cloud/docs/guides/features/display-zone/display-zone-concept
👉 Grid Materials for AR Planes shown in this video (Affiliate Link): assetstore.unity.com/packages/2d/textures-materials/grid-prototype-materials-214264?aid=1101l7LXo
Also huge thanks to @MagicLeap @MagicLeapDevs for sponsoring this ML2 video.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#openxr #unity #magicleap
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
I will also go over Unity project setup with the updated Meta XR packages, new hand locomotion examples, new comprehensive rig examples, and lastly, multimodal support.
📌 Here is a great guide with additional details which could be helpful as you integrate Interaction SDK: developer.oculus.com/documentation/unity/unity-isdk-getting-started
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #meta #sdk #xr
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We will then use this map to place virtual objects relative to the physical devices located in my studio.
👉 Sign-Up for a FREE Immersal Account: immersal.com/register?DILMER (affiliate link)
📚 Video Chapters:
00:00 - Mapping My Studio With Immersal AR (Introduction)
00:29 - Creating A New Unity Project
00:55 - Installing Immersal SDK Packages, Samples, And Scanning My Office
02:16 - AR Camera Setup & Immersal SDK Components
07:00 - Getting Map Id From The Immersal Developer Hub
08:33 - Changing the AR Localization Behavior
12:51 - Adding A Script To Toggle Point Cloud Visualizers
14:25 - Adding AR Objects Relative To Our AR Map
16:30 - Adding AR Content Raycast For AR Object Selection
19:25 - Outro
📌 The Unity Project shown today can be downloaded or cloned from GitHub:
github.com/dilmerv/UnityImmersalDemos
ℹ️ Recommended resources to learn more about Immersal SDK:
👉 Mapping: developers.immersal.com/docs/mapsmapping/howtomap
👉 Edit Maps: developers.immersal.com/docs/mapsmapping/advanced/map-editing-feature
Also huge 🎉 thanks to @Immersal for sponsoring this XR video. I had a great experience by learning and testing their useful AR localization tools.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#augmentedreality #spatialcomputing #unity
All the research I did today will help me get there, and I should’ve a total 2 new videos this month!
ℹ️ To Get Started With Unity visionOS development for Apple Vision Pro, make sure to download the template from: docs.unity3d.com/Packages/com.unity.polyspatial.visionos@1.0/manual/TutorialCreateFromTemplate.html
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#visionpro #unity
Learn how I use this today through a short Vision Pro development video with Xcode. For further resources on visionOS development, check out the playlists below.
📌 Unity VisionOS PolySpatial Dev Videos: youtube.com/playlist?list=PLQMQNmwN3FvxD8pQaNmrLLRJcYjA-xP9D
📌 Apple Native Dev Videos: youtube.com/playlist?list=PLQMQNmwN3Fvwx18OKmvgk5itrqhyqblB1
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #Apple
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
👉 Sign-Up for a FREE Immersal Account: immersal.com/register?DILMER (affiliate link)
We'll also explore an AR Navigation Demo created with Immersal SDK, demoing their cool and very reliable AR localization features. Additionally, we will build a Unity demo demonstrating persistent AR content placement.
ℹ️ Recommended resources to learn more about Immersal SDK:
👉 Mapping: developers.immersal.com/docs/mapsmapping/howtomap
👉 Edit Maps: developers.immersal.com/docs/mapsmapping/advanced/map-editing-feature
📚 Immersal SDK Video Chapters:
00:00 - Immersal AR Technology (Introduction)
01:06 - AR Navigation Demo With Immersal
01:43 - AR Navigation Demo Prototype In Unity
02:44 - AR Navigation Demo Testing With an iPhone 15 Pro
03:19 - Using Mapper 2.0 To Scan My Studio (Immersal Workflow)
04:10 - Immersal Developer Hub Dashboard
08:25 - Integrating Immersal SDK in Unity
19:13 - Testing Our Immersal Demo App With iOS
19:51 - Switching To Android And Testing With a Google Pixel 4
Also huge 🎉 thanks to @Immersal for sponsoring this XR video. I had a great experience by learning and testing their useful AR localization tools.
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#augmentedreality #immersal #unity #xr
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Today, I would like to answer some of those questions by going through unboxing, installation, Xcode deployment comparisons with Wi-Fi vs USB-C, running Virtual Display with USB-C, Apple Configuration with USB-C, and Reality Composer Pro 4K USB-C transferred videos.
📢 To order the Apple Developer Pro you MUST be registered as an Apple Developer. Once registered order it from: developer.apple.com/visionos/developer-strap/purchase
Tech specs from Apple: USB-C data connection, individually amplified dual driver audio pods, and compatible with Mac.
📚 Vision Pro Developer Strap Chapters:
00:00 - Vision Pro Developer Strap (Intro)
00:26 - Unboxing The Vision Pro Developer Strap
01:55 - Installing The Vision Pro Developer Strap
05:11 - Connecting The Vision Pro Developer Strap To Your MAC
05:19 - Enabling Apple Vision Pro Developer Mode
05:38 - Using Apple Configuration With Vision Pro Developer Strap Via USB-C
06:06 - Connecting Vision Pro Developer Strap To Xcode
06:41 - Xcode USB-C Vs WiFI Deployments
08:18 - Vision Pro Virtual Display Connection Via USB-C
08:40 - Reality Composer Pro Developer Capture 4K Transfers Via USB-C
09:06 - Reality Composer Pro Vision Pro Connection
09:21 - Conclusion
10:18 - Outro
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #Apple
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Today, I'll be unboxing the Apple Vision Pro, showing you a few cool demos as well as core visionOS features, and lastly I will give you my early review about what I like and don't like so far about Apple Vision Pro. Keep in mind that I will be doing a more detailed review in a few weeks.
Feel free to share your thoughts on the Apple Vision Pro in the comments section below! I'm curious to hear your opinions.
📚 Apple Vision Pro Chapters:
00:00 - Apple Vision Pro (Intro)
00:28 - Unboxing & Specs
09:55 - Device Setup & Persona Results
10:47 - Passthrough Quality
11:29 - visionOS Core Interactions
13:03 - visionOS Environments
13:31 - Sharing Mac screen on visionOS & Persistent UI
14:04 - Encounter Dinosaurs
14:38 - My Early Review / Takeaways
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#AppleVisionPro #VisionPro #AppleVisionProReview
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
📚 XR Hands Custom Gestures Chapters:
00:00 - 00:23 - XR Hands Custom Gestures (Introduction)
00:23 - 00:57 - Unity Project Setup (Packages & OpenXR Configuration)
00:57 - 07:47 - Creating A Vulcan Salute Hand Gesture (Hand Shapes)
07:47 - 09:06 - Adding Orientation To Vulcan Salute Hand Gesture (Hand Pose)
09:06 - 13:12 - Creating A Gun Pointing Hand Gesture (Hand Shapes)
13:12 - 17:14 - Adding A Ray, Spawner, & Binding To Static Hand Gesture Component Events
ℹ️ Recommended resources:
Building Blocks: docs.unity3d.com/Packages/com.unity.xr.hands@1.4/manual/gestures/building-blocks.html
Finger Shapes: docs.unity3d.com/Packages/com.unity.xr.hands@1.4/manual/gestures/finger-shapes.html
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #xr #xrhands
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We'll also create a demo scene where Magic Leap 2 hand tracking permissions will be configured in Unity, and we'll be building a real-time hand visualizer to display each hand skeleton bone as well as its position and rotation.
📚 Magic Leap 2 Hand Tracking Video Chapters:
00:00 - 00:58 - Introduction to Magic Leap 2 Hand Tracking Features
00:58 - 04:53 - ML2 Hand Tracking Project Setup
04:53 - 06:08 - Integrating Hand Tracking with Hand Tracking Manager Script
06:08 - 07:52 - Getting XR Input Devices For Left And Right Hand Device
07:52 - 12:48 - Building A Hand Tracking Bone Visualizer
12:48 - 15:05 - Getting And Displaying Detected Gestures
15:05 - 17:11 - Adding Bone Names To Bone Visualizer
💡 Previous video about ML2 Input available here:
youtu.be/XswLBXZ916k
💻 ML2 Project shown today available via GitHub:
github.com/dilmerv/MagicLeapInputDemos
ℹ️ If you’ve any questions about this or XR development in general let me know below, thanks!
📙 Great Magic Leap 2 Hand Tracking Resources:
- Hand Key poses and calculated angles: https://developer-docs.magicleap.cloud/docs/guides/features/hand-tracking/hand-tracking-developer
- Gestures API: https://developer-docs.magicleap.cloud/docs/guides/unity/input/gesture-classification/unity-gesture-classification-example/
- Hand Tracking design guidelines: https://developer-docs.magicleap.cloud/docs/guides/features/hand-tracking/hand-tracking-design
Also huge thanks to @MagicLeap for sponsoring this ML2 video!
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #mixedreality #unity #magicleap
💡How can we prototype an Apple Vision Pro Prototype with ShapesXR and convert the results into a Fully Working Mixed Reality Unity project? Well, I answer those questions and many more with this long-form video: youtu.be/rkKGfp1PZ3c
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter:
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#shorts #visionos #unity #mixedreality
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We'll utilize ShapesXR tools for UI Design, Eye Gaze Interactions, and Hand Pinch Gestures. In addition, I will use the ShapesXR Unity Plugin to convert the design into a Unity project, creating a fully functional VR/MR demo for Quest Pro with Eye Gaze and Pinch Gestures.
📚 What are we going to cover today?
00:00 - 00:47 - ShapesXR Prototype For Apple Vision Pro (Introduction)
00:47 - 00:53 - ShapesXR MR/VR App Installation Steps
00:53 - 01:13 - Pairing Your Quest 3 Or Quest Pro With ShapesXR
01:13 - 04:28 - ShapesXR Dashboard, Figma Token Setup, & Adding visionOS Resources
04:28 - 07:01 - Designing An Apple Vision Pro Landing Area With ShapesXR
07:01 - 11:06 - Setting Up Meta Tools, XR Toolkit, And Meta Gaze Adapter
11:06 - 13:52 - Installing ShapesXR Unity Plugin And Importing ShapesXR visionOS Space
13:52 - 25:11 - Adding XR Interactions And Implementing Eye Gaze With Hand Pinch Detection
25:11 - 25:28 - Outro
Also huge 🎉 thanks to @ShapesXR for sponsoring this XR video. I had a blast and this tool was designed in such a way that it enables you to be very creative, super easy to use, but at the same time very powerful.
ℹ️ Recommended resources for ShapesXR:
👉 Download ShapesXR from the Meta Store: meta.com/en-gb/experiences/3899112273551602
👉 Figma Apple Design For visionOS: figma.com/community/file/1253443272911187215/apple-design-resources-visionos
👉 ShapesXR Official Website: shapesxr.com
👉 ShapesXR Daily News: twitter.com/ShapesXR
👉 ShapesXR Detailed Video Tutorials: youtube.com/channel/UClrmPAK9iRT8fY1XP9MdCNw
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#shapesxr #applevisionpro #unity
📌 Here’re some of the highlights:
👉 Users will notice a 6x improvement in overall accuracy and a 10% improvement in latency of virtual hands.
👉 Keypoints are more closely aligned with users real hands, and depth is more consistent.
👉 Gestures are more responsive and reliable, with notable impacts to pinch and home gesture detection.
👉 New setting added to activate near vs far hand tracking interactions which adds a significant level of improvement to hand tracking features.
Overall, it feels much more in line with real hand movements. Gestures are more responsive during detection, and the virtual hands displayed within their "Model Viewer" experience look very impressive.
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#augmentedreality #mixedreality #arglasses
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
The tools covered today include: Meta Haptics Studio, Meta Haptics Studio Companion App, and Meta Haptics SDK (For Unity & Unreal).
I'm also excited to show you how we can take an already established mixed reality game, such as The World Beyond, and guide you through the process of integrating Haptics.
📚 Meta Haptics SDK Video Chapters:
00:00 - 01:18 - Meta Haptics Introduction (What We'll Cover Today)
01:18 - 02:19 - Sneak Peek "The World Beyond" Project With Integrated Haptics
02:19 - 03:07 - Installing Meta Haptics Studio And Meta Companion App
03:07 - 13:38 - Meta Haptics Studio Overview (Amplitude, Frequency, Emphasis Envelopes)
13:38 - 24:56 - Integrating Haptics SDK into "The World Beyond" Game And Testing
24:56 - 25:18 - Outro
ℹ️ Two ways to add the Meta Haptics SDK:
1- By Using Meta NPM Registry: developer.oculus.com/documentation/unity/unity-package-manager/#add-sdk-from-the-npm-registry
2- By downloading it from the Unity Asset Store (this is coming soon since meta is currently working on making it available)
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#meta #haptics #quest3
💡 A Full YouTube video about these tools coming out this weekend!
ℹ️ More info about this new Meta Haptics release at 👉 developer.oculus.com/blog/haptics-public-release-enhance-your-immersive-experiences-on-meta-quest
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#meta #quest3 #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We will also review the compatibility matrix for all requirements needed to run the Play To Device tool, learn how to configure the tool, and explore a few visionOS demos while using it. Additionally, I will share some interesting history about ARKit Remote as a fun part of this video.
📚 Unity PolySpatial Play To Device Chapters:
00:00 - 00:32 - Introduction to Unity PolySpatial Play To Device and video overview
00:32 - 03:16 - ARKit Remote History (to give you more context about why this tool is so important)
03:16 - 04:42 - Why is Unity PolySpatial Play To Device Really Needed?
04:42 - 06:48 - Unity PolySpatial Play To Device Requirements
06:48 - 11:54 - Setting Up And Reviewing Unity PolySpatial Play To Device Compatibility Matrix (Dependencies)
11:52 - 18:30 - Running Unity visionOS demos with Play To Device (IP Address Connectivity)
18:30 - 20:23 - Testing Unity PolySpatial With AR Features Through XR Simulation
📙 Few resources to supplement learning Unity PolySpatial including play to device tool mentioned today:
- Unity PolySpatial Play To Device Host Download:
drive.google.com/drive/u/0/folders/1ZmWoS6NhrrmvabYia79hlvbyPV1mUN2p
- Unity Version Compatibility Matrix:
docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/PlayToDevice.html
- Play To Device host FAQ:
docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/FAQ.html
- A video to help you with setting up Xcode & visionOS tools:
youtu.be/LeqVHfqRq_I
💻 GitHub repo to help you get started with Unity PolySpatial is available here: github.com/dilmerv/HelloVisionOS
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #metaverse #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
📌 My experience with native visionOS vs Unity visionOS development available here: blog.learnxr.io/xr-development/unity-visionos-polyspatial-tools-are-here
We'll also explore a demo I created by using a bounded volume camera for mixed reality, as well as a variety of demos created by Unity.
📢 Be sure to go over the visionOS requirements and Unity licensing requirements in this video before you start with visionOS in Unity.
📚 Unity VisionOS PolySpatial Video Chapters:
00:00 - 00:51 - Unity visionOS PolySpatial Tools Video Overview
00:51 - 03:08 - Unity visionOS PolySpatial Demos (Bounded Volume Camera Demos)
03:09 - 05:23 - Unity visionOS Platform Requirements
05:23 - 07:52 - Unity Licensing Requirements for visionOS Platform
07:52 - 12:54 - Creating Your First VisionOS Full Immersive VR Experience With Unity
12:54 - 13:25 - Installing visionOS PolySpatial Packages
13:25 - 23:56 - Creating A PolySpatial Experience For MR Apps (Bounded Volume Camera Versus Unbounded Volume Camera Is Covered In This Section)
23:56 - 29:25 - Testing visionOS Experiences In Unity With XR Simulated Environments & XR Device Simulator
💻 GitHub repo to help you get started available here:
github.com/dilmerv/HelloVisionOS
📙 Unity VisionOS & PolySpatial Resources:
- Unity VisionOS Platform Overview: docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/visionOSPlatformOverview.html
- Supported vs Unsupported Components: docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/SupportedFeatures.html
- FAQ (For Common VisionOS PolySpatial Issues): docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.5/manual/FAQ.html#q-skinned-meshes-are-not-animating
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #visionos #apple #xr
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
We'll go over how to detect controller input changes, how to read controller state information directly, and how we can detect a variety of gestures generated from the controller touchpad. Also, we will make use of head pose info to adjust a canvas UI position and rotation, which will make the UI follow us around. Lastly, We’ll test all of these features by using a powerful dev tool called the “Application Simulator” as well as deploying to the device.
💡 Download or clone the Magic Leap 2 Input Unity project from: github.com/dilmerv/MagicLeapInputDemos
📚 Magic Leap 2 Input Video Chapters:
00:00 - 00:31 - Introduction to Magic Leap 2 Input (Controller & Head Pose)
00:31 - 01:31 - Creating a new unity project with ML2 input features and Unity ML2 application simulator
01:31 - 02:50 - ML2 application simulator action bindings and demos
02:50 - 15:54 - Interacting with ML2 Input API with Unity scripting (Controller Input)
15:54 - 19:02 - Reading head pose information to change UI position and rotation during input events
📙 Great Magic Leap 2 Input Resources:
- Controller API Overview: https://developer-docs.magicleap.cloud/docs/guides/unity/input/controller/unity-controller-api-overview/
- Application Simulator (Action Bindings): https://developer-docs.magicleap.cloud/docs/guides/developer-tools/app-sim/app-sim-action-bindings/#movement-controls
- Helpful ways to read input within callbacks: docs.unity3d.com/Packages/com.unity.inputsystem@1.0/api/UnityEngine.InputSystem.InputAction.html
- Controller Gestures: https://www.magicleap.care/hc/en-us/articles/4424698871565-Controller-Overview
Also huge thanks to @MagicLeap for sponsoring this ML2 video!
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #metaverse #unity #magicleap
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Magic Leap 2 Dynamic Dimmer provides two powerful options for developers:
- A Global Dimmer, which dims the environment to ensure clear, solid, and vibrant digital content in bright areas. Think of this as a tint applied to the background under all the virtual content, in which you can control its opacity value.
- A Segmented Dimmer, which allows applications to locally dim just the part of the display with virtual content. This means a subtle tint or border is applied around the edges of 2D/UI content and even 3D content.
💡 Clone or download the Magic Leap 2 Dynamic Dimmer project from: github.com/dilmerv/MagicLeapDimmerDemos
📙 Great resources to learn more about ML2 Dynamic Dimmer features:
👉 Unity info: https://developer-docs.magicleap.cloud/docs/guides/unity/display/unity-global-dimming/
👉 Guides: https://developer-docs.magicleap.cloud/docs/guides/features/dimmer-feature/
Also huge thanks to @MagicLeap for sponsoring this ML2 video!
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#metaverse #magicleap #unity #xr
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Meta Depth API can greatly enhance mixed reality experiences by occluding digital objects with the real world. I will also explore various occlusion examples, including the creation of a basic 3D platformer with passthrough, scene understanding, and the exciting new occlusion features.
📚 Quest 3 With Meta Depth API Video Chapters:
00:00 - 00:35 - Meta Depth API With Quest 3 video introduction
00:35 - 02:40 - A variety of Demos With Meta Depth API (Hard Occlusion vs Soft Occlusion)
02:40 - 09:56 - Building a Meta Depth API demo with Occlusion Standard and Occlusion Particle Standard Unlit shader
09:56 - 10:19 - Testing your first Meta Depth API Unity Project!
10:19 - 15:16 - Adding a Robot Character Controller and testing it on the Quest 3
15:16 - 15:57 - Adding additional features such as UI, interactions, and score system
15:57 - 16:31 - Wrapping Up Meta Depth API tutorial and video
📌 Helpful resources including Depth API Guitar demos available below:
developer.oculus.com/blog/mesh-depth-api-meta-quest-3-developers-mixed-reality
github.com/oculus-samples/Unity-DepthAPI
💡 Recommended Oculus link cable:
amzn.to/3rSLzF7 (affiliate link)
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#xr #metaverse #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
Today, we will be exploring the Quest 3 development tools, including deploying from Unity. Today, I'd like to share what I've learned and my takeaways from this testing experience.
📚 Quest 3 Video Chapters:
00:00 - 00:27 - Quest 3 video introduction
00:27 - 01:57 - Testing Quest 3 First Encounters mixed reality demo
01:57 - 03:48 - Testing Quest 3 passthrough quality with a few objects
03:48 - 04:55 - Testing Quest 3 with Cubism mixed reality & hand tracking
04:55 - 06:09 - Testing Quest 3 with Immersed
06:09 - 07:06 - Opening the Quest 3 headset and Quest 3 accessories
07:06 - 09:16 - Quest 3 specifications
09:16 - 11:50 - Quest 3 development setup and deploying your first Quest 3 Unity App
11:50 - 12:26 - Comparing Quest 3 passthrough quality with Quest 2 and Quest Pro
12:26 - 13:25 - My overall takeaways about the Quest 3 device
💡 Recommended Oculus link cable:
amzn.to/3rSLzF7 (affiliate link)
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#quest3 #mixedreality #unity
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
📌 This video covers additional visionOS SDK topics including:
- Structure of RealityViews including Update, Placeholder, and Attachments functions.
- Adding a Swift extension method to provide image based lights and image based lights receivers to loaded entities.
- Adding an immersive space of type mixed in addition to existing volumetric and full views created in the previous video.
- Adding an Orbit System and Orbit Component for circular movement applied to SpaceX capsule.
- Using the Preview tag for rapid development during System and Component testing.
Here're the visionOS tutorial project requirements:
- Xcode Version 15 beta 8 or greater
- visionOS Version 1 beta 3 Simulator Runtime or greater
- (This is bundled with Xcode) Reality Composer Pro Version 1.0 (393.3) or greater
📣 Full project source code available via GitHub: github.com/dilmerv/VisionOSInspiration4
📢 Download VisionOS SDK From Apple Developer Portal:
developer.apple.com/visionos
📌 Sketchfab 3d models used today and links for attributions:
- SpaceX Dragon 2 exterior: sketchfab.com/3d-models/spacex-dragon-2-exterior-2575398db20c406cab2cf72b89a9be8b
- SpaceX Falcon 9 rocket: sketchfab.com/3d-models/falcon-9-spacex-rocket-58784d6b55ad47d2985f353459759f06
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#visionOS #swiftui #visionpro
❤️ Support on Patreon: patreon.com/dilmerv
🔔 Subscribe for more XR Tutorials : youtube.com/@dilmerv?sub_confirmation=1
🐦 Twitter X: twitter.com/dilmerv
👥 Discord : discord.gg/dNMHBc8KdP
📸 Instagram : instagram.com/dilmerv
This video includes discussing all the dependencies, developer tools, and environment configurations necessary for integrating the NEW Magic Leap 2 Unreal Plugin.
📚 Magic Leap UE5 Plugin Video Chapters:
00:00 - 00:40 - Unreal 5 compile from source with or without ML2
00:40 - 01:20 - Requesting permissions to Unreal Engine GitHub repository
01:20 - 02:14 - Magic Leap 2 Hub installation, Magic Leap Unreal SDK, and Magic Leap Native C SDK
02:14 - 03:45 - Magic Leap 2 Android dependencies setup
03:45 - 05:10 - Compiling and building Unreal Engine 5 from source
05:10 - 10:39 - Magic Leap 2 UE5 project setup (camera / capsule collisions)
10:39 - 15:03 - Adding UE5 Magic Leap 2 controller support
15:03 - 15:43 - Player character animations with ML2 controller inputs
15:43 - 16:16 - Project summary and ML2 dev video recommendation
📙 Magic Leap UE5 Dev Resources:
https://developer-docs.magicleap.cloud/docs/guides/unreal/unreal-overview
Also huge thanks to @MagicLeap for sponsoring this ML2 video!
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unrealengine5 #mixedreality #magicleap