Dilmer Valecillos | ARCore Scene Semantics API For Unity Is Now Available! @dilmerv | Uploaded May 2023 | Updated October 2024, 4 hours ago.
In today's XR video, we will look at a NEW Google feature for Augmented Reality called Scene Semantics API, which is now part of ARCore Extensions for Unity. The Scene Semantics feature provides AR developers with a machine learning model for real-time semantic information.
💡 The API returns a label for each pixel across a set of useful semantic classes, such as sky, building, tree, road, sidewalk, vehicle, person, and more. In addition to pixel labels, this ARCore feature also offers confidence values for each pixel label and an easy-to-use way to query the confidence value of a given label.
📚 ARCore Scene Semantics For Unity Chapters:
00:03 - Google's ARCore Scene Semantics Introduction
00:17 - Scene Semantics Labels Demos (Sky, Terrains, Vehicles, Person, etc)
00:52 - Creating a brand new Unity scene with ARCore and Scene Semantics
03:50 - Adding a new "Overlay" Semantics Camera for Semantic Images Rendering
07:47 - Adding SemanticsUI to control semantic options
10:05 - AR Semantic Images Manager (Inspector Options Overview)
13:39 - Implementing AR Semantic Images Manager (Semantic Feature Methods)
25:57 - Scene Semantics Unity Demo running on Android
27:31 - What devices are supported with ARCore Scene Semantics?
📢 Watch the previous video on ARCore Streetscape Geometry API from:
youtu.be/nbH36I18UO8
📙 Resources used or mentioned on the video:
- Geospatial Unity Demo Project shown on this video can be downloaded from:
github.com/dilmerv/GeospatialCreatorDemos
- ARCore scene semantics documentation:
developers.google.com/ar/develop/scene-semantics
- Lightship ARDK semantic segmentation (for iOS and Android):
https://lightship.dev/docs/ardk/context_awareness/semantic_segmentation/semantics.html
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#arcore #metaverse #unity #xr
In today's XR video, we will look at a NEW Google feature for Augmented Reality called Scene Semantics API, which is now part of ARCore Extensions for Unity. The Scene Semantics feature provides AR developers with a machine learning model for real-time semantic information.
💡 The API returns a label for each pixel across a set of useful semantic classes, such as sky, building, tree, road, sidewalk, vehicle, person, and more. In addition to pixel labels, this ARCore feature also offers confidence values for each pixel label and an easy-to-use way to query the confidence value of a given label.
📚 ARCore Scene Semantics For Unity Chapters:
00:03 - Google's ARCore Scene Semantics Introduction
00:17 - Scene Semantics Labels Demos (Sky, Terrains, Vehicles, Person, etc)
00:52 - Creating a brand new Unity scene with ARCore and Scene Semantics
03:50 - Adding a new "Overlay" Semantics Camera for Semantic Images Rendering
07:47 - Adding SemanticsUI to control semantic options
10:05 - AR Semantic Images Manager (Inspector Options Overview)
13:39 - Implementing AR Semantic Images Manager (Semantic Feature Methods)
25:57 - Scene Semantics Unity Demo running on Android
27:31 - What devices are supported with ARCore Scene Semantics?
📢 Watch the previous video on ARCore Streetscape Geometry API from:
youtu.be/nbH36I18UO8
📙 Resources used or mentioned on the video:
- Geospatial Unity Demo Project shown on this video can be downloaded from:
github.com/dilmerv/GeospatialCreatorDemos
- ARCore scene semantics documentation:
developers.google.com/ar/develop/scene-semantics
- Lightship ARDK semantic segmentation (for iOS and Android):
https://lightship.dev/docs/ardk/context_awareness/semantic_segmentation/semantics.html
📌 Support me by Subscribing to avoid missing future videos!
youtube.com/@dilmerv
📣 Consider becoming a Patreon today:
patreon.com/dilmerv and GET MY “Full Source Code” Tier
💡 What do you get from Patreon ?
👉 Access to this video GitHub repo + all code I work on for each video
👉 Access to special Patreon discord group where I can answer questions
📌 Get XR & game development tips from me in Twitter
twitter.com/dilmerv
🥽 Learn & Get my XR Training from:
learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#arcore #metaverse #unity #xr
