Uploaded January 2026 | Updated November 2026, 3 hours ago
Today, Iβll show you how to use LLMs in Unity with AI Building Blocks, powered by AI features available in Meta SDKs v83 and later. In the previous video, we configured object detection using both on-device and cloud inference for context-aware experiences. Now weβll focus on conversational AI, using multimodal prompts, text, images, and video, to create more intelligent and interactive XR applications.
π The project shown today is available on GitHub: github.com/dilmerv/AIBuildingBlocksDemos
π AI Building Blocks Video Chapters:
00:00 AI Building Blocks (Large Language Models) Video Overview
00:45 Adding and configuring the LLMs Building Block
11:45 Demo showcasing testing LLMs Building Block with the LLM Agent Helper
15:12 Reviewing LLM Agent features while debugging with Rider
20:36 Demo showcasing testing Large Language Models with Immersive Debugger
22:57 Adding Passthrough Building Block
24:32 Setting Up a LLMs with Multimodal support
32:29 Creating a custom UI that utilizes LLM features
49:30 Demo showcasing the Custom UI with LLM features to request details about the captured Passthrough Image
51:14 Outro
π Subscribe for more XR + AI Tutorials: youtube.com/@dilmerv
π X : https://x.com/dilmerv
π₯ Discord : discord.gg/dNMHBc8KdP
πΈ Instagram : tiktok.com/@dilmerval
π₯½ Learn & Get my XR Courses from:
learnxr.io
π My Blog / π₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #meta #ai
Today, Iβll show you how to use LLMs in Unity with AI Building Blocks, powered by AI features available in Meta SDKs v83 and later. In the previous video, we configured object detection using both on-device and cloud inference for context-aware experiences. Now weβll focus on conversational AI, using multimodal prompts, text, images, and video, to create more intelligent and interactive XR applications.
π The project shown today is available on GitHub: github.com/dilmerv/AIBuildingBlocksDemos
π AI Building Blocks Video Chapters:
00:00 AI Building Blocks (Large Language Models) Video Overview
00:45 Adding and configuring the LLMs Building Block
11:45 Demo showcasing testing LLMs Building Block with the LLM Agent Helper
15:12 Reviewing LLM Agent features while debugging with Rider
20:36 Demo showcasing testing Large Language Models with Immersive Debugger
22:57 Adding Passthrough Building Block
24:32 Setting Up a LLMs with Multimodal support
32:29 Creating a custom UI that utilizes LLM features
49:30 Demo showcasing the Custom UI with LLM features to request details about the captured Passthrough Image
51:14 Outro
π Subscribe for more XR + AI Tutorials: youtube.com/@dilmerv
π X : https://x.com/dilmerv
π₯ Discord : discord.gg/dNMHBc8KdP
πΈ Instagram : tiktok.com/@dilmerval
π₯½ Learn & Get my XR Courses from:
learnxr.io
π My Blog / π₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#unity #meta #ai










