How to Add LLMs to VR Apps with AI Building Blocks @dilmerv
How to Add LLMs to VR Apps with AI Building Blocks  @dilmerv
Uploaded January 2026 | Updated November 2026, 3 hours ago
Today, I’ll show you how to use LLMs in Unity with AI Building Blocks, powered by AI features available in Meta SDKs v83 and later. In the previous video, we configured object detection using both on-device and cloud inference for context-aware experiences. Now we’ll focus on conversational AI, using multimodal prompts, text, images, and video, to create more intelligent and interactive XR applications.

πŸ“Œ The project shown today is available on GitHub: github.com/dilmerv/AIBuildingBlocksDemos

πŸ“š AI Building Blocks Video Chapters:
00:00 AI Building Blocks (Large Language Models) Video Overview
00:45 Adding and configuring the LLMs Building Block
11:45 Demo showcasing testing LLMs Building Block with the LLM Agent Helper
15:12 Reviewing LLM Agent features while debugging with Rider
20:36 Demo showcasing testing Large Language Models with Immersive Debugger
22:57 Adding Passthrough Building Block
24:32 Setting Up a LLMs with Multimodal support
32:29 Creating a custom UI that utilizes LLM features
49:30 Demo showcasing the Custom UI with LLM features to request details about the captured Passthrough Image
51:14 Outro

πŸ”” Subscribe for more XR + AI Tutorials: youtube.com/@dilmerv
πŸ”— X : https://x.com/dilmerv
πŸ‘₯ Discord : discord.gg/dNMHBc8KdP
πŸ“Έ Instagram : tiktok.com/@dilmerval

πŸ₯½ Learn & Get my XR Courses from:
learnxr.io

πŸ‘‰ My Blog / πŸ”₯ Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io

#unity #meta #ai
How to Add LLMs to VR Apps with AI Building BlocksMagic Leap 2 AR Glasses Final Box And Hardware #ShortsBuilding A Mixed Reality Tabletop Game FAST - Quest 3 & Presence Platform!AI Building Blocks Just Changed How We Build VR/MR Apps (Object Detection)Unity XR Hands Custom Gestures Tools Are Here!AR Glasses Magic Leap 2 Through The Glasses Footage !Lens Studio Tutorial: How To Create AR ExperiencesGet Ahead of the Game: AR/VR Development With My New XR Courses !Programming In Virtual Reality With Immersed For Oculus Quest ! #ShortsAugmented Reality Glasses: XREAL Air 2 Pro With Beam Pro In-Depth ReviewNEW Interaction SDK Features Are HERE! Hands Locomotion & MORE!How To GET Advanced VR & AR Player Data With Cognitive3D Analytics
Dilmer Valecillos |

How to Add LLMs to VR Apps with AI Building Blocks

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER