Automatically Route Every Task to the Right Model with Unity Gateway @Databricks
Automatically Route Every Task to the Right Model with Unity Gateway  @Databricks
Uploaded October 2026 | Updated November 2026, 20 hours ago
Databricks Unity Gateway puts every model behind one governed gateway, and Smart Routing picks the lowest-cost model that can handle each task before your coding agent starts. Small edits go to fast, low-cost models, risky production changes go to frontier models, and nobody has to pick a model by hand.

โฐ Chapters
00:00 - Unity Gateway, Model Choice and Smart Routing Explained
00:54 - AI Spend and a Governed Model with Fallback and Rate Limits
02:02 - MCP Tools, the ug CLI and Agent Configuration
03:07 - Approved Models in Codex and Claude Code
03:50 - Smart Routing in Action: Small Edit vs Production Change
04:48 - Where the Money Goes: Coding Agent Spend in Genie Code

๐Ÿงญ How Smart Routing works
Unity Gateway, formerly Unity AI Gateway, serves frontier models like GPT and Claude next to open-weight models like Kimi K3 and GLM 5.3, so the router has real choice. Before the agent starts, the router reads the task, picks the lowest-cost model that can handle it, and shows its reasoning. If a model returns errors or hits limits, requests fall back to another model automatically, with no code changes. Every model service lives in Unity Catalog, so it gets the same permissions and lineage as your data.

๐Ÿ› ๏ธ What you'll see in the demo
โ€ข Reviewing AI spend in the AI Gateway usage dashboard, where one frontier model, Claude Opus 5.5, takes the biggest share
โ€ข Creating a model service in Unity Catalog with a 50/50 traffic split between Kimi K3 and GPT-6 Astra, and Claude Opus 5.5 as the fallback
โ€ข Setting rate limits of 100 requests and 100,000 tokens per minute for the service, and 20 requests and 20,000 tokens per user
โ€ข Governing the MCP tools agents can call, like Genie, GitHub, Atlassian, and Slack
โ€ข Connecting Claude Code, Codex, Gemini, Copilot, OpenCode, and Pi with the Unity Gateway CLI (ug), and setting each agent's models, Smart Routing, and budget-based smart defaults in Agent Configuration
โ€ข Working with only the models the admin approved in Codex and Claude Code, including open-weight Kimi K3 and GLM 5.3
โ€ข Watching Smart Routing send a one-line edit to GPT-6 Luna and a zero-downtime production migration to GPT-6.1 Sol
โ€ข Asking Genie Code where the money went: Claude Opus 5.5 cost an estimated $133, about 3x Claude Haiku 4.5 for the same token volume, while open-weight models came to under $2

Whether you're a platform team rolling out coding agents, an engineering leader watching the AI bill, or a developer who wants the right model without choosing one for every task, Unity Gateway gives you model choice, governance, and cost control in one place.

๐Ÿ”— Resources
๐Ÿ“˜ Unity Gateway documentation: docs.databricks.com/aws/en/unity-gateway
๐Ÿค– Get started with coding agents: docs.databricks.com/aws/en/ai-gateway/coding-agent-integration
๐Ÿ“‚ Unity Gateway CLI (ug) on GitHub: github.com/databricks/unity-gateway
๐Ÿš€ Databricks Unity Gateway: databricks.com/product/artificial-intelligence/ai-gateway

๐Ÿค Stay connected
Website: databricks.com
Twitter: https://x.com/databricks/
LinkedIn: linkedin.com/company/databricks
Instagram: instagram.com/databricksinc
Facebook: facebook.com/databricksinc
Automatically Route Every Task to the Right Model with Unity Gateway3. What is Databricks Unity AI Gateway and how it worksHow Enterprises Govern AI Agents Across Multiple ModelsDatabricks for Good x MapAid: Creating a Searchable Database for Groundwater DiscoveryHow Getnet Automates Global Financial Operations on DatabricksHow to Go From an Agent Prompt to a Live Databricks App | Databricks Apps DemoAI for Data Intelligence Demo: Real-time fraud Detection with DatabricksHow to write data from Excel to DatabricksHow to Build an AI Security Governance Hub with Agent BricksDemo: Genie Code for Lakeflow Spark Declarative PipelinesAnnouncing CustomerLake: the agentic CDP embedded in DatabricksDatabricks launches across the Data + AI stack in 90 seconds
Databricks |

Automatically Route Every Task to the Right Model with Unity Gateway

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER