Fixing an Agents SQL Tool Calls with Phoenix and PXI @arizeai
Fixing an Agents SQL Tool Calls with Phoenix and PXI  @arizeai
Uploaded July 2026 | Updated November 2026, 3 hours ago
An agent that writes its own SQL will invent tables that don't exist. The fix could be as simple as including the database's schema in the system prompt. This video shows how to use PXI to run an experiment to find out!

Watch this video to learn:
• When to use a code evaluator instead of an LLM judge (hint: if you can verify it programmatically, do)
• Why both prompts must run on the same model — you're testing the prompt, not the model
• The first rule of failing evals: when an evaluator fails almost everything, suspect the evaluator before the model

#ArizeAI #LLMEvaluation #AgentObservability #Phoenix #PromptEngineering

🎵 Music by Phoenix engineer Tony Powell — check out more of his music at soundcloud.com/cephalization/sets/some-sounds

🔗 Try Phoenix: arize.com/phoenix/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=rnabors
🔔 Subscribe for weekly content on LLMs, agents, and evaluation: youtube.com/@arizeai?sub_confirmation=1
Fixing an Agents SQL Tool Calls with Phoenix and PXILLM-as-a-Judge Evaluation: When To Use Role of COT, Reasoning & ExplanationsMCP vs. the CLI: a head-to-head evaluation of agent tool integration patternsHow AI Agents Will Debug Their Own Production CodeThe Model Knew What to Say. The Harness Failed. | Rise of the AI Engineer | Laurie VossAI Agents Need Specs, Not Prompts | George Zhang, OpenClaw | Arize Observe 2026AI Agents Certification Course: Lab 1 and 2 – Base Agent Setup & First Run + ObservabilityHow Startups Slash LLM Token Bills Without Losing QualityThe Return of the Data Scientist in AI Engineering | Hamel Husain | Arize Observe 2026Boost Claude Code performance with prompt learning - optimize your prompts automatically with evalsHow Coinbase Rebuilt Product Development Around AI Agents | Arize Observe 2026Why AI Engineers Are Walking Around With Half-Open Laptops
Arize AI |

Fixing an Agent's SQL Tool Calls with Phoenix and PXI

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER