Uploaded July 2025 | Updated September 2026, 2 weeks ago
Explore how to construct, evaluate, and monitor agentic AI workflows using W&B Weave in this comprehensive demo. Karan and Nico guide you through the development of a Hiring Assistant that assesses candidate applications for interview suitability.
-Advanced tracing of agentic workflow with hallucination guardrail - self-reflection or human-in-the-loop interaction for hallucinated decision reasoning
-In-depth evaluation on quantitative and qualitative scores based on deterministic scorers and LLM judges
-First part of a series on building an E2E Hiring Agent with consideration of the EU AI Act (incl. Fine-tuning of open-source models). Explore the public project, full code, and *EU AI Act whitepaper here:* wandb.ai/wandb-smle/hiring-agent-demo-public/reports/Hiring-Agent-E2E-AI-Evaluation-for-Fair-Auditable-Hiring-Decisions--VmlldzoxMjI0MjI0Mw
⏳Timestamps:
0:00 Introduction to Hiring Agent AI system
2:40 Demo: Hiring Agent prototype in action
4:47 Tracing AI Application with W&B Weave
14:15 Human-in-the-Loop: Expert Annotator View
17:05 Debugging AI Agents with the Weave Playground
24:31 Evaluate AI Agents in Weave
25:45 Quantitative Benchmark: Diving into Evaluation Results
29:15 Qualitative Drill-down: Reviewing Model Outputs
43:33 Conclusion and invitation to Explore W&B Weave
Explore how to construct, evaluate, and monitor agentic AI workflows using W&B Weave in this comprehensive demo. Karan and Nico guide you through the development of a Hiring Assistant that assesses candidate applications for interview suitability.
-Advanced tracing of agentic workflow with hallucination guardrail - self-reflection or human-in-the-loop interaction for hallucinated decision reasoning
-In-depth evaluation on quantitative and qualitative scores based on deterministic scorers and LLM judges
-First part of a series on building an E2E Hiring Agent with consideration of the EU AI Act (incl. Fine-tuning of open-source models). Explore the public project, full code, and *EU AI Act whitepaper here:* wandb.ai/wandb-smle/hiring-agent-demo-public/reports/Hiring-Agent-E2E-AI-Evaluation-for-Fair-Auditable-Hiring-Decisions--VmlldzoxMjI0MjI0Mw
⏳Timestamps:
0:00 Introduction to Hiring Agent AI system
2:40 Demo: Hiring Agent prototype in action
4:47 Tracing AI Application with W&B Weave
14:15 Human-in-the-Loop: Expert Annotator View
17:05 Debugging AI Agents with the Weave Playground
24:31 Evaluate AI Agents in Weave
25:45 Quantitative Benchmark: Diving into Evaluation Results
29:15 Qualitative Drill-down: Reviewing Model Outputs
43:33 Conclusion and invitation to Explore W&B Weave
