Un-observable AI is un-trustworthy AI  by  Annie Freeman @DevoxxForever
Un-observable AI is un-trustworthy AI  by  Annie Freeman  @DevoxxForever
Uploaded April 2026 | Updated September 2026, 2 weeks ago
Please subscribe to our YouTube channel @ youtube.com/@DevoxxForever
Subscribe to LinkedIn @ linkedin.com/company/voxxed-days-amsterdam
Follow us on Twitter @ twitter.com/voxxedamsterdam

As more AI systems move into production, ensuring models are responsible, ethical, and sustainable becomes critical. This talk explores how observability can help teams build AI systems they can actually trust.

For the last few years, I’ve been driven by the question: what responsibility do we have for the software we put into the world? That question originally led me to focus on reducing the environmental impact of software. Now, as teams deploy inference-heavy LLM workloads into production, it’s become even more pressing.

Using LLMs at scale raises serious questions around energy usage, cost, and ethics. A Gartner report predicts that 40% of agentic AI projects will be canceled by the end of 2027 due to escalating costs and unclear business value. How much of that comes down to a lack of visibility into how these systems behave once they’re live?

So how do you build trust in AI systems? How do you detect drift toward bias or toxicity? How do you understand the real resource cost and carbon footprint of inference at scale? And once you do have visibility, how do you turn it into meaningful guardrails?

In this talk, we’ll look at
Why traditional monitoring falls short for AI,
Which signals actually matter for responsible systems,
How to instrument AI workloads with OpenTelemetry,
How to use telemetry data to implement guardrails that improve trust, sustainability, and reliability in production AI.
Un-observable AI is un-trustworthy AI  by  Annie FreemanWelcome to Voxxed Days Amsterdam 2026 - Opening (room 1)[VDBUH2026] Andrei Mihai & Bianca Bulbuc - How Agentic AI Empowers Creative ThinkingDistributed Systems - What Can Go Wrong and How to Get It Right by Florian MairWhy Hexagonal and Onion Architecture Are Answers to The Wrong Question by Oliver Drotbohm[VDBUH2026] George Patrașcu - Ports, Adapters, and Other Ways to Stop Breaking Your Business LogicSupercharge your JVM performance with Project Leyden and Spring Boot by  Moritz HalbritterDebugging Your Health: Fitness for Desk Warriors by Radek KargulDevoxx 2008 RoxorLoops + Welcome by Stephan #BlastFromThePastHow to Write Bad Java Code by Pratik PatelPossessed by Packages: Is Your JavaScript Haunted? by Chris DeMarsAgentic AI Patterns by Kevin Dubois
Devoxx |

Un-observable AI is un-trustworthy AI  by Annie Freeman

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER