Uploaded October 2026 | Updated November 2026, 15 hours ago
AI chatbots now handle our banking, healthcare, and support but how do we know they're safe? Unlike traditional software, the same question can get a helpful answer one moment and a wrong, unsafe, or manipulated one the next, and a human tester chatting for an hour barely scratches the surface.
This talk introduces AI SimTest: an engine that uses AI to test AI. It generates hundreds of simulated users, including adversarial ones, runs real conversations against any bot, and judges every response for accuracy, safety, and compliance. We'll show how "AI testing AI" catches failures before real people do.
thoughtworks.com/xconf
AI chatbots now handle our banking, healthcare, and support but how do we know they're safe? Unlike traditional software, the same question can get a helpful answer one moment and a wrong, unsafe, or manipulated one the next, and a human tester chatting for an hour barely scratches the surface.
This talk introduces AI SimTest: an engine that uses AI to test AI. It generates hundreds of simulated users, including adversarial ones, runs real conversations against any bot, and judges every response for accuracy, safety, and compliance. We'll show how "AI testing AI" catches failures before real people do.
thoughtworks.com/xconf










