[Oxford Seminar] Matthew Daggit | Developing support for end-to-end verification of neural AI agents @ToposInstitute
[Oxford Seminar] Matthew Daggit | Developing support for end-to-end verification of neural AI agents  @ToposInstitute
Uploaded May 2025 | Updated September 2026, 2 weeks ago
Oxford Seminar, 1st of May 2025,

Full Title: Developing programming language support for end-to-end verification of neural AI agents

Over the past decade, there has been impressive progress in developing algorithms capable of formally verifying first-order, linear specifications about small-to-medium-sized neural networks. This has opened the door to formally verifying the correctness of neural AI agents operating in complex environments. However, due to the complexity of integrating these verification algorithms with other reasoning tools and the many moving parts involved, deploying them in practice has proven more challenging than anticipated.

In this talk, I will introduce Vehicle, a tool that my collaborators and I have been developing. Vehicle allows users to: (i) write specifications for AI agents in a high-level, domain-specific language; (ii) use these specifications to guide training; (iii) formally verify whether the resulting neural network satisfies the specification; and (iv) export verified specifications to interactive theorem provers where the agents can be reasoned in the context of their environment. In the talk I will highlight how we leverage type theory in unusual ways to improve the user experience, our use of real-valued logic semantics to interpret Boolean specifications, and finally some of the open theoretical challenges in the field.

Links:
github.com/vehicle-lang/vehicle
[Oxford Seminar] Matthew Daggit | Developing support for end-to-end verification of neural AI agents[DOTS Lectures] 6. Categories of Moore Machines[2-torial] Owen tells Tim about elaborators for type theories [2/2][Berkeley Seminar] Aaron Huntley (Topos Institute) | Generalised coproduct completionsSeth Frey: Online communities as model systems for commons governanceBart Jacobs: Update rules of Pearl and Jeffrey[Oxford Seminar] Adrián Puerto Aubel | A glance at Petri net theoryCarl Miller: Graphical Methods in Quantum Cryptography[DOTS Lectures] 2. More categories of systems
Topos Institute |

[Oxford Seminar] Matthew Daggit | Developing support for end-to-end verification of neural AI agents

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER