Vending-Bench: Testing long-term coherence in agents 
We present Vending-Bench - a simulated environment that tests how well AI models can manage a simple but long-running business scenario: operating a vending machine.
Publications
Vending-Bench: Testing long-term coherence in agents
From Text to Action: Future-Proofing Evaluations of LLMs' Agentic Capabilities for Social Impact
Through a case study of AI-generated deepfake audio, we demonstrate the need for robust evaluation methods to ensure safe and responsible development of agentic AI systems.