ROAD: Debugging for Zero-Shot LLM Agent Alignment

This paper introduces ROAD, a novel framework for optimizing LLM agents without relying on large, labeled datasets. It frames optimization as a debugging process, using a multi-agent architecture to analyze failures and improve performance. The approach is particularly relevant for real-world scenarios where curated datasets are scarce, offering a more data-efficient alternative to traditional methods like RL.

• •ROAD optimizes LLM agents through a debugging-focused approach, bypassing the need for large labeled datasets.
• •The framework uses a multi-agent architecture (Analyzer, Optimizer, Coach) to analyze failures and generate Decision Tree Protocols.
• •ROAD demonstrates improved performance on both academic benchmarks and real-world applications.
• •The method is sample-efficient, achieving significant performance gains within a few iterations.