Interactive Debugging and Steering of Multi-Agent AI Systems
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917946231619584 |
|---|---|
| author | Epperson, Will Bansal, Gagan Dibia, Victor Fourney, Adam Gerrits, Jack Zhu, Erkang Amershi, Saleema |
| author_facet | Epperson, Will Bansal, Gagan Dibia, Victor Fourney, Adam Gerrits, Jack Zhu, Erkang Amershi, Saleema |
| contents | Fully autonomous teams of LLM-powered AI agents are emerging that collaborate to perform complex tasks for users. What challenges do developers face when trying to build and debug these AI agent teams? In formative interviews with five AI agent developers, we identify core challenges: difficulty reviewing long agent conversations to localize errors, lack of support in current tools for interactive debugging, and the need for tool support to iterate on agent configuration. Based on these needs, we developed an interactive multi-agent debugging tool, AGDebugger, with a UI for browsing and sending messages, the ability to edit and reset prior agent messages, and an overview visualization for navigating complex message histories. In a two-part user study with 14 participants, we identify common user strategies for steering agents and highlight the importance of interactive message resets for debugging. Our studies deepen understanding of interfaces for debugging increasingly important agentic workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_02068 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Interactive Debugging and Steering of Multi-Agent AI Systems Epperson, Will Bansal, Gagan Dibia, Victor Fourney, Adam Gerrits, Jack Zhu, Erkang Amershi, Saleema Multiagent Systems Artificial Intelligence Human-Computer Interaction Fully autonomous teams of LLM-powered AI agents are emerging that collaborate to perform complex tasks for users. What challenges do developers face when trying to build and debug these AI agent teams? In formative interviews with five AI agent developers, we identify core challenges: difficulty reviewing long agent conversations to localize errors, lack of support in current tools for interactive debugging, and the need for tool support to iterate on agent configuration. Based on these needs, we developed an interactive multi-agent debugging tool, AGDebugger, with a UI for browsing and sending messages, the ability to edit and reset prior agent messages, and an overview visualization for navigating complex message histories. In a two-part user study with 14 participants, we identify common user strategies for steering agents and highlight the importance of interactive message resets for debugging. Our studies deepen understanding of interfaces for debugging increasingly important agentic workflows. |
| title | Interactive Debugging and Steering of Multi-Agent AI Systems |
| topic | Multiagent Systems Artificial Intelligence Human-Computer Interaction |
| url | https://arxiv.org/abs/2503.02068 |