AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shi, Ruijie, Zhang, Houbin, Han, Yuecheng, Wang, Yuheng, Fan, Jingru, Yang, Runde, Dang, Yufan, Li, Huatao, Liu, Dewen, Cheng, Yuan, Qian, Chen
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914526856740864
author Shi, Ruijie
Zhang, Houbin
Han, Yuecheng
Wang, Yuheng
Fan, Jingru
Yang, Runde
Dang, Yufan
Li, Huatao
Liu, Dewen
Cheng, Yuan
Qian, Chen
author_facet Shi, Ruijie
Zhang, Houbin
Han, Yuecheng
Wang, Yuheng
Fan, Jingru
Yang, Runde
Dang, Yufan
Li, Huatao
Liu, Dewen
Cheng, Yuan
Qian, Chen
contents Large Language Models have shown strong capabilities in complex problem solving, yet many agentic systems remain difficult to interpret and control due to opaque internal workflows. While some frameworks offer explicit architectures for collaboration, many deployed agentic systems operate as black boxes to users. We address this by introducing Agentic Workflow Reconstruction (AWR), a new task aiming to synthesize an explicit, interpretable stand-in workflow that approximates a black-box system using only input-output access. We propose AgentXRay, a search-based framework that formulates AWR as a combinatorial optimization problem over discrete agent roles and tool invocations in a chain-structured workflow space. Unlike model distillation, AgentXRay produces editable white-box workflows that match target outputs under an observable, output-based proxy metric, without accessing model parameters. To navigate the vast search space, AgentXRay employs Monte Carlo Tree Search enhanced by a scoring-based Red-Black Pruning mechanism, which dynamically integrates proxy quality with search depth. Experiments across diverse domains demonstrate that AgentXRay achieves higher proxy similarity and reduces token consumption compared to unpruned search, enabling deeper workflow exploration under fixed iteration budgets.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05353
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
Shi, Ruijie
Zhang, Houbin
Han, Yuecheng
Wang, Yuheng
Fan, Jingru
Yang, Runde
Dang, Yufan
Li, Huatao
Liu, Dewen
Cheng, Yuan
Qian, Chen
Artificial Intelligence
Computation and Language
Large Language Models have shown strong capabilities in complex problem solving, yet many agentic systems remain difficult to interpret and control due to opaque internal workflows. While some frameworks offer explicit architectures for collaboration, many deployed agentic systems operate as black boxes to users. We address this by introducing Agentic Workflow Reconstruction (AWR), a new task aiming to synthesize an explicit, interpretable stand-in workflow that approximates a black-box system using only input-output access. We propose AgentXRay, a search-based framework that formulates AWR as a combinatorial optimization problem over discrete agent roles and tool invocations in a chain-structured workflow space. Unlike model distillation, AgentXRay produces editable white-box workflows that match target outputs under an observable, output-based proxy metric, without accessing model parameters. To navigate the vast search space, AgentXRay employs Monte Carlo Tree Search enhanced by a scoring-based Red-Black Pruning mechanism, which dynamically integrates proxy quality with search depth. Experiments across diverse domains demonstrate that AgentXRay achieves higher proxy similarity and reduces token consumption compared to unpruned search, enabling deeper workflow exploration under fixed iteration budgets.
title AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2602.05353