ANCHOR: Branch-Point Data Generation for GUI Agents

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wei, Jinbiao, Zhao, Yilun, Ni, Kangqi, Cohan, Arman
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914465638776832
author Wei, Jinbiao
Zhao, Yilun
Ni, Kangqi
Cohan, Arman
author_facet Wei, Jinbiao
Zhao, Yilun
Ni, Kangqi
Cohan, Arman
contents End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy, goal-drifting trajectories. We present a trajectory expansion framework Anchor that bootstraps scalable desktop supervision from a small set of verified seed demonstrations. Starting from each seed, we identify branch points that correspond to meaningful state changes and propose new, state-grounded task variants conditioned on the current GUI context. An executing agent then follows the proposed instructions to generate new trajectories, while a verifier enforces task completion via state-aware checks and trajectory-level consistency. To improve supervision quality, we further apply task-conditioned step-level filtering to remove ungrounded actions and denoise post-branch segments to maintain coherent intent. Experiments on standard desktop benchmarks, OSWorld and WindowsAgentArena, show that models fine-tuned on our expanded corpus achieve consistent improvements over zero-shot agents and representative synthesis baselines, and generalize across applications and operating systems.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07153
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ANCHOR: Branch-Point Data Generation for GUI Agents
Wei, Jinbiao
Zhao, Yilun
Ni, Kangqi
Cohan, Arman
Artificial Intelligence
End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy, goal-drifting trajectories. We present a trajectory expansion framework Anchor that bootstraps scalable desktop supervision from a small set of verified seed demonstrations. Starting from each seed, we identify branch points that correspond to meaningful state changes and propose new, state-grounded task variants conditioned on the current GUI context. An executing agent then follows the proposed instructions to generate new trajectories, while a verifier enforces task completion via state-aware checks and trajectory-level consistency. To improve supervision quality, we further apply task-conditioned step-level filtering to remove ungrounded actions and denoise post-branch segments to maintain coherent intent. Experiments on standard desktop benchmarks, OSWorld and WindowsAgentArena, show that models fine-tuned on our expanded corpus achieve consistent improvements over zero-shot agents and representative synthesis baselines, and generalize across applications and operating systems.
title ANCHOR: Branch-Point Data Generation for GUI Agents
topic Artificial Intelligence
url https://arxiv.org/abs/2602.07153