SynthAgent: Adapting Web Agents with Synthetic Supervision
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917400790695936 |
|---|---|
| author | Wang, Zhaoyang Liang, Yiming Zhang, Xuchao Wu, Qianhui Han, Siwei Bastos, Anson Wang, Rujia Bansal, Chetan Peng, Baolin Gao, Jianfeng Rajmohan, Saravan Yao, Huaxiu |
| author_facet | Wang, Zhaoyang Liang, Yiming Zhang, Xuchao Wu, Qianhui Han, Siwei Bastos, Anson Wang, Rujia Bansal, Chetan Peng, Baolin Gao, Jianfeng Rajmohan, Saravan Yao, Huaxiu |
| contents | Web agents struggle to adapt to new websites due to the scarcity of environment specific tasks and demonstrations. Recent works have explored synthetic data generation to address this challenge, however, they suffer from data quality issues where synthesized tasks contain hallucinations that cannot be executed, and collected trajectories are noisy with redundant or misaligned actions. In this paper, we propose SynthAgent, a fully synthetic supervision framework that aims at improving synthetic data quality via dual refinement of both tasks and trajectories. Our approach begins by synthesizing diverse tasks through categorized exploration of web elements, ensuring efficient coverage of the target environment. During trajectory collection, tasks are refined only when conflicts with observations are detected, which mitigates hallucinations while preserving task consistency. After collection, we conduct trajectory refinement with global context to mitigate potential noise or misalignments. Finally, we fine-tune open-source web agents on the refined synthetic data to adapt them to the target environment. Experimental results demonstrate that SynthAgent outperforms existing synthetic data methods, validating the importance of high-quality synthetic supervision. The code is publicly available at https://github.com/aiming-lab/SynthAgent. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_06101 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SynthAgent: Adapting Web Agents with Synthetic Supervision Wang, Zhaoyang Liang, Yiming Zhang, Xuchao Wu, Qianhui Han, Siwei Bastos, Anson Wang, Rujia Bansal, Chetan Peng, Baolin Gao, Jianfeng Rajmohan, Saravan Yao, Huaxiu Machine Learning Artificial Intelligence Computation and Language Web agents struggle to adapt to new websites due to the scarcity of environment specific tasks and demonstrations. Recent works have explored synthetic data generation to address this challenge, however, they suffer from data quality issues where synthesized tasks contain hallucinations that cannot be executed, and collected trajectories are noisy with redundant or misaligned actions. In this paper, we propose SynthAgent, a fully synthetic supervision framework that aims at improving synthetic data quality via dual refinement of both tasks and trajectories. Our approach begins by synthesizing diverse tasks through categorized exploration of web elements, ensuring efficient coverage of the target environment. During trajectory collection, tasks are refined only when conflicts with observations are detected, which mitigates hallucinations while preserving task consistency. After collection, we conduct trajectory refinement with global context to mitigate potential noise or misalignments. Finally, we fine-tune open-source web agents on the refined synthetic data to adapt them to the target environment. Experimental results demonstrate that SynthAgent outperforms existing synthetic data methods, validating the importance of high-quality synthetic supervision. The code is publicly available at https://github.com/aiming-lab/SynthAgent. |
| title | SynthAgent: Adapting Web Agents with Synthetic Supervision |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2511.06101 |