Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.13060 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912832215318528 |
|---|---|
| author | Li, Zecheng Cao, Zhihui Huang, Wenke Zhang, Yudong Qi, Keying Wang, Rui Zheng, Zeyu Zhao, Jian Zhu, Hao Wu, Hengxin Wang, Yuran Fan, Guitao Wu, Guokun Liu, Yicong Gao, Zhilin Xu, Haikun Yang, He Xiang, Minqi Liu, Xingyu Wang, Zuojian |
| author_facet | Li, Zecheng Cao, Zhihui Huang, Wenke Zhang, Yudong Qi, Keying Wang, Rui Zheng, Zeyu Zhao, Jian Zhu, Hao Wu, Hengxin Wang, Yuran Fan, Guitao Wu, Guokun Liu, Yicong Gao, Zhilin Xu, Haikun Yang, He Xiang, Minqi Liu, Xingyu Wang, Zuojian |
| contents | Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent trajectories and generating high-quality training data at scale to enable continual improvement. Existing approaches often depend on manual annotation or static rule-based verification, which restricts scalability and limits adaptability in dynamic environments. We present MagicGUI-RMS, a multi-agent reward model system that delivers adaptive trajectory evaluation, corrective feedback, and self-evolving learning capabilities. MagicGUI-RMS integrates a Domain-Specific Reward Model (DS-RM) with a General-Purpose Reward Model (GP-RM), enabling fine-grained action assessment and robust generalization across heterogeneous GUI tasks. To support reward learning at scale, we design a structured data construction pipeline that automatically produces balanced and diverse reward datasets, effectively reducing annotation costs while maintaining sample fidelity. During execution, the reward model system identifies erroneous actions, proposes refined alternatives, and continuously enhances agent behavior through an automated data-reflux mechanism. Extensive experiments demonstrate that MagicGUI-RMS yields substantial gains in task accuracy, behavioral robustness. These results establish MagicGUI-RMS as a principled and effective foundation for building self-improving GUI agents driven by reward-based adaptation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_13060 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux Li, Zecheng Cao, Zhihui Huang, Wenke Zhang, Yudong Qi, Keying Wang, Rui Zheng, Zeyu Zhao, Jian Zhu, Hao Wu, Hengxin Wang, Yuran Fan, Guitao Wu, Guokun Liu, Yicong Gao, Zhilin Xu, Haikun Yang, He Xiang, Minqi Liu, Xingyu Wang, Zuojian Artificial Intelligence Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent trajectories and generating high-quality training data at scale to enable continual improvement. Existing approaches often depend on manual annotation or static rule-based verification, which restricts scalability and limits adaptability in dynamic environments. We present MagicGUI-RMS, a multi-agent reward model system that delivers adaptive trajectory evaluation, corrective feedback, and self-evolving learning capabilities. MagicGUI-RMS integrates a Domain-Specific Reward Model (DS-RM) with a General-Purpose Reward Model (GP-RM), enabling fine-grained action assessment and robust generalization across heterogeneous GUI tasks. To support reward learning at scale, we design a structured data construction pipeline that automatically produces balanced and diverse reward datasets, effectively reducing annotation costs while maintaining sample fidelity. During execution, the reward model system identifies erroneous actions, proposes refined alternatives, and continuously enhances agent behavior through an automated data-reflux mechanism. Extensive experiments demonstrate that MagicGUI-RMS yields substantial gains in task accuracy, behavioral robustness. These results establish MagicGUI-RMS as a principled and effective foundation for building self-improving GUI agents driven by reward-based adaptation. |
| title | MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2601.13060 |