How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910019970138112 |
|---|---|
| author | Feng, Sidong Chen, Chunyang |
| author_facet | Feng, Sidong Chen, Chunyang |
| contents | GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is described with radically different degrees of autonomy, obscuring capability, responsibility and risk. We call for conceptual clarity through GUI Agent Autonomy Levels (GAL), a six-level framework that makes autonomy explicit and helps benchmark progress toward trustworthy software interaction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_11514 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction Feng, Sidong Chen, Chunyang Software Engineering Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is described with radically different degrees of autonomy, obscuring capability, responsibility and risk. We call for conceptual clarity through GUI Agent Autonomy Levels (GAL), a six-level framework that makes autonomy explicit and helps benchmark progress toward trustworthy software interaction. |
| title | How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction |
| topic | Software Engineering Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.11514 |