Modeling Distinct Human Interaction in Web Agents
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910275040444416 |
|---|---|
| author | Huq, Faria Wang, Zora Zhiruo Guo, Zhanqiu Arangarajan, Venu Arvind Ou, Tianyue Xu, Frank Zhou, Shuyan Neubig, Graham Bigham, Jeffrey P. |
| author_facet | Huq, Faria Wang, Zora Zhiruo Guo, Zhanqiu Arangarajan, Venu Arvind Ou, Tianyue Xu, Frank Zhou, Shuyan Neubig, Graham Bigham, Jeffrey P. |
| contents | Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why humans intervene, often proceeding autonomously past critical decision points or requesting unnecessary confirmation. In this work, we introduce the task of modeling human intervention to support collaborative web task execution. We collect CowCorpus, a dataset of 400 real-user web navigation trajectories containing over 4,200 interleaved human and agent actions. We identify four distinct patterns of user interaction with agents -- hands-off supervision, hands-on oversight, collaborative task-solving, and full user takeover. Leveraging these insights, we train language models (LMs) to anticipate when users are likely to intervene based on their interaction styles, yielding a 61.4-63.4% improvement in intervention prediction accuracy over base LMs. Finally, we deploy these intervention-aware models in live web navigation agents and evaluate them in a user study, finding a 36.8% increase in user-rated agent usefulness. Together, our results show structured modeling of human intervention leads to more adaptive, collaborative agents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_17588 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Modeling Distinct Human Interaction in Web Agents Huq, Faria Wang, Zora Zhiruo Guo, Zhanqiu Arangarajan, Venu Arvind Ou, Tianyue Xu, Frank Zhou, Shuyan Neubig, Graham Bigham, Jeffrey P. Computation and Language Human-Computer Interaction Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why humans intervene, often proceeding autonomously past critical decision points or requesting unnecessary confirmation. In this work, we introduce the task of modeling human intervention to support collaborative web task execution. We collect CowCorpus, a dataset of 400 real-user web navigation trajectories containing over 4,200 interleaved human and agent actions. We identify four distinct patterns of user interaction with agents -- hands-off supervision, hands-on oversight, collaborative task-solving, and full user takeover. Leveraging these insights, we train language models (LMs) to anticipate when users are likely to intervene based on their interaction styles, yielding a 61.4-63.4% improvement in intervention prediction accuracy over base LMs. Finally, we deploy these intervention-aware models in live web navigation agents and evaluate them in a user study, finding a 36.8% increase in user-rated agent usefulness. Together, our results show structured modeling of human intervention leads to more adaptive, collaborative agents. |
| title | Modeling Distinct Human Interaction in Web Agents |
| topic | Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.17588 |