Cover Image

ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Yuanbo, Tang, Huaze, Cao, Tingyu, Nguyen, Lam, Zhang, Anping, Cao, Xinwen, Liu, Chunkang, Ding, Wenbo, Li, Yang
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ProAgent: Harnessing On-Demand Sensory Contexts for Proactive LLM Agent Systems in the Wild
by: Yang, Bufang, et al.
Published: (2025)

ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agent
by: Zhao, Yuheng, et al.
Published: (2025)

Reframe Anything: LLM Agent for Open World Video Reframing
by: Cao, Jiawang, et al.
Published: (2024)

ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptions
by: Yang, Bufang, et al.
Published: (2025)

DataScout: Automatic Data Fact Retrieval for Statement Augmentation with an LLM-Based Agent
by: Chen, Chuer, et al.
Published: (2025)

SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents
by: Ai, Kuangshi, et al.
Published: (2026)

Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents
by: Lee, Geonsun, et al.
Published: (2025)

FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM Agents
by: Yang, Qinglong, et al.
Published: (2025)

ArticulatePro: A Comparative Study on a Proactive and Non-Proactive Assistant in a Climate Data Exploration Task
by: Tabalba, Roderick, et al.
Published: (2024)

In-Browser Agents for Search Assistance
by: Zerhoudi, Saber, et al.
Published: (2026)

Pro$^2$Assist: Continuous Step-Aware Proactive Assistance with Multimodal Egocentric Perception for Long-Horizon Procedural Tasks
by: Xu, Lilin, et al.
Published: (2026)

ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi-Modal Wearable Devices
by: Pu, Kevin, et al.
Published: (2025)

Comparing Perceptions of Static and Adaptive Proactive Speech Agents
by: Edwards, Justin, et al.
Published: (2024)

ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agents
by: Liu, Tianjian, et al.
Published: (2025)

MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents
by: Wang, Luyuan, et al.
Published: (2024)

Proactive Conversational Agents with Inner Thoughts
by: Liu, Xingyu Bruce, et al.
Published: (2024)

LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?
by: Sun, Lu, et al.
Published: (2025)

"Shall We Dig Deeper?": Designing and Evaluating Strategies for LLM Agents to Advance Knowledge Co-Construction in Asynchronous Online Discussions
by: Zhang, Yuanhao, et al.
Published: (2025)

PACT: Proactive Asking for Continual Task Assistance in Human-Robot Collaboration
by: He, Chengbo, et al.
Published: (2026)

ComPeer: A Generative Conversational Agent for Proactive Peer Support
by: Liu, Tianjian, et al.
Published: (2024)

Can Virtual Agents Care? Designing an Empathetic and Personalized LLM-Driven Conversational Agent
by: Toan, Truong Le Minh, et al.
Published: (2026)

SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents
by: Guo, Longjie, et al.
Published: (2025)

PRISM: Festina Lente Proactivity -- Risk-Sensitive, Uncertainty-Aware Deliberation for Proactive Agents
by: Fu, Yuxuan, et al.
Published: (2026)

An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling
by: Wu, Lixiu, et al.
Published: (2024)

VTutor: An Animated Pedagogical Agent SDK that Provide Real Time Multi-Model Feedback
by: Chen, Eason, et al.
Published: (2025)

Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformation
by: Hao, Pan, et al.
Published: (2026)

From Tool to Teammate: LLM Coding Agents as Collaborative Partners for Behavioral Labeling in Educational Dialogue Analysis
by: Chen, Eason, et al.
Published: (2026)

Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support
by: Pu, Kevin, et al.
Published: (2025)

LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing
by: Wang, Bryan, et al.
Published: (2024)

(Computer) Vision in Action: Comparing Remote Sighted Assistance and a Multimodal Voice Agent in Inspection Sequences
by: Rudaz, Damien, et al.
Published: (2026)

CaseMaster: Designing and Evaluating a Probe for Oral Case Presentation Training with LLM Assistance
by: Ouyang, Yang, et al.
Published: (2026)

Exploring The Impact Of Proactive Generative AI Agent Roles In Time-Sensitive Collaborative Problem-Solving Tasks
by: Mukhopadhyay, Anirban, et al.
Published: (2026)

Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?
by: Liu, Xiaoze, et al.
Published: (2026)

Towards Human-centered Proactive Conversational Agents
by: Deng, Yang, et al.
Published: (2024)

How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessions
by: Tang, Ningzhi, et al.
Published: (2026)

Simulating Classroom Education with LLM-Empowered Agents
by: Zhang, Zheyuan, et al.
Published: (2024)

"Having Lunch Now": Understanding How Users Engage with a Proactive Agent for Daily Planning and Self-Reflection
by: Abbas, Adnan, et al.
Published: (2025)

Revolutionizing Mental Health Support: An Innovative Affective Mobile Framework for Dynamic, Proactive, and Context-Adaptive Conversational Agents
by: Islam, Rahul, et al.
Published: (2024)

Sharing Construction Safety Inspection Experiences and Site-Specific Knowledge through XR-Augmented Visual Assistance
by: Liu, Pengkun, et al.
Published: (2022)

Characterizing Data Scientists in the Real World
by: Pereira, Paula, et al.
Published: (2024)