Cover Image

HiL-Bench (Human-in-Loop Benchmark): Do Agents Know When to Ask for Help?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Trinh, Tu, Elfeki, Mohamed, Luo, Guangze, Luu, Kelvin, Hunt, Nathan, Hernandez, Ernesto, Marwaha, Nandan, He, Yannis Yiming, Wang, Charles, Carabedo, Fernando, Castillo, Alessa, Liu, Bing
Format:	Preprint
Published:	2026
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

vEDGAR -- Can CARLA Do HiL?
by: Gehrke, Nils, et al.
Published: (2025)

E2HiL: Entropy-Guided Sample Selection for Efficient Real-World Human-in-the-Loop Reinforcement Learning
by: Deng, Haoyuan, et al.
Published: (2026)

HiL Demonstration of Online Battery Capacity and Impedance Estimation with Minimal a Priori Parametrization Effort
by: Beckers, Camiel J. J., et al.
Published: (2024)

Why Ask One When You Can Ask $k$? Learning-to-Defer to the Top-$k$ Experts
by: Montreuil, Yannis, et al.
Published: (2025)

When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification
by: Zhao, Jiale, et al.
Published: (2026)

Knowing When to Ask -- Bridging Large Language Models and Data
by: Radhakrishnan, Prashanth, et al.
Published: (2024)

R2V Agent: Teaching SLMs When to Ask for Help
by: Hemadri, Raghu Vamshi, et al.
Published: (2026)

Knowing When to Ask: Segment-Level Credit Assignment for LLM Tool Use
by: Kumar, Abhijit, et al.
Published: (2026)

When Models Know When They Do Not Know: Calibration, Cascading, and Cleaning
by: Hao, Chenjie, et al.
Published: (2026)

LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?
by: Takehi, Rikiya, et al.
Published: (2024)

What to Do When They Ask for Nancy Drew: A Bibliography.
by: Birtha, Jessie, et al.
Published: (1979)

Learning When to Ask for Help: Efficient Interactive Navigation via Implicit Uncertainty Estimation
by: Igbinedion, Ifueko, et al.
Published: (2023)

Need Help?...Ask Your Mentor.
by: Logsdon, Janis
Published: (1992)

Analyzing Reluctance to Ask for Help When Cooperating With Robots: Insights to Integrate Artificial Agents in HRC
by: Martin, Ane San, et al.
Published: (2025)

Do Retrieval Augmented Language Models Know When They Don't Know?
by: Zhou, Youchao, et al.
Published: (2025)

Reasoning about Uncertainty: Do Reasoning Models Know When They Don't Know?
by: Mei, Zhiting, et al.
Published: (2025)

What Does the Public Want To Know? Ask Libraries.
by: Oder, Norman
Published: (1997)

What and When Do They Know? Web-Based Assessment.
by: Samson, Sue
Published: (2000)

Know-How To Help Kids Know How.
by: Farmer, Lesley S. J.
Published: (1998)

Epistemic Deep Learning: Enabling Machine Learning Models to Know When They Do Not Know
by: Manchingal, Shireen Kudukkil
Published: (2025)

Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)?
by: Zhang, Yue, et al.
Published: (2026)

"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation
by: Thakur, Nandan, et al.
Published: (2023)

When Do "More Contexts" Help with Sarcasm Recognition?
by: Nimase, Ojas, et al.
Published: (2024)

Ask Early, Ask Late, Ask Right: When Does Clarification Timing Matter for Long-Horizon Agents?
by: Gulati, Anmol, et al.
Published: (2026)

HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoning
by: Jiang, Zhuohang, et al.
Published: (2025)

Getting By Goal Misgeneralization With a Little Help From a Mentor
by: Trinh, Tu, et al.
Published: (2024)

Everything You Always Wanted to Know About How Causal Set Theory Can Help with Open Questions in Cosmology, but Were Afraid to Ask
by: Yazdi, Yasaman K.
Published: (2023)

LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
by: Cao, Qi, et al.
Published: (2026)

Epistemic Artificial Intelligence is Essential for Machine Learning Models to Truly 'Know When They Do Not Know'
by: Manchingal, Shireen Kudukkil, et al.
Published: (2025)

Web Site Quality: Do Students Know It When They See It?
by: Small, Ruth V., et al.
Published: (1999)

Return of the Encoder: Maximizing Parameter Efficiency for SLMs
by: Elfeki, Mohamed, et al.
Published: (2025)

YRC-Bench: A Benchmark for Learning to Coordinate with Experts
by: Danesh, Mohamad H., et al.
Published: (2025)

May We Help You Find Something? AskNSDL!
by: Silverstein, Joanne
Published: (2003)

Knowing but Not Showing: LLMs Recognize Ambiguity but Rarely Ask Clarifying Questions
by: Su, Jinyan, et al.
Published: (2026)

Know When To Hold 'em, Know When To Fold 'em.
by: Jacso, Peter
Published: (1999)

AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answering
by: Kuan, Chun-Yi, et al.
Published: (2026)

Do Language Models Know When They're Hallucinating References?
by: Agrawal, Ayush, et al.
Published: (2023)

Grounding Multimodal LLMs to Embodied Agents that Ask for Help with Reinforcement Learning
by: Ramrakhya, Ram, et al.
Published: (2025)

Robots That Know What to Ask: Recovering Misaligned Rewards through Targeted Explanations
by: Merker, Helena, et al.
Published: (2026)

When Do LLMs Help With Node Classification? A Comprehensive Analysis
by: Wu, Xixi, et al.
Published: (2025)