Cover Image

Deep Research, Shallow Evaluation: A Case Study in Meta-Evaluation for Long-Form QA Benchmarks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hwang, Jena D., Kishore, Varsha, Singh, Amanpreet, Haddad, Dany, Naik, Aakanksha, Hamada, Malachi, Bragg, Jonathan, D'Arcy, Mike, Weld, Daniel S., Wang, Lucy Lu, Downey, Doug, Feldman, Sergey
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Ai2 Scholar QA: Organized Literature Synthesis with Attribution
by: Singh, Amanpreet, et al.
Published: (2025)

Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users
by: Balepur, Nishant, et al.
Published: (2026)

DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute
by: Balepur, Nishant, et al.
Published: (2026)

MARG: Multi-Agent Review Generation for Scientific Papers
by: D'Arcy, Mike, et al.
Published: (2024)

ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews
by: D'Arcy, Mike, et al.
Published: (2023)

TOPICAL: TOPIC Pages AutomagicaLly
by: Giorgi, John, et al.
Published: (2024)

AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite
by: Bragg, Jonathan, et al.
Published: (2025)

Omakase: proactive assistance with actionable suggestions for evolving scientific research projects
by: Siangliulue, Pao, et al.
Published: (2026)

Improving Attributed Long-form Question Answering with Intent Awareness
by: Zhao, Xinran, et al.
Published: (2026)

Understanding Usage and Engagement in AI-Powered Scientific Research Tools: The Asta Interaction Dataset
by: Haddad, Dany, et al.
Published: (2026)

CARE: Extracting Experimental Findings From Clinical Literature
by: Naik, Aakanksha, et al.
Published: (2023)

Intent-Aware Schema Generation And Refinement For Literature Review Tables
by: Padmakumar, Vishakh, et al.
Published: (2025)

Transforming Hawai'i
by: D’Arcy, Paul
Published: (2018)

Generating Literature-Driven Scientific Theories at Scale
by: Jansen, Peter, et al.
Published: (2026)

LXIV.—Note on a dolphin showing traces of an encounter with a cuttlefish
by: Thompson, D'Arcy Wentworth
Published: (1901)

Extremal properties of max-autoregressive moving average processes for modelling extreme river flows
by: D'Arcy, Eleanor, et al.
Published: (2024)

Evaluation of prescription medication changes following sleeve gastrectomy surgery
by: Gina Arena, et al.
Published: (2024)

PreScience: A Benchmark for Forecasting Scientific Contributions
by: Ajith, Anirudh, et al.
Published: (2026)

Recognition of tribes Capsiceae and Physaleae, subfamily Solanoideae, Solanaceae
by: Averett, John E, et al.
Published: (1996)

Holographic realization of higher-spin Carrollian free fields
by: D'Arcy, Ethan, et al.
Published: (2026)

Exploring behavior management strategies in pediatric group therapy
by: Maud D'Arcy, et al.
Published: (2024)

RCT Rejection Sampling for Causal Estimation Evaluation
by: Keith, Katherine A., et al.
Published: (2023)

LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape
by: Kambhamettu, Hita, et al.
Published: (2026)

Using PBPK to Simulate Target Biopredictive Dissolution Profiles for Long‐Acting Injectables ‐ Where to Begin With Critical Bioavailability Attributes?
by: Hannah Cleary, et al.
Published: (2026)

Daily meteorological observations of maximum air temperatures for Ambodifotatra, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of minimum air temperatures for Ambodifotatra, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of mean air temperatures for Ambodifotatra, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of cloud cover for Ambodifotatra, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of dry bulb temperature for Ambodifotatra, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of precipitation for Bambari, Central African Republic
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of wind direction for Bambari, Central African Republic
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of precipitation for Birao, Central African Republic
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of precipitation for Moramanga, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of station level pressure for Moramanga, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of cloud cover for Morombe, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of relative humidity for Morombe, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of station level pressure for Morombe, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of wind speed for Morombe, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Sub-daily meteorological observations of wet bulb temperature for Nosy Varika, Madagascar
by: Noone, Simon, et al.
Published: (2025)

Daily meteorological observations of precipitation for Andapa, Madagascar
by: Noone, Simon, et al.
Published: (2025)