Imagen de Portada

ScholarGym: Benchmarking Large Language Model Capabilities in the Information-Gathering Stage of Deep Research

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Shen, Hao, Yang, Hang, Gu, Zhouhong, Han, Weili
Formato:	Preprint
Publicado:	2026
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

PII-Bench: Evaluating Query-Aware Privacy Protection Systems
por: Shen, Hao, et al.
Publicado: (2025)

Teaching Language Models To Gather Information Proactively
por: Huang, Tenghao, et al.
Publicado: (2025)

Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications
por: Han, Jindong, et al.
Publicado: (2025)

ResearchGym: Evaluating Language Model Agents on Real-World AI Research
por: Garikaparthi, Aniketh, et al.
Publicado: (2026)

ItinBench: Benchmarking Planning Across Multiple Cognitive Dimensions with Large Language Models
por: Wang, Tianlong, et al.
Publicado: (2026)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
por: Gu, Zhouhong, et al.
Publicado: (2024)

Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisons
por: So, Chi Chiu, et al.
Publicado: (2025)

Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Models
por: Huang, Wenxuan, et al.
Publicado: (2026)

PokeGym: A Visually-Driven Long-Horizon Benchmark for Vision-Language Models
por: Zhang, Ruizhi, et al.
Publicado: (2026)

MCP-RADAR: A Multi-Dimensional Benchmark for Evaluating Tool Use Capabilities in Large Language Models
por: Gao, Xuanqi, et al.
Publicado: (2025)

Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism
por: Bick, Aviv, et al.
Publicado: (2025)

Asking Before Acting: Gather Information in Embodied Decision Making with Language Models
por: Chen, Xiaoyu, et al.
Publicado: (2023)

ResearchArena: Benchmarking Large Language Models' Ability to Collect and Organize Information as Research Agents
por: Kang, Hao, et al.
Publicado: (2024)

Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language
por: Pauli, Amalie Brogaard, et al.
Publicado: (2024)

ViroGym: Realistic Large-Scale Benchmarks for Evaluating Viral Proteins
por: Zhou, Yichen, et al.
Publicado: (2026)

REAL: Benchmarking Abilities of Large Language Models for Housing Transactions and Services
por: Zhu, Kexin, et al.
Publicado: (2025)

Exploring and Benchmarking the Planning Capabilities of Large Language Models
por: Bohnet, Bernd, et al.
Publicado: (2024)

FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models
por: Li, Wei, et al.
Publicado: (2024)

DeepMath-Creative: A Benchmark for Evaluating Mathematical Creativity of Large Language Models
por: Chen, Xiaoyang, et al.
Publicado: (2025)

AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
por: Xi, Zhiheng, et al.
Publicado: (2024)

MARO: Learning Stronger Reasoning from Social Interaction
por: Cai, Yin, et al.
Publicado: (2026)

MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models
por: Wang, Wentian, et al.
Publicado: (2024)

DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis
por: Patel, Liana, et al.
Publicado: (2025)

BoxingGym: Benchmarking Progress in Automated Experimental Design and Model Discovery
por: Gandhi, Kanishk, et al.
Publicado: (2025)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
por: Li, Ce, et al.
Publicado: (2025)

Fundamental Safety-Capability Trade-offs in Fine-tuning Large Language Models
por: Chen, Pin-Yu, et al.
Publicado: (2025)

Exploring the Privacy Protection Capabilities of Chinese Large Language Models
por: Yang, Yuqi, et al.
Publicado: (2024)

ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents
por: Savadikar, Chinmay, et al.
Publicado: (2026)

AstroMMBench: A Benchmark for Evaluating Multimodal Large Language Models Capabilities in Astronomy
por: Shi, Jinghang, et al.
Publicado: (2025)

TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models
por: Srinivasa, Rakshith S, et al.
Publicado: (2025)

PCEval: A Benchmark for Evaluating Physical Computing Capabilities of Large Language Models
por: Song, Inpyo, et al.
Publicado: (2025)

ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction
por: Zhang, Yanlin, et al.
Publicado: (2024)

ElectriQ: A Benchmark for Assessing the Response Capability of Large Language Models in Power Marketing
por: Wang, Jinzhi, et al.
Publicado: (2025)

Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models
por: Liu, Shaonan, et al.
Publicado: (2026)

A Benchmark for Audio Reasoning Capabilities of Multimodal Large Language Models
por: Christop, Iwona, et al.
Publicado: (2026)

Exploring the Capabilities of the Frontier Large Language Models for Nuclear Energy Research
por: Almeldein, Ahmed, et al.
Publicado: (2025)

Online Competitive Information Gathering for Partially Observable Trajectory Games
por: Krusniak, Mel, et al.
Publicado: (2025)

On Calibration of Large Language Models: From Response To Capability
por: Yang, Sin-Han, et al.
Publicado: (2026)

WebThinker: Empowering Large Reasoning Models with Deep Research Capability
por: Li, Xiaoxi, et al.
Publicado: (2025)

WorldGym: World Model as An Environment for Policy Evaluation
por: Quevedo, Julian, et al.
Publicado: (2025)