Imagen de Portada

ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sharma, Manasi, Zhang, Chen Bo Calvin, Bandi, Chaithanya, Wang, Clinton, Aich, Ankit, Nghiem, Huy, Rabbani, Tahseen, Htet, Ye, Jang, Brian, Basu, Sumana, Balwani, Aishwarya, Peskoff, Denis, Ayestaran, Marcos, Hendryx, Sean M., Kenstler, Brad, Liu, Bing
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
por: Gunjal, Anisha, et al.
Publicado: (2025)

PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoning
por: Akyürek, Afra Feyza, et al.
Publicado: (2025)

Deep Research as Rubric for Reinforcement Learning
por: Mei, Wangyi, et al.
Publicado: (2026)

Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation
por: Harrasse, Abir, et al.
Publicado: (2024)

Rubrics.
por: Callison, Daniel
Publicado: (2000)

Online Rubrics Elicitation from Pairwise Comparisons
por: Rezaei, MohammadHossein, et al.
Publicado: (2025)

RubricBench: Aligning Model-Generated Rubrics with Human Standards
por: Zhang, Qiyuan, et al.
Publicado: (2026)

Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR
por: Tyagi, Utkarsh, et al.
Publicado: (2026)

AutoRubric: Rubric-Based Generative Rewards for Faithful Multimodal Reasoning
por: Jia, Mengzhao, et al.
Publicado: (2025)

Open Rubric System: Scaling Reinforcement Learning with Pairwise Adaptive Rubric
por: Jia, Ruipeng, et al.
Publicado: (2026)

DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
por: Shao, Rulin, et al.
Publicado: (2025)

EvoRubric: Self-Evolving Rubric-Driven RL for Open-Ended Generation
por: Guan, Xin, et al.
Publicado: (2026)

Auto-Rubric: Learning From Implicit Weights to Explicit Rubrics for Reward Modeling
por: Xie, Lipeng, et al.
Publicado: (2025)

Demystifying the Evaluation Process for Parents: Rubrics for Marking Student Research Projects
por: Shaw, Joan
Publicado: (2004)

RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards
por: Li, Gaotang, et al.
Publicado: (2026)

OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignment
por: Liu, Tianci, et al.
Publicado: (2025)

AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learning
por: Ding, Liang
Publicado: (2026)

AMARIS: A Memory-Augmented Rubric Improvement System for Rubric-Based Reinforcement Learning
por: Wu, Peilin, et al.
Publicado: (2026)

Rubric-based On-policy Distillation
por: Fang, Junfeng, et al.
Publicado: (2026)

Reinforcement Learning with Rubric Anchors
por: Huang, Zenan, et al.
Publicado: (2025)

RubricEval: A Rubric-Level Meta-Evaluation Benchmark for LLM Judges in Instruction Following
por: Pan, Tianjun, et al.
Publicado: (2026)

Rubric Is All You Need: Enhancing LLM-based Code Evaluation With Question-Specific Rubrics
por: Pathak, Aditya, et al.
Publicado: (2025)

Rubrics to Tokens: Bridging Response-level Rubrics and Token-level Rewards in Instruction Following Tasks
por: Xu, Tianze, et al.
Publicado: (2026)

RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation
por: Li, Sunzhu, et al.
Publicado: (2026)

RubricRAG: Towards Interpretable and Reliable LLM Evaluation via Domain Knowledge Retrieval for Rubric Generation
por: Dhole, Kaustubh D., et al.
Publicado: (2026)

DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Report
por: Li, Ruizhe, et al.
Publicado: (2026)

REL: Working out is all you need
por: Simonds, Toby, et al.
Publicado: (2024)

Improving Learning Through Assessment Rubrics
por: Gonsalves, Chahna, et al.
Publicado: (2024)

Visual Preference Optimization with Rubric Rewards
por: Yu, Ya-Qi, et al.
Publicado: (2026)

Reinforcement Learning with Robust Rubric Rewards
por: Yu, Ya-Qi, et al.
Publicado: (2026)

Involving Students in Learning through Rubrics
por: Yoshina, Joan M., et al.
Publicado: (2007)

Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation
por: Lv, Changze, et al.
Publicado: (2026)

Balancing Label Imbalance in Federated Environments Using Only Mixup and Artificially-Labeled Noise
por: Sang, Kyle, et al.
Publicado: (2024)

Autorubric: Unifying Rubric-based LLM Evaluation
por: Rao, Delip, et al.
Publicado: (2026)

Step-wise Rubric Rewards for LLM Reasoning
por: Xie, Weichu, et al.
Publicado: (2026)

Preference-Aware Rubric Learning for Personalized Evaluation
por: Qiu, Yilun, et al.
Publicado: (2026)

Agentic Rubrics as Contextual Verifiers for SWE Agents
por: Raghavendra, Mohit, et al.
Publicado: (2026)

A Grading Rubric for AI Safety Frameworks
por: Alaga, Jide, et al.
Publicado: (2024)

Robust Reward Modeling via Causal Rubrics
por: Srivastava, Pragya, et al.
Publicado: (2025)

A Comprehensive Rubric for Annotating Pathological Speech
por: Corrales-Astorgano, Mario, et al.
Publicado: (2024)