Imagen de Portada

Evaluating LLMs at Detecting Errors in LLM Responses

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kamoi, Ryo, Das, Sarkar Snigdha Sarathi, Lou, Renze, Ahn, Jihyun Janice, Zhao, Yilun, Lu, Xiaoxin, Zhang, Nan, Zhang, Yusen, Zhang, Ranran Haoran, Vummanthala, Sujeeth Reddy, Dave, Salika, Qin, Shaobo, Cohan, Arman, Yin, Wenpeng, Zhang, Rui
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Information
por: Kamoi, Ryo, et al.
Publicado: (2024)

Efficient PRM Training Data Synthesis via Formal Verification
por: Kamoi, Ryo, et al.
Publicado: (2025)

Direct-Inverse Prompting: Analyzing LLMs' Discriminative Capacity in Self-Improving Generation
por: Ahn, Jihyun Janice, et al.
Publicado: (2024)

GReaTer: Gradients over Reasoning Makes Smaller Language Models Strong Prompt Optimizers
por: Das, Sarkar Snigdha Sarathi, et al.
Publicado: (2024)

HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding?
por: Zhang, Yusen, et al.
Publicado: (2025)

Verbosity $\neq$ Veracity: Demystify Verbosity Compensation Behavior of Large Language Models
por: Zhang, Yusen, et al.
Publicado: (2024)

Enhance Multimodal Consistency and Coherence for Text-Image Plan Generation
por: Lu, Xiaoxin, et al.
Publicado: (2025)

GREATERPROMPT: A Unified, Customizable, and High-Performing Open-Source Toolkit for Prompt Optimization
por: Zheng, Wenliang, et al.
Publicado: (2025)

AAAR-1.0: Assessing AI's Potential to Assist Research
por: Lou, Renze, et al.
Publicado: (2024)

Prompt-Reverse Inconsistency: LLM Self-Inconsistency Beyond Generative Randomness and Prompt Paraphrasing
por: Ahn, Jihyun Janice, et al.
Publicado: (2025)

Large Language Models for Mathematical Reasoning: Progresses and Challenges
por: Ahn, Janice, et al.
Publicado: (2024)

Large Language Model Instruction Following: A Survey of Progresses and Challenges
por: Lou, Renze, et al.
Publicado: (2023)

Toward Zero-Shot Instruction Following
por: Lou, Renze, et al.
Publicado: (2023)

When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMs
por: Kamoi, Ryo, et al.
Publicado: (2024)

MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
por: Lou, Renze, et al.
Publicado: (2023)

DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Long and Specialized Documents
por: Zhao, Yilun, et al.
Publicado: (2023)

HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation
por: Yu, Zhaojian, et al.
Publicado: (2024)

LimRank: Less is More for Reasoning-Intensive Information Reranking
por: Song, Tingyu, et al.
Publicado: (2025)

SAGE: Benchmarking and Improving Retrieval for Deep Research Agents
por: Hu, Tiansheng, et al.
Publicado: (2026)

Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Models
por: Li, Xi, et al.
Publicado: (2024)

Coverage-based Fairness in Multi-document Summarization
por: Li, Haoyuan, et al.
Publicado: (2024)

Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models
por: Shin, Philip Wootaek, et al.
Publicado: (2024)

Fair Abstractive Summarization of Diverse Perspectives
por: Zhang, Yusen, et al.
Publicado: (2023)

Z1: Efficient Test-time Scaling with Code
por: Yu, Zhaojian, et al.
Publicado: (2025)

SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers
por: Singh, Shruti, et al.
Publicado: (2024)

ANCHOR: Branch-Point Data Generation for GUI Agents
por: Wei, Jinbiao, et al.
Publicado: (2026)

SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
por: Liu, Hongjun, et al.
Publicado: (2025)

MCTS-RAG: Enhancing Retrieval-Augmented Generation with Monte Carlo Tree Search
por: Hu, Yunhai, et al.
Publicado: (2025)

Table-R1: Inference-Time Scaling for Table Reasoning
por: Yang, Zheyuan, et al.
Publicado: (2025)

Can Multimodal Foundation Models Understand Schematic Diagrams? An Empirical Study on Information-Seeking QA over Scientific Papers
por: Zhao, Yilun, et al.
Publicado: (2025)

FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domains
por: Zhao, Yilun, et al.
Publicado: (2023)

Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems
por: Zhao, Yilun, et al.
Publicado: (2026)

Cycle V — The Reconciliation of Sky and Stone
por: Compa, Salika Bista
Publicado: (2025)

Bridging the Know-Act Gap via Task-Level Autoregressive Reasoning
por: Ahn, Jihyun Janice, et al.
Publicado: (2026)

AlphaResearch: Accelerating New Algorithm Discovery with Language Models
por: Yu, Zhaojian, et al.
Publicado: (2025)

Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective
por: Zhang, Siyue, et al.
Publicado: (2025)

UMIE: Unified Multimodal Information Extraction with Instruction Tuning
por: Sun, Lin, et al.
Publicado: (2024)

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
por: Tang, Xiangru, et al.
Publicado: (2023)

MSRS: Evaluating Multi-Source Retrieval-Augmented Generation
por: Phanse, Rohan, et al.
Publicado: (2025)

Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet
por: Atil, Berk, et al.
Publicado: (2025)