Image de couverture de livre

NeedleBench: Evaluating LLM Retrieval and Reasoning Across Varying Information Densities

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Mo, Zhang, Songyang, Zhang, Taolin, Duan, Haodong, Liu, Yunxin, Chen, Kai
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
par: Cao, Maosong, et autres
Publié: (2025)

Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective
par: Liu, Junnan, et autres
Publié: (2025)

MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark
par: Liu, Hongwei, et autres
Publié: (2024)

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks
par: Wang, Chonghua, et autres
Publié: (2024)

Rethinking Verification for LLM Code Generation: From Generation to Testing
par: Ma, Zihan, et autres
Publié: (2025)

CompassJudger-1: All-in-one Judge Model Helps Model Evaluation and Evolution
par: Cao, Maosong, et autres
Publié: (2024)

CompassJudger-2: Towards Generalist Judge Model via Verifiable Rewards
par: Zhang, Taolin, et autres
Publié: (2025)

Coding Triangle: How Does Large Language Model Understand Code?
par: Zhang, Taolin, et autres
Publié: (2025)

ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
par: Zhuo, Jingming, et autres
Publié: (2024)

Thinking in a Crowd: How Auxiliary Information Shapes LLM Reasoning
par: Zhao, Haodong, et autres
Publié: (2025)

Rectifying LLM Thought from Lens of Optimization
par: Liu, Junnan, et autres
Publié: (2025)

Information Density Principle for MLLM Benchmarks
par: Li, Chunyi, et autres
Publié: (2025)

How Brittle is Agent Safety? Rethinking Agent Risk under Intent Concealment and Task Complexity
par: Ma, Zihan, et autres
Publié: (2025)

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models
par: Que, Haoran, et autres
Publié: (2024)

Are Your LLMs Capable of Stable Reasoning?
par: Liu, Junnan, et autres
Publié: (2024)

Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains
par: Zhang, Taolin, et autres
Publié: (2026)

SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types
par: Mou, Yutao, et autres
Publié: (2024)

ThinkBench: Dynamic Out-of-Distribution Evaluation for Robust LLM Reasoning
par: Huang, Shulin, et autres
Publié: (2025)

General-Reasoner: Advancing LLM Reasoning Across All Domains
par: Ma, Xueguang, et autres
Publié: (2025)

BELLE: A Bi-Level Multi-Agent Reasoning Framework for Multi-Hop Question Answering
par: Zhang, Taolin, et autres
Publié: (2025)

ROG: Retrieval-Augmented LLM Reasoning for Complex First-Order Queries over Knowledge Graphs
par: Zhang, Ziyan, et autres
Publié: (2026)

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
par: Kong, Huanjun, et autres
Publié: (2024)

TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models
par: Zhang, Yiran, et autres
Publié: (2025)

R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models
par: Zhang, Taolin, et autres
Publié: (2024)

Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs
par: Qiao, Yuxuan, et autres
Publié: (2024)

Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning
par: Chen, Qizhou, et autres
Publié: (2024)

An Information-Theoretic Framework for Robust Large Language Model Editing
par: Chen, Qizhou, et autres
Publié: (2025)

Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoning
par: Sun, Yunxin, et autres
Publié: (2025)

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis
par: Zhao, Yufeng, et autres
Publié: (2025)

A Short Survey on Small Reasoning Models: Training, Inference, Applications and Research Directions
par: Wang, Chengyu, et autres
Publié: (2025)

GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling
par: Li, Siqi, et autres
Publié: (2025)

GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents
par: Costarelli, Anthony, et autres
Publié: (2024)

MMBench: Is Your Multi-modal Model an All-around Player?
par: Liu, Yuan, et autres
Publié: (2023)

MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation
par: Li, Xiaoyuan, et autres
Publié: (2025)

The Imitation Game: Turing Machine Imitator is Length Generalizable Reasoner
par: Hua, Zhouqi, et autres
Publié: (2025)

GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
par: Zhao, Junjie, et autres
Publié: (2026)

WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
par: Ding, Shuangrui, et autres
Publié: (2026)

RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
par: Lin, Jingru, et autres
Publié: (2025)

CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
par: Liu, Shudong, et autres
Publié: (2025)

GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generation
par: Xiao, Yilin, et autres
Publié: (2025)