Cover Image

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bianchi, Owen, Koretsky, Mathew J., Willey, Maya, Alvarado, Chelsea X., Nayak, Tanay, Asija, Adi, Kuznetsov, Nicole, Nalls, Mike A., Faghri, Faraz, Khashabi, Daniel
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge Bases
by: Koretsky, Mathew J., et al.
Published: (2025)

GOLD PANNING: Strategic Context Shuffling for Needle-in-Haystack Reasoning
by: Byerly, Adam, et al.
Published: (2025)

Finding BSM Needles in Electromagnetic Haystacks at DUNE
by: Brdar, Vedran, et al.
Published: (2025)

Hell or High Water: Evaluating Agentic Recovery from External Failures
by: Wang, Andrew, et al.
Published: (2025)

Tur[k]ingBench: A Challenge Benchmark for Web Agents
by: Xu, Kevin, et al.
Published: (2024)

Artificial Intelligence for Quantum Matter: Finding a Needle in a Haystack
by: Nazaryan, Khachatur, et al.
Published: (2025)

Needle In A Multimodal Haystack
by: Wang, Weiyun, et al.
Published: (2024)

Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure
by: Agarwal, Rahul, et al.
Published: (2025)

Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark
by: Wu, Tsung-Han, et al.
Published: (2024)

Reasoning on Multiple Needles In A Haystack
by: Wang, Yidong
Published: (2025)

Looking for the Information Needle in the Internet Haystack.
by: Clausen, Helge
Published: (1996)

An Infinite Needle in a Finite Haystack: Finding Infinite Counter-Models in Deductive Verification
by: Elad, Neta, et al.
Published: (2023)

In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss
by: Kuratov, Yuri, et al.
Published: (2024)

Needle in a Haystack: Information Recovery in Low Signal‐to‐Noise Piezoresponse Force Microscopy Data
by: Kerisha N. Williams, et al.
Published: (2025)

Finding Needles in Emb(a)dding Haystacks: Legal Document Retrieval via Bagging and SVR Ensembles
by: Bönisch, Kevin, et al.
Published: (2025)

Two Causally Related Needles in a Video Haystack
by: Li, Miaoyu, et al.
Published: (2025)

Needle in the Haystack for Memory Based Large Language Models
by: Nelson, Elliot, et al.
Published: (2024)

MAGNET: A Multi-agent Framework for Finding Audio-Visual Needles by Reasoning over Multi-Video Haystacks
by: Chowdhury, Sanjoy, et al.
Published: (2025)

Needles in Haystacks: Exploring Selective Novel Adsorbents for PFAS Treatment
by: Bryan Sadowski, et al.
Published: (2026)

Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion
by: Kassem, Aly M., et al.
Published: (2024)

Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts
by: Yu, Yifei, et al.
Published: (2025)

From Haystack to Needle: Label Space Reduction for Zero-shot Classification
by: Vandemoortele, Nathan, et al.
Published: (2025)

Many Needles in a Haystack: Active Hit Discovery for Perturbation Experiments
by: Rubbi, Andrea, et al.
Published: (2026)

DENIAHL: In-Context Features Influence LLM Needle-In-A-Haystack Abilities
by: Dai, Hui, et al.
Published: (2024)

Quirky Quotes and Needles in the Haystack: Tracing Grammatical Change in Untagged Corpora
by: Muriel Norde
Published: (2013)

Needle in a Haystack: Information Recovery in Low Signal‐to‐Noise Piezoresponse Force Microscopy Data (Small Methods 2/2026)
by: Kerisha N. Williams, et al.
Published: (2026)

Citation Searching: Search Smarter & Find More
by: Hammond, Chelsea C., et al.
Published: (2008)

Death Rights
by: Koretsky, Deanna P.
Published: (2022)

Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs
by: Zhao, Zijia, et al.
Published: (2024)

A Needle in a Haystack: Intent-driven Reusable Artifacts Recommendation with LLMs
by: Jin, Dongming, et al.
Published: (2025)

A Needle in a Cosmic Haystack: A Review of FRB Search Techniques
by: Rajwade, Kaustubh, et al.
Published: (2024)

Needle in a Poissonian Haystack—An X‐Ray Astronomer's Guide to QPE Fishing
by: Erwan Quintin, et al.
Published: (2026)

Finding a Needle in a Haystack: A Systematic Approach for Searching Through Public Databases for Youth Mental Well‐Being Programs
by: Alice‐Simone Balter, et al.
Published: (2025)

The Needle is a Thread: Finding Planted Paths in Noisy Process Trees
by: Le, Maya, et al.
Published: (2026)

Crown-Like Structures in Breast Adipose Tissue: Finding a 'Needle-in-a-Haystack' using Artificial Intelligence and Collaborative Active Learning on the Web
by: Bhawsar, Praphulla MS, et al.
Published: (2024)

Beyond Needle(s) in the Embodied Haystack: Environment, Architecture, and Training Considerations for Long Context Reasoning
by: Kim, Bosung, et al.
Published: (2025)

Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks?
by: Roberts, Jonathan, et al.
Published: (2024)

U-NIAH: Unified RAG and LLM Evaluation for Long Context Needle-In-A-Haystack
by: Gao, Yunfan, et al.
Published: (2025)

Semantic Needles in Document Haystacks: Sensitivity Testing of LLM-as-a-Judge Similarity Scoring
by: Aksoy, Sinan G., et al.
Published: (2026)

Benefit of Interventional Septal Reduction for Hypertrophic Cardiomyopathy: Looking for a Needle in a Haystack?
by: Olivier Piot, et al.
Published: (2024)