Imagen de Portada

In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kuratov, Yuri, Bulatov, Aydar, Anokhin, Petr, Sorokin, Dmitry, Sorokin, Artyom, Burtsev, Mikhail
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
por: Kuratov, Yuri, et al.
Publicado: (2024)

Associative Recurrent Memory Transformer
por: Rodkin, Ivan, et al.
Publicado: (2024)

Scaling Transformer to 1M tokens and beyond with RMT
por: Bulatov, Aydar, et al.
Publicado: (2023)

Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Models
por: Chepurova, Alla, et al.
Publicado: (2025)

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents
por: Anokhin, Petr, et al.
Publicado: (2024)

Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacity
por: Kuratov, Yuri, et al.
Publicado: (2025)

SRMT: Shared Memory for Multi-agent Lifelong Pathfinding
por: Sagirova, Alsu, et al.
Publicado: (2025)

Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling
por: Rodkin, Ivan, et al.
Publicado: (2025)

HeroBench: A Benchmark for Long-Horizon Planning and Structured Reasoning in Virtual Worlds
por: Anokhin, Petr, et al.
Publicado: (2025)

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find
por: Bianchi, Owen, et al.
Publicado: (2025)

Long Input Benchmark for Russian Analysis
por: Churin, Igor, et al.
Publicado: (2024)

Needle in the Haystack for Memory Based Large Language Models
por: Nelson, Elliot, et al.
Publicado: (2024)

Reasoning on Multiple Needles In A Haystack
por: Wang, Yidong
Publicado: (2025)

Learning Elementary Cellular Automata with Transformers
por: Burtsev, Mikhail
Publicado: (2024)

From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data
por: Xiong, Zheyang, et al.
Publicado: (2024)

From Haystack to Needle: Label Space Reduction for Zero-shot Classification
por: Vandemoortele, Nathan, et al.
Publicado: (2025)

DENIAHL: In-Context Features Influence LLM Needle-In-A-Haystack Abilities
por: Dai, Hui, et al.
Publicado: (2024)

Q-RAG: Long Context Multi-step Retrieval via Value-based Embedder Training
por: Sorokin, Artyom, et al.
Publicado: (2025)

Self-Guided Plan Extraction for Instruction-Following Tasks with Goal-Conditional Reinforcement Learning
por: Volovikova, Zoya, et al.
Publicado: (2026)

Revisiting Tree Search for LLMs: Gumbel and Sequential Halving for Budget-Scalable Reasoning
por: Ugadiarov, Leonid, et al.
Publicado: (2026)

Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure
por: Agarwal, Rahul, et al.
Publicado: (2025)

Limitations of Normalization in Attention Mechanism
por: Mudarisov, Timur, et al.
Publicado: (2025)

Needle In A Multimodal Haystack
por: Wang, Weiyun, et al.
Publicado: (2024)

Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models
por: Giebisch, Rafael, et al.
Publicado: (2025)

Semantic Needles in Document Haystacks: Sensitivity Testing of LLM-as-a-Judge Similarity Scoring
por: Aksoy, Sinan G., et al.
Publicado: (2026)

Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts
por: Sharma, Aditya, et al.
Publicado: (2024)

Can Search-Based Testing with Pareto Optimization Effectively Cover Failure-Revealing Test Inputs?
por: Sorokin, Lev, et al.
Publicado: (2024)

Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models
por: Wang, Hengyi, et al.
Publicado: (2024)

Winning Amazon KDD Cup'24
por: Deotte, Chris, et al.
Publicado: (2024)

Jailbreaking in the Haystack
por: Shah, Rishi Rajesh, et al.
Publicado: (2025)

DeepTest Tool Competition 2026: Benchmarking an LLM-Based Automotive Assistant
por: Sorokin, Lev, et al.
Publicado: (2026)

Finding Needles in Emb(a)dding Haystacks: Legal Document Retrieval via Bagging and SVR Ensembles
por: Bönisch, Kevin, et al.
Publicado: (2025)

Searching by Code: a New SearchBySnippet Dataset and SnippeR Retrieval Model for Searching by Code Snippets
por: Sedykh, Ivan, et al.
Publicado: (2023)

Two Causally Related Needles in a Video Haystack
por: Li, Miaoyu, et al.
Publicado: (2025)

RuCCoD: Towards Automated ICD Coding in Russian
por: Nesterov, Aleksandr, et al.
Publicado: (2025)

Complexity of Symbolic Representation in Working Memory of Transformer Correlates with the Complexity of a Task
por: Sagirova, Alsu, et al.
Publicado: (2024)

AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset
por: Moshkov, Ivan, et al.
Publicado: (2025)

What Is The Political Content in LLMs' Pre- and Post-Training Data?
por: Ceron, Tanise, et al.
Publicado: (2025)

Diagonal Batching Unlocks Parallelism in Recurrent Memory Transformers for Long Contexts
por: Sivtsov, Danil, et al.
Publicado: (2025)

Simulator Ensembles for Trustworthy Autonomous Driving Testing
por: Sorokin, Lev, et al.
Publicado: (2025)