Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QA
Fuente:
arXiv
Saved in:
| Main Authors: | Baker, George Arthur, Raut, Ankush, Shaier, Sagi, Hunter, Lawrence E, von der Wense, Katharina |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Desiderata for the Context Use of Question Answering Systems
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
Who Are All The Stochastic Parrots Imitating? They Should Tell Us!
by: Shaier, Sagi, et al.
Published: (2023)
by: Shaier, Sagi, et al.
Published: (2023)
It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
Comparing Template-based and Template-free Language Model Probing
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
Asking Again and Again: Exploring LLM Robustness to Repeated Questions
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
Excitation: Momentum For Experts
by: Shaier, Sagi
Published: (2026)
by: Shaier, Sagi
Published: (2026)
NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts
by: Gupta, Abhay, et al.
Published: (2025)
by: Gupta, Abhay, et al.
Published: (2025)
Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations
by: Shaier, Sagi, et al.
Published: (2024)
by: Shaier, Sagi, et al.
Published: (2024)
Corrective In-Context Learning: Evaluating Self-Correction in Large Language Models
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
Improving Low-Resource Morphological Inflection via Self-Supervised Objectives
by: Wiemerslage, Adam, et al.
Published: (2025)
by: Wiemerslage, Adam, et al.
Published: (2025)
JGU Mainz's Submission to the WMT25 Shared Task on LLMs with Limited Resources for Slavic Languages: MT and QA
by: Saadi, Hossain Shaikh, et al.
Published: (2025)
by: Saadi, Hossain Shaikh, et al.
Published: (2025)
The Trade-off between Performance, Efficiency, and Fairness in Adapter Modules for Text Classification
by: Bui, Minh Duc, et al.
Published: (2024)
by: Bui, Minh Duc, et al.
Published: (2024)
Mitigating Label Length Bias in Large Language Models
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Models
by: Bui, Minh Duc, et al.
Published: (2024)
by: Bui, Minh Duc, et al.
Published: (2024)
The Reasoning Bottleneck in Graph-RAG: Structured Prompting and Context Compression for Multi-Hop QA
by: Zarrinkia, Yasaman, et al.
Published: (2026)
by: Zarrinkia, Yasaman, et al.
Published: (2026)
ReAgent: Reversible Multi-Agent Reasoning for Knowledge-Enhanced Multi-Hop QA
by: Zhao, Xinjie, et al.
Published: (2025)
by: Zhao, Xinjie, et al.
Published: (2025)
Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language Documentation
by: Rice, Enora, et al.
Published: (2025)
by: Rice, Enora, et al.
Published: (2025)
Model-Based Ranking of Source Languages for Zero-Shot Cross-Lingual Transfer
by: Ebrahimi, Abteen, et al.
Published: (2025)
by: Ebrahimi, Abteen, et al.
Published: (2025)
DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections
by: Park, Jiwon, et al.
Published: (2025)
by: Park, Jiwon, et al.
Published: (2025)
MoreHopQA: More Than Multi-hop Reasoning
by: Schnitzler, Julian, et al.
Published: (2024)
by: Schnitzler, Julian, et al.
Published: (2024)
CLIX: Cross-Lingual Explanations of Idiomatic Expressions
by: Gluck, Aaron, et al.
Published: (2025)
by: Gluck, Aaron, et al.
Published: (2025)
Making Long-Context Language Models Better Multi-Hop Reasoners
by: Li, Yanyang, et al.
Published: (2024)
by: Li, Yanyang, et al.
Published: (2024)
UETQuintet at BioCreative IX -- MedHopQA: Enhancing Biomedical QA with Selective Multi-hop Reasoning and Contextual Retrieval
by: Nguyen, Quoc-An, et al.
Published: (2026)
by: Nguyen, Quoc-An, et al.
Published: (2026)
Grounded Multi-Hop VideoQA in Long-Form Egocentric Videos
by: Chen, Qirui, et al.
Published: (2024)
by: Chen, Qirui, et al.
Published: (2024)
RELOOP: Recursive Retrieval with Multi-Hop Reasoner and Planners for Heterogeneous QA
by: Yang, Ruiyi, et al.
Published: (2025)
by: Yang, Ruiyi, et al.
Published: (2025)
Mind the Gap: A Closer Look at Tokenization for Multiple-Choice Question Answering with LLMs
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
by: Sanz-Guerrero, Mario, et al.
Published: (2025)
DeepRAG: Integrating Hierarchical Reasoning and Process Supervision for Biomedical Multi-Hop QA
by: Ji, Yuelyu, et al.
Published: (2025)
by: Ji, Yuelyu, et al.
Published: (2025)
DTKG: Dual-Track Knowledge Graph-Verified Reasoning Framework for Multi-Hop QA
by: Wang, Changhao, et al.
Published: (2025)
by: Wang, Changhao, et al.
Published: (2025)
DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels
by: Xu, Zhe, et al.
Published: (2024)
by: Xu, Zhe, et al.
Published: (2024)
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training
by: He, Junqing, et al.
Published: (2023)
by: He, Junqing, et al.
Published: (2023)
FinReflectKG -- MultiHop: Financial QA Benchmark for Reasoning with Knowledge Graph Evidence
by: Arun, Abhinav, et al.
Published: (2025)
by: Arun, Abhinav, et al.
Published: (2025)
Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA
by: Wu, Yuchen, et al.
Published: (2025)
by: Wu, Yuchen, et al.
Published: (2025)
Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget
by: Bui, Minh Duc, et al.
Published: (2024)
by: Bui, Minh Duc, et al.
Published: (2024)
From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation
by: Marashian, Ali, et al.
Published: (2024)
by: Marashian, Ali, et al.
Published: (2024)
Meenz bleibt Meenz, but Large Language Models Do Not Speak Its Dialect
by: Bui, Minh Duc, et al.
Published: (2026)
by: Bui, Minh Duc, et al.
Published: (2026)
Untangling the Influence of Typology, Data and Model Architecture on Ranking Transfer Languages for Cross-Lingual POS Tagging
by: Rice, Enora, et al.
Published: (2025)
by: Rice, Enora, et al.
Published: (2025)
Implicitly Aligning Humans and Autonomous Agents through Shared Task Abstractions
by: Aroca-Ouellette, Stéphane, et al.
Published: (2025)
by: Aroca-Ouellette, Stéphane, et al.
Published: (2025)
TAMS: Translation-Assisted Morphological Segmentation
by: Rice, Enora, et al.
Published: (2024)
by: Rice, Enora, et al.
Published: (2024)
Similar Items
-
Desiderata for the Context Use of Question Answering Systems
by: Shaier, Sagi, et al.
Published: (2024) -
Who Are All The Stochastic Parrots Imitating? They Should Tell Us!
by: Shaier, Sagi, et al.
Published: (2023) -
It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension
by: Shaier, Sagi, et al.
Published: (2024) -
MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset
by: Shaier, Sagi, et al.
Published: (2024) -
Comparing Template-based and Template-free Language Model Probing
by: Shaier, Sagi, et al.
Published: (2024)