Guardado en:
| Autores principales: | Li, Aaron Branson Cigres, Wang, Zhaowei, Zhao, Yu, Du, Yiming, Li, Haobo, Ren, Xiyu, Wong, Ginny, See, Simon, Luo, Lishu, Duan, Haodong, Minervini, Pasquale, Song, Yangqiu |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2605.27243 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
MMLongBench: Benchmarking Long-Context Vision-Language Models Effectively and Thoroughly
por: Wang, Zhaowei, et al.
Publicado: (2025)
por: Wang, Zhaowei, et al.
Publicado: (2025)
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
por: Ren, Xiyu, et al.
Publicado: (2026)
por: Ren, Xiyu, et al.
Publicado: (2026)
Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context
por: Wang, Zhaowei, et al.
Publicado: (2026)
por: Wang, Zhaowei, et al.
Publicado: (2026)
$\mathbb{R}^{2k}$ is Theoretically Large Enough for Embedding-based Top-$k$ Retrieval
por: Wang, Zihao, et al.
Publicado: (2026)
por: Wang, Zihao, et al.
Publicado: (2026)
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
por: Gema, Aryo Pradipta, et al.
Publicado: (2024)
por: Gema, Aryo Pradipta, et al.
Publicado: (2024)
Retrieval Head Mechanistically Explains Long-Context Factuality
por: Wu, Wenhao, et al.
Publicado: (2024)
por: Wu, Wenhao, et al.
Publicado: (2024)
Evaluating and Safeguarding the Adversarial Robustness of Retrieval-Based In-Context Learning
por: Yu, Simon, et al.
Publicado: (2024)
por: Yu, Simon, et al.
Publicado: (2024)
VERA: Identifying and Leveraging Visual Evidence Retrieval Heads in Long-Context Understanding
por: Pei, Rongcan, et al.
Publicado: (2026)
por: Pei, Rongcan, et al.
Publicado: (2026)
Answerability in Retrieval-Augmented Open-Domain Question Answering
por: Abdumalikov, Rustam, et al.
Publicado: (2024)
por: Abdumalikov, Rustam, et al.
Publicado: (2024)
Retrieval Heads are Dynamic
por: Lin, Yuping, et al.
Publicado: (2026)
por: Lin, Yuping, et al.
Publicado: (2026)
The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning
por: Zheng, Tianshi, et al.
Publicado: (2025)
por: Zheng, Tianshi, et al.
Publicado: (2025)
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation
por: Wang, Zhaowei, et al.
Publicado: (2024)
por: Wang, Zhaowei, et al.
Publicado: (2024)
ZigzagAttention: Efficient Long-Context Inference with Exclusive Retrieval and Streaming Heads
por: Liu, Zhuorui, et al.
Publicado: (2025)
por: Liu, Zhuorui, et al.
Publicado: (2025)
From Interpretability to Performance: Optimizing Retrieval Heads for Long-Context Language Models
por: Ma, Youmi, et al.
Publicado: (2026)
por: Ma, Youmi, et al.
Publicado: (2026)
Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking
por: Zhang, Wuwei, et al.
Publicado: (2025)
por: Zhang, Wuwei, et al.
Publicado: (2025)
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
por: Xiao, Guangxuan, et al.
Publicado: (2024)
por: Xiao, Guangxuan, et al.
Publicado: (2024)
Understanding Synthetic Context Extension via Retrieval Heads
por: Zhao, Xinyu, et al.
Publicado: (2024)
por: Zhao, Xinyu, et al.
Publicado: (2024)
ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertainty
por: Zong, Qing, et al.
Publicado: (2024)
por: Zong, Qing, et al.
Publicado: (2024)
The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation
por: Kahardipraja, Patrick, et al.
Publicado: (2025)
por: Kahardipraja, Patrick, et al.
Publicado: (2025)
LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning
por: Zheng, Tianshi, et al.
Publicado: (2025)
por: Zheng, Tianshi, et al.
Publicado: (2025)
LongHeads: Multi-Head Attention is Secretly a Long Context Processor
por: Lu, Yi, et al.
Publicado: (2024)
por: Lu, Yi, et al.
Publicado: (2024)
PosterSum: A Multimodal Benchmark for Scientific Poster Summarization
por: Saxena, Rohit, et al.
Publicado: (2025)
por: Saxena, Rohit, et al.
Publicado: (2025)
Contrastive Retrieval Heads Improve Attention-Based Re-Ranking
por: Tran, Linh, et al.
Publicado: (2025)
por: Tran, Linh, et al.
Publicado: (2025)
VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
por: Saxena, Rohit, et al.
Publicado: (2026)
por: Saxena, Rohit, et al.
Publicado: (2026)
Persona Knowledge-Aligned Prompt Tuning Method for Online Debate
por: Chan, Chunkit, et al.
Publicado: (2024)
por: Chan, Chunkit, et al.
Publicado: (2024)
Lost in Time: Clock and Calendar Understanding Challenges in Multimodal LLMs
por: Saxena, Rohit, et al.
Publicado: (2025)
por: Saxena, Rohit, et al.
Publicado: (2025)
Do Composed Image Retrieval Benchmarks Require Multimodal Composition?
por: Attimonelli, Matteo, et al.
Publicado: (2026)
por: Attimonelli, Matteo, et al.
Publicado: (2026)
Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoning
por: Fang, Tianqing, et al.
Publicado: (2023)
por: Fang, Tianqing, et al.
Publicado: (2023)
ILRe: Intermediate Layer Retrieval for Context Compression in Causal Language Models
por: Liang, Manlai, et al.
Publicado: (2025)
por: Liang, Manlai, et al.
Publicado: (2025)
A Parametric Memory Head for Continual Generative Retrieval
por: Mekonnen, Kidist Amde, et al.
Publicado: (2026)
por: Mekonnen, Kidist Amde, et al.
Publicado: (2026)
Headings, Subject. See SUBJECT HEADINGS
por: Woods, William Edward
Publicado: (1972)
por: Woods, William Edward
Publicado: (1972)
Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domain
por: Sayin, Burcu, et al.
Publicado: (2024)
por: Sayin, Burcu, et al.
Publicado: (2024)
XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
por: Shohan, Faisal Tareque, et al.
Publicado: (2024)
por: Shohan, Faisal Tareque, et al.
Publicado: (2024)
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
por: Fu, Yu, et al.
Publicado: (2024)
por: Fu, Yu, et al.
Publicado: (2024)
CompressKV: Semantic Retrieval Heads Know What Tokens are Not Important Before Generation
por: Lin, Xiaolin, et al.
Publicado: (2025)
por: Lin, Xiaolin, et al.
Publicado: (2025)
The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval
por: Chiang, Ting-Rui, et al.
Publicado: (2025)
por: Chiang, Ting-Rui, et al.
Publicado: (2025)
Mixtures of In-Context Learners
por: Hong, Giwon, et al.
Publicado: (2024)
por: Hong, Giwon, et al.
Publicado: (2024)
UniHead: Unifying Multi-Perception for Detection Heads
por: Zhou, Hantao, et al.
Publicado: (2023)
por: Zhou, Hantao, et al.
Publicado: (2023)
MLDocRAG: Multimodal Long-Context Document Retrieval Augmented Generation
por: Zhang, Yongyue, et al.
Publicado: (2026)
por: Zhang, Yongyue, et al.
Publicado: (2026)
LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
por: Cai, Qifeng, et al.
Publicado: (2025)
por: Cai, Qifeng, et al.
Publicado: (2025)
Ejemplares similares
-
MMLongBench: Benchmarking Long-Context Vision-Language Models Effectively and Thoroughly
por: Wang, Zhaowei, et al.
Publicado: (2025) -
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
por: Ren, Xiyu, et al.
Publicado: (2026) -
Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context
por: Wang, Zhaowei, et al.
Publicado: (2026) -
$\mathbb{R}^{2k}$ is Theoretically Large Enough for Embedding-based Top-$k$ Retrieval
por: Wang, Zihao, et al.
Publicado: (2026) -
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
por: Gema, Aryo Pradipta, et al.
Publicado: (2024)