:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Wenhao, Wang, Yizhong, Xiao, Guangxuan, Peng, Hao, Fu, Yao
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	https://arxiv.org/abs/2404.15574
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
di: Xiao, Guangxuan, et al.
Pubblicazione: (2024)

Long Context Alignment with Short Instructions and Synthesized Positions
di: Wu, Wenhao, et al.
Pubblicazione: (2024)

LongEmbed: Extending Embedding Models for Long Context Retrieval
di: Zhu, Dawei, et al.
Pubblicazione: (2024)

Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
di: Tang, Jiaming, et al.
Pubblicazione: (2024)

Context-Efficient Retrieval with Factual Decomposition
di: Li, Yanhong, et al.
Pubblicazione: (2025)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
di: Xiao, Chaojun, et al.
Pubblicazione: (2024)

Induction Head Toxicity Mechanistically Explains Repetition Curse in Large Language Models
di: Wang, Shuxun, et al.
Pubblicazione: (2025)

ZigzagAttention: Efficient Long-Context Inference with Exclusive Retrieval and Streaming Heads
di: Liu, Zhuorui, et al.
Pubblicazione: (2025)

From Interpretability to Performance: Optimizing Retrieval Heads for Long-Context Language Models
di: Ma, Youmi, et al.
Pubblicazione: (2026)

Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking
di: Zhang, Wuwei, et al.
Pubblicazione: (2025)

VERA: Identifying and Leveraging Visual Evidence Retrieval Heads in Long-Context Understanding
di: Pei, Rongcan, et al.
Pubblicazione: (2026)

Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation
di: Ren, Ruiyang, et al.
Pubblicazione: (2023)

FlashBack:Efficient Retrieval-Augmented Language Modeling for Long Context Inference
di: Liu, Runheng, et al.
Pubblicazione: (2024)

HGOT: Hierarchical Graph of Thoughts for Retrieval-Augmented In-Context Learning in Factuality Evaluation
di: Fang, Yihao, et al.
Pubblicazione: (2024)

Understanding Synthetic Context Extension via Retrieval Heads
di: Zhao, Xinyu, et al.
Pubblicazione: (2024)

LongHeads: Multi-Head Attention is Secretly a Long Context Processor
di: Lu, Yi, et al.
Pubblicazione: (2024)

Long$^2$RAG: Evaluating Long-Context & Long-Form Retrieval-Augmented Generation with Key Point Recall
di: Qi, Zehan, et al.
Pubblicazione: (2024)

Mechanistic Understanding and Mitigation of Language Model Non-Factual Hallucinations
di: Yu, Lei, et al.
Pubblicazione: (2024)

Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning
di: Wang, Jianing, et al.
Pubblicazione: (2023)

Co-occurrence is not Factual Association in Language Models
di: Zhang, Xiao, et al.
Pubblicazione: (2024)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
di: Xiao, Guangxuan, et al.
Pubblicazione: (2022)

BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models
di: Cao, Qingqing, et al.
Pubblicazione: (2023)

Factuality and Transparency Are All RAG Needs! Self-Explaining Contrastive Evidence Re-ranking
di: Vargas, Francielle, et al.
Pubblicazione: (2025)

Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
di: Fu, Yu, et al.
Pubblicazione: (2024)

Challenges in Deploying Long-Context Transformers: A Theoretical Peak Performance Analysis
di: Fu, Yao
Pubblicazione: (2024)

FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answering
di: Cai, Tianchi, et al.
Pubblicazione: (2024)

A Little Goes a Long Way: Efficient Long Context Training and Inference with Partial Contexts
di: Ge, Suyu, et al.
Pubblicazione: (2024)

Inference Scaling for Long-Context Retrieval Augmented Generation
di: Yue, Zhenrui, et al.
Pubblicazione: (2024)

Infinite Retrieval: Attention Enhanced LLMs in Long-Context Processing
di: Ye, Xiaoju, et al.
Pubblicazione: (2025)

Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding
di: Li, Yuqing, et al.
Pubblicazione: (2025)

CTkvr: KV Cache Retrieval for Long-Context LLMs via Centroid then Token Indexing
di: Lu, Kuan, et al.
Pubblicazione: (2025)

Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence
di: Fayyaz, Mohsen, et al.
Pubblicazione: (2025)

Optimizing Mixture of Block Attention
di: Xiao, Guangxuan, et al.
Pubblicazione: (2025)

Only Say What You Know: Calibration-Aware Generation for Long-Form Factuality
di: Luo, Wen, et al.
Pubblicazione: (2026)

Beyond Factual Accuracy: Evaluating Coverage of Diverse Factual Information in Long-form Text Generation
di: Samarinas, Chris, et al.
Pubblicazione: (2025)

Agent-as-Judge for Factual Summarization of Long Narratives
di: Jeong, Yeonseok, et al.
Pubblicazione: (2025)

Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness
di: Bi, Baolong, et al.
Pubblicazione: (2024)

Locret: Enhancing Eviction in Long-Context LLM Inference with Trained Retaining Heads on Consumer-Grade Devices
di: Huang, Yuxiang, et al.
Pubblicazione: (2024)

RRAttention: Dynamic Block Sparse Attention via Per-Head Round-Robin Shifts for Long-Context Inference
di: Liu, Siran, et al.
Pubblicazione: (2026)

Dr. SoW: Density Ratio of Strong-over-weak LLMs for Reducing the Cost of Human Annotation in Preference Tuning
di: Xu, Guangxuan, et al.
Pubblicazione: (2024)