Cover Image

Submodular Context Partitioning and Compression for In-Context Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Shaoyi, Zhang, Canyu, Zhou, Tianyi, Wang, Shengjie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context
by: Teng, Xin, et al.
Published: (2026)

Data-Efficient Biomedical In-Context Learning: A Diversity-Enhanced Submodular Perspective
by: Wang, Jun, et al.
Published: (2025)

Efficient Context Propagating Perceiver Architectures for Auto-Regressive Language Modeling
by: Mahmood, Kaleel, et al.
Published: (2024)

Compressing Lengthy Context With UltraGist
by: Zhang, Peitian, et al.
Published: (2024)

Density-aware Soft Context Compression with Semi-Dynamic Compression Ratio
by: Yu, Yijiong, et al.
Published: (2026)

Where to show Demos in Your Prompt: A Positional Bias of In-Context Learning
by: Cobbina, Kwesi, et al.
Published: (2025)

CCF: A Context Compression Framework for Efficient Long-Sequence Language Modeling
by: Li, Wenhao, et al.
Published: (2025)

Long Context Compression with Activation Beacon
by: Zhang, Peitian, et al.
Published: (2024)

DataSculpt: Crafting Data Landscapes for Long-Context LLMs through Multi-Objective Partitioning
by: Lu, Keer, et al.
Published: (2024)

In-Context Former: Lightning-fast Compressing Context for Large Language Model
by: Wang, Xiangfeng, et al.
Published: (2024)

Effective In-Context Example Selection through Data Compression
by: Sun, Zhongxiang, et al.
Published: (2024)

COMI: Coarse-to-fine Context Compression via Marginal Information Gain
by: Tang, Jiwei, et al.
Published: (2026)

BenTo: Benchmark Task Reduction with In-Context Transferability
by: Zhao, Hongyu, et al.
Published: (2024)

Recurrent Context Compression: Efficiently Expanding the Context Window of LLM
by: Huang, Chensen, et al.
Published: (2024)

Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression
by: Zhang, Yong, et al.
Published: (2025)

QUITO: Accelerating Long-Context Reasoning through Query-Guided Context Compression
by: Wang, Wenshan, et al.
Published: (2024)

Read As Human: Compressing Context via Parallelizable Close Reading and Skimming
by: Tang, Jiwei, et al.
Published: (2026)

TAMTRL: Teacher-Aligned Reward Reshaping for Multi-Turn Reinforcement Learning in Long-Context Compression
by: Wang, Li, et al.
Published: (2026)

Compress the Context, Keep the Commitments: A Formal Framework for Verifiable LLM Context Compression
by: Trukhina, Natalia, et al.
Published: (2026)

LongAttnComp: Cross-Family Context Compression for Long-Context Reasoning
by: Ji, Mengmeng, et al.
Published: (2026)

From Compression to Expression: A Layerwise Analysis of In-Context Learning
by: Jiang, Jiachen, et al.
Published: (2025)

APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs
by: Huang, Yuxiang, et al.
Published: (2025)

From Context to EDUs: Faithful and Structured Context Compression via Elementary Discourse Unit Decomposition
by: Zhou, Yiqing, et al.
Published: (2025)

Query Suggestion for Retrieval-Augmented Generation via Dynamic In-Context Learning
by: Spaeh, Fabian, et al.
Published: (2026)

Learning-to-Context Slope: Evaluating In-Context Learning Effectiveness Beyond Performance Illusions
by: Wang, Dingzriui, et al.
Published: (2025)

AdaComp: Extractive Context Compression with Adaptive Predictor for Retrieval-Augmented Large Language Models
by: Zhang, Qianchi, et al.
Published: (2024)

GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment
by: Tang, Jiwei, et al.
Published: (2025)

DynamicKV: Task-Aware Adaptive KV Cache Compression for Long Context LLMs
by: Zhou, Xiabin, et al.
Published: (2024)

Enhancing RAG Efficiency with Adaptive Context Compression
by: Guo, Shuyu, et al.
Published: (2025)

On Many-Shot In-Context Learning for Long-Context Evaluation
by: Zou, Kaijian, et al.
Published: (2024)

Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven
by: Tang, Jiwei, et al.
Published: (2026)

Contexting as Recommendation: Evolutionary Collaborative Filtering for Context Engineering
by: Zhu, Jiachen, et al.
Published: (2026)

Concise and Precise Context Compression for Tool-Using Language Models
by: Xu, Yang, et al.
Published: (2024)

AdmTree: Compressing Lengthy Context with Adaptive Semantic Trees
by: Li, Yangning, et al.
Published: (2025)

Revealing the Learning Dynamics of Long-Context Continual Pre-training
by: Liang, Yupu, et al.
Published: (2026)

Evaluating Zero-Shot Long-Context LLM Compression
by: Wang, Chenyu, et al.
Published: (2024)

Attn-GS: Attention-Guided Context Compression for Efficient Personalized LLMs
by: Zeng, Shenglai, et al.
Published: (2026)

Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios
by: Tang, Jiwei, et al.
Published: (2024)

Context-Adaptive Synthesis and Compression for Enhanced Retrieval-Augmented Generation in Complex Domains
by: Zhou, Peiran, et al.
Published: (2025)

Data Distribution Matters: A Data-Centric Perspective on Context Compression for Large Language Model
by: Lv, Kangtao, et al.
Published: (2026)