Cover Image

GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Jiwei, Zhang, Zhicheng, Wu, Shunlong, Ye, Jingheng, Bai, Lichen, Wang, Zitai, Lu, Tingwei, Hai, Lin, Zhao, Yiming, Zheng, Hai-Tao, Kim, Hong-Gee
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SemantiCache: Efficient KV Cache Compression via Semantic Chunking and Clustered Merging
by: Wu, Shunlong, et al.
Published: (2026)

Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios
by: Tang, Jiwei, et al.
Published: (2024)

Read As Human: Compressing Context via Parallelizable Close Reading and Skimming
by: Tang, Jiwei, et al.
Published: (2026)

CL$^2$GEC: A Multi-Discipline Benchmark for Continual Learning in Chinese Literature Grammatical Error Correction
by: Qin, Shang, et al.
Published: (2025)

COMI: Coarse-to-fine Context Compression via Marginal Information Gain
by: Tang, Jiwei, et al.
Published: (2026)

RAISE: Reinforced Adaptive Instruction Selection For Large Language Models
by: Lv, Qingsong, et al.
Published: (2025)

AdmTree: Compressing Lengthy Context with Adaptive Semantic Trees
by: Li, Yangning, et al.
Published: (2025)

Removing Averaging: Personalized Lip-Sync Driven Characters Based on Identity Adapter
by: Zhu, Yanyu, et al.
Published: (2025)

From Token to Line: Enhancing Code Generation with a Long-Term Perspective
by: Lu, Tingwei, et al.
Published: (2025)

Corrections Meet Explanations: A Unified Framework for Explainable Grammatical Error Correction
by: Ye, Jingheng, et al.
Published: (2025)

Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging
by: Liu, Deyuan, et al.
Published: (2024)

Exploring the Implicit Semantic Ability of Multimodal Large Language Models: A Pilot Study on Entity Set Expansion
by: Wang, Hebin, et al.
Published: (2024)

Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven
by: Tang, Jiwei, et al.
Published: (2026)

Compressing Lengthy Context With UltraGist
by: Zhang, Peitian, et al.
Published: (2024)

Long Context Compression with Activation Beacon
by: Zhang, Peitian, et al.
Published: (2024)

FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writing
by: Ye, Jingheng, et al.
Published: (2025)

OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Models
by: Deng, Yuchen, et al.
Published: (2026)

LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging
by: Kim, Jinuk, et al.
Published: (2024)

CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction
by: Ye, Jingheng, et al.
Published: (2024)

Semantic Alignment in Hyperbolic Space for Open-Vocabulary Semantic Segmentation
by: Truong, Hoang M., et al.
Published: (2026)

ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questions
by: Ye, Jingheng, et al.
Published: (2024)

Beyond Boundary Frames: Context-Centric Video Interpolation with Audio-Visual Semantics
by: Deng, Yuchen, et al.
Published: (2025)

Self-Judge: Selective Instruction Following with Alignment Self-Evaluation
by: Ye, Hai, et al.
Published: (2024)

Auxiliary-Hyperparameter-Free Sampling: Entropy Equilibrium for Text Generation
by: Cai, Xiaodong, et al.
Published: (2025)

HSUGA: LLM-Enhanced Recommendation with Hierarchical Semantic Understanding and Group-Aware Alignment
by: Li, Guorui, et al.
Published: (2026)

RegMean++: Enhancing Effectiveness and Generalization of Regression Mean for Model Merging
by: Nguyen, The-Hai, et al.
Published: (2025)

Expert Merging: Model Merging with Unsupervised Expert Alignment and Importance-Guided Layer Chunking
by: Zhang, Dengming, et al.
Published: (2025)

LexSemBridge: Fine-Grained Dense Representation Enhancement through Token-Aware Embedding Augmentation
by: Zhan, Shaoxiong, et al.
Published: (2025)

Entanglement and Magic Correlations Generated by Discrete Beam‐Splitters
by: Lingxuan Feng, et al.
Published: (2025)

Revisiting Classification Taxonomy for Grammatical Errors
by: Zou, Deqing, et al.
Published: (2025)

Enhanced Analysis for the Decoy-State Method
by: Xu, Zitai, et al.
Published: (2024)

Enhanced Analysis for the Decoy‐State Method
by: Zitai Xu, et al.
Published: (2025)

Negative Stiffness Cylindrical Metamaterial via Synergy Between Compression–Torsion Metamaterial and Curved Beams
by: Yun‐Xiao Zhang, et al.
Published: (2026)

Incorporating Scene Context and Semantic Labels for Enhanced Group-level Emotion Recognition
by: Zhu, Qing, et al.
Published: (2025)

Loss-Aware Curriculum Learning for Chinese Grammatical Error Correction
by: Zhang, Ding, et al.
Published: (2024)

DAST: Context-Aware Compression in LLMs via Dynamic Allocation of Soft Tokens
by: Chen, Shaoshen, et al.
Published: (2025)

Directed Information $γ$-covering: An Information-Theoretic Framework for Context Engineering
by: Huang, Hai
Published: (2025)

Robust Image Watermarking Theories and Techniques: A Review
by: Hai Tao
Published: (2014)

Group twirling and noise tailoring for multi-qubit controlled phase gates
by: Liu, Guoding, et al.
Published: (2023)

In-Context Defense in Computer Agents: An Empirical Study
by: Yang, Pei, et al.
Published: (2025)