Cover Image

Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ji, Yixin, Xiang, Yang, Li, Juntao, Xia, Qingrong, Ye, Zi, Duan, Xinyu, Wang, Zhefeng, Chen, Kehai, Zhang, Min
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Beware of Calibration Data for Pruning Large Language Models
by: Ji, Yixin, et al.
Published: (2024)

OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure
by: Wang, Jikai, et al.
Published: (2024)

CaliDrop: KV Cache Compression with Calibration
by: Su, Yi, et al.
Published: (2025)

$A^3$: Attention-Aware Accurate KV Cache Fusion for Fast Large Language Model Serving
by: Zhou, Yuechi, et al.
Published: (2025)

Alignment-Augmented Speculative Decoding with Alignment Sampling and Conditional Verification
by: Wang, Jikai, et al.
Published: (2025)

Taming the Titans: A Survey of Efficient LLM Inference Serving
by: Zhen, Ranran, et al.
Published: (2025)

Accurate KV Cache Quantization with Outlier Tokens Tracing
by: Su, Yi, et al.
Published: (2025)

The Power of Personality: A Human Simulation Perspective to Investigate Large Language Model Agents
by: Duan, Yifan, et al.
Published: (2025)

Think Before You Prune: Selective Self-Generated Calibration for Pruning Large Reasoning Models
by: Xiang, Yang, et al.
Published: (2025)

Adapprox: Adaptive Approximation in Adam Optimization via Randomized Low-Rank Matrices
by: Zhao, Pengxiang, et al.
Published: (2024)

ORPP: Self-Optimizing Role-playing Prompts to Enhance Language Model Capabilities
by: Duan, Yifan, et al.
Published: (2025)

XIFBench: Evaluating Large Language Models on Multilingual Instruction Following
by: Li, Zhenyu, et al.
Published: (2025)

LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning
by: Zhang, Hongbin, et al.
Published: (2024)

Exploring the Translation Mechanism of Large Language Models
by: Zhang, Hongbin, et al.
Published: (2025)

MASTER: Enhancing Large Language Model via Multi-Agent Simulated Teaching
by: Yue, Liang, et al.
Published: (2025)

Efficient Safety Alignment of Large Language Models via Preference Re-ranking and Representation-based Reward Modeling
by: Deng, Qiyuan, et al.
Published: (2025)

When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning
by: Xiang, Yang, et al.
Published: (2026)

Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model
by: Zhang, Hongbin, et al.
Published: (2024)

A Survey on Human Preference Learning for Large Language Models
by: Jiang, Ruili, et al.
Published: (2024)

1+1>2: A Synergistic Sparse and Low-Rank Compression Method for Large Language Models
by: Zong, Zeliang, et al.
Published: (2025)

SkipCat: Rank-Maximized Low-Rank Compression of Large Language Models via Shared Projection and Block Skipping
by: Lu, Yu-Chen, et al.
Published: (2025)

Agentic Tool Use in Large Language Models
by: Hu, Jinchao, et al.
Published: (2026)

MemLong: Memory-Augmented Retrieval for Long Text Modeling
by: Liu, Weijie, et al.
Published: (2024)

TF-Attack: Transferable and Fast Adversarial Attacks on Large Language Models
by: Li, Zelin, et al.
Published: (2024)

A Bayesian Interpretation of Adaptive Low-Rank Adaptation
by: Chen, Haolin, et al.
Published: (2024)

High-order Joint Constituency and Dependency Parsing
by: Gu, Yanggan, et al.
Published: (2023)

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
by: Onal, Emre, et al.
Published: (2024)

Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning
by: Zhu, Yingjie, et al.
Published: (2024)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
by: Shi, Haizhou, et al.
Published: (2024)

Evaluating and Steering Modality Preferences in Multimodal Large Language Model
by: Zhang, Yu, et al.
Published: (2025)

Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
by: Jin, Feihu, et al.
Published: (2024)

When to Trust Tools? Adaptive Tool Trust Calibration For Tool-Integrated Math Reasoning
by: Xu, Ruotao, et al.
Published: (2026)

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
by: Samplawski, Colin, et al.
Published: (2025)

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
by: Wang, Yibin, et al.
Published: (2024)

Generator-Assistant Stepwise Rollback Framework for Large Language Model Agent
by: Li, Xingzuo, et al.
Published: (2025)

RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models
by: Wang, Bichen, et al.
Published: (2024)

Where Matters More Than What: Decoding-aligned KV Cache Compression via Position-aware Pseudo Queries
by: Tian, Zhenxu, et al.
Published: (2026)

Large Language Models for Classical Chinese Poetry Translation: Benchmarking, Evaluating, and Improving
by: Chen, Andong, et al.
Published: (2024)

Dynamic Rank Reinforcement Learning for Adaptive Low-Rank Multi-Head Self Attention in Large Language Models
by: Erden, Caner
Published: (2025)

ZigZagkv: Dynamic KV Cache Compression for Long-context Modeling based on Layer Uncertainty
by: Zhong, Meizhi, et al.
Published: (2024)