AdaSVD: Adaptive Singular Value Decomposition for Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | Li, Zhiteng, Xia, Mingyuan, Zhang, Jingyuan, Hui, Zheng, Qin, Haotong, Kong, Linghe, Zhang, Yulun, Yang, Xiaokang |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
ARB-LLM: Alternating Refined Binarizations for Large Language Models
by: Li, Zhiteng, et al.
Published: (2024)
by: Li, Zhiteng, et al.
Published: (2024)
QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation
by: Wu, Junyi, et al.
Published: (2025)
by: Wu, Junyi, et al.
Published: (2025)
SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
by: Wang, Xin, et al.
Published: (2024)
by: Wang, Xin, et al.
Published: (2024)
VEQ: Modality-Adaptive Quantization for MoE Vision-Language Models
by: Qin, Guangshuo, et al.
Published: (2026)
by: Qin, Guangshuo, et al.
Published: (2026)
BinaryHPE: 3D Human Pose and Shape Estimation via Binarization
by: Li, Zhiteng, et al.
Published: (2023)
by: Li, Zhiteng, et al.
Published: (2023)
SVD-LLM V2: Optimizing Singular Value Truncation for Large Language Model Compression
by: Wang, Xin, et al.
Published: (2025)
by: Wang, Xin, et al.
Published: (2025)
FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editing
by: Wu, Junyi, et al.
Published: (2025)
by: Wu, Junyi, et al.
Published: (2025)
DVD-Quant: Data-free Video Diffusion Transformers Quantization
by: Li, Zhiteng, et al.
Published: (2025)
by: Li, Zhiteng, et al.
Published: (2025)
ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration
by: Yan, Xianglong, et al.
Published: (2025)
by: Yan, Xianglong, et al.
Published: (2025)
Recursive Generalization Transformer for Image Super-Resolution
by: Chen, Zheng, et al.
Published: (2023)
by: Chen, Zheng, et al.
Published: (2023)
CLIP-SVD: Efficient and Interpretable Vision-Language Adaptation via Singular Values
by: Koleilat, Taha, et al.
Published: (2025)
by: Koleilat, Taha, et al.
Published: (2025)
ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
by: Yuan, Zhihang, et al.
Published: (2023)
by: Yuan, Zhihang, et al.
Published: (2023)
QuantFace: Efficient Quantization for Face Restoration
by: Li, Jiatong, et al.
Published: (2025)
by: Li, Jiatong, et al.
Published: (2025)
Large Language Models Still Face Challenges in Multi-Hop Reasoning with External Knowledge
by: Zhang, Haotong
Published: (2024)
by: Zhang, Haotong
Published: (2024)
Dual Decomposition of Weights and Singular Value Low Rank Adaptation
by: Han, Jialong, et al.
Published: (2025)
by: Han, Jialong, et al.
Published: (2025)
AdaComp: Extractive Context Compression with Adaptive Predictor for Retrieval-Augmented Large Language Models
by: Zhang, Qianchi, et al.
Published: (2024)
by: Zhang, Qianchi, et al.
Published: (2024)
Binarized Diffusion Model for Image Super-Resolution
by: Chen, Zheng, et al.
Published: (2024)
by: Chen, Zheng, et al.
Published: (2024)
Xformer: Hybrid X-Shaped Transformer for Image Denoising
by: Zhang, Jiale, et al.
Published: (2023)
by: Zhang, Jiale, et al.
Published: (2023)
BiMaCoSR: Binary One-Step Diffusion Model Leveraging Flexible Matrix Compression for Real Super-Resolution
by: Liu, Kai, et al.
Published: (2025)
by: Liu, Kai, et al.
Published: (2025)
SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models
by: Cao, Yang, et al.
Published: (2024)
by: Cao, Yang, et al.
Published: (2024)
SAES-SVD: Self-Adaptive Suppression of Accumulated and Local Errors for SVD-based LLM Compression
by: Hu, Xing, et al.
Published: (2026)
by: Hu, Xing, et al.
Published: (2026)
ERC-SVD: Error-Controlled SVD for Large Language Model Compression
by: Bai, Haolei, et al.
Published: (2025)
by: Bai, Haolei, et al.
Published: (2025)
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
by: Yang, Yifan, et al.
Published: (2024)
by: Yang, Yifan, et al.
Published: (2024)
AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback
by: Zhang, Wanpeng, et al.
Published: (2023)
by: Zhang, Wanpeng, et al.
Published: (2023)
Image Super-Resolution with Text Prompt Diffusion
by: Chen, Zheng, et al.
Published: (2023)
by: Chen, Zheng, et al.
Published: (2023)
CondiQuant: Condition Number Based Low-Bit Quantization for Image Super-Resolution
by: Liu, Kai, et al.
Published: (2025)
by: Liu, Kai, et al.
Published: (2025)
Edu-Values: Towards Evaluating the Chinese Education Values of Large Language Models
by: Zhang, Peiyi, et al.
Published: (2024)
by: Zhang, Peiyi, et al.
Published: (2024)
Value-Spectrum: Quantifying Preferences of Vision-Language Models via Value Decomposition in Social Media Contexts
by: Li, Jingxuan, et al.
Published: (2024)
by: Li, Jingxuan, et al.
Published: (2024)
PassionSR: Post-Training Quantization with Adaptive Scale in One-Step Diffusion based Image Super-Resolution
by: Zhu, Libo, et al.
Published: (2024)
by: Zhu, Libo, et al.
Published: (2024)
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models
by: Zheng, Lifan, et al.
Published: (2026)
by: Zheng, Lifan, et al.
Published: (2026)
AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging
by: Zhao, Yiran, et al.
Published: (2024)
by: Zhao, Yiran, et al.
Published: (2024)
AdaSpec: Adaptive Speculative Decoding for Fast, SLO-Aware Large Language Model Serving
by: Huang, Kaiyu, et al.
Published: (2025)
by: Huang, Kaiyu, et al.
Published: (2025)
SARA: Singular-Value Based Adaptive Low-Rank Adaption
by: Gu, Jihao, et al.
Published: (2024)
by: Gu, Jihao, et al.
Published: (2024)
Demystifying Singular Defects in Large Language Models
by: Wang, Haoqi, et al.
Published: (2025)
by: Wang, Haoqi, et al.
Published: (2025)
Parrot Mind: Towards Explaining the Complex Task Reasoning of Pretrained Large Language Models with Template-Content Structure
by: Yang, Haotong, et al.
Published: (2023)
by: Yang, Haotong, et al.
Published: (2023)
Evaluating the Generation Capabilities of Large Chinese Language Models
by: Zeng, Hui, et al.
Published: (2023)
by: Zeng, Hui, et al.
Published: (2023)
NeuronMLP: Efficient LLM Inference via Singular Value Decomposition Compression and Tiling on AWS Trainium
by: Song, Dinghong, et al.
Published: (2025)
by: Song, Dinghong, et al.
Published: (2025)
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution
by: Liu, Kai, et al.
Published: (2024)
by: Liu, Kai, et al.
Published: (2024)
AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
by: Yan, Shannan, et al.
Published: (2026)
by: Yan, Shannan, et al.
Published: (2026)
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender
by: Zhao, Weixiang, et al.
Published: (2025)
by: Zhao, Weixiang, et al.
Published: (2025)
Similar Items
-
ARB-LLM: Alternating Refined Binarizations for Large Language Models
by: Li, Zhiteng, et al.
Published: (2024) -
QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation
by: Wu, Junyi, et al.
Published: (2025) -
SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
by: Wang, Xin, et al.
Published: (2024) -
VEQ: Modality-Adaptive Quantization for MoE Vision-Language Models
by: Qin, Guangshuo, et al.
Published: (2026) -
BinaryHPE: 3D Human Pose and Shape Estimation via Binarization
by: Li, Zhiteng, et al.
Published: (2023)