Copertina

Optimizing Singular Spectrum for Large Language Model Compression

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Dengjie, Shen, Tiancheng, Zhou, Yao, Yang, Baisong, Liu, Zhongying, Yang, Masheng, Ghanem, Bernard, Yang, Yibo, Zhong, Yujie, Yang, Ming-Hsuan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

HiMix: Reducing Computational Complexity in Large Vision-Language Models
di: Zhang, Xuange, et al.
Pubblicazione: (2025)

Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence
di: Yang, Yibo, et al.
Pubblicazione: (2025)

Generalizable Entity Grounding via Assistance of Large Language Model
di: Qi, Lu, et al.
Pubblicazione: (2024)

ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
di: Yuan, Zhihang, et al.
Pubblicazione: (2023)

SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models
di: Cao, Yang, et al.
Pubblicazione: (2024)

SVD-LLM V2: Optimizing Singular Value Truncation for Large Language Model Compression
di: Wang, Xin, et al.
Pubblicazione: (2025)

Advancing Visual Large Language Model for Multi-granular Versatile Perception
di: Xiang, Wentao, et al.
Pubblicazione: (2025)

Beyond Pass-by-Pass Optimization: Intent-Driven IR Optimization with Large Language Models
di: Qiu, Lei, et al.
Pubblicazione: (2026)

Towards Reliable and Interpretable Traffic Crash Pattern Prediction and Safety Interventions Using Customized Large Language Models
di: Zhao, Yang, et al.
Pubblicazione: (2025)

Large Language Model Unlearning
di: Yao, Yuanshun, et al.
Pubblicazione: (2023)

CLMN: Concept based Language Models via Neural Symbolic Reasoning
di: Yang, Yibo
Pubblicazione: (2025)

Data-free Weight Compress and Denoise for Large Language Models
di: Peng, Runyu, et al.
Pubblicazione: (2024)

Classifying Cancer Stage with Open-Source Clinical Large Language Models
di: Chang, Chia-Hsuan, et al.
Pubblicazione: (2024)

Blockwise SFT for Diffusion Language Models: Reconciling Bidirectional Attention and Autoregressive Decoding
di: Sun, Bowen, et al.
Pubblicazione: (2025)

Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging
di: An, Bang, et al.
Pubblicazione: (2025)

Collaboration among Multiple Large Language Models for Medical Question Answering
di: Shang, Kexin, et al.
Pubblicazione: (2025)

Large Language Models as Optimizers
di: Yang, Chengrun, et al.
Pubblicazione: (2023)

LLAVADI: What Matters For Multimodal Large Language Models Distillation
di: Xu, Shilin, et al.
Pubblicazione: (2024)

Survey of Specialized Large Language Model
di: Yang, Chenghan, et al.
Pubblicazione: (2025)

The Efficiency Spectrum of Large Language Models: An Algorithmic Survey
di: Ding, Tianyu, et al.
Pubblicazione: (2023)

Personalized Decision Modeling: Utility Optimization or Textualized-Symbolic Reasoning
di: Zhao, Yibo, et al.
Pubblicazione: (2025)

Hierarchical Federated Unlearning for Large Language Models
di: Zhong, Yisheng, et al.
Pubblicazione: (2025)

LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment
di: Yang, Ge, et al.
Pubblicazione: (2024)

Self-Evolutionary Large Language Models through Uncertainty-Enhanced Preference Optimization
di: Wang, Jianing, et al.
Pubblicazione: (2024)

Membership Inference Attack against Long-Context Large Language Models
di: Wang, Zixiong, et al.
Pubblicazione: (2024)

HGAdapter: Hypergraph-based Adapters in Language Models for Code Summarization and Clone Detection
di: Yang, Guang, et al.
Pubblicazione: (2025)

MiniDisc: Minimal Distillation Schedule for Language Model Compression
di: Zhang, Chen, et al.
Pubblicazione: (2022)

Behind the Magic, MERLIM: Multi-modal Evaluation Benchmark for Large Image-Language Models
di: Villa, Andrés, et al.
Pubblicazione: (2023)

Large Language Models are In-context Teachers for Knowledge Reasoning
di: Zhao, Jiachen, et al.
Pubblicazione: (2023)

Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization
di: Ji, Yixin, et al.
Pubblicazione: (2024)

SPQ: An Ensemble Technique for Large Language Model Compression
di: Yao, Jiamin, et al.
Pubblicazione: (2026)

Federated Cross-Domain Click-Through Rate Prediction With Large Language Model Augmentation
di: Qin, Jiangcheng, et al.
Pubblicazione: (2025)

OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language Models
di: Liu, Yang, et al.
Pubblicazione: (2024)

Value-Spectrum: Quantifying Preferences of Vision-Language Models via Value Decomposition in Social Media Contexts
di: Li, Jingxuan, et al.
Pubblicazione: (2024)

Optimizing RLHF Training for Large Language Models with Stage Fusion
di: Zhong, Yinmin, et al.
Pubblicazione: (2024)

SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
di: Wang, Xin, et al.
Pubblicazione: (2024)

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models
di: Yang, Jinbiao
Pubblicazione: (2024)

Bayesian Optimization for Enhanced Language Models: Optimizing Acquisition Functions
di: Bao, Zishuo, et al.
Pubblicazione: (2025)

Data Proportion Detection for Optimized Data Management for Large Language Models
di: Liang, Hao, et al.
Pubblicazione: (2024)

SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
di: Hinojosa, Carlos, et al.
Pubblicazione: (2026)