Image de couverture de livre

Singular Value Decomposition on Kronecker Adaptation for Large Language Model

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chong, Yee Hin, Qu, Peng
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
par: Meng, Fanxu, et autres
Publié: (2024)

KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models
par: Wang, Fan, et autres
Publié: (2024)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
par: Nasiri, Hamid, et autres
Publié: (2025)

Invisible Backdoor Attack Through Singular Value Decomposition
par: Chen, Wenmin, et autres
Publié: (2024)

GADPN: Graph Adaptive Denoising and Perturbation Networks via Singular Value Decomposition
par: Deng, Hao, et autres
Publié: (2026)

LFA applied to CNNs: Efficient Singular Value Decomposition of Convolutional Mappings by Local Fourier Analysis
par: van Betteray, Antonia, et autres
Publié: (2025)

Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models
par: Chekalina, Viktoriia, et autres
Publié: (2025)

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning
par: Yang, Yibo, et autres
Publié: (2024)

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving
par: Gao, Wei, et autres
Publié: (2025)

What Makes Reasoning Invalid: Echo Reflection Mitigation for Large Language Models
par: He, Chen, et autres
Publié: (2025)

VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Models
par: Xu, Hefei, et autres
Publié: (2026)

A Generalized Singular Value Theory for Neural Networks
par: Brown, Brian Charles, et autres
Publié: (2026)

SLaB: Sparse-Lowrank-Binary Decomposition for Efficient Large Language Models
par: Li, Ziwei, et autres
Publié: (2026)

FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models
par: Ramesh, Hariharan, et autres
Publié: (2025)

CoSA: Compressed Sensing-Based Adaptation of Large Language Models
par: Wei, Songtao, et autres
Publié: (2026)

Higher-Order Transformers With Kronecker-Structured Attention
par: Omranpour, Soroush, et autres
Publié: (2024)

An Interpretable and Scalable Framework for Evaluating Large Language Models
par: Qu, Xinhao, et autres
Publié: (2026)

Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Models
par: Guo, Hanze, et autres
Publié: (2025)

Skewed Memorization in Large Language Models: Quantification and Decomposition
par: Li, Hao, et autres
Publié: (2025)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation
par: Chong, Yee Hin, et autres
Publié: (2026)

Evidence-based Distributional Alignment for Large Language Models
par: Pham, Viet-Thanh, et autres
Publié: (2026)

L3Ms -- Lagrange Large Language Models
par: Dhillon, Guneet S., et autres
Publié: (2024)

TLoRA: Tri-Matrix Low-Rank Adaptation of Large Language Models
par: Islam, Tanvir
Publié: (2025)

Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain
par: Wi, Hyowon, et autres
Publié: (2025)

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression
par: Kautsar, Muchammad Daniyal, et autres
Publié: (2025)

Relative Value Biases in Large Language Models
par: Hayes, William M., et autres
Publié: (2024)

Exploring Federated Pruning for Large Language Models
par: Guo, Pengxin, et autres
Publié: (2025)

CURing Large Models: Compression via CUR Decomposition
par: Park, Sanghyeon, et autres
Publié: (2025)

FANoise: Singular Value-Adaptive Noise Modulation for Robust Multimodal Representation Learning
par: Li, Jiaoyang, et autres
Publié: (2025)

SPA-Cache: Singular Proxies for Adaptive Caching in Diffusion Language Models
par: Sun, Wenhao, et autres
Publié: (2026)

On the Limits of Self-Improving in Large Language Models: The Singularity Is Not Near Without Symbolic Model Synthesis
par: Zenil, Hector
Publié: (2026)

Auditing Language Model Unlearning via Information Decomposition
par: Goel, Anmol, et autres
Publié: (2026)

The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models
par: Jeong, Daniel P., et autres
Publié: (2024)

TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
par: Mu, Lin, et autres
Publié: (2026)

Internal Value Alignment in Large Language Models through Controlled Value Vector Activation
par: Jin, Haoran, et autres
Publié: (2025)

MoKA: Mixture of Kronecker Adapters
par: Sadeghi, Mohammadreza, et autres
Publié: (2025)

RE-Adapt: Reverse Engineered Adaptation of Large Language Models
par: Fleshman, William, et autres
Publié: (2024)

LEAD: Learning Decomposition for Source-free Universal Domain Adaptation
par: Qu, Sanqing, et autres
Publié: (2024)

Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress?
par: Jeong, Daniel P., et autres
Publié: (2024)

Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities
par: Lin, Zheng, et autres
Publié: (2023)