Image de couverture de livre

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Azizi, Seyedarmin, Kundu, Souvik, Pedram, Massoud
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Top-H Decoding: Adapting the Creativity and Coherence with Bounded Entropy in Text Generation
par: Potraghloo, Erfan Baghaei, et autres
Publié: (2025)

One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness
par: Potraghloo, Erfan Baghaei, et autres
Publié: (2026)

Memory-Efficient Vision Transformers: An Activation-Aware Mixed-Rank Compression Strategy
par: Azizi, Seyedarmin, et autres
Publié: (2024)

Activation Steering for Chain-of-Thought Compression
par: Azizi, Seyedarmin, et autres
Publié: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

Sensitivity-Aware Mixed-Precision Quantization and Width Optimization of Deep Neural Networks Through Cluster-Based Tree-Structured Parzen Estimation
par: Azizi, Seyedarmin, et autres
Publié: (2023)

Efficient Noise Mitigation for Enhancing Inference Accuracy in DNNs on Mixed-Signal Accelerators
par: Azizi, Seyedarmin, et autres
Publié: (2024)

Training-Free Acceleration of ViTs with Delayed Spatial Merging
par: Heo, Jung Hwan, et autres
Publié: (2023)

Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoning
par: Azizi, Seyedarmin, et autres
Publié: (2026)

Understanding the Performance and Estimating the Cost of LLM Fine-Tuning
par: Xia, Yuchen, et autres
Publié: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
par: Nasiri, Hamid, et autres
Publié: (2025)

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
par: Nikdan, Mahdi, et autres
Publié: (2024)

ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
par: Hameed, Marawan Gamal Abdel, et autres
Publié: (2024)

Enhancing Trust in Large Language Models via Uncertainty-Calibrated Fine-Tuning
par: Krishnan, Ranganath, et autres
Publié: (2024)

Boosting Large Language Models with Mask Fine-Tuning
par: Zhang, Mingyuan, et autres
Publié: (2025)

Scaling Sparse Fine-Tuning to Large Language Models
par: Ansell, Alan, et autres
Publié: (2024)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

Improving Large Language Models with Concept-Aware Fine-Tuning
par: Chen, Michael K., et autres
Publié: (2025)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Shi, Zhengxiang, et autres
Publié: (2023)

BEFT: Bias-Efficient Fine-Tuning of Language Models in Low-Data Regimes
par: Huang, Baichuan, et autres
Publié: (2025)

An Efficient Sparse Fine-Tuning with Low Quantization Error via Neural Network Pruning
par: Li, Cen-Jhih, et autres
Publié: (2025)

3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection
par: Ding, Hongxin, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
par: Wang, Luping, et autres
Publié: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Chang, Huandong, et autres
Publié: (2025)

PEANO-ViT: Power-Efficient Approximations of Non-Linearities in Vision Transformers
par: Sadeghi, Mohammad Erfan, et autres
Publié: (2024)

Joint Localization and Activation Editing for Low-Resource Fine-Tuning
par: Lai, Wen, et autres
Publié: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
par: Hayou, Soufiane, et autres
Publié: (2024)

Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Models
par: Chow, Yinlam, et autres
Publié: (2024)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
par: Liu, Yilun, et autres
Publié: (2025)

PoliTune: Analyzing the Impact of Data Selection and Fine-Tuning on Economic and Political Biases in Large Language Models
par: Agiza, Ahmed, et autres
Publié: (2024)

Model Editing by Standard Fine-Tuning
par: Gangadhar, Govind, et autres
Publié: (2024)

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
par: Samplawski, Colin, et autres
Publié: (2025)

Hyperbolic Fine-Tuning for Large Language Models
par: Yang, Menglin, et autres
Publié: (2024)

DATA: Decomposed Attention-based Task Adaptation for Rehearsal-Free Continual Learning
par: Liao, Huanxuan, et autres
Publié: (2025)

Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts
par: Heuillet, Maxime, et autres
Publié: (2025)

Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models
par: Bui, Nghia, et autres
Publié: (2025)

Linear Chain Transformation: Expanding Optimization Dynamics for Fine-Tuning Large Language Models
par: Wang, Yulong, et autres
Publié: (2024)

COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models
par: Fayyazi, Arya, et autres
Publié: (2026)