Imagen de Portada

LoQT: Low-Rank Adapters for Quantized Pretraining

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Loeschcke, Sebastian, Toftrup, Mads, Kastoryano, Michael J., Belongie, Serge, Snæbjarnarson, Vésteinn
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Contrastive Decoding for Synthetic Data Generation in Low-Resource Language Modeling
por: Ulm, Jannek, et al.
Publicado: (2025)

Coarse-To-Fine Tensor Trains for Compact Visual Representations
por: Loeschcke, Sebastian, et al.
Publicado: (2024)

Assessing Neural Network Robustness via Adversarial Pivotal Tuning
por: Christensen, Peter Ebert, et al.
Publicado: (2022)

Gumbel Counterfactual Generation From Language Models
por: Ravfogel, Shauli, et al.
Publicado: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

Unlocking the Global Synergies in Low-Rank Adapters
por: Zhang, Zixi, et al.
Publicado: (2024)

Ensembles of Low-Rank Expert Adapters
por: Li, Yinghao, et al.
Publicado: (2025)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
por: Rajabzadeh, Hossein, et al.
Publicado: (2024)

On the Proper Treatment of Units in Surprisal Theory
por: Kiegeland, Samuel, et al.
Publicado: (2026)

Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
por: Muñoz, J. Pablo, et al.
Publicado: (2025)

LQER: Low-Rank Quantization Error Reconstruction for LLMs
por: Zhang, Cheng, et al.
Publicado: (2024)

Multi-Modal Framing Analysis of News
por: Arora, Arnav, et al.
Publicado: (2025)

Multiple Choice Learning of Low-Rank Adapters for Language Modeling
por: Letzelter, Victor, et al.
Publicado: (2025)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

LoLA: Low-Rank Linear Attention With Sparse Caching
por: McDermott, Luke, et al.
Publicado: (2025)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
por: Shi, Haizhou, et al.
Publicado: (2024)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
por: Gowda, Dhananjaya, et al.
Publicado: (2025)

AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model
por: Yan, Yongyu, et al.
Publicado: (2022)

LCQ: Low-Rank Codebook based Quantization for Large Language Models
por: Cai, Wen-Pu, et al.
Publicado: (2024)

Low-Rank Quantization-Aware Training for LLMs
por: Bondarenko, Yelysei, et al.
Publicado: (2024)

Revealing Fine-Grained Values and Opinions in Large Language Models
por: Wright, Dustin, et al.
Publicado: (2024)

LoLCATs: On Low-Rank Linearizing of Large Language Models
por: Zhang, Michael, et al.
Publicado: (2024)

LoTR: Low Tensor Rank Weight Adaptation
por: Bershatsky, Daniel, et al.
Publicado: (2024)

LoRMA: Low-Rank Multiplicative Adaptation for LLMs
por: Bihany, Harsh, et al.
Publicado: (2025)

ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals
por: Saxena, Utkarsh, et al.
Publicado: (2024)

Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization
por: Hajimolahoseini, Habib, et al.
Publicado: (2023)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Zhang, Haojie
Publicado: (2025)

HiP-LoRA: Budgeted Spectral Plasticity for Robust Low-Rank Adaptation
por: Chen, Lixian, et al.
Publicado: (2026)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
por: Wang, Xinjue, et al.
Publicado: (2026)

Learning Adapter Rank via Symmetry Breaking
por: Doyle, Cooper, et al.
Publicado: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

Queryable LoRA: Instruction-Regularized Routing Over Shared Low-Rank Update Atoms
por: Vaidya, Omatharv Bharat, et al.
Publicado: (2026)

LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning
por: Guo, Han, et al.
Publicado: (2023)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
por: Zhou, Kaiye, et al.
Publicado: (2024)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)

LoRe: Personalizing LLMs via Low-Rank Reward Modeling
por: Bose, Avinandan, et al.
Publicado: (2025)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
por: Liu, Ziyun, et al.
Publicado: (2026)

Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
por: Li, Yang, et al.
Publicado: (2024)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
por: Zhang, Ruiyi, et al.
Publicado: (2024)

LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
por: Perin, Gabriel J., et al.
Publicado: (2025)