Imagen de Portada

A Single Linear Layer Yields Task-Adapted Low-Rank Matrices

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kim, Hwichan, Sasaki, Shota, Hoshino, Sho, Honda, Ukyo
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Revisiting the Capacity Gap in Chain-of-Thought Distillation from a Practical Perspective
por: Kajitsuka, Tokio, et al.
Publicado: (2026)

Annotation-Efficient Language Model Alignment via Diverse and Representative Response Texts
por: Jinnai, Yuu, et al.
Publicado: (2024)

Exploring Explanations Improves the Robustness of In-Context Learning
por: Honda, Ukyo, et al.
Publicado: (2025)

Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition
por: Cho, Yoonjun, et al.
Publicado: (2025)

Does Self-Consistency Improve the Recall of Encyclopedic Knowledge?
por: Hoshino, Sho, et al.
Publicado: (2026)

LoLCATs: On Low-Rank Linearizing of Large Language Models
por: Zhang, Michael, et al.
Publicado: (2024)

LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
por: Zhang, Juzheng, et al.
Publicado: (2025)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)

CeRA: Overcoming the Linear Ceiling of Low-Rank Adaptation via Capacity Expansion
por: Chen, Hung-Hsuan
Publicado: (2026)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
por: Tang, Chuanyu, et al.
Publicado: (2024)

Toward LLMs Beyond English-Centric Development
por: Takase, Sho, et al.
Publicado: (2026)

Ensembles of Low-Rank Expert Adapters
por: Li, Yinghao, et al.
Publicado: (2025)

The Expressive Power of Low-Rank Adaptation
por: Zeng, Yuchen, et al.
Publicado: (2023)

Low-Rank Quantization-Aware Training for LLMs
por: Bondarenko, Yelysei, et al.
Publicado: (2024)

Variational Low-Rank Adaptation Using IVON
por: Cong, Bai, et al.
Publicado: (2024)

Batched Low-Rank Adaptation of Foundation Models
por: Wen, Yeming, et al.
Publicado: (2023)

Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization
por: Hajimolahoseini, Habib, et al.
Publicado: (2023)

A3 : an Analytical Low-Rank Approximation Framework for Attention
por: Wong, Jeffrey T. H., et al.
Publicado: (2025)

On the True Distribution Approximation of Minimum Bayes-Risk Decoding
por: Ohashi, Atsumoto, et al.
Publicado: (2024)

Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding
por: Jinnai, Yuu, et al.
Publicado: (2024)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
por: Zhou, Kaiye, et al.
Publicado: (2024)

LoTR: Low Tensor Rank Weight Adaptation
por: Bershatsky, Daniel, et al.
Publicado: (2024)

LoRMA: Low-Rank Multiplicative Adaptation for LLMs
por: Bihany, Harsh, et al.
Publicado: (2025)

Low-Rank Adaptation for Multilingual Summarization: An Empirical Study
por: Whitehouse, Chenxi, et al.
Publicado: (2023)

From Symbolic Tasks to Code Generation: Diversification Yields Better Task Performers
por: Zhang, Dylan, et al.
Publicado: (2024)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
por: Zhang, Ruiyi, et al.
Publicado: (2024)

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training
por: Shivagunde, Namrata, et al.
Publicado: (2026)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
por: Po, Lai-Man, et al.
Publicado: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

Sequences of Logits Reveal the Low Rank Structure of Language Models
por: Golowich, Noah, et al.
Publicado: (2025)

GoRA: Gradient-driven Adaptive Low Rank Adaptation
por: He, Haonan, et al.
Publicado: (2025)

Multiple Choice Learning of Low-Rank Adapters for Language Modeling
por: Letzelter, Victor, et al.
Publicado: (2025)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
por: Sehanobish, Arijit, et al.
Publicado: (2026)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
por: Shi, Haizhou, et al.
Publicado: (2024)

Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
por: Saxena, Utkarsh, et al.
Publicado: (2024)

Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
por: Wei, Boyi, et al.
Publicado: (2024)

Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
por: Muñoz, J. Pablo, et al.
Publicado: (2025)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
por: Gowda, Dhananjaya, et al.
Publicado: (2025)