Cover Image

VeRA: Vector-based Random Matrix Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kopiczko, Dawid J., Blankevoort, Tijmen, Asano, Yuki M.
Format:	Preprint
Published:	2023
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bitune: Leveraging Bidirectional Attention to Improve Decoder-Only LLMs
by: Kopiczko, Dawid J., et al.
Published: (2024)

Data Repetition Beats Data Scaling in Long-CoT Supervised Fine-Tuning
by: Kopiczko, Dawid J., et al.
Published: (2026)

What Layers When: Learning to Skip Compute in LLMs with Residual Gates
by: Laitenberger, Filipe, et al.
Published: (2025)

Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding
by: Bergner, Benjamin, et al.
Published: (2024)

The LLM Surgeon
by: van der Ouderaa, Tycho F. A., et al.
Published: (2023)

VeRA: Verified Reasoning Data Augmentation at Scale
by: Cheng, Zerui, et al.
Published: (2026)

KV Cache Steering for Controlling Frozen LLMs
by: Belitsky, Max, et al.
Published: (2025)

VeRA+: Vector-Based Lightweight Digital Compensation for Drift-Resilient RRAM In-Memory Computing
by: Dong, Weirong, et al.
Published: (2026)

Elastic ViTs from Pretrained Models without Retraining
by: Simoncini, Walter, et al.
Published: (2025)

PVeRA: Probabilistic Vector-Based Random Matrix Adaptation
by: Fillioux, Leo, et al.
Published: (2025)

ID-LoRA: Efficient Low-Rank Adaptation Inspired by Matrix Interpolative Decomposition
by: Ma, Xindian, et al.
Published: (2026)

GPTVQ: The Blessing of Dimensionality for LLM Quantization
by: van Baalen, Mart, et al.
Published: (2024)

SpinQuant: LLM quantization with learned rotations
by: Liu, Zechun, et al.
Published: (2024)

Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling
by: Cook, Jack, et al.
Published: (2025)

PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMs
by: Han, Jiuzhou, et al.
Published: (2023)

Statistical Uncertainty in Word Embeddings: GloVe-V
by: Vallebueno, Andrea, et al.
Published: (2024)

Sarcasm Detection in Tweets with BERT and GloVe Embeddings
by: Khatri, Akshay, et al.
Published: (2020)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
by: Zhang, Ruiyi, et al.
Published: (2024)

BeamLoRA: Beam-Constraint Low-Rank Adaptation
by: Gu, Naibin, et al.
Published: (2025)

Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
by: Liang, Yao, et al.
Published: (2024)

Adaptive LoRA Merge with Parameter Pruning for Low-Resource Generation
by: Miyano, Ryota, et al.
Published: (2025)

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
by: Li, Yang, et al.
Published: (2024)

Little Data, Big Impact: Privacy-Aware Visual Language Models via Minimal Tuning
by: Samson, Laurens, et al.
Published: (2024)

CROC: Evaluating and Training T2I Metrics with Pseudo- and Human-Labeled Contrastive Robustness Checks
by: Leiter, Christoph, et al.
Published: (2025)

DoRA: Weight-Decomposed Low-Rank Adaptation
by: Liu, Shih-Yang, et al.
Published: (2024)

SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model
by: Yu, Jiayang, et al.
Published: (2025)

ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
by: Hu, Junyan, et al.
Published: (2024)

OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models
by: Büyükakyüz, Kerim
Published: (2024)

BoRA: Bi-dimensional Weight-Decomposed Low-Rank Adaptation
by: Wang, Qiushi, et al.
Published: (2024)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
by: Li, Jiacheng, et al.
Published: (2025)

Better Language Models Exhibit Higher Visual Alignment
by: Ruthardt, Jona, et al.
Published: (2024)

OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation
by: Han, Jialong, et al.
Published: (2025)

FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning
by: Park, Juneyoung, et al.
Published: (2026)

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
by: Guo, Chenlu, et al.
Published: (2025)

MASA: Rethinking the Representational Bottleneck in LoRA with Multi-A Shared Adaptation
by: Dong, Qin, et al.
Published: (2025)

Multi-label Text Classification using GloVe and Neural Network Models
by: Wang, Hongren
Published: (2023)

No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations
by: Simoncini, Walter, et al.
Published: (2024)

CSULoRA: Closest Safe Update Low-Rank Adaptation
by: Breneur, Oleksandr Marchenko, et al.
Published: (2026)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
by: Wang, Shaowen, et al.
Published: (2024)

PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation
by: Benedek, Nadav, et al.
Published: (2024)