Cover Image

VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Miles, Roy, Reddy, Pradyumna, Elezi, Ismail, Deng, Jiankang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
by: Miles, Roy, et al.
Published: (2024)

G3DR: Generative 3D Reconstruction in ImageNet
by: Reddy, Pradyumna, et al.
Published: (2024)

Deep Active Learning: A Reality Check
by: Gashi, Edrina, et al.
Published: (2024)

RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
by: Ye-Bin, Moon, et al.
Published: (2025)

SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing
by: Toker, Aysim, et al.
Published: (2025)

Do You See What I Am Pointing At? Gesture-Based Egocentric Video Question Answering
by: Choi, Yura, et al.
Published: (2026)

ViCToR: Improving Visual Comprehension via Token Reconstruction for Pretraining LMMs
by: Xie, Yin, et al.
Published: (2024)

DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces
by: Khan, Mohammad Sadil, et al.
Published: (2026)

Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learning
by: Ma, Chengcheng, et al.
Published: (2023)

"Principal Components" Enable A New Language of Images
by: Wen, Xin, et al.
Published: (2025)

Fractal Calibration for long-tailed object detection
by: Alexandridis, Konstantinos Panagiotis, et al.
Published: (2024)

Selective LoRA for Visual Tokens and Attention Heads
by: Luo, Tiange, et al.
Published: (2025)

Region-based Cluster Discrimination for Visual Representation Learning
by: Xie, Yin, et al.
Published: (2025)

RecycleLoRA: Rank-Revealing QR-Based Dual-LoRA Subspace Adaptation for Domain Generalized Semantic Segmentation
by: Cho, Chanseul, et al.
Published: (2026)

LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
by: Che, Chang, et al.
Published: (2025)

DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion
by: Wu, Yujia, et al.
Published: (2024)

PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation
by: Hwang, Injoon, et al.
Published: (2024)

ConsNoTrainLoRA: Data-driven Weight Initialization of Low-rank Adapters using Constraints
by: Das, Debasmit, et al.
Published: (2025)

PointLoRA: Low-Rank Adaptation with Token Selection for Point Cloud Learning
by: Wang, Song, et al.
Published: (2025)

MedSAGa: Few-shot Memory Efficient Medical Image Segmentation using Gradient Low-Rank Projection in SAM
by: Mahla, Navyansh, et al.
Published: (2024)

AvatarMMC: 3D Head Avatar Generation and Editing with Multi-Modal Conditioning
by: Para, Wamiq Reyaz, et al.
Published: (2024)

Learning to Project for Cross-Task Knowledge Distillation
by: Auty, Dylan, et al.
Published: (2024)

Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation
by: Mrabah, Nairouz, et al.
Published: (2025)

FM-LoRA: Factorized Low-Rank Meta-Prompting for Continual Learning
by: Yu, Xiaobing, et al.
Published: (2025)

InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
by: Liang, Yan-Shuo, et al.
Published: (2024)

MultLFG: Training-free Multi-LoRA composition using Frequency-domain Guidance
by: Roy, Aniket, et al.
Published: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
by: Chang, Huandong, et al.
Published: (2025)

NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
by: Chen, Chuheng, et al.
Published: (2025)

Not All Layers Are Created Equal: Adaptive LoRA Ranks for Personalized Image Generation
by: Shenaj, Donald, et al.
Published: (2026)

Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation
by: Li, Likun, et al.
Published: (2024)

LoRA-TTT: Low-Rank Test-Time Training for Vision-Language Models
by: Kojima, Yuto, et al.
Published: (2025)

LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models
by: Yang, Yang, et al.
Published: (2024)

CDM-QTA: Quantized Training Acceleration for Efficient LoRA Fine-Tuning of Diffusion Model
by: Lu, Jinming, et al.
Published: (2025)

AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation
by: Deb, Prantik, et al.
Published: (2026)

Empower Vision Applications with LoRA LMM
by: Mi, Liang, et al.
Published: (2024)

1LoRA: Summation Compression for Very Low-Rank Adaptation
by: Quercia, Alessio, et al.
Published: (2025)

EMLoC: Emulator-based Memory-efficient Fine-tuning with LoRA Correction
by: Lin, Hsi-Che, et al.
Published: (2025)

High-Accuracy ECG Image Interpretation using Parameter-Efficient LoRA Fine-Tuning with Multimodal LLaMA 3.2
by: M, Nandakishor, et al.
Published: (2025)

VeCLIP: Improving CLIP Training via Visual-enriched Captions
by: Lai, Zhengfeng, et al.
Published: (2023)

LangVision-LoRA-NAS: Neural Architecture Search for Variable LoRA Rank in Vision Language Models
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)