Cover Image

Training Neural Networks from Scratch with Parallel Low-Rank Adapters

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huh, Minyoung, Cheung, Brian, Bernstein, Jeremy, Isola, Phillip, Agrawal, Pulkit
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Platonic Representation Hypothesis
by: Huh, Minyoung, et al.
Published: (2024)

AdapterTune: Zero-Initialized Low-Rank Adapters for Frozen Vision Transformers
by: Khazem, Salim
Published: (2026)

Adaptive Length Image Tokenization via Recurrent Allocation
by: Duggal, Shivam, et al.
Published: (2024)

Single-pass Adaptive Image Tokenization for Minimum Program Search
by: Duggal, Shivam, et al.
Published: (2025)

HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks
by: Xiao, Jinqi, et al.
Published: (2023)

End-to-End Training for Unified Tokenization and Latent Denoising
by: Duggal, Shivam, et al.
Published: (2026)

Words That Make Language Models Perceive
by: Wang, Sophie L., et al.
Published: (2025)

Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget
by: Sehwag, Vikash, et al.
Published: (2024)

Bayesian Low-Rank LeArning (Bella): A Practical Approach to Bayesian Neural Networks
by: Doan, Bao Gia, et al.
Published: (2024)

Large Pre-Training Datasets Don't Always Guarantee Robustness after Fine-Tuning
by: Hwang, Jaedong, et al.
Published: (2024)

Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models
by: Li, Zhiqi, et al.
Published: (2025)

General Cyclical Training of Neural Networks
by: Smith, Leslie N.
Published: (2022)

DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models
by: Ke, Wenjin, et al.
Published: (2025)

Scratching Visual Transformer's Back with Uniform Attention
by: Hyeon-Woo, Nam, et al.
Published: (2022)

Training-Free Restoration of Pruned Neural Networks
by: Lee, Keonho, et al.
Published: (2025)

OrthoFuse: Training-free Riemannian Fusion of Orthogonal Style-Concept Adapters for Diffusion Models
by: Aliev, Ali, et al.
Published: (2026)

Training-Only Heterogeneous Image-Patch-Text Graph Supervision for Advancing Few-Shot Learning Adapters
by: Mohammad, Mohammed Rahman Sherif Khan, et al.
Published: (2026)

Multi-Modal Adapter for Vision-Language Models
by: Seputis, Dominykas, et al.
Published: (2024)

IDEA: Image Description Enhanced CLIP-Adapter
by: Ye, Zhipeng, et al.
Published: (2025)

Drone Detection using Deep Neural Networks Trained on Pure Synthetic Data
by: Wisniewski, Mariusz, et al.
Published: (2024)

Automatic Joint Structured Pruning and Quantization for Efficient Neural Network Training and Compression
by: Qu, Xiaoyi, et al.
Published: (2025)

Regularizing Neural Network Training via Identity-wise Discriminative Feature Suppression
by: Chapman, Avraham, et al.
Published: (2022)

Robustness Feature Adapter for Efficient Adversarial Training
by: Wu, Quanwei, et al.
Published: (2025)

GSPN-2: Efficient Parallel Sequence Modeling
by: Wang, Hongjun, et al.
Published: (2025)

Walking the Web of Concept-Class Relationships in Incrementally Trained Interpretable Models
by: Agrawal, Susmit, et al.
Published: (2025)

PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization
by: Lahiany, Assaf, et al.
Published: (2025)

Continual Diffusion with STAMINA: STack-And-Mask INcremental Adapters
by: Smith, James Seale, et al.
Published: (2023)

Distilled Feature Fields Enable Few-Shot Language-Guided Manipulation
by: Shen, William, et al.
Published: (2023)

A Robust Incomplete Multimodal Low-Rank Adaptation Approach for Emotion Recognition
by: Zhao, Xinkui, et al.
Published: (2025)

FM-LoRA: Factorized Low-Rank Meta-Prompting for Continual Learning
by: Yu, Xiaobing, et al.
Published: (2025)

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers
by: Grigore, Diana-Nicoleta, et al.
Published: (2024)

InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
by: Liang, Yan-Shuo, et al.
Published: (2024)

Dynamic Integration of Task-Specific Adapters for Class Incremental Learning
by: Li, Jiashuo, et al.
Published: (2024)

Efficient Training with Denoised Neural Weights
by: Gong, Yifan, et al.
Published: (2024)

Stress-Aware Resilient Neural Training
by: Shakarami, Ashkan, et al.
Published: (2025)

MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning
by: Agiza, Ahmed, et al.
Published: (2024)

ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks
by: Sui, Yang, et al.
Published: (2024)

Anomaly-Aware Vision-Language Adapters for Zero-Shot Anomaly Detection
by: Aqeel, Muhammad, et al.
Published: (2026)

Continual Adapter Tuning with Semantic Shift Compensation for Class-Incremental Learning
by: Zhou, Qinhao, et al.
Published: (2024)

KernelDNA: Dynamic Kernel Sharing via Decoupled Naive Adapters
by: Huang, Haiduo, et al.
Published: (2025)