Cover Image

Asymmetry in Low-Rank Adapters of Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Jiacheng, Greenewald, Kristjan, Nadjahi, Kimia, Borde, Haitz Sáez de Ocáriz, Gabrielsson, Rickard Brüel, Choshen, Leshem, Ghassemi, Marzyeh, Yurochkin, Mikhail, Solomon, Justin
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead
by: Brüel-Gabrielsson, Rickard, et al.
Published: (2024)

Slicing Mutual Information Generalization Bounds for Neural Networks
by: Nadjahi, Kimia, et al.
Published: (2024)

Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters
by: Kratsios, Anastasis, et al.
Published: (2025)

Closed-Form Diffusion Models
by: Scarvelis, Christopher, et al.
Published: (2023)

Score Distillation via Reparametrized DDIM
by: Lukoianov, Artem, et al.
Published: (2024)

Mathematical Foundations of Geometric Deep Learning
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2025)

Beyond Parallelism: Synergistic Computational Graph Effects in Multi-Head Attention
by: Borde, Haitz Sáez de Ocáriz
Published: (2025)

Deep Augmentation: Dropout as Augmentation for Self-Supervised Learning
by: Brüel-Gabrielsson, Rickard, et al.
Published: (2023)

Complementing Self-Consistency with Cross-Model Disagreement for Uncertainty Quantification
by: Hamidieh, Kimia, et al.
Published: (2026)

Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization
by: Gallici, Matteo, et al.
Published: (2025)

Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2023)

Keep It Light! Simplifying Image Clustering Via Text-Free Adapters
by: Li, Yicen, et al.
Published: (2025)

LoRA Fine-Tuning Without GPUs: A CPU-Efficient Meta-Generation Framework for LLMs
by: Arabpour, Reza, et al.
Published: (2025)

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
by: De Schouwer, Jonas, et al.
Published: (2026)

Metric Learning for Clifford Group Equivariant Neural Networks
by: Ali, Riccardo, et al.
Published: (2024)

Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
by: Kratsios, Anastasis, et al.
Published: (2024)

Bridging Graph and State-Space Modeling for Intensive Care Unit Length of Stay Prediction
by: Zi, Shuqi, et al.
Published: (2025)

Soro: A Lightweight Foundation Model and Chatbot for Tajik
by: Liashkov, Stanislav, et al.
Published: (2026)

Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families
by: Polo, Felipe Maia, et al.
Published: (2024)

Neural Spacetimes for DAG Representation Learning
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2024)

Scalable Message Passing Neural Networks: No Need for Attention in Large Graph Representation Learning
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2024)

Towards Quantifying Long-Range Interactions in Graph Machine Learning: a Large Graph Dataset and a Measurement
by: Liang, Huidong, et al.
Published: (2025)

tinyBenchmarks: evaluating LLMs with fewer examples
by: Polo, Felipe Maia, et al.
Published: (2024)

Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)
by: Merchant, Nicholas, et al.
Published: (2025)

Every Feedforward Neural Network Definable in an o-Minimal Structure Has Finite Sample Complexity
by: Kratsios, Anastasis, et al.
Published: (2026)

Learning 3D Hypersonic Flow with Physics-Enhanced Neural Fields: A Case Study on the Orion Reentry Capsule
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2026)

The Stepwise Informativeness Assumption: Why are Entropy Dynamics and Reasoning Correlated in LLMs?
by: Català, Mar Gonzàlez I, et al.
Published: (2026)

DreamUp3D: Object-Centric Generative Models for Single-View 3D Scene Understanding and Real-to-Sim Transfer
by: Wu, Yizhe, et al.
Published: (2024)

Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation
by: Hamidieh, Kimia, et al.
Published: (2024)

Efficient Multi-Adapter LLM Serving via Cross-Model KV-Cache Reuse with Activated LoRA
by: Li, Allison, et al.
Published: (2025)

Classification Fields: Arbitrarily Fine Recursive Hierarchical Clustering From Few Examples
by: Li, Yicen, et al.
Published: (2026)

Finite sample rates of convergence for the Bigraphical and Tensor graphical Lasso estimators
by: Zhou, Shuheng, et al.
Published: (2023)

Identifying Implicit Social Biases in Vision-Language Models
by: Hamidieh, Kimia, et al.
Published: (2024)

Convergence Rates for Distribution Matching with Sliced Optimal Transport
by: Thurin, Gauthier, et al.
Published: (2026)

Expected Batch Optimal Transport Plans and Consequences for Flow Matching
by: Boïté, Samuel, et al.
Published: (2026)

Tighter CMI-Based Generalization Bounds via Stochastic Projection and Quantization
by: Sefidgaran, Milad, et al.
Published: (2025)

Optimal Transport-based Conformal Prediction
by: Thurin, Gauthier, et al.
Published: (2025)

Mitigating Model Drift in Developing Economies Using Synthetic Data and Outliers
by: Varshavskiy, Ilyas, et al.
Published: (2025)

Assessing the Geographic Generalization and Physical Consistency of Generative Models for Climate Downscaling
by: Saccardi, Carlo, et al.
Published: (2025)

Risk Aware Benchmarking of Large Language Models
by: Nitsure, Apoorva, et al.
Published: (2023)