Cover Image

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lingam, Vijay, Tejaswi, Atula, Vavre, Aditya, Shetty, Aneesh, Gudur, Gautham Krishna, Ghosh, Joydeep, Dimakis, Alex, Choi, Eunsol, Bojchevski, Aleksandar, Sanghavi, Sujay
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RARe: Retrieval Augmented Retrieval with In-Context Examples
by: Tejaswi, Atula, et al.
Published: (2024)

Exploring Design Choices for Building Language-Specific LLMs
by: Tejaswi, Atula, et al.
Published: (2024)

Entropy Aware Reward Guidance for Diffusion Language Model Alignment
by: Tejaswi, Atula, et al.
Published: (2026)

Geometric Median Matching for Robust k-Subset Selection from Noisy Data
by: Acharya, Anish, et al.
Published: (2025)

When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
by: Sanyal, Sunny, et al.
Published: (2024)

Upweighting Easy Samples in Fine-Tuning Mitigates Forgetting
by: Sanyal, Sunny, et al.
Published: (2025)

MURPHY: Feedback-Aware GRPO with Retrospective Credit Assignment for Multi-Turn Code Generation
by: Ekbote, Chanakya, et al.
Published: (2025)

Robust Conformal Prediction with a Single Binary Certificate
by: Zargarbashi, Soroush H., et al.
Published: (2025)

Conformal Inductive Graph Neural Networks
by: Zargarbashi, Soroush H., et al.
Published: (2024)

Context-Free Synthetic Data Mitigates Forgetting
by: Bansal, Parikshit, et al.
Published: (2025)

Enabling Approximate Joint Sampling in Diffusion LMs
by: Bansal, Parikshit, et al.
Published: (2025)

Test-Time Training Undermines Safety Guardrails
by: Antonelli, Simone, et al.
Published: (2026)

Goal-Conditioned Supervised Learning for LLM Fine-Tuning
by: Li, Shijun, et al.
Published: (2026)

Valori: A Deterministic Memory Substrate for AI Systems
by: Gudur, Varshith
Published: (2025)

Valori: A Deterministic Memory Substrate for AI Systems
by: Gudur, Varshith
Published: (2025)

Learning Mixtures of Experts with EM: A Mirror Descent Perspective
by: Fruytier, Quentin, et al.
Published: (2024)

Geometric Median (GM) Matching for Robust Data Pruning
by: Acharya, Anish, et al.
Published: (2024)

Understanding Self-Supervised Learning via Gaussian Mixture Models
by: Bansal, Parikshit, et al.
Published: (2024)

HiSpec: Hierarchical Speculative Decoding for LLMs
by: Kumar, Avinash, et al.
Published: (2025)

Test-Time Speculation
by: Kumar, Avinash, et al.
Published: (2026)

Robust Yet Efficient Conformal Prediction Sets
by: Zargarbashi, Soroush H., et al.
Published: (2024)

SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids
by: Ghamizi, Salah, et al.
Published: (2024)

Hierarchical Randomized Smoothing
by: Scholten, Yan, et al.
Published: (2023)

One Sample is Enough to Make Conformal Prediction Robust
by: Zargarbashi, Soroush H., et al.
Published: (2025)

Localized Randomized Smoothing for Collective Robustness Certification
by: Schuchardt, Jan, et al.
Published: (2022)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
by: Ding, Xinyu, et al.
Published: (2025)

VectorFit : Adaptive Singular & Bias Vector Fine-Tuning of Pre-trained Foundation Models
by: Hegde, Suhas G, et al.
Published: (2025)

Gated Adaptation for Continual Learning in Human Activity Recognition
by: Azghan, Reza Rahimi, et al.
Published: (2026)

CLAD-Net: Continual Activity Recognition in Multi-Sensor Wearable Systems
by: Azghan, Reza Rahimi, et al.
Published: (2025)

KurTail : Kurtosis-based LLM Quantization
by: Akhondzadeh, Mohammad Sadegh, et al.
Published: (2025)

EgoVLM: Policy Optimization for Egocentric Video Understanding
by: Vinod, Ashwin, et al.
Published: (2025)

Towards Quantifying the Preconditioning Effect of Adam
by: Das, Rudrajit, et al.
Published: (2024)

Blocking Bandits
by: Basu, Soumya, et al.
Published: (2019)

On the Hausdorff dimension of Weighted Singular Vectors
by: Aggarwal, Gaurav, et al.
Published: (2024)

Sculpting Latent Spaces With MMD: Disentanglement With Programmable Priors
by: Fruytier, Quentin, et al.
Published: (2025)

EvA: Evolutionary Attacks on Graphs
by: Akhondzadeh, Mohammad Sadegh, et al.
Published: (2025)

Randomized Message-Interception Smoothing: Gray-box Certificates for Graph Neural Networks
by: Scholten, Yan, et al.
Published: (2023)

ExecTune: Effective Steering of Black-Box LLMs with Guide Models
by: Lingam, Vijay, et al.
Published: (2026)

Orbital Hall Conductivity in a Graphene/Haldane and Haldane/Haldane Bilayers
by: Ghosh, Sovan, et al.
Published: (2023)

Layer-Dependent Orbital Magnetization in Graphene-Haldane Heterostructures
by: Ghosh, Sovan, et al.
Published: (2026)