Copertina

AdaPaD: Adaptive Parallel Deflation for PEFT with Self-Correcting Rank Discovery

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Su, Barbara, Liao, Fangshuo, Kyrillidis, Anastasios
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Provable Model-Parallel Distributed Principal Component Analysis with Parallel Deflation
di: Liao, Fangshuo, et al.
Pubblicazione: (2025)

On the Error-Propagation of Inexact Hotelling's Deflation for Principal Component Analysis
di: Liao, Fangshuo, et al.
Pubblicazione: (2023)

Guided by the Experts: Provable Feature Learning Dynamic of Soft-Routed Mixture-of-Experts
di: Liao, Fangshuo, et al.
Pubblicazione: (2025)

Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
di: Liao, Fangshuo, et al.
Pubblicazione: (2023)

One Rank at a Time: Cascading Error Dynamics in Sequential Learning
di: Vandchali, Mahtab Alizadeh, et al.
Pubblicazione: (2025)

Exploiting Low-Rank Structure in Max-K-Cut Problems
di: Stevens, Ria, et al.
Pubblicazione: (2026)

SGD at the Edge of Stability: The Stochastic Sharpness Gap
di: Liao, Fangshuo, et al.
Pubblicazione: (2026)

Convergence Analysis of Two-Layer Neural Networks under Gaussian Input Masking
di: Kolomvaki, Afroditi, et al.
Pubblicazione: (2026)

One Model, Two Roles: Emergent Specialization in a Shared Recurrent Transformer
di: Shen, Jucheng, et al.
Pubblicazione: (2026)

GHOST: Unmasking Phantom States in Mamba2 via Grouped Hidden-state Output-aware Selection & Truncation
di: Menezes, Michael, et al.
Pubblicazione: (2026)

Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings
di: Farhat, Yehya, et al.
Pubblicazione: (2023)

TwIST: Rigging the Lottery in Transformers with Independent Subnetwork Training
di: Menezes, Michael, et al.
Pubblicazione: (2025)

Better Schedules for Low Precision Training of Deep Neural Networks
di: Wolfe, Cameron R., et al.
Pubblicazione: (2024)

Quantum EigenGame for excited state calculation
di: Quiroga, David, et al.
Pubblicazione: (2025)

Unveiling Hidden Pivotal Players with GoalNet: A GNN-Based Soccer Player Evaluation System
di: Jiang, Jacky Hao, et al.
Pubblicazione: (2025)

Adaptive Federated Learning with Auto-Tuned Clients
di: Kim, Junhyung Lyle, et al.
Pubblicazione: (2023)

AdaRank: Adaptive Rank Pruning for Enhanced Model Merging
di: Lee, Chanhyuk, et al.
Pubblicazione: (2025)

Three Birds with One Stone: Improving Performance, Convergence, and System Throughput with Nest
di: Huo, Yuqian, et al.
Pubblicazione: (2025)

When is Momentum Extragradient Optimal? A Polynomial-Based Analysis
di: Kim, Junhyung Lyle, et al.
Pubblicazione: (2022)

AdaRankGrad: Adaptive Gradient-Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
di: Refael, Yehonathan, et al.
Pubblicazione: (2024)

AntiPaSTO: Self-Supervised Honesty Steering via Anti-Parallel Representations
di: Clark, Michael J.
Pubblicazione: (2026)

A Catalyst Framework for the Quantum Linear System Problem via the Proximal Point Algorithm
di: Kim, Junhyung Lyle, et al.
Pubblicazione: (2024)

Data-Driven Discovery of Conservation Laws from Trajectories via Neural Deflation
di: Chen, Shaoxuan, et al.
Pubblicazione: (2024)

COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Sampling
di: Flynn, Noah
Pubblicazione: (2026)

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation
di: Dong, Yihe
Pubblicazione: (2024)

Deflation-Free Optimal Scoring
di: Afroz, Sharmin, et al.
Pubblicazione: (2026)

Deflated Dynamics Value Iteration
di: Lee, Jongmin, et al.
Pubblicazione: (2024)

AdaMuon: Adaptive Muon Optimizer
di: Si, Chongjie, et al.
Pubblicazione: (2025)

A Preliminary Agentic Framework for Matrix Deflation
di: Goulart, Paimon, et al.
Pubblicazione: (2026)

AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine
di: Siebenschuh, Carlo, et al.
Pubblicazione: (2025)

PaSE: Parallelization Strategies for Efficient DNN Training
di: Elango, Venmugil
Pubblicazione: (2024)

AdaDPO: Self-Adaptive Direct Preference Optimization with Balanced Gradient Updates
di: Chen, Shaolong, et al.
Pubblicazione: (2026)

GRIT -- Geometry-Aware PEFT with K-FACPreconditioning, Fisher-Guided Reprojection, andDynamic Rank Adaptation
di: Saha, Pritish, et al.
Pubblicazione: (2026)

PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning
di: Hu, Jingcheng, et al.
Pubblicazione: (2026)

PaPaformer: Language Model from Pre-trained Parallel Paths
di: Tapaninaho, Joonas, et al.
Pubblicazione: (2025)

RecCrysFormer: Refined Protein Structural Prediction from 3D Patterson Maps via Recycling Training Runs
di: Pan, Tom, et al.
Pubblicazione: (2025)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
di: Wang, Xinjue, et al.
Pubblicazione: (2026)

Eigenpruning: an Interpretability-Inspired PEFT Method
di: Vergara-Browne, Tomás, et al.
Pubblicazione: (2024)

Quantum-PEFT: Ultra parameter-efficient fine-tuning
di: Koike-Akino, Toshiaki, et al.
Pubblicazione: (2025)

Completion of partial structures using Patterson maps with the CrysFormer machine learning model
di: Pan, Tom, et al.
Pubblicazione: (2025)