:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Nguyen, Son, Chen, Lizhang, Liu, Bo, Liu, Qiang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	https://arxiv.org/abs/2406.09958
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Memory-Efficient LLM Training with Online Subspace Descent
di: Liang, Kaizhao, et al.
Pubblicazione: (2024)

Improving Adaptive Moment Optimization via Preconditioner Diagonalization
di: Nguyen, Son, et al.
Pubblicazione: (2025)

Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
di: Chen, Lizhang, et al.
Pubblicazione: (2023)

Muon Optimizes Under Spectral Norm Constraints
di: Chen, Lizhang, et al.
Pubblicazione: (2025)

Cautious Optimizers: Improving Training with One Line of Code
di: Liang, Kaizhao, et al.
Pubblicazione: (2024)

DeMo: Decoupled Momentum Optimization
di: Peng, Bowen, et al.
Pubblicazione: (2024)

Communication Efficient Distributed Training with Distributed Lion
di: Liu, Bo, et al.
Pubblicazione: (2024)

Training-Free Looped Transformers
di: Chen, Lizhang, et al.
Pubblicazione: (2026)

Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
di: Fu, Qiang, et al.
Pubblicazione: (2025)

Conflict-Averse Gradient Descent for Multi-task Learning
di: Liu, Bo, et al.
Pubblicazione: (2021)

Momentum Guidance: Plug-and-Play Guidance for Flow Models
di: Liao, Runlong, et al.
Pubblicazione: (2026)

Preconditioning for Accelerated Gradient Descent Optimization and Regularization
di: Ye, Qiang
Pubblicazione: (2024)

$ϕ$-Balancing for Mixture-of-Experts Training
di: Chen, Lizhang, et al.
Pubblicazione: (2026)

Quantum Optimization via Gradient-Based Hamiltonian Descent
di: Leng, Jiaqi, et al.
Pubblicazione: (2025)

Omni-Masked Gradient Descent: Memory-Efficient Optimization via Mask Traversal with Improved Convergence
di: Yang, Hui, et al.
Pubblicazione: (2026)

Scalable Community Detection Using Quantum Hamiltonian Descent and QUBO Formulation
di: Cheng, Jinglei, et al.
Pubblicazione: (2024)

When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize
di: Wang, Yi, et al.
Pubblicazione: (2026)

Hidden State Differential Private Mini-Batch Block Coordinate Descent for Multi-convexity Optimization
di: Chen, Ding, et al.
Pubblicazione: (2024)

FluidML: Fast and Memory Efficient Inference Optimization
di: Liu, Jinjie, et al.
Pubblicazione: (2024)

Cautious Weight Decay
di: Chen, Lizhang, et al.
Pubblicazione: (2025)

Multiple Wasserstein Gradient Descent Algorithm for Multi-Objective Distributional Optimization
di: Nguyen, Dai Hai, et al.
Pubblicazione: (2025)

COSMOS: A Hybrid Adaptive Optimizer for Memory-Efficient Training of LLMs
di: Liu, Liming, et al.
Pubblicazione: (2025)

SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization
di: Park, Kwangryeol, et al.
Pubblicazione: (2024)

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization
di: Abuduweili, Abulikemu, et al.
Pubblicazione: (2024)

CUPID in the Model Zoo: Online Matchmaking for Selecting Your Dream LLM
di: Nguyen, Son, et al.
Pubblicazione: (2026)

A Memory Efficient Randomized Subspace Optimization Method for Training Large Language Models
di: Chen, Yiming, et al.
Pubblicazione: (2025)

Optimizing Canaries for Privacy Auditing with Metagradient Descent
di: Boglioni, Matteo, et al.
Pubblicazione: (2025)

Learning Associative Memories with Gradient Descent
di: Cabannes, Vivien, et al.
Pubblicazione: (2024)

Self-Auditing Parameter-Efficient Fine-Tuning for Few-Shot 3D Medical Image Segmentation
di: Ly, Son Thai, et al.
Pubblicazione: (2026)

Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deployment
di: Nguyen, Cuong Manh, et al.
Pubblicazione: (2026)

An Experimental Study of Semantic Continuity for Deep Learning Models
di: Wu, Shangxi, et al.
Pubblicazione: (2020)

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models
di: Son, Hyegang, et al.
Pubblicazione: (2024)

PowerStep: Memory-Efficient Adaptive Optimization via $\ell_p$-Norm Steepest Descent
di: Lu, Yao, et al.
Pubblicazione: (2026)

AdaFRUGAL: Adaptive Memory-Efficient Training with Dynamic Control
di: Bui, Quang-Hung, et al.
Pubblicazione: (2025)

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent
di: Liu, Zhiyu, et al.
Pubblicazione: (2024)

One-Step Flow Policy Mirror Descent
di: Chen, Tianyi, et al.
Pubblicazione: (2025)

Optimizing ML Training with Metagradient Descent
di: Engstrom, Logan, et al.
Pubblicazione: (2025)

Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent
di: Chen, Bo, et al.
Pubblicazione: (2024)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
di: Liu, Junkang, et al.
Pubblicazione: (2026)

Beyond Cross-Validation: Adaptive Parameter Selection for Kernel-Based Gradient Descents
di: Liu, Xiaotong, et al.
Pubblicazione: (2026)