Imagen de Portada

Adaptive Memory Momentum via a Model-Based Framework for Deep Learning Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Topollai, Kristi, Choromanska, Anna
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Understanding Quantization of Optimizer States in LLM Pre-training: Dynamics of State Staleness and Effectiveness of State Resets
por: Topollai, Kristi, et al.
Publicado: (2026)

Task-Level Contrastiveness for Cross-Domain Few-Shot Learning
por: Topollai, Kristi, et al.
Publicado: (2025)

Outer-Momentum Restarting in High-Dimensional Two-Phase Optimization
por: Topollai, Kristi, et al.
Publicado: (2026)

Worker Disagreement Reveals Sharp Directions in Local SGD
por: Dimlioglu, Tolga, et al.
Publicado: (2026)

OncoReason: Structuring Clinical Reasoning in LLMs for Robust and Interpretable Survival Prediction
por: Hemadri, Raghu Vamshi, et al.
Publicado: (2025)

GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models
por: Dimlioglu, Tolga, et al.
Publicado: (2024)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
por: Dimlioglu, Tolga, et al.
Publicado: (2025)

Self-Supervised Representation Learning with Joint Embedding Predictive Architecture for Automotive LiDAR Object Detection
por: Zhu, Haoran, et al.
Publicado: (2025)

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
por: Wang, Jing, et al.
Publicado: (2025)

Streamlining Industrial Contract Management with Retrieval-Augmented LLMs
por: Topollai, Kristi, et al.
Publicado: (2025)

TAME: Task Agnostic Continual Learning using Multiple Experts
por: Zhu, Haoran, et al.
Publicado: (2022)

Adjacent Leader Decentralized Stochastic Gradient Descent
por: He, Haoze, et al.
Publicado: (2024)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
por: Xie, Xingyu, et al.
Publicado: (2022)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
por: Patitucci, Francisco, et al.
Publicado: (2026)

Optimizing the Adversarial Perturbation with a Momentum-based Adaptive Matrix
por: Tao, Wei, et al.
Publicado: (2025)

Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
por: Lin, Wu, et al.
Publicado: (2023)

Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
por: He, Xiaoyu, et al.
Publicado: (2025)

Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations
por: Naeinian, Fatemeh, et al.
Publicado: (2026)

Score-based Generative Models with Adaptive Momentum
por: Wen, Ziqing, et al.
Publicado: (2024)

SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization
por: Park, Kwangryeol, et al.
Publicado: (2024)

Hindsight-Guided Momentum (HGM) Optimizer: An Approach to Adaptive Learning Rate
por: Sarkar, Krisanu
Publicado: (2025)

Dynamic Memory Based Adaptive Optimization
por: Szegedy, Balázs, et al.
Publicado: (2024)

AdaMemento: Adaptive Memory-Assisted Policy Optimization for Reinforcement Learning
por: Yan, Renye, et al.
Publicado: (2024)

Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework
por: Zhang, Zeyu, et al.
Publicado: (2025)

Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
por: Petrov, Egor, et al.
Publicado: (2025)

AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training
por: Lu, Binghang, et al.
Publicado: (2026)

TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers
por: Cheng, Peng, et al.
Publicado: (2026)

Low-rank Momentum Factorization for Memory Efficient Training
por: Mahdavinia, Pouria, et al.
Publicado: (2025)

Provable Generalization Bounds for Deep Neural Networks with Momentum-Adaptive Gradient Dropout
por: Safder, Adeel
Publicado: (2025)

AdaCubic: An Adaptive Cubic Regularization Optimizer for Deep Learning
por: Tsingalis, Ioannis, et al.
Publicado: (2026)

RMNP: Row-Momentum Normalized Preconditioning for Scalable Matrix-Based Optimization
por: Deng, Shenyang, et al.
Publicado: (2026)

Fast Generalization after Interpolation via Critically Damped Momentum Optimization
por: Muscarnera, Luca, et al.
Publicado: (2026)

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum
por: Kim, Jihwan, et al.
Publicado: (2026)

Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees
por: Nguyen, Thien Hang, et al.
Publicado: (2024)

Measuring Learning Progress via Gradient-Momentum Coupling
por: Blad, Samuel, et al.
Publicado: (2026)

Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization
por: Shukurlu, Altun
Publicado: (2025)

Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training
por: Wang, Zhifeng, et al.
Publicado: (2025)

FLAMES: A Hybrid Spiking-State Space Model for Adaptive Memory Retention in Event-Based Learning
por: Chakraborty, Biswadeep, et al.
Publicado: (2025)

Momentum Boosted Episodic Memory for Improving Learning in Long-Tailed RL Environments
por: Fernandes, Dolton, et al.
Publicado: (2025)

GPU-Fuzz: Finding Memory Errors in Deep Learning Frameworks
por: Li, Zihao, et al.
Publicado: (2026)