Imagen de Portada

A Method for Enhancing Generalization of Adam by Multiple Integrations

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jin, Long, Nong, Han, Chen, Liangming, Su, Zhenming
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Combining Adam and its Inverse Counterpart to Enhance Generalization of Deep Learning Optimizers
por: Shi, Tao, et al.
Publicado: (2026)

Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization
por: Yu, Yaxin, et al.
Publicado: (2026)

Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
por: Yu, Yaxin, et al.
Publicado: (2026)

HomeAdam: Adam and AdamW Algorithms Sometimes Go Home to Obtain Better Provable Generalization
por: Huang, Feihu, et al.
Publicado: (2026)

Do Latent-CoT Models Think Step-by-Step? A Mechanistic Study on Sequential Reasoning Tasks
por: Liang, Jia, et al.
Publicado: (2026)

A Refined Generalization Analysis for Extreme Multi-class Supervised Contrastive Representation Learning
por: Hieu, Nong Minh, et al.
Publicado: (2026)

Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models
por: Chen, Danchun, et al.
Publicado: (2026)

Generalization Analysis for Supervised Contrastive Representation Learning under Non-IID Settings
por: Hieu, Nong Minh, et al.
Publicado: (2025)

Understanding the Generalization of Stochastic Gradient Adam in Learning Neural Networks
por: Tang, Xuan, et al.
Publicado: (2025)

Mechanistic Data Attribution: Tracing the Training Origins of Interpretable LLM Units
por: Chen, Jianhui, et al.
Publicado: (2026)

MEMS Gyroscope Multi-Feature Calibration Using Machine Learning Technique
por: Long, Yaoyao, et al.
Publicado: (2024)

On Median of Incomplete U-Statistics
por: Hieu, Nong Minh
Publicado: (2026)

AdamZ: An Enhanced Optimisation Method for Neural Network Training
por: Zaznov, Ilia, et al.
Publicado: (2024)

Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
por: Xiao, Nachuan, et al.
Publicado: (2023)

Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methods
por: Chen, Chuanqi, et al.
Publicado: (2023)

CaAdam: Improving Adam optimizer using connection aware methods
por: Genet, Remi, et al.
Publicado: (2024)

WarpAdam: A new Adam optimizer based on Meta-Learning approach
por: Pan, Chengxi, et al.
Publicado: (2024)

Generalization Bounds for Semi-supervised Matrix Completion with Distributional Side Information
por: Ledent, Antoine, et al.
Publicado: (2025)

A Comprehensive Framework for Analyzing the Convergence of Adam: Bridging the Gap with SGD
por: Jin, Ruinan, et al.
Publicado: (2024)

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models
por: Liu, Junkang, et al.
Publicado: (2025)

Generalization Analysis for Deep Contrastive Representation Learning
por: Hieu, Nong Minh, et al.
Publicado: (2024)

Batch size invariant Adam
por: Wang, Xi, et al.
Publicado: (2024)

Tune My Adam, Please!
por: Athanasiadis, Theodoros, et al.
Publicado: (2025)

In Search of Adam's Secret Sauce
por: Orvieto, Antonio, et al.
Publicado: (2025)

Generalizing Fair Clustering to Multiple Groups: Algorithms and Applications
por: Chakraborty, Diptarka, et al.
Publicado: (2025)

Deep Learning Approach for Knee Point Detection on Noisy Data
por: Fok, Ting Yan, et al.
Publicado: (2024)

MCL-GAN: Generative Adversarial Networks with Multiple Specialized Discriminators
por: Choi, Jinyoung, et al.
Publicado: (2021)

Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps
por: Ellis, Benjamin, et al.
Publicado: (2024)

The Implicit Bias of Adam on Separable Data
por: Zhang, Chenyang, et al.
Publicado: (2024)

Adam Simplified: Bias Correction Debunked
por: Laing, Sam, et al.
Publicado: (2025)

Refresh-Scaling the Memory of Balanced Adam
por: Fernández-Hernández, Alberto, et al.
Publicado: (2026)

ODE approximation for the Adam algorithm: General and overparametrized setting
por: Dereich, Steffen, et al.
Publicado: (2025)

Why Transformers Need Adam: A Hessian Perspective
por: Zhang, Yushun, et al.
Publicado: (2024)

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise
por: Ahn, Kwangjun, et al.
Publicado: (2024)

Enhancing EEG Signal Generation through a Hybrid Approach Integrating Reinforcement Learning and Diffusion Models
por: An, Yang, et al.
Publicado: (2024)

A Generative Model Enhanced Multi-Agent Reinforcement Learning Method for Electric Vehicle Charging Navigation
por: Qi, Tianyang, et al.
Publicado: (2025)

SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Models
por: Deng, Jiangyi, et al.
Publicado: (2024)

Enhanced Feature Learning via Regularisation: Integrating Neural Networks and Kernel Methods
por: Follain, Bertille, et al.
Publicado: (2024)

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails
por: Jin, Ruinan, et al.
Publicado: (2026)

AdamO: A Collapse-Suppressed Optimizer for Offline RL
por: Qiao, Nan, et al.
Publicado: (2026)