Cover Image

On the Performance Analysis of Momentum Method: A Frequency Domain Perspective

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Xianliang, Luo, Jun, Zheng, Zhiwei, Wang, Hanxiao, Luo, Li, Wen, Lingkun, Wu, Linlong, Xu, Sheng
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Global Variational Inference Enhanced Robust Domain Adaptation
by: Luo, Lingkun, et al.
Published: (2025)

Beyond Batch Learning: Global Awareness Enhanced Domain Adaptation
by: Luo, Lingkun, et al.
Published: (2025)

Noise Optimized Conditional Diffusion for Domain Adaptation
by: Luo, Lingkun, et al.
Published: (2025)

Score-based Generative Models with Adaptive Momentum
by: Wen, Ziqing, et al.
Published: (2024)

Heavy-Ball Momentum Method in Continuous Time and Discretization Error Analysis
by: Lyu, Bochen, et al.
Published: (2025)

Downstream-Pretext Domain Knowledge Traceback for Active Learning
by: Zhang, Beichen, et al.
Published: (2024)

Convergence Analysis of Natural Gradient Descent for Over-parameterized Physics-Informed Neural Networks
by: Xu, Xianliang, et al.
Published: (2024)

Ordered Local Momentum for Asynchronous Distributed Learning under Arbitrary Delays
by: Shi, Chang-Wei, et al.
Published: (2026)

A Self-Adaptive Frequency Domain Network for Continuous Intraoperative Hypotension Prediction
by: Zeng, Xian, et al.
Published: (2025)

Convergence analysis of wide shallow neural operators within the framework of Neural Tangent Kernel
by: Xu, Xianliang, et al.
Published: (2024)

Improving Out-of-Domain Robustness with Targeted Augmentation in Frequency and Pixel Spaces
by: Wang, Ruoqi, et al.
Published: (2025)

Optimistic Critic Reconstruction and Constrained Fine-Tuning for General Offline-to-Online RL
by: Luo, Qin-Wen, et al.
Published: (2024)

Learning to Trust Bellman Updates: Selective State-Adaptive Regularization for Offline RL
by: Luo, Qin-Wen, et al.
Published: (2025)

Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks
by: Bai, Zhiwei, et al.
Published: (2022)

FSMLP: Modelling Channel Dependencies With Simplex Theory Based Multi-Layer Perceptions In Frequency Domain
by: Li, Zhengnan, et al.
Published: (2024)

MIDG: Mixture of Invariant Experts with knowledge injection for Domain Generalization in Multimodal Sentiment Analysis
by: Li, Yangle, et al.
Published: (2025)

Cross-Domain Continual Learning for Edge Intelligence in Wireless ISAC Networks
by: Hu, Jingzhi, et al.
Published: (2025)

Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective
by: Lian, Puwei, et al.
Published: (2025)

Ordered Momentum for Asynchronous SGD
by: Shi, Chang-Wei, et al.
Published: (2024)

Time Series Analysis in Frequency Domain: A Survey of Open Challenges, Opportunities and Benchmarks
by: Zhang, Qianru, et al.
Published: (2025)

Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
by: Hao, Zhiwei, et al.
Published: (2025)

DTP-Net: Learning to Reconstruct EEG signals in Time-Frequency Domain by Multi-scale Feature Reuse
by: Pei, Yan, et al.
Published: (2023)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
by: Zhao, Shen-Yi, et al.
Published: (2020)

Global Momentum Compression for Sparse Communication in Distributed Learning
by: Shi, Chang-Wei, et al.
Published: (2019)

Improved Analysis for Sign-based Methods with Momentum Updates
by: Jiang, Wei, et al.
Published: (2025)

From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics
by: Chen, Zheng-An, et al.
Published: (2025)

Optimizing the Adversarial Perturbation with a Momentum-based Adaptive Matrix
by: Tao, Wei, et al.
Published: (2025)

Agents Play Thousands of 3D Video Games
by: Xu, Zhongwen, et al.
Published: (2025)

FISMO: Fisher-Structured Momentum-Orthogonalized Optimizer
by: Xu, Chenrui, et al.
Published: (2026)

High-Energy Concentration for Federated Learning in Frequency Domain
by: Shi, Haozhi, et al.
Published: (2025)

Learning Virtual Machine Scheduling in Cloud Computing through Language Agents
by: Wu, JieHao, et al.
Published: (2025)

Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
by: He, Xiaoyu, et al.
Published: (2025)

Benchmarking Smoothness and Reducing High-Frequency Oscillations in Continuous Control Policies
by: Christmann, Guilherme, et al.
Published: (2024)

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
by: Luo, Qijun, et al.
Published: (2024)

Compress the Easy, Explore the Hard: Difficulty-Aware Entropy Regularization for Efficient LLM Reasoning
by: Luo, Qin-Wen, et al.
Published: (2026)

Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspective
by: Wang, Zexin, et al.
Published: (2024)

Federated Joint Learning for Domain and Class Generalization
by: Xu, Haoran, et al.
Published: (2026)

TimeCF: A TimeMixer-Based Model with adaptive Convolution and Sharpness-Aware Minimization Frequency Domain Loss for long-term time seris forecasting
by: Wang, Bin, et al.
Published: (2025)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
by: Xu, Xianliang, et al.
Published: (2024)

TimeDP: Learning to Generate Multi-Domain Time Series with Domain Prompts
by: Huang, Yu-Hao, et al.
Published: (2025)