Cover Image

Conjugate-Gradient-like Based Adaptive Moment Estimation Optimization Algorithm for Deep Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tian, Jiawu, Xu, Liwei, Zhang, Xiaowei, Li, Yongqi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive Moment Estimation Optimization Algorithm Using Projection Gradient for Deep Learning
by: Li, Yongqi, et al.
Published: (2025)

MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates
by: Mozaffari, Mohammad, et al.
Published: (2023)

LORE: Lagrangian-Optimized Robust Embeddings for Visual Encoders
by: Khodabandeh, Borna, et al.
Published: (2025)

Exposing Diversity Bias in Deep Generative Models: Statistical Origins and Correction of Diversity Error
by: Farnia, Farzan, et al.
Published: (2026)

Provably Learning Diverse Features in Multi-View Data with Midpoint Mixup
by: Chidambaram, Muthu, et al.
Published: (2022)

KOALA: A Kalman Optimization Algorithm with Loss Adaptivity
by: Davtyan, Aram, et al.
Published: (2021)

EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence
by: Yau, Chung-Yiu, et al.
Published: (2024)

Training-free Diffusion Model Alignment with Sampling Demons
by: Yeh, Po-Hung, et al.
Published: (2024)

Pattern based learning and optimisation through pricing for bin packing problem
by: Zhang, Huayan, et al.
Published: (2024)

Decentralized Personalized Federated Learning
by: Kharrat, Salma, et al.
Published: (2024)

Deep Unrolled Meta-Learning for Multi-Coil and Multi-Modality MRI with Adaptive Optimization
by: Fouladvand, Merham, et al.
Published: (2025)

An Improved Optimal Proximal Gradient Algorithm for Non-Blind Image Deblurring
by: Wang, Qingsong, et al.
Published: (2025)

SMI: Statistical Membership Inference for Reliable Unlearned Model Auditing
by: Sun, Jialong, et al.
Published: (2026)

Unsupervised Point Cloud Pre-Training via Contrasting and Clustering
by: Mei, Guofeng, et al.
Published: (2022)

Amortized Guidance for Image Inpainting with Pretrained Diffusion Models
by: Huang, Yilie, et al.
Published: (2026)

Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?
by: Su, Weijie
Published: (2025)

EXAdam: The Power of Adaptive Cross-Moments
by: Adly, Ahmed M.
Published: (2024)

Identifying and Understanding Cross-Class Features in Adversarial Training
by: Wei, Zeming, et al.
Published: (2025)

Calibrated Adversarial Sampling: Multi-Armed Bandit-Guided Generalization Against Unforeseen Attacks
by: Wang, Rui, et al.
Published: (2025)

On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
by: Ma, Shaocong, et al.
Published: (2025)

DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models
by: Saadati, Nastaran, et al.
Published: (2024)

Learning Spatially Adaptive $\ell_1$-Norms Weights for Convolutional Synthesis Regularization
by: Kofler, Andreas, et al.
Published: (2025)

A Brief Overview of Optimization-Based Algorithms for MRI Reconstruction Using Deep Learning
by: Bian, Wanyu
Published: (2024)

Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination
by: Wang, Peng, et al.
Published: (2023)

Deep graph matching meets mixed-integer linear programming: Relax at your own risk ?
by: Xu, Zhoubo, et al.
Published: (2021)

Dynamic Memory Based Adaptive Optimization
by: Szegedy, Balázs, et al.
Published: (2024)

DualHash: A Stochastic Primal-Dual Algorithm with Theoretical Guarantee for Deep Hashing
by: Li, Luxuan, et al.
Published: (2025)

On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis
by: Chen, Lesi, et al.
Published: (2023)

Interpreting and Improving Diffusion Models from an Optimization Perspective
by: Permenter, Frank, et al.
Published: (2023)

Memory-Efficient 4-bit Preconditioned Stochastic Optimization
by: Li, Jingyang, et al.
Published: (2024)

Understanding Optimization in Deep Learning with Central Flows
by: Cohen, Jeremy M., et al.
Published: (2024)

Deep unrolling for learning optimal spatially varying regularisation parameters for Total Generalised Variation
by: Vu, Thanh Trung, et al.
Published: (2025)

Optimizing Grasping in Legged Robots: A Deep Learning Approach to Loco-Manipulation
by: Almeida, Dilermando, et al.
Published: (2025)

On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions
by: Böther, Maximilian, et al.
Published: (2024)

FreeAugment: Data Augmentation Search Across All Degrees of Freedom
by: Bekor, Tom, et al.
Published: (2024)

Deep Learning for Two-Stage Robust Integer Optimization
by: Dumouchelle, Justin, et al.
Published: (2023)

Hindsight-Guided Momentum (HGM) Optimizer: An Approach to Adaptive Learning Rate
by: Sarkar, Krisanu
Published: (2025)

Multi-Objective Optimization for Sparse Deep Multi-Task Learning
by: Hotegni, S. S., et al.
Published: (2023)

ERIC: Estimating Rainfall with Commodity Doorbell Camera for Precision Residential Irrigation
by: Liu, Tian, et al.
Published: (2024)

Riemann Sum Optimization for Accurate Integrated Gradients Computation
by: Swain, Swadesh, et al.
Published: (2024)