Cover Image

Continuous-Time Analysis of Adaptive Optimization and Normalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gould, Rhys, Tanaka, Hidenori
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CLeAN: Continual Learning Adaptive Normalization in Dynamic Environments
by: Marasco, Isabella, et al.
Published: (2026)

Frequency Adaptive Normalization For Non-stationary Time Series Forecasting
by: Ye, Weiwei, et al.
Published: (2024)

Learning the Preferences of a Learning Agent
by: Sadek, Karim Abdel, et al.
Published: (2026)

TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting
by: Hu, Yue, et al.
Published: (2026)

Towards a Theory of AI Personhood
by: Ward, Francis Rhys
Published: (2025)

A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language
by: Lubana, Ekdeep Singh, et al.
Published: (2024)

$\textit{New News}$: System-2 Fine-tuning for Robust Integration of New Knowledge
by: Park, Core Francisco, et al.
Published: (2025)

ANAct: Adaptive Normalization for Activation Functions
by: Peiwen, Yuan, et al.
Published: (2022)

Does Your Optimizer Care How You Normalize? Normalization-Optimizer Coupling in LLM Training
by: Abouzeid, Abdelrahman
Published: (2026)

GRANOLA: Adaptive Normalization for Graph Neural Networks
by: Eliasof, Moshe, et al.
Published: (2024)

TimeGMM: Single-Pass Probabilistic Forecasting via Adaptive Gaussian Mixture Models with Reversible Normalization
by: Liu, Lei, et al.
Published: (2026)

Self-Normalized Resets for Plasticity in Continual Learning
by: Farias, Vivek F., et al.
Published: (2024)

Forking Paths in Neural Text Generation
by: Bigelow, Eric, et al.
Published: (2024)

MANGO: Meta-Adaptive Network Gradient Optimization for Online Continual Learning
by: Awasthi, Ankita, et al.
Published: (2026)

Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space
by: Park, Core Francisco, et al.
Published: (2024)

BNPO: Beta Normalization Policy Optimization
by: Xiao, Changyi, et al.
Published: (2025)

Normality-Guided Distributional Reinforcement Learning for Continuous Control
by: Byun, Ju-Seung, et al.
Published: (2022)

Inner-Instance Normalization for Time Series Forecasting
by: Jibao, Zipo, et al.
Published: (2025)

Channel Normalization for Time Series Channel Identification
by: Lee, Seunghan, et al.
Published: (2025)

Latent Bayesian Optimization via Autoregressive Normalizing Flows
by: Lee, Seunghun, et al.
Published: (2025)

Neural Nonmyopic Bayesian Optimization in Dynamic Cost Settings
by: Truong, Sang T., et al.
Published: (2026)

A Convergence Analysis of Adaptive Optimizers under Floating-point Quantization
by: Tang, Xuan, et al.
Published: (2025)

In-Context Learning Strategies Emerge Rationally
by: Wurgaft, Daniel, et al.
Published: (2025)

Large language models as uncertainty-calibrated optimizers for experimental discovery
by: Ranković, Bojana, et al.
Published: (2025)

Neuro-Argumentative Learning with Case-Based Reasoning
by: Gould, Adam, et al.
Published: (2025)

On the Convergence of Continual Learning with Adaptive Methods
by: Han, Seungyub, et al.
Published: (2024)

Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate
by: Xu, Huangyu, et al.
Published: (2026)

Adaptive Normalization Mamba with Multi Scale Trend Decomposition and Patch MoE Encoding
by: Jeon, MinCheol
Published: (2025)

Continuity and Ordinality Matter: Constraining Time Series Tokens for Effective Time Series Analysis with Large Language Models
by: Li, Musheng, et al.
Published: (2026)

Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements
by: Li, Haoran, et al.
Published: (2025)

Temporal-Conditioned Normalizing Flows for Multivariate Time Series Anomaly Detection
by: Baumgartner, David, et al.
Published: (2026)

Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model
by: Khona, Mikail, et al.
Published: (2024)

ATLO-ML: Adaptive Time-Length Optimizer for Machine Learning -- Insights from Air Quality Forecasting
by: Kao, I-Hsi, et al.
Published: (2025)

Self-Supervised Spatial-Temporal Normality Learning for Time Series Anomaly Detection
by: Chen, Yutong, et al.
Published: (2024)

Optimization and Generalization Guarantees for Weight Normalization
by: Cisneros-Velarde, Pedro, et al.
Published: (2024)

FlowPure: Continuous Normalizing Flows for Adversarial Purification
by: Collaert, Elias, et al.
Published: (2025)

Preserving Plasticity in Continual Learning with Adaptive Linearity Injection
by: Rohani, Seyed Roozbeh Razavi, et al.
Published: (2025)

Adaptive Variance-Penalized Continual Learning with Fisher Regularization
by: Sarkar, Krisanu
Published: (2025)

SDPM: Survival Diffusion Probabilistic Model for Continuous-Time Survival Analysis
by: Kirpichenko, Stanislav R., et al.
Published: (2026)

Proximal Policy Optimization with Adaptive Exploration
by: Lixandru, Andrei
Published: (2024)