Cover Image

Neural Optimizer Equation, Decay Function, and Learning Rate Schedule Joint Evolution

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Morgan, Brandon, Hougen, Dean
Format:	Preprint
Published:	2024
Subjects:	Neural and Evolutionary Computing Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evolving Loss Functions for Specific Image Augmentation Techniques
by: Morgan, Brandon, et al.
Published: (2024)

Online Optimization of Curriculum Learning Schedules using Evolutionary Optimization
by: Jiwatode, Mohit, et al.
Published: (2024)

Discrete Differential Evolution Particle Swarm Optimization Algorithm for Energy Saving Flexible Job Shop Scheduling Problem Considering Machine Multi States
by: Wang, Da, et al.
Published: (2025)

Evolution and Efficiency in Neural Architecture Search: Bridging the Gap Between Expert Design and Automated Optimization
by: Meng, Fanfei, et al.
Published: (2024)

Beyond Rate Coding: Surrogate Gradients Enable Spike Timing Learning in Spiking Neural Networks
by: Yu, Ziqiao, et al.
Published: (2025)

Evolution Transformer: In-Context Evolutionary Optimization
by: Lange, Robert Tjarko, et al.
Published: (2024)

Knowledge-Assisted Dual-Stage Evolutionary Optimization of Large-Scale Crude Oil Scheduling
by: Zhang, Wanting, et al.
Published: (2024)

On the Use of Evolutionary Optimization for the Dynamic Chance Constrained Open-Pit Mine Scheduling Problem
by: Pathiranage, Ishara Hewa, et al.
Published: (2026)

Energy Decay Network (EDeN)
by: Shelley, Jamie Nicholas, et al.
Published: (2021)

Energy Costs and Neural Complexity Evolution in Changing Environments
by: Heesom-Green, Sian, et al.
Published: (2025)

Task-Specific Activation Functions for Neuroevolution using Grammatical Evolution
by: Winter, Benjamin David, et al.
Published: (2025)

Simultaneous Genetic Evolution of Neural Networks for Optimal SFC Embedding
by: Krishnamohan, Theviyanthan, et al.
Published: (2025)

Online Operator Design in Evolutionary Optimization for Flexible Job Shop Scheduling via Large Language Models
by: Liao, Rongjie, et al.
Published: (2025)

From Propagator to Oscillator: The Dual Role of Symmetric Differential Equations in Neural Systems
by: Jiang, Kun
Published: (2025)

Optimisation of Aircraft Maintenance Schedules
by: Urquhart, Neil, et al.
Published: (2025)

Playing Atari Space Invaders with Sparse Cosine Optimized Policy Evolution
by: O'Connor, Jim, et al.
Published: (2025)

Evolution of Optimization Algorithms for Global Placement via Large Language Models
by: Yao, Xufeng, et al.
Published: (2025)

DECN: Evolution Inspired Deep Convolution Network for Black-box Optimization
by: Wu, Kai, et al.
Published: (2023)

Bi-Objective Evolutionary Optimization for Large-Scale Open Pit Mine Scheduling Problem under Uncertainty with Chance Constraints
by: Pathiranage, Ishara Hewa, et al.
Published: (2025)

Parallel Hyperparameter Optimization Of Spiking Neural Network
by: Firmin, Thomas, et al.
Published: (2024)

Evolution of Thought: Diverse and High-Quality Reasoning via Multi-Objective Optimization
by: Qi, Biqing, et al.
Published: (2024)

Reinforcement learning Based Automated Design of Differential Evolution Algorithm for Black-box Optimization
by: Yang, Xu, et al.
Published: (2025)

RDEx-MOP: Indicator-Guided Reconstructed Differential Evolution for Fixed-Budget Multiobjective Optimization
by: Tao, Sichen, et al.
Published: (2026)

Training-Free Diffusion-Driven Modeling of Pareto Set Evolution for Dynamic Multiobjective Optimization
by: Guan, Jian, et al.
Published: (2026)

RDEx-CMOP: Feasibility-Aware Indicator-Guided Differential Evolution for Fixed-Budget Constrained Multiobjective Optimization
by: Tao, Sichen, et al.
Published: (2026)

Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks
by: Han, Bing, et al.
Published: (2023)

Genetic-based Constraint Programming for Resource Constrained Job Scheduling
by: Nguyen, Su, et al.
Published: (2024)

Fuzzy Logic -- Based Scheduling System for Part-Time Workforce
by: Nguyen, Tri, et al.
Published: (2025)

RDEx-SOP: Exploitation-Biased Reconstructed Differential Evolution for Fixed-Budget Bound-Constrained Single-Objective Optimization
by: Tao, Sichen, et al.
Published: (2026)

MetaDE: Evolving Differential Evolution by Differential Evolution
by: Chen, Minyang, et al.
Published: (2025)

An Evolutional Neural Network Framework for Classification of Microarray Data
by: Evari, Maryam Eshraghi, et al.
Published: (2024)

Novel Deep Neural Network Classifier Characterization Metrics with Applications to Dataless Evaluation
by: Dean, Nathaniel, et al.
Published: (2024)

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs
by: Bergsma, Shane, et al.
Published: (2025)

Learning Characteristics of Reverse Quaternion Neural Network
by: Yamauchi, Shogo, et al.
Published: (2024)

Reactor Optimization Benchmark by Reinforcement Learning
by: Schwarcz, Deborah, et al.
Published: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

Continual Learning with Columnar Spiking Neural Networks
by: Larionov, Denis, et al.
Published: (2025)

Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
by: Ding, Yongqi, et al.
Published: (2026)

Optimization of Low-Latency Spiking Neural Networks Utilizing Historical Dynamics of Refractory Periods
by: Tao, Liying, et al.
Published: (2025)

Lifelong Evolution of Swarms
by: Leuzzi, Lorenzo, et al.
Published: (2025)