Imagen de Portada

A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Fernández, Jesús García, Ahmad, Nasir, van Gerven, Marcel
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Ornstein-Uhlenbeck Adaptation as a Mechanism for Learning in Brains and Machines
por: Fernandez, Jesus Garcia, et al.
Publicado: (2024)

Noise-based reward-modulated learning
por: Fernández, Jesús García, et al.
Publicado: (2025)

Node Perturbation Can Effectively Train Multi-Layer Neural Networks
por: Dalm, Sander, et al.
Publicado: (2023)

Gradient-Free Training of Recurrent Neural Networks using Random Perturbations
por: Fernandez, Jesus Garcia, et al.
Publicado: (2024)

Efficient Deep Learning with Decorrelated Backpropagation
por: Dalm, Sander, et al.
Publicado: (2024)

Correlations Are Ruining Your Gradient Descent
por: Ahmad, Nasir
Publicado: (2024)

Subspace Node Pruning
por: Offergeld, Joshua, et al.
Publicado: (2024)

Efficient Deep Reinforcement Learning with Predictive Processing Proximal Policy Optimization
por: Küçükoğlu, Burcu, et al.
Publicado: (2022)

Neural Co-state Policies: Structuring Hidden States in Recurrent Reinforcement Learning
por: Leeftink, David, et al.
Publicado: (2026)

Fractional Order Distributed Optimization
por: Lixandru, Andrei, et al.
Publicado: (2024)

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations
por: ElGazzar, Ahmed, et al.
Publicado: (2024)

Energy-Efficient Spiking Recurrent Neural Network for Gesture Recognition on Embedded GPUs
por: Varposhti, Marzieh Hassanshahi, et al.
Publicado: (2024)

Spiking Neural Networks for Continuous Control via End-to-End Model-Based Learning
por: Huebotter, Justus, et al.
Publicado: (2025)

Probabilistic Forecasting via Autoregressive Flow Matching
por: ElGazzar, Ahmed, et al.
Publicado: (2025)

Langevin Unlearning: A New Perspective of Noisy Gradient Descent for Machine Unlearning
por: Chien, Eli, et al.
Publicado: (2024)

Decorrelated Soft Actor-Critic for Efficient Deep Reinforcement Learning
por: Küçükoğlu, Burcu, et al.
Publicado: (2025)

A Bootstrap Perspective on Stochastic Gradient Descent
por: Lan, Hongjian, et al.
Publicado: (2025)

Enhancing Fractional Gradient Descent with Learned Optimizers
por: Sobotka, Jan, et al.
Publicado: (2025)

Hybrid Coordinate Descent for Efficient Neural Network Learning Using Line Search and Gradient Descent
por: Hsiao, Yen-Che, et al.
Publicado: (2024)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
por: Taheri, Hossein, et al.
Publicado: (2025)

Noise-based Local Learning using Stochastic Magnetic Tunnel Junctions
por: Koenders, Kees, et al.
Publicado: (2024)

A Granger-Causal Perspective on Gradient Descent with Application to Pruning
por: Shah, Aditya, et al.
Publicado: (2024)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
por: Ma, Yuhan, et al.
Publicado: (2024)

Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matching
por: Rogalla, Nicole, et al.
Publicado: (2026)

Multi-objective Portfolio Optimization Via Gradient Descent
por: Oliva, Christian, et al.
Publicado: (2025)

A Review of Neuroscience-Inspired Machine Learning
por: Ororbia, Alexander, et al.
Publicado: (2024)

A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond
por: Li, Yipeng, et al.
Publicado: (2025)

Distributed Gradient Descent for Functional Learning
por: Yu, Zhan, et al.
Publicado: (2023)

Stochastic Gradient Descent for Two-layer Neural Networks
por: Cao, Dinghao, et al.
Publicado: (2024)

Variational Stochastic Gradient Descent for Deep Neural Networks
por: Chen, Haotian, et al.
Publicado: (2024)

Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equations
por: Aslanimoghanloo, Muhammad, et al.
Publicado: (2025)

Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent
por: Kumar, Mohit, et al.
Publicado: (2024)

Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent
por: Liu, Weihua, et al.
Publicado: (2024)

Discovering Continuous-Time Memory-Based Symbolic Policies using Genetic Programming
por: de Vries, Sigur, et al.
Publicado: (2024)

Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks
por: Zhang, Chenyang, et al.
Publicado: (2025)

Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients
por: Chiang, John
Publicado: (2022)

Preconditioning for Accelerated Gradient Descent Optimization and Regularization
por: Ye, Qiang
Publicado: (2024)

Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
por: Ma, Wenquan, et al.
Publicado: (2026)

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks
por: Wang, Puyu, et al.
Publicado: (2023)

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization
por: Zhu, Yuchen, et al.
Publicado: (2024)