Imagen de Portada

Generalized Euler Logarithm and its Applications in Machine Learning: Natural Gradient, Backpropagation, Generalized EG, Mirror Descent and OLPS

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Cichocki, Andrzej
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Mirror Descent Using the Tempesta Generalized Multi-parametric Logarithms
por: Cichocki, Andrzej
Publicado: (2025)

Mirror Descent and Novel Exponentiated Gradient Algorithms Using Trace-Form Entropies and Deformed Logarithms
por: Cichocki, Andrzej, et al.
Publicado: (2025)

Group Entropies and Mirror Duality: A Class of Flexible Mirror Descent Updates for Machine Learning
por: Cichocki, Andrzej, et al.
Publicado: (2026)

Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Compression of Deep Neural Networks
por: Cichocki, Andrzej, et al.
Publicado: (2026)

ONG: Orthogonal Natural Gradient Descent
por: Yadav, Yajat, et al.
Publicado: (2025)

Fisher-Orthogonal Projected Natural Gradient Descent for Continual Learning
por: Garg, Ishir, et al.
Publicado: (2026)

Policy Mirror Descent with Lookahead
por: Protopapas, Kimon, et al.
Publicado: (2024)

Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation
por: Sun, Mingfei
Publicado: (2026)

Stochastic MeanFlow Policies: One-Step Generative Control with Entropic Mirror Descent
por: Wang, Zeyuan, et al.
Publicado: (2026)

Functional Acceleration for Policy Mirror Descent
por: Chelu, Veronica, et al.
Publicado: (2024)

Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent
por: Kumar, Mohit, et al.
Publicado: (2024)

Optimizing Attention with Mirror Descent: Generalized Max-Margin Token Selection
por: Julistiono, Addison Kristanto, et al.
Publicado: (2024)

Adaptive Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Learning
por: Liu, Meitong, et al.
Publicado: (2024)

Natural Gradient Descent for Online Continual Learning
por: Khawand, Joe, et al.
Publicado: (2026)

GRADE: Replacing Policy Gradients with Backpropagation for LLM Alignment
por: Nel, Lukas Abrie
Publicado: (2025)

Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients
por: Flügel, Katharina, et al.
Publicado: (2024)

Improving LLM General Preference Alignment via Optimistic Online Mirror Descent
por: Zhang, Yuheng, et al.
Publicado: (2025)

Learning Associative Memories with Gradient Descent
por: Cabannes, Vivien, et al.
Publicado: (2024)

Geodesic Gradient Descent: A Generic and Learning-rate-free Optimizer on Objective Function-induced Manifolds
por: Hu, Liwei, et al.
Publicado: (2026)

Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks
por: Wang, Puyu, et al.
Publicado: (2026)

Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection
por: Cichocki, Andrzej, et al.
Publicado: (2024)

Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent
por: Liu, Weihua, et al.
Publicado: (2024)

StaQ it! Growing neural networks for Policy Mirror Descent
por: Shilova, Alena, et al.
Publicado: (2025)

The Initialization Determines Whether In-Context Learning Is Gradient Descent
por: Xie, Shifeng, et al.
Publicado: (2025)

Elastic Multi-Gradient Descent for Parallel Continual Learning
por: Lyu, Fan, et al.
Publicado: (2024)

Conflict-Averse Gradient Descent for Multi-task Learning
por: Liu, Bo, et al.
Publicado: (2021)

Beyond the Mean: Fisher-Orthogonal Projection for Natural Gradient Descent in Large Batch Training
por: Lu, Yishun, et al.
Publicado: (2025)

Gradient Descent Algorithm Survey
por: Fucheng, Deng, et al.
Publicado: (2025)

Beyond State-Wise Mirror Descent: Offline Policy Optimization with Parametric Policies
por: Li, Xiang, et al.
Publicado: (2026)

Randomness and Interpolation Improve Gradient Descent
por: Li, Jiawen, et al.
Publicado: (2025)

A Universal Banach--Bregman Framework for Stochastic Iterations: Unifying Stochastic Mirror Descent, Learning and LLM Training
por: Zhang, Johnny R., et al.
Publicado: (2025)

Transformers Learn to Implement Multi-step Gradient Descent with Chain of Thought
por: Huang, Jianhao, et al.
Publicado: (2025)

GradTree: Learning Axis-Aligned Decision Trees with Gradient Descent
por: Marton, Sascha, et al.
Publicado: (2023)

Hyperdimensional Vector Tsetlin Machines with Applications to Sequence Learning and Generation
por: Blakely, Christian D.
Publicado: (2024)

Practical Boolean Backpropagation
por: Golbert, Simon
Publicado: (2025)

Adaptive Heavy-Tailed Stochastic Gradient Descent
por: Gong, Bodu, et al.
Publicado: (2025)

Vanilla Gradient Descent for Oblique Decision Trees
por: Panda, Subrat Prasad, et al.
Publicado: (2024)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
por: Lei, Yunwen, et al.
Publicado: (2026)

Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?
por: Gatmiry, Khashayar, et al.
Publicado: (2024)

Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates
por: Fokam, Cabrel Teguemne, et al.
Publicado: (2024)