Cover Image

PPO in the Fisher-Rao geometry

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lascu, Razvan-Andrei, Šiška, David, Szpruch, Łukasz
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Fisher-Rao gradient flow for entropic mean-field min-max games
by: Lascu, Razvan-Andrei, et al.
Published: (2024)

Linear convergence of proximal descent schemes on the Wasserstein space
by: Lascu, Razvan-Andrei, et al.
Published: (2024)

Mirror Descent-Ascent for mean-field min-max problems
by: Lascu, Razvan-Andrei, et al.
Published: (2024)

Entropic mean-field min-max problems via Best Response flow
by: Lascu, Razvan-Andrei, et al.
Published: (2023)

From Saddle Points Toward Global Minima: A Newton-Type Method on Wasserstein Space
by: Lascu, Razvan-Andrei, et al.
Published: (2026)

Gradient Flows for Regularized Stochastic Control Problems
by: Šiška, David, et al.
Published: (2020)

A Fisher-Rao gradient flow for entropy-regularised Markov decision processes in Polish spaces
by: Kerimkulov, Bekzhan, et al.
Published: (2023)

Non-convex entropic mean-field optimization via Best Response flow
by: Lascu, Razvan-Andrei, et al.
Published: (2025)

Convergence of actor-critic for entropy regularised MDPs in general action spaces
by: Zorba, Denis, et al.
Published: (2025)

Mirror descent actor-critic methods for entropy regularised MDPs in general spaces: stability and convergence
by: Zorba, Denis, et al.
Published: (2026)

Multi-Objective Optimization via Wasserstein-Fisher-Rao Gradient Flow
by: Ren, Yinuo, et al.
Published: (2023)

A note on convergence of Wasserstein policy optimization
by: Šiška, David, et al.
Published: (2026)

Inclusive KL Minimization: A Wasserstein-Fisher-Rao Gradient Flow Perspective
by: Zhu, Jia-Jie
Published: (2024)

On propagation of chaos for the Fisher-Rao gradient flow in entropic mean-field optimization
by: Lazić, Petra, et al.
Published: (2026)

Non-Asymptotic Global Convergence of PPO-Clip
by: Liu, Yin, et al.
Published: (2025)

AdaFisher: Adaptive Second Order Optimization via Fisher Information
by: Gomes, Damien Martins, et al.
Published: (2024)

Mirror Descent for Stochastic Control Problems with Measure-valued Controls
by: Kerimkulov, Bekzhan, et al.
Published: (2024)

$ε$-Policy Gradient for Online Pricing
by: Szpruch, Lukasz, et al.
Published: (2024)

An Approximate Ascent Approach To Prove Convergence of PPO
by: Doering, Leif, et al.
Published: (2026)

Logarithmic regret in the ergodic Avellaneda-Stoikov market making model
by: Cao, Jialun, et al.
Published: (2024)

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis
by: Gomes, Damien Martins
Published: (2025)

Gradient-Normalized Smoothness for Optimization with Approximate Hessians
by: Semenov, Andrei, et al.
Published: (2025)

Mirror descent for constrained stochastic control problems
by: Sethi, Deven, et al.
Published: (2025)

Black-Box Approximation and Optimization with Hierarchical Tucker Decomposition
by: Ryzhakov, Gleb, et al.
Published: (2024)

Enhancing GNNs Performance on Combinatorial Optimization by Recurrent Feature Update
by: Pugacheva, Daria, et al.
Published: (2024)

Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
by: Kornilov, Nikita, et al.
Published: (2025)

A Simplified Analysis of SGD for Linear Regression with Weight Averaging
by: Meterez, Alexandru, et al.
Published: (2025)

Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps
by: Ellis, Benjamin, et al.
Published: (2024)

Generalized infinite dimensional Alpha-Procrustes based geometries
by: Goomanee, Salvish, et al.
Published: (2025)

Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
by: Chezhegov, Savelii, et al.
Published: (2024)

Towards sparse optimization over convex loops: Equivalence of Square Root Velocity distance and Wasserstein-Fisher-Rao
by: Cristinelli, Giacomo, et al.
Published: (2026)

Smooth Quasar-Convex Optimization with Constraints
by: Martínez-Rubio, David
Published: (2025)

Stability of the Monge Map in Semi-Dual Optimal Transport
by: Selitskiy, Anton, et al.
Published: (2026)

Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients
by: Müller, Johannes, et al.
Published: (2024)

The geometry of financial institutions -- Wasserstein clustering of financial data
by: Riess, Lorenz, et al.
Published: (2023)

Beyond Short Steps in Frank-Wolfe Algorithms
by: Martínez-Rubio, David, et al.
Published: (2025)

Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders
by: Bruns-Smith, David, et al.
Published: (2023)

A second-order-like optimizer with adaptive gradient scaling for deep learning
by: Bolte, Jérôme, et al.
Published: (2024)

Tractable Representations for Convergent Approximation of Distributional HJB Equations
by: Alhosh, Julie, et al.
Published: (2025)

Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
by: Beznosikov, Aleksandr, et al.
Published: (2023)