Cover Image

Bellman Residual Minimization for Control: Geometry, Stationarity, and Convergence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lee, Donghwan, Yang, Hyukjun
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Systems and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Contraction-Aligned Analysis of Soft Bellman Residual Minimization with Weighted Lp-Norm for Markov Decision Problem
by: Yang, Hyukjun, et al.
Published: (2026)

Beyond the Bellman Fixed Point: Geometry and Fast Policy Identification in Value Iteration
by: Lee, Donghwan
Published: (2026)

Analysis of Off-Policy Multi-Step TD-Learning with Linear Function Approximation
by: Lee, Donghwan
Published: (2024)

Lyapunov-Certified Direct Switching Theory for Q-Learning
by: Lee, Donghwan
Published: (2026)

Finite-Time Analysis of Q-Value Iteration for General-Sum Stackelberg Games
by: Jeong, Narim, et al.
Published: (2026)

Finite-Time Analysis of Simultaneous Double Q-learning
by: Na, Hyunjun, et al.
Published: (2024)

Finite-Time Accuracy of Temporal-Difference Learning Under Schur-Stable Recursions
by: Lee, Donghwan, et al.
Published: (2022)

Deep Q-Learning with Gradient Target Tracking
by: Park, Bum Geun, et al.
Published: (2025)

Verifiable Error Bounds for Physics-Informed Neural Network Solutions of Lyapunov and Hamilton-Jacobi-Bellman Equations
by: Liu, Jun
Published: (2026)

Signatures Meet Dynamic Programming: Generalizing Bellman Equations for Trajectory Following
by: Ohnishi, Motoya, et al.
Published: (2023)

Computationally Efficient RL under Linear Bellman Completeness for Deterministic Dynamics
by: Wu, Runzhe, et al.
Published: (2024)

Universal Approximation Power of Deep Residual Neural Networks via Nonlinear Control Theory
by: Tabuada, Paulo, et al.
Published: (2020)

Periodic Regularized Q-Learning
by: Yang, Hyukjun, et al.
Published: (2026)

Residual Power Flow for Neural Solvers
by: Stiasny, Jochen, et al.
Published: (2026)

Beyond Stationarity: Convergence Analysis of Stochastic Softmax Policy Gradient Methods
by: Klein, Sara, et al.
Published: (2023)

ORN-CBF: Learning Observation-conditioned Residual Neural Control Barrier Functions via Hypernetworks
by: Derajić, Bojan, et al.
Published: (2025)

Online Residual Learning from Offline Experts for Pedestrian Tracking
by: Vlachos, Anastasios, et al.
Published: (2024)

On the Convergence of Overlapping Schwarz Decomposition for Nonlinear Optimal Control
by: Na, Sen, et al.
Published: (2020)

On Some Geometric Behavior of Value Iteration on the Orthant: Switching System Perspective
by: Lee, Donghwan
Published: (2023)

Convergence and stability of Q-learning in Hierarchical Reinforcement Learning
by: Manenti, Massimiliano, et al.
Published: (2025)

Geometry-Preserving Neural Architectures on Manifolds with Boundary
by: Elamvazhuthi, Karthik, et al.
Published: (2026)

Enhancing Convergence of Decentralized Gradient Tracking under the KL Property
by: Chen, Xiaokai, et al.
Published: (2024)

Is Bellman Equation Enough for Learning Control?
by: You, Haoxiang, et al.
Published: (2025)

ControlSynth Neural ODEs: Modeling Dynamical Systems with Guaranteed Convergence
by: Mei, Wenjie, et al.
Published: (2024)

A Short and Unified Convergence Analysis of the SAG, SAGA, and IAG Algorithms
by: Zhu, Feng, et al.
Published: (2026)

On Linear Convergence of PI Consensus Algorithm under the Restricted Secant Inequality
by: Chakrabarti, Kushal, et al.
Published: (2023)

Nonuniqueness and Convergence to Equivalent Solutions in Observer-based Inverse Reinforcement Learning
by: Town, Jared, et al.
Published: (2022)

On the Global Convergence of Policy Gradient in Average Reward Markov Decision Processes
by: Kumar, Navdeep, et al.
Published: (2024)

Safe Multi-Agent Reinforcement Learning with Convergence to Generalized Nash Equilibrium
by: Li, Zeyang, et al.
Published: (2024)

Last-Iterate Convergent Policy Gradient Primal-Dual Methods for Constrained MDPs
by: Ding, Dongsheng, et al.
Published: (2023)

Control in Stochastic Environment with Delays: A Model-based Reinforcement Learning Approach
by: Yao, Zhiyuan, et al.
Published: (2024)

Dynamic Controlled Variables Based Dynamic Self-Optimizing Control
by: Zhou, Chenchen, et al.
Published: (2026)

Nonasymptotic Regret Analysis of Adaptive Linear Quadratic Control with Model Misspecification
by: Lee, Bruce D., et al.
Published: (2023)

Reinforcement Learning Based Traffic Signal Design to Minimize Queue Lengths
by: Nandakumar, Anirud, et al.
Published: (2025)

Non-Parametric Learning of Stochastic Differential Equations with Non-asymptotic Fast Rates of Convergence
by: Bonalli, Riccardo, et al.
Published: (2023)

Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropout
by: Dezhboro, Amirhossein, et al.
Published: (2026)

Active Learning for Control-Oriented Identification of Nonlinear Systems
by: Lee, Bruce D., et al.
Published: (2024)

ReACT: Reinforcement Learning for Controller Parametrization using B-Spline Geometries
by: Rudolf, Thomas, et al.
Published: (2024)

Data-Driven Predictive Control of Nonholonomic Robots Based on a Bilinear Koopman Realization: Data Does Not Replace Geometry
by: Rosenfelder, Mario, et al.
Published: (2024)

Active Learning-Based Optimization of Hydroelectric Turbine Startup to Minimize Fatigue Damage
by: Mai, Vincent, et al.
Published: (2024)