A General and Streamlined Differentiable Optimization Framework

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rosemberg, Andrew W., Garcia, Joaquim Dias, Pacaud, François, Parker, Robert B., Legat, Benoît, Sundar, Kaarthik, Bent, Russell, Van Hentenryck, Pascal
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908619846451200
author Rosemberg, Andrew W.
Garcia, Joaquim Dias
Pacaud, François
Parker, Robert B.
Legat, Benoît
Sundar, Kaarthik
Bent, Russell
Van Hentenryck, Pascal
author_facet Rosemberg, Andrew W.
Garcia, Joaquim Dias
Pacaud, François
Parker, Robert B.
Legat, Benoît
Sundar, Kaarthik
Bent, Russell
Van Hentenryck, Pascal
contents Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface mismatches. This paper presents a general and streamlined framework-an updated DiffOpt.jl-that unifies modeling and differentiation within the Julia optimization stack. The framework computes forward - and reverse-mode solution and objective sensitivities for smooth, potentially nonconvex programs by differentiating the KKT system under standard regularity assumptions. A first-class, JuMP-native parameter-centric API allows users to declare named parameters and obtain derivatives directly with respect to them - even when a parameter appears in multiple constraints and objectives - eliminating brittle bookkeeping from coefficient-level interfaces. We illustrate these capabilities on convex and nonconvex models, including economic dispatch, mean-variance portfolio selection with conic risk constraints, and nonlinear robot inverse kinematics. Two companion studies further demonstrate impact at scale: gradient-based iterative methods for strategic bidding in energy markets and Sobolev-style training of end-to-end optimization proxies using solver-accurate sensitivities. Together, these results demonstrate that differentiable optimization can be deployed as a routine tool for experimentation, learning, calibration, and design-without deviating from standard JuMP modeling practices and while retaining access to a broad ecosystem of solvers.
format Preprint
id arxiv_https___arxiv_org_abs_2510_25986
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A General and Streamlined Differentiable Optimization Framework
Rosemberg, Andrew W.
Garcia, Joaquim Dias
Pacaud, François
Parker, Robert B.
Legat, Benoît
Sundar, Kaarthik
Bent, Russell
Van Hentenryck, Pascal
Machine Learning
Optimization and Control
Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface mismatches. This paper presents a general and streamlined framework-an updated DiffOpt.jl-that unifies modeling and differentiation within the Julia optimization stack. The framework computes forward - and reverse-mode solution and objective sensitivities for smooth, potentially nonconvex programs by differentiating the KKT system under standard regularity assumptions. A first-class, JuMP-native parameter-centric API allows users to declare named parameters and obtain derivatives directly with respect to them - even when a parameter appears in multiple constraints and objectives - eliminating brittle bookkeeping from coefficient-level interfaces. We illustrate these capabilities on convex and nonconvex models, including economic dispatch, mean-variance portfolio selection with conic risk constraints, and nonlinear robot inverse kinematics. Two companion studies further demonstrate impact at scale: gradient-based iterative methods for strategic bidding in energy markets and Sobolev-style training of end-to-end optimization proxies using solver-accurate sensitivities. Together, these results demonstrate that differentiable optimization can be deployed as a routine tool for experimentation, learning, calibration, and design-without deviating from standard JuMP modeling practices and while retaining access to a broad ecosystem of solvers.
title A General and Streamlined Differentiable Optimization Framework
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2510.25986