Sub-optimality bounds for certainty equivalent policies in partially observed systems
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911417754451968 |
|---|---|
| author | Bozkurt, Berk Mahajan, Aditya Nayyar, Ashutosh Ouyang, Yi |
| author_facet | Bozkurt, Berk Mahajan, Aditya Nayyar, Ashutosh Ouyang, Yi |
| contents | In this paper, we present a generalization of the certainty equivalence principle of stochastic control. One interpretation of the classical certainty equivalence principle for linear systems with output feedback and quadratic costs is as follows: the optimal action at each time is obtained by evaluating the optimal state-feedback policy of the stochastic linear system at the minimum mean square error (MMSE) estimate of the state. Motivated by this interpretation, we consider certainty equivalent policies for general (non-linear) partially observed stochastic systems that allow for any state estimate rather than restricting to MMSE estimates. In such settings, the certainty equivalent policy is not optimal. For models where the cost and the dynamics are smooth in an appropriate sense, we derive upper bounds on the sub-optimality of certainty equivalent policies. We present several examples to illustrate the results. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_02814 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Sub-optimality bounds for certainty equivalent policies in partially observed systems Bozkurt, Berk Mahajan, Aditya Nayyar, Ashutosh Ouyang, Yi Optimization and Control Robotics Systems and Control In this paper, we present a generalization of the certainty equivalence principle of stochastic control. One interpretation of the classical certainty equivalence principle for linear systems with output feedback and quadratic costs is as follows: the optimal action at each time is obtained by evaluating the optimal state-feedback policy of the stochastic linear system at the minimum mean square error (MMSE) estimate of the state. Motivated by this interpretation, we consider certainty equivalent policies for general (non-linear) partially observed stochastic systems that allow for any state estimate rather than restricting to MMSE estimates. In such settings, the certainty equivalent policy is not optimal. For models where the cost and the dynamics are smooth in an appropriate sense, we derive upper bounds on the sub-optimality of certainty equivalent policies. We present several examples to illustrate the results. |
| title | Sub-optimality bounds for certainty equivalent policies in partially observed systems |
| topic | Optimization and Control Robotics Systems and Control |
| url | https://arxiv.org/abs/2602.02814 |