Physics-informed reinforcement learning for sample-efficient optimization of freeform nanophotonic devices

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Park, Chaejin, Kim, Sanmun, Jung, Anthony W., Park, Juho, Seo, Dongjin, Kim, Yongha, Park, Chanhyung, Park, Chan Y., Jang, Min Seok
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913920210436096
author Park, Chaejin
Kim, Sanmun
Jung, Anthony W.
Park, Juho
Seo, Dongjin
Kim, Yongha
Park, Chanhyung
Park, Chan Y.
Jang, Min Seok
author_facet Park, Chaejin
Kim, Sanmun
Jung, Anthony W.
Park, Juho
Seo, Dongjin
Kim, Yongha
Park, Chanhyung
Park, Chan Y.
Jang, Min Seok
contents In the field of optics, precise control of light with arbitrary spatial resolution has long been a sought-after goal. Freeform nanophotonic devices are critical building blocks for achieving this goal, as they provide access to a design potential that could hardly be achieved by conventional fixed-shape devices. However, finding an optimal device structure in the vast combinatorial design space that scales exponentially with the number of freeform design parameters has been an enormous challenge. In this study, we propose physics-informed reinforcement learning (PIRL) as an optimization method for freeform nanophotonic devices, which combines the adjoint-based method with reinforcement learning to enhance the sample efficiency of the optimization algorithm and overcome the issue of local minima. To illustrate these advantages of PIRL over other conventional optimization algorithms, we design a family of one-dimensional metasurface beam deflectors using PIRL, obtaining more performant devices. We also explore the transfer learning capability of PIRL that further improves sample efficiency and demonstrate how the minimum feature size of the design can be enforced in PIRL through reward engineering. With its high sample efficiency, robustness, and ability to seamlessly incorporate practical device design constraints, our method offers a promising approach to highly combinatorial freeform device optimization in various physical domains.
format Preprint
id arxiv_https___arxiv_org_abs_2306_04108
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Physics-informed reinforcement learning for sample-efficient optimization of freeform nanophotonic devices
Park, Chaejin
Kim, Sanmun
Jung, Anthony W.
Park, Juho
Seo, Dongjin
Kim, Yongha
Park, Chanhyung
Park, Chan Y.
Jang, Min Seok
Computational Physics
Optics
In the field of optics, precise control of light with arbitrary spatial resolution has long been a sought-after goal. Freeform nanophotonic devices are critical building blocks for achieving this goal, as they provide access to a design potential that could hardly be achieved by conventional fixed-shape devices. However, finding an optimal device structure in the vast combinatorial design space that scales exponentially with the number of freeform design parameters has been an enormous challenge. In this study, we propose physics-informed reinforcement learning (PIRL) as an optimization method for freeform nanophotonic devices, which combines the adjoint-based method with reinforcement learning to enhance the sample efficiency of the optimization algorithm and overcome the issue of local minima. To illustrate these advantages of PIRL over other conventional optimization algorithms, we design a family of one-dimensional metasurface beam deflectors using PIRL, obtaining more performant devices. We also explore the transfer learning capability of PIRL that further improves sample efficiency and demonstrate how the minimum feature size of the design can be enforced in PIRL through reward engineering. With its high sample efficiency, robustness, and ability to seamlessly incorporate practical device design constraints, our method offers a promising approach to highly combinatorial freeform device optimization in various physical domains.
title Physics-informed reinforcement learning for sample-efficient optimization of freeform nanophotonic devices
topic Computational Physics
Optics
url https://arxiv.org/abs/2306.04108