Multi-Agent Reinforcement Learning for Inverse Design in Photonic Integrated Circuits
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908416960626688 |
|---|---|
| author | Mahlau, Yannik Schier, Maximilian Reinders, Christoph Schubert, Frederik Bügling, Marco Rosenhahn, Bodo |
| author_facet | Mahlau, Yannik Schier, Maximilian Reinders, Christoph Schubert, Frederik Bügling, Marco Rosenhahn, Bodo |
| contents | Inverse design of photonic integrated circuits (PICs) has traditionally relied on gradientbased optimization. However, this approach is prone to end up in local minima, which results in suboptimal design functionality. As interest in PICs increases due to their potential for addressing modern hardware demands through optical computing, more adaptive optimization algorithms are needed. We present a reinforcement learning (RL) environment as well as multi-agent RL algorithms for the design of PICs. By discretizing the design space into a grid, we formulate the design task as an optimization problem with thousands of binary variables. We consider multiple two- and three-dimensional design tasks that represent PIC components for an optical computing system. By decomposing the design space into thousands of individual agents, our algorithms are able to optimize designs with only a few thousand environment samples. They outperform previous state-of-the-art gradient-based optimization in both twoand three-dimensional design tasks. Our work may also serve as a benchmark for further exploration of sample-efficient RL for inverse design in photonics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_18627 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Multi-Agent Reinforcement Learning for Inverse Design in Photonic Integrated Circuits Mahlau, Yannik Schier, Maximilian Reinders, Christoph Schubert, Frederik Bügling, Marco Rosenhahn, Bodo Machine Learning Artificial Intelligence Inverse design of photonic integrated circuits (PICs) has traditionally relied on gradientbased optimization. However, this approach is prone to end up in local minima, which results in suboptimal design functionality. As interest in PICs increases due to their potential for addressing modern hardware demands through optical computing, more adaptive optimization algorithms are needed. We present a reinforcement learning (RL) environment as well as multi-agent RL algorithms for the design of PICs. By discretizing the design space into a grid, we formulate the design task as an optimization problem with thousands of binary variables. We consider multiple two- and three-dimensional design tasks that represent PIC components for an optical computing system. By decomposing the design space into thousands of individual agents, our algorithms are able to optimize designs with only a few thousand environment samples. They outperform previous state-of-the-art gradient-based optimization in both twoand three-dimensional design tasks. Our work may also serve as a benchmark for further exploration of sample-efficient RL for inverse design in photonics. |
| title | Multi-Agent Reinforcement Learning for Inverse Design in Photonic Integrated Circuits |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2506.18627 |