Real-Time Black-Box Optimization for Dynamic Discrete Environments Using Embedded Ising Machines
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909654204809216 |
|---|---|
| author | Kashimata, Tomoya Hamakawa, Yohei Yamasaki, Masaya Tatsumura, Kosuke |
| author_facet | Kashimata, Tomoya Hamakawa, Yohei Yamasaki, Masaya Tatsumura, Kosuke |
| contents | Many real-time systems require the optimization of discrete variables. Black-box optimization (BBO) algorithms and multi-armed bandit (MAB) algorithms perform optimization by repeatedly taking actions and observing the corresponding instant rewards without any prior knowledge. Recently, a BBO method using an Ising machine has been proposed to find the best action that is represented by a combination of discrete values and maximizes the instant reward in static environments. In contrast, dynamic environments, where real-time systems operate, necessitate MAB algorithms that maximize the average reward over multiple trials. However, due to the enormous number of actions resulting from the combinatorial nature of discrete optimization, conventional MAB algorithms cannot effectively optimize dynamic, discrete environments. Here, we show a heuristic MAB method for dynamic, discrete environments by extending the BBO method, in which an Ising machine effectively explores the actions while considering interactions between variables and changes in dynamic environments. We demonstrate the dynamic adaptability of the proposed method in a wireless communication system with moving users. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_16924 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Real-Time Black-Box Optimization for Dynamic Discrete Environments Using Embedded Ising Machines Kashimata, Tomoya Hamakawa, Yohei Yamasaki, Masaya Tatsumura, Kosuke Artificial Intelligence Emerging Technologies I.2.8 Many real-time systems require the optimization of discrete variables. Black-box optimization (BBO) algorithms and multi-armed bandit (MAB) algorithms perform optimization by repeatedly taking actions and observing the corresponding instant rewards without any prior knowledge. Recently, a BBO method using an Ising machine has been proposed to find the best action that is represented by a combination of discrete values and maximizes the instant reward in static environments. In contrast, dynamic environments, where real-time systems operate, necessitate MAB algorithms that maximize the average reward over multiple trials. However, due to the enormous number of actions resulting from the combinatorial nature of discrete optimization, conventional MAB algorithms cannot effectively optimize dynamic, discrete environments. Here, we show a heuristic MAB method for dynamic, discrete environments by extending the BBO method, in which an Ising machine effectively explores the actions while considering interactions between variables and changes in dynamic environments. We demonstrate the dynamic adaptability of the proposed method in a wireless communication system with moving users. |
| title | Real-Time Black-Box Optimization for Dynamic Discrete Environments Using Embedded Ising Machines |
| topic | Artificial Intelligence Emerging Technologies I.2.8 |
| url | https://arxiv.org/abs/2506.16924 |