Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2505.05852 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908380472279040 |
|---|---|
| author | Köster, Felix Kanno, Kazutaka Uchida, Atsushi |
| author_facet | Köster, Felix Kanno, Kazutaka Uchida, Atsushi |
| contents | Reservoir computing has proven effective for tasks such as time-series prediction, particularly in the context of chaotic systems. However, conventional reservoir computing frameworks often face challenges in achieving high prediction accuracy and adapting to diverse dynamical problems due to their reliance on fixed weight structures. A concept of an attention-enhanced reservoir computer has been proposed, which integrates an attention mechanism into the output layer of the reservoir computing model. This addition enables the system to prioritize distinct features dynamically, enhancing adaptability and prediction performance. In this study, we demonstrate the capability of the attention-enhanced reservoir computer to learn and predict multiple chaotic attractors simultaneously with a single set of weights, thus enabling transitions between attractors without explicit retraining. The method is validated using benchmark tasks, including the Lorenz system, Rössler system, Henon map, Duffing oscillator, and Mackey-Glass delay-differential equation. Our results indicate that the attention-enhanced reservoir computer achieves superior prediction accuracy, valid prediction times, and improved representation of spectral and histogram characteristics compared to traditional reservoir computing methods, establishing it as a robust tool for modeling complex dynamical systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_05852 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Attention-Enhanced Reservoir Computing as a Multiple Dynamical System Approximator Köster, Felix Kanno, Kazutaka Uchida, Atsushi Chaotic Dynamics Reservoir computing has proven effective for tasks such as time-series prediction, particularly in the context of chaotic systems. However, conventional reservoir computing frameworks often face challenges in achieving high prediction accuracy and adapting to diverse dynamical problems due to their reliance on fixed weight structures. A concept of an attention-enhanced reservoir computer has been proposed, which integrates an attention mechanism into the output layer of the reservoir computing model. This addition enables the system to prioritize distinct features dynamically, enhancing adaptability and prediction performance. In this study, we demonstrate the capability of the attention-enhanced reservoir computer to learn and predict multiple chaotic attractors simultaneously with a single set of weights, thus enabling transitions between attractors without explicit retraining. The method is validated using benchmark tasks, including the Lorenz system, Rössler system, Henon map, Duffing oscillator, and Mackey-Glass delay-differential equation. Our results indicate that the attention-enhanced reservoir computer achieves superior prediction accuracy, valid prediction times, and improved representation of spectral and histogram characteristics compared to traditional reservoir computing methods, establishing it as a robust tool for modeling complex dynamical systems. |
| title | Attention-Enhanced Reservoir Computing as a Multiple Dynamical System Approximator |
| topic | Chaotic Dynamics |
| url | https://arxiv.org/abs/2505.05852 |