Plasma Shape Control via Zero-shot Generative Reinforcement Learning
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918164187578368 |
|---|---|
| author | Wu, Niannian Li, Rongpeng Yang, Zongyu Xiao, Yong Wei, Ning Chen, Yihang Li, Bo Zhao, Zhifeng Zhong, Wulyu |
| author_facet | Wu, Niannian Li, Rongpeng Yang, Zongyu Xiao, Yong Wei, Ning Chen, Yihang Li, Bo Zhao, Zhifeng Zhong, Wulyu |
| contents | Traditional PID controllers have limited adaptability for plasma shape control, and task-specific reinforcement learning (RL) methods suffer from limited generalization and the need for repetitive retraining. To overcome these challenges, this paper proposes a novel framework for developing a versatile, zero-shot control policy from a large-scale offline dataset of historical PID-controlled discharges. Our approach synergistically combines Generative Adversarial Imitation Learning (GAIL) with Hilbert space representation learning to achieve dual objectives: mimicking the stable operational style of the PID data and constructing a geometrically structured latent space for efficient, goal-directed control. The resulting foundation policy can be deployed for diverse trajectory tracking tasks in a zero-shot manner without any task-specific fine-tuning. Evaluations on the HL-3 tokamak simulator demonstrate that the policy excels at precisely and stably tracking reference trajectories for key shape parameters across a range of plasma scenarios. This work presents a viable pathway toward developing highly flexible and data-efficient intelligent control systems for future fusion reactors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_17531 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Plasma Shape Control via Zero-shot Generative Reinforcement Learning Wu, Niannian Li, Rongpeng Yang, Zongyu Xiao, Yong Wei, Ning Chen, Yihang Li, Bo Zhao, Zhifeng Zhong, Wulyu Plasma Physics Machine Learning Traditional PID controllers have limited adaptability for plasma shape control, and task-specific reinforcement learning (RL) methods suffer from limited generalization and the need for repetitive retraining. To overcome these challenges, this paper proposes a novel framework for developing a versatile, zero-shot control policy from a large-scale offline dataset of historical PID-controlled discharges. Our approach synergistically combines Generative Adversarial Imitation Learning (GAIL) with Hilbert space representation learning to achieve dual objectives: mimicking the stable operational style of the PID data and constructing a geometrically structured latent space for efficient, goal-directed control. The resulting foundation policy can be deployed for diverse trajectory tracking tasks in a zero-shot manner without any task-specific fine-tuning. Evaluations on the HL-3 tokamak simulator demonstrate that the policy excels at precisely and stably tracking reference trajectories for key shape parameters across a range of plasma scenarios. This work presents a viable pathway toward developing highly flexible and data-efficient intelligent control systems for future fusion reactors. |
| title | Plasma Shape Control via Zero-shot Generative Reinforcement Learning |
| topic | Plasma Physics Machine Learning |
| url | https://arxiv.org/abs/2510.17531 |