Reinforcement Learning on Reconfigurable Hardware: Overcoming Material Variability in Laser Material Processing
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912261888540672 |
|---|---|
| author | Masinelli, Giulio Rajani, Chang Hoffmann, Patrik Wasmer, Kilian Atienza, David |
| author_facet | Masinelli, Giulio Rajani, Chang Hoffmann, Patrik Wasmer, Kilian Atienza, David |
| contents | Ensuring consistent processing quality is challenging in laser processes due to varying material properties and surface conditions. Although some approaches have shown promise in solving this problem via automation, they often rely on predetermined targets or are limited to simulated environments. To address these shortcomings, we propose a novel real-time reinforcement learning approach for laser process control, implemented on a Field Programmable Gate Array to achieve real-time execution. Our experimental results from laser welding tests on stainless steel samples with a range of surface roughnesses validated the method's ability to adapt autonomously, without relying on reward engineering or prior setup information. Specifically, the algorithm learned the correct power profile for each unique surface characteristic, demonstrating significant improvements over hand-engineered optimal constant power strategies -- up to 23% better performance on rougher surfaces and 7% on mixed surfaces. This approach represents a significant advancement in automating and optimizing laser processes, with potential applications across multiple industries. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_19102 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Reinforcement Learning on Reconfigurable Hardware: Overcoming Material Variability in Laser Material Processing Masinelli, Giulio Rajani, Chang Hoffmann, Patrik Wasmer, Kilian Atienza, David Machine Learning Ensuring consistent processing quality is challenging in laser processes due to varying material properties and surface conditions. Although some approaches have shown promise in solving this problem via automation, they often rely on predetermined targets or are limited to simulated environments. To address these shortcomings, we propose a novel real-time reinforcement learning approach for laser process control, implemented on a Field Programmable Gate Array to achieve real-time execution. Our experimental results from laser welding tests on stainless steel samples with a range of surface roughnesses validated the method's ability to adapt autonomously, without relying on reward engineering or prior setup information. Specifically, the algorithm learned the correct power profile for each unique surface characteristic, demonstrating significant improvements over hand-engineered optimal constant power strategies -- up to 23% better performance on rougher surfaces and 7% on mixed surfaces. This approach represents a significant advancement in automating and optimizing laser processes, with potential applications across multiple industries. |
| title | Reinforcement Learning on Reconfigurable Hardware: Overcoming Material Variability in Laser Material Processing |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.19102 |