Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.15508 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929357508837376 |
|---|---|
| author | Parra, Olivia Jullian Pardiñas, Julián García Pérez, Lorenzo Del Pianta Janisch, Maximilian Klaver, Suzanne Lehéricy, Thomas Serra, Nicola |
| author_facet | Parra, Olivia Jullian Pardiñas, Julián García Pérez, Lorenzo Del Pianta Janisch, Maximilian Klaver, Suzanne Lehéricy, Thomas Serra, Nicola |
| contents | Data Quality Monitoring (DQM) is a crucial task in large particle physics experiments, since detector malfunctioning can compromise the data. DQM is currently performed by human shifters, which is costly and results in limited accuracy. In this work, we provide a proof-of-concept for applying human-in-the-loop Reinforcement Learning (RL) to automate the DQM process while adapting to operating conditions that change over time. We implement a prototype based on the Proximal Policy Optimization (PPO) algorithm and validate it on a simplified synthetic dataset. We demonstrate how a multi-agent system can be trained for continuous automated monitoring during data collection, with human intervention actively requested only when relevant. We show that random, unbiased noise in human classification can be reduced, leading to an improved accuracy over the baseline. Additionally, we propose data augmentation techniques to deal with scarce data and to accelerate the learning process. Finally, we discuss further steps needed to implement the approach in the real world, including protocols for periodic control of the algorithm's outputs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_15508 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Human-in-the-loop Reinforcement Learning for Data Quality Monitoring in Particle Physics Experiments Parra, Olivia Jullian Pardiñas, Julián García Pérez, Lorenzo Del Pianta Janisch, Maximilian Klaver, Suzanne Lehéricy, Thomas Serra, Nicola High Energy Physics - Experiment Machine Learning Data Quality Monitoring (DQM) is a crucial task in large particle physics experiments, since detector malfunctioning can compromise the data. DQM is currently performed by human shifters, which is costly and results in limited accuracy. In this work, we provide a proof-of-concept for applying human-in-the-loop Reinforcement Learning (RL) to automate the DQM process while adapting to operating conditions that change over time. We implement a prototype based on the Proximal Policy Optimization (PPO) algorithm and validate it on a simplified synthetic dataset. We demonstrate how a multi-agent system can be trained for continuous automated monitoring during data collection, with human intervention actively requested only when relevant. We show that random, unbiased noise in human classification can be reduced, leading to an improved accuracy over the baseline. Additionally, we propose data augmentation techniques to deal with scarce data and to accelerate the learning process. Finally, we discuss further steps needed to implement the approach in the real world, including protocols for periodic control of the algorithm's outputs. |
| title | Human-in-the-loop Reinforcement Learning for Data Quality Monitoring in Particle Physics Experiments |
| topic | High Energy Physics - Experiment Machine Learning |
| url | https://arxiv.org/abs/2405.15508 |