Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2310.12387 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917624468733952 |
|---|---|
| author | Wang, Chen Huang, Victoria Chen, Gang Ma, Hui Chen, Bryce Schmidt, Jochen |
| author_facet | Wang, Chen Huang, Victoria Chen, Gang Ma, Hui Chen, Bryce Schmidt, Jochen |
| contents | The optimal placement of sensors for environmental monitoring and disaster management is a challenging problem due to its NP-hard nature. Traditional methods for sensor placement involve exact, approximation, or heuristic approaches, with the latter being the most widely used. However, heuristic methods are limited by expert intuition and experience. Deep learning (DL) has emerged as a promising approach for generating heuristic algorithms automatically. In this paper, we introduce a novel sensor placement approach focused on learning improvement heuristics using deep reinforcement learning (RL) methods. Our approach leverages an RL formulation for learning improvement heuristics, driven by an actor-critic algorithm for training the policy network. We compare our method with several state-of-the-art approaches by conducting comprehensive experiments, demonstrating the effectiveness and superiority of our proposed approach in producing high-quality solutions. Our work presents a promising direction for applying advanced DL and RL techniques to challenging climate sensor placement problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_12387 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Learning to Optimise Climate Sensor Placement using a Transformer Wang, Chen Huang, Victoria Chen, Gang Ma, Hui Chen, Bryce Schmidt, Jochen Machine Learning Artificial Intelligence The optimal placement of sensors for environmental monitoring and disaster management is a challenging problem due to its NP-hard nature. Traditional methods for sensor placement involve exact, approximation, or heuristic approaches, with the latter being the most widely used. However, heuristic methods are limited by expert intuition and experience. Deep learning (DL) has emerged as a promising approach for generating heuristic algorithms automatically. In this paper, we introduce a novel sensor placement approach focused on learning improvement heuristics using deep reinforcement learning (RL) methods. Our approach leverages an RL formulation for learning improvement heuristics, driven by an actor-critic algorithm for training the policy network. We compare our method with several state-of-the-art approaches by conducting comprehensive experiments, demonstrating the effectiveness and superiority of our proposed approach in producing high-quality solutions. Our work presents a promising direction for applying advanced DL and RL techniques to challenging climate sensor placement problems. |
| title | Learning to Optimise Climate Sensor Placement using a Transformer |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2310.12387 |