UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescue
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908361275998208 |
|---|---|
| author | Yaqoot, Yasheerah Mustafa, Muhammad Ahsan Sautenkov, Oleg Lykov, Artem Serpiva, Valerii Tsetserukou, Dzmitry |
| author_facet | Yaqoot, Yasheerah Mustafa, Muhammad Ahsan Sautenkov, Oleg Lykov, Artem Serpiva, Valerii Tsetserukou, Dzmitry |
| contents | Emergency search and rescue (SAR) operations often require rapid and precise target identification in complex environments where traditional manual drone control is inefficient. In order to address these scenarios, a rapid SAR system, UAV-VLRR (Vision-Language-Rapid-Response), is developed in this research. This system consists of two aspects: 1) A multimodal system which harnesses the power of Visual Language Model (VLM) and the natural language processing capabilities of ChatGPT-4o (LLM) for scene interpretation. 2) A non-linearmodel predictive control (NMPC) with built-in obstacle avoidance for rapid response by a drone to fly according to the output of the multimodal system. This work aims at improving response times in emergency SAR operations by providing a more intuitive and natural approach to the operator to plan the SAR mission while allowing the drone to carry out that mission in a rapid and safe manner. When tested, our approach was faster on an average by 33.75% when compared with an off-the-shelf autopilot and 54.6% when compared with a human pilot. Video of UAV-VLRR: https://youtu.be/KJqQGKKt1xY |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_02465 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescue Yaqoot, Yasheerah Mustafa, Muhammad Ahsan Sautenkov, Oleg Lykov, Artem Serpiva, Valerii Tsetserukou, Dzmitry Robotics Systems and Control Emergency search and rescue (SAR) operations often require rapid and precise target identification in complex environments where traditional manual drone control is inefficient. In order to address these scenarios, a rapid SAR system, UAV-VLRR (Vision-Language-Rapid-Response), is developed in this research. This system consists of two aspects: 1) A multimodal system which harnesses the power of Visual Language Model (VLM) and the natural language processing capabilities of ChatGPT-4o (LLM) for scene interpretation. 2) A non-linearmodel predictive control (NMPC) with built-in obstacle avoidance for rapid response by a drone to fly according to the output of the multimodal system. This work aims at improving response times in emergency SAR operations by providing a more intuitive and natural approach to the operator to plan the SAR mission while allowing the drone to carry out that mission in a rapid and safe manner. When tested, our approach was faster on an average by 33.75% when compared with an off-the-shelf autopilot and 54.6% when compared with a human pilot. Video of UAV-VLRR: https://youtu.be/KJqQGKKt1xY |
| title | UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescue |
| topic | Robotics Systems and Control |
| url | https://arxiv.org/abs/2503.02465 |