Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challenges

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Aubard, Martin, Madureira, Ana, Teixeira, Luís, Pinto, José
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917870152187904
author Aubard, Martin
Madureira, Ana
Teixeira, Luís
Pinto, José
author_facet Aubard, Martin
Madureira, Ana
Teixeira, Luís
Pinto, José
contents With the growing interest in underwater exploration and monitoring, Autonomous Underwater Vehicles (AUVs) have become essential. The recent interest in onboard Deep Learning (DL) has advanced real-time environmental interaction capabilities relying on efficient and accurate vision-based DL models. However, the predominant use of sonar in underwater environments, characterized by limited training data and inherent noise, poses challenges to model robustness. This autonomy improvement raises safety concerns for deploying such models during underwater operations, potentially leading to hazardous situations. This paper aims to provide the first comprehensive overview of sonar-based DL under the scope of robustness. It studies sonar-based DL perception task models, such as classification, object detection, segmentation, and SLAM. Furthermore, the paper systematizes sonar-based state-of-the-art datasets, simulators, and robustness methods such as neural network verification, out-of-distribution, and adversarial attacks. This paper highlights the lack of robustness in sonar-based DL research and suggests future research pathways, notably establishing a baseline sonar-based dataset and bridging the simulation-to-reality gap.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11840
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challenges
Aubard, Martin
Madureira, Ana
Teixeira, Luís
Pinto, José
Robotics
Computer Vision and Pattern Recognition
Signal Processing
With the growing interest in underwater exploration and monitoring, Autonomous Underwater Vehicles (AUVs) have become essential. The recent interest in onboard Deep Learning (DL) has advanced real-time environmental interaction capabilities relying on efficient and accurate vision-based DL models. However, the predominant use of sonar in underwater environments, characterized by limited training data and inherent noise, poses challenges to model robustness. This autonomy improvement raises safety concerns for deploying such models during underwater operations, potentially leading to hazardous situations. This paper aims to provide the first comprehensive overview of sonar-based DL under the scope of robustness. It studies sonar-based DL perception task models, such as classification, object detection, segmentation, and SLAM. Furthermore, the paper systematizes sonar-based state-of-the-art datasets, simulators, and robustness methods such as neural network verification, out-of-distribution, and adversarial attacks. This paper highlights the lack of robustness in sonar-based DL research and suggests future research pathways, notably establishing a baseline sonar-based dataset and bridging the simulation-to-reality gap.
title Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challenges
topic Robotics
Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2412.11840