Modeling of AUV Dynamics with Limited Resources: Efficient Online Learning Using Uncertainty

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tešnar, Michal, Wehbe, Bilal, Valdenegro-Toro, Matias
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909568480575488
author Tešnar, Michal
Wehbe, Bilal
Valdenegro-Toro, Matias
author_facet Tešnar, Michal
Wehbe, Bilal
Valdenegro-Toro, Matias
contents Machine learning proves effective in constructing dynamics models from data, especially for underwater vehicles. Continuous refinement of these models using incoming data streams, however, often requires storage of an overwhelming amount of redundant data. This work investigates the use of uncertainty in the selection of data points to rehearse in online learning when storage capacity is constrained. The models are learned using an ensemble of multilayer perceptrons as they perform well at predicting epistemic uncertainty. We present three novel approaches: the Threshold method, which excludes samples with uncertainty below a specified threshold, the Greedy method, designed to maximize uncertainty among the stored points, and Threshold-Greedy, which combines the previous two approaches. The methods are assessed on data collected by an underwater vehicle Dagon. Comparison with baselines reveals that the Threshold exhibits enhanced stability throughout the learning process and also yields a model with the least cumulative testing loss. We also conducted detailed analyses on the impact of model parameters and storage size on the performance of the models, as well as a comparison of three different uncertainty estimation methods.
format Preprint
id arxiv_https___arxiv_org_abs_2504_04583
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Modeling of AUV Dynamics with Limited Resources: Efficient Online Learning Using Uncertainty
Tešnar, Michal
Wehbe, Bilal
Valdenegro-Toro, Matias
Machine Learning
Robotics
Machine learning proves effective in constructing dynamics models from data, especially for underwater vehicles. Continuous refinement of these models using incoming data streams, however, often requires storage of an overwhelming amount of redundant data. This work investigates the use of uncertainty in the selection of data points to rehearse in online learning when storage capacity is constrained. The models are learned using an ensemble of multilayer perceptrons as they perform well at predicting epistemic uncertainty. We present three novel approaches: the Threshold method, which excludes samples with uncertainty below a specified threshold, the Greedy method, designed to maximize uncertainty among the stored points, and Threshold-Greedy, which combines the previous two approaches. The methods are assessed on data collected by an underwater vehicle Dagon. Comparison with baselines reveals that the Threshold exhibits enhanced stability throughout the learning process and also yields a model with the least cumulative testing loss. We also conducted detailed analyses on the impact of model parameters and storage size on the performance of the models, as well as a comparison of three different uncertainty estimation methods.
title Modeling of AUV Dynamics with Limited Resources: Efficient Online Learning Using Uncertainty
topic Machine Learning
Robotics
url https://arxiv.org/abs/2504.04583