Underwater Soft Fin Flapping Motion with Deep Neural Network Based Surrogate Model

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hamamatsu, Yuya, Kupyn, Pavlo, Gkliva, Roza, Ristolainen, Asko, Kruusmaa, Maarja
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912221246783488
author Hamamatsu, Yuya
Kupyn, Pavlo
Gkliva, Roza
Ristolainen, Asko
Kruusmaa, Maarja
author_facet Hamamatsu, Yuya
Kupyn, Pavlo
Gkliva, Roza
Ristolainen, Asko
Kruusmaa, Maarja
contents This study presents a novel framework for precise force control of fin-actuated underwater robots by integrating a deep neural network (DNN)-based surrogate model with reinforcement learning (RL). To address the complex interactions with the underwater environment and the high experimental costs, a DNN surrogate model acts as a simulator for enabling efficient training for the RL agent. Additionally, grid-switching control is applied to select optimized models for specific force reference ranges, improving control accuracy and stability. Experimental results show that the RL agent, trained in the surrogate simulation, generates complex thrust motions and achieves precise control of a real soft fin actuator. This approach provides an efficient control solution for fin-actuated robots in challenging underwater environments.
format Preprint
id arxiv_https___arxiv_org_abs_2502_03135
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Underwater Soft Fin Flapping Motion with Deep Neural Network Based Surrogate Model
Hamamatsu, Yuya
Kupyn, Pavlo
Gkliva, Roza
Ristolainen, Asko
Kruusmaa, Maarja
Robotics
Machine Learning
This study presents a novel framework for precise force control of fin-actuated underwater robots by integrating a deep neural network (DNN)-based surrogate model with reinforcement learning (RL). To address the complex interactions with the underwater environment and the high experimental costs, a DNN surrogate model acts as a simulator for enabling efficient training for the RL agent. Additionally, grid-switching control is applied to select optimized models for specific force reference ranges, improving control accuracy and stability. Experimental results show that the RL agent, trained in the surrogate simulation, generates complex thrust motions and achieves precise control of a real soft fin actuator. This approach provides an efficient control solution for fin-actuated robots in challenging underwater environments.
title Underwater Soft Fin Flapping Motion with Deep Neural Network Based Surrogate Model
topic Robotics
Machine Learning
url https://arxiv.org/abs/2502.03135