Invisible Servoing: a Visual Servoing Approach with Return-Conditioned Latent Diffusion
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916711534428160 |
|---|---|
| author | Gerges, Bishoy Bazzana, Barbara Botteghi, Nicolò Aboudorra, Youssef Franchi, Antonio |
| author_facet | Gerges, Bishoy Bazzana, Barbara Botteghi, Nicolò Aboudorra, Youssef Franchi, Antonio |
| contents | In this paper, we present a novel visual servoing (VS) approach based on latent Denoising Diffusion Probabilistic Models (DDPMs), that explores the application of generative models for vision-based navigation of UAVs (Uncrewed Aerial Vehicles). Opposite to classical VS methods, the proposed approach allows reaching the desired target view, even when the target is initially not visible. This is possible thanks to the learning of a latent representation that the DDPM uses for planning and a dataset of trajectories encompassing target-invisible initial views. A compact representation is learned from raw images using a Cross-Modal Variational Autoencoder. Given the current image, the DDPM generates trajectories in the latent space driving the robotic platform to the desired visual target. The approach has been validated in simulation using two generic multi-rotor UAVs (a quadrotor and a hexarotor). The results show that we can successfully reach the visual target, even if not visible in the initial view. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_13337 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Invisible Servoing: a Visual Servoing Approach with Return-Conditioned Latent Diffusion Gerges, Bishoy Bazzana, Barbara Botteghi, Nicolò Aboudorra, Youssef Franchi, Antonio Robotics In this paper, we present a novel visual servoing (VS) approach based on latent Denoising Diffusion Probabilistic Models (DDPMs), that explores the application of generative models for vision-based navigation of UAVs (Uncrewed Aerial Vehicles). Opposite to classical VS methods, the proposed approach allows reaching the desired target view, even when the target is initially not visible. This is possible thanks to the learning of a latent representation that the DDPM uses for planning and a dataset of trajectories encompassing target-invisible initial views. A compact representation is learned from raw images using a Cross-Modal Variational Autoencoder. Given the current image, the DDPM generates trajectories in the latent space driving the robotic platform to the desired visual target. The approach has been validated in simulation using two generic multi-rotor UAVs (a quadrotor and a hexarotor). The results show that we can successfully reach the visual target, even if not visible in the initial view. |
| title | Invisible Servoing: a Visual Servoing Approach with Return-Conditioned Latent Diffusion |
| topic | Robotics |
| url | https://arxiv.org/abs/2409.13337 |