Guardado en:
Detalles Bibliográficos
Autores principales: Srivastava, Kushagra, Kulkarni, Rutwik, Velmurugan, Manoj, Sanket, Nitin J.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2503.22876
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912305188438016
author Srivastava, Kushagra
Kulkarni, Rutwik
Velmurugan, Manoj
Sanket, Nitin J.
author_facet Srivastava, Kushagra
Kulkarni, Rutwik
Velmurugan, Manoj
Sanket, Nitin J.
contents Autonomous aerial robots are becoming commonplace in our lives. Hands-on aerial robotics courses are pivotal in training the next-generation workforce to meet the growing market demands. Such an efficient and compelling course depends on a reliable testbed. In this paper, we present VizFlyt, an open-source perception-centric Hardware-In-The-Loop (HITL) photorealistic testing framework for aerial robotics courses. We utilize pose from an external localization system to hallucinate real-time and photorealistic visual sensors using 3D Gaussian Splatting. This enables stress-free testing of autonomy algorithms on aerial robots without the risk of crashing into obstacles. We achieve over 100Hz of system update rate. Lastly, we build upon our past experiences of offering hands-on aerial robotics courses and propose a new open-source and open-hardware curriculum based on VizFlyt for the future. We test our framework on various course projects in real-world HITL experiments and present the results showing the efficacy of such a system and its large potential use cases. Code, datasets, hardware guides and demo videos are available at https://pear.wpi.edu/research/vizflyt.html
format Preprint
id arxiv_https___arxiv_org_abs_2503_22876
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VizFlyt: Perception-centric Pedagogical Framework For Autonomous Aerial Robots
Srivastava, Kushagra
Kulkarni, Rutwik
Velmurugan, Manoj
Sanket, Nitin J.
Robotics
Computer Vision and Pattern Recognition
Autonomous aerial robots are becoming commonplace in our lives. Hands-on aerial robotics courses are pivotal in training the next-generation workforce to meet the growing market demands. Such an efficient and compelling course depends on a reliable testbed. In this paper, we present VizFlyt, an open-source perception-centric Hardware-In-The-Loop (HITL) photorealistic testing framework for aerial robotics courses. We utilize pose from an external localization system to hallucinate real-time and photorealistic visual sensors using 3D Gaussian Splatting. This enables stress-free testing of autonomy algorithms on aerial robots without the risk of crashing into obstacles. We achieve over 100Hz of system update rate. Lastly, we build upon our past experiences of offering hands-on aerial robotics courses and propose a new open-source and open-hardware curriculum based on VizFlyt for the future. We test our framework on various course projects in real-world HITL experiments and present the results showing the efficacy of such a system and its large potential use cases. Code, datasets, hardware guides and demo videos are available at https://pear.wpi.edu/research/vizflyt.html
title VizFlyt: Perception-centric Pedagogical Framework For Autonomous Aerial Robots
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.22876