Depth Completion in Unseen Field Robotics Environments Using Extremely Sparse Depth Measurements

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Job, Marco, Stastny, Thomas, Kelasidi, Eleni, Siegwart, Roland, Pantic, Michael
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910238169366528
author Job, Marco
Stastny, Thomas
Kelasidi, Eleni
Siegwart, Roland
Pantic, Michael
author_facet Job, Marco
Stastny, Thomas
Kelasidi, Eleni
Siegwart, Roland
Pantic, Michael
contents Autonomous field robots operating in unstructured environments require robust perception to ensure safe and reliable operations. Recent advances in monocular depth estimation have demonstrated the potential of low-cost cameras as depth sensors; however, their adoption in field robotics remains limited due to the absence of reliable scale cues, ambiguous or low-texture conditions, and the scarcity of large-scale datasets. To address these challenges, we propose a depth completion model that trains on synthetic data and uses extremely sparse measurements from depth sensors to predict dense metric depth in unseen field robotics environments. A synthetic dataset generation pipeline tailored to field robotics enables the creation of multiple realistic datasets for training purposes. This dataset generation approach utilizes textured 3D meshes from Structure from Motion and photorealistic rendering with novel viewpoint synthesis to simulate diverse field robotics scenarios. Our approach achieves an end-to-end latency of 53 ms per frame on a Nvidia Jetson AGX Orin, enabling real-time deployment on embedded platforms. Extensive evaluation demonstrates competitive performance across diverse real-world field robotics scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2602_03209
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Depth Completion in Unseen Field Robotics Environments Using Extremely Sparse Depth Measurements
Job, Marco
Stastny, Thomas
Kelasidi, Eleni
Siegwart, Roland
Pantic, Michael
Robotics
Autonomous field robots operating in unstructured environments require robust perception to ensure safe and reliable operations. Recent advances in monocular depth estimation have demonstrated the potential of low-cost cameras as depth sensors; however, their adoption in field robotics remains limited due to the absence of reliable scale cues, ambiguous or low-texture conditions, and the scarcity of large-scale datasets. To address these challenges, we propose a depth completion model that trains on synthetic data and uses extremely sparse measurements from depth sensors to predict dense metric depth in unseen field robotics environments. A synthetic dataset generation pipeline tailored to field robotics enables the creation of multiple realistic datasets for training purposes. This dataset generation approach utilizes textured 3D meshes from Structure from Motion and photorealistic rendering with novel viewpoint synthesis to simulate diverse field robotics scenarios. Our approach achieves an end-to-end latency of 53 ms per frame on a Nvidia Jetson AGX Orin, enabling real-time deployment on embedded platforms. Extensive evaluation demonstrates competitive performance across diverse real-world field robotics scenarios.
title Depth Completion in Unseen Field Robotics Environments Using Extremely Sparse Depth Measurements
topic Robotics
url https://arxiv.org/abs/2602.03209