Temporally Consistent Unsupervised Segmentation for Mobile Robot Perception

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ellis, Christian, Wigness, Maggie, Lennon, Craig, Fiondella, Lance
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913965299204096
author Ellis, Christian
Wigness, Maggie
Lennon, Craig
Fiondella, Lance
author_facet Ellis, Christian
Wigness, Maggie
Lennon, Craig
Fiondella, Lance
contents Rapid progress in terrain-aware autonomous ground navigation has been driven by advances in supervised semantic segmentation. However, these methods rely on costly data collection and labor-intensive ground truth labeling to train deep models. Furthermore, autonomous systems are increasingly deployed in unrehearsed, unstructured environments where no labeled data exists and semantic categories may be ambiguous or domain-specific. Recent zero-shot approaches to unsupervised segmentation have shown promise in such settings but typically operate on individual frames, lacking temporal consistency-a critical property for robust perception in unstructured environments. To address this gap we introduce Frontier-Seg, a method for temporally consistent unsupervised segmentation of terrain from mobile robot video streams. Frontier-Seg clusters superpixel-level features extracted from foundation model backbones-specifically DINOv2-and enforces temporal consistency across frames to identify persistent terrain boundaries or frontiers without human supervision. We evaluate Frontier-Seg on a diverse set of benchmark datasets-including RUGD and RELLIS-3D-demonstrating its ability to perform unsupervised segmentation across unstructured off-road environments.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22194
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Temporally Consistent Unsupervised Segmentation for Mobile Robot Perception
Ellis, Christian
Wigness, Maggie
Lennon, Craig
Fiondella, Lance
Computer Vision and Pattern Recognition
Robotics
Rapid progress in terrain-aware autonomous ground navigation has been driven by advances in supervised semantic segmentation. However, these methods rely on costly data collection and labor-intensive ground truth labeling to train deep models. Furthermore, autonomous systems are increasingly deployed in unrehearsed, unstructured environments where no labeled data exists and semantic categories may be ambiguous or domain-specific. Recent zero-shot approaches to unsupervised segmentation have shown promise in such settings but typically operate on individual frames, lacking temporal consistency-a critical property for robust perception in unstructured environments. To address this gap we introduce Frontier-Seg, a method for temporally consistent unsupervised segmentation of terrain from mobile robot video streams. Frontier-Seg clusters superpixel-level features extracted from foundation model backbones-specifically DINOv2-and enforces temporal consistency across frames to identify persistent terrain boundaries or frontiers without human supervision. We evaluate Frontier-Seg on a diverse set of benchmark datasets-including RUGD and RELLIS-3D-demonstrating its ability to perform unsupervised segmentation across unstructured off-road environments.
title Temporally Consistent Unsupervised Segmentation for Mobile Robot Perception
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2507.22194