Saved in:
Bibliographic Details
Main Authors: Li, Zeshun, Li, Fuhao, Zhang, Wanting, Zheng, Zijie, Liu, Xueping, Liu, Yongjin, Zeng, Long
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.08096
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909424503750656
author Li, Zeshun
Li, Fuhao
Zhang, Wanting
Zheng, Zijie
Liu, Xueping
Liu, Yongjin
Zeng, Long
author_facet Li, Zeshun
Li, Fuhao
Zhang, Wanting
Zheng, Zijie
Liu, Xueping
Liu, Yongjin
Zeng, Long
contents Most existing mobile robotic datasets primarily capture static scenes, limiting their utility for evaluating robotic performance in dynamic environments. To address this, we present a mobile robot oriented large-scale indoor dataset, denoted as THUD++ (TsingHua University Dynamic) robotic dataset, for dynamic scene understanding. Our current dataset includes 13 large-scale dynamic scenarios, combining both real-world and synthetic data collected with a real robot platform and a physical simulation platform, respectively. The RGB-D dataset comprises over 90K image frames, 20M 2D/3D bounding boxes of static and dynamic objects, camera poses, and IMU. The trajectory dataset covers over 6,000 pedestrian trajectories in indoor scenes. Additionally, the dataset is augmented with a Unity3D-based simulation platform, allowing researchers to create custom scenes and test algorithms in a controlled environment. We evaluate state-of-the-art methods on THUD++ across mainstream indoor scene understanding tasks, e.g., 3D object detection, semantic segmentation, relocalization, pedestrian trajectory prediction, and navigation. Our experiments highlight the challenges mobile robots encounter in indoor environments, especially when navigating in complex, crowded, and dynamic scenes. By sharing this dataset, we aim to accelerate the development and testing of mobile robot algorithms, contributing to real-world robotic applications.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08096
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle THUD++: Large-Scale Dynamic Indoor Scene Dataset and Benchmark for Mobile Robots
Li, Zeshun
Li, Fuhao
Zhang, Wanting
Zheng, Zijie
Liu, Xueping
Liu, Yongjin
Zeng, Long
Robotics
Most existing mobile robotic datasets primarily capture static scenes, limiting their utility for evaluating robotic performance in dynamic environments. To address this, we present a mobile robot oriented large-scale indoor dataset, denoted as THUD++ (TsingHua University Dynamic) robotic dataset, for dynamic scene understanding. Our current dataset includes 13 large-scale dynamic scenarios, combining both real-world and synthetic data collected with a real robot platform and a physical simulation platform, respectively. The RGB-D dataset comprises over 90K image frames, 20M 2D/3D bounding boxes of static and dynamic objects, camera poses, and IMU. The trajectory dataset covers over 6,000 pedestrian trajectories in indoor scenes. Additionally, the dataset is augmented with a Unity3D-based simulation platform, allowing researchers to create custom scenes and test algorithms in a controlled environment. We evaluate state-of-the-art methods on THUD++ across mainstream indoor scene understanding tasks, e.g., 3D object detection, semantic segmentation, relocalization, pedestrian trajectory prediction, and navigation. Our experiments highlight the challenges mobile robots encounter in indoor environments, especially when navigating in complex, crowded, and dynamic scenes. By sharing this dataset, we aim to accelerate the development and testing of mobile robot algorithms, contributing to real-world robotic applications.
title THUD++: Large-Scale Dynamic Indoor Scene Dataset and Benchmark for Mobile Robots
topic Robotics
url https://arxiv.org/abs/2412.08096