Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916169575825408 |
|---|---|
| author | Wang, Kewei Wu, Yizheng Cen, Jun Pan, Zhiyu Li, Xingyi Wang, Zhe Cao, Zhiguo Lin, Guosheng |
| author_facet | Wang, Kewei Wu, Yizheng Cen, Jun Pan, Zhiyu Li, Xingyi Wang, Zhe Cao, Zhiguo Lin, Guosheng |
| contents | The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming. Therefore, several annotation-efficient methods have been proposed to address this challenge. Although effective, these methods rely on weak annotations or additional multi-modal data like images, and the potential benefits inherent in the point cloud sequence are still underexplored. To this end, we explore the feasibility of self-supervised motion prediction with only unlabeled LiDAR point clouds. Initially, we employ an optimal transport solver to establish coarse correspondences between current and future point clouds as the coarse pseudo motion labels. Training models directly using such coarse labels leads to noticeable spatial and temporal prediction inconsistencies. To mitigate these issues, we introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively. Experimental results demonstrate the significant superiority of our approach over the state-of-the-art self-supervised methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_13261 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations Wang, Kewei Wu, Yizheng Cen, Jun Pan, Zhiyu Li, Xingyi Wang, Zhe Cao, Zhiguo Lin, Guosheng Computer Vision and Pattern Recognition The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming. Therefore, several annotation-efficient methods have been proposed to address this challenge. Although effective, these methods rely on weak annotations or additional multi-modal data like images, and the potential benefits inherent in the point cloud sequence are still underexplored. To this end, we explore the feasibility of self-supervised motion prediction with only unlabeled LiDAR point clouds. Initially, we employ an optimal transport solver to establish coarse correspondences between current and future point clouds as the coarse pseudo motion labels. Training models directly using such coarse labels leads to noticeable spatial and temporal prediction inconsistencies. To mitigate these issues, we introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively. Experimental results demonstrate the significant superiority of our approach over the state-of-the-art self-supervised methods. |
| title | Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.13261 |