Timealign: A multi-modal object detection method for time misalignment fusing in autonomous driving
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913610701209600 |
|---|---|
| author | Song, Zhihang Peng, Lihui Hu, Jianming Yao, Danya Zhang, Yi |
| author_facet | Song, Zhihang Peng, Lihui Hu, Jianming Yao, Danya Zhang, Yi |
| contents | The multi-modal perception methods are thriving in the autonomous driving field due to their better usage of complementary data from different sensors. Such methods depend on calibration and synchronization between sensors to get accurate environmental information. There have already been studies about space-alignment robustness in autonomous driving object detection process, however, the research for time-alignment is relatively few. As in reality experiments, LiDAR point clouds are more challenging for real-time data transfer, our study used historical frames of LiDAR to better align features when the LiDAR data lags exist. We designed a Timealign module to predict and combine LiDAR features with observation to tackle such time misalignment based on SOTA GraphBEV framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_10033 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Timealign: A multi-modal object detection method for time misalignment fusing in autonomous driving Song, Zhihang Peng, Lihui Hu, Jianming Yao, Danya Zhang, Yi Computer Vision and Pattern Recognition The multi-modal perception methods are thriving in the autonomous driving field due to their better usage of complementary data from different sensors. Such methods depend on calibration and synchronization between sensors to get accurate environmental information. There have already been studies about space-alignment robustness in autonomous driving object detection process, however, the research for time-alignment is relatively few. As in reality experiments, LiDAR point clouds are more challenging for real-time data transfer, our study used historical frames of LiDAR to better align features when the LiDAR data lags exist. We designed a Timealign module to predict and combine LiDAR features with observation to tackle such time misalignment based on SOTA GraphBEV framework. |
| title | Timealign: A multi-modal object detection method for time misalignment fusing in autonomous driving |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.10033 |