HawkDrive: A Transformer-driven Visual Perception System for Autonomous Driving in Night Scene
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916236044009472 |
|---|---|
| author | Guo, Ziang Perminov, Stepan Konenkov, Mikhail Tsetserukou, Dzmitry |
| author_facet | Guo, Ziang Perminov, Stepan Konenkov, Mikhail Tsetserukou, Dzmitry |
| contents | Many established vision perception systems for autonomous driving scenarios ignore the influence of light conditions, one of the key elements for driving safety. To address this problem, we present HawkDrive, a novel perception system with hardware and software solutions. Hardware that utilizes stereo vision perception, which has been demonstrated to be a more reliable way of estimating depth information than monocular vision, is partnered with the edge computing device Nvidia Jetson Xavier AGX. Our software for low light enhancement, depth estimation, and semantic segmentation tasks, is a transformer-based neural network. Our software stack, which enables fast inference and noise reduction, is packaged into system modules in Robot Operating System 2 (ROS2). Our experimental results have shown that the proposed end-to-end system is effective in improving the depth estimation and semantic segmentation performance. Our dataset and codes will be released at https://github.com/ZionGo6/HawkDrive. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_04653 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | HawkDrive: A Transformer-driven Visual Perception System for Autonomous Driving in Night Scene Guo, Ziang Perminov, Stepan Konenkov, Mikhail Tsetserukou, Dzmitry Computer Vision and Pattern Recognition Robotics Many established vision perception systems for autonomous driving scenarios ignore the influence of light conditions, one of the key elements for driving safety. To address this problem, we present HawkDrive, a novel perception system with hardware and software solutions. Hardware that utilizes stereo vision perception, which has been demonstrated to be a more reliable way of estimating depth information than monocular vision, is partnered with the edge computing device Nvidia Jetson Xavier AGX. Our software for low light enhancement, depth estimation, and semantic segmentation tasks, is a transformer-based neural network. Our software stack, which enables fast inference and noise reduction, is packaged into system modules in Robot Operating System 2 (ROS2). Our experimental results have shown that the proposed end-to-end system is effective in improving the depth estimation and semantic segmentation performance. Our dataset and codes will be released at https://github.com/ZionGo6/HawkDrive. |
| title | HawkDrive: A Transformer-driven Visual Perception System for Autonomous Driving in Night Scene |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2404.04653 |