Dense Road Surface Grip Map Prediction from Multimodal Image Data
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913330838372352 |
|---|---|
| author | Maanpää, Jyri Pesonen, Julius Hyyti, Heikki Melekhov, Iaroslav Kannala, Juho Manninen, Petri Kukko, Antero Hyyppä, Juha |
| author_facet | Maanpää, Jyri Pesonen, Julius Hyyti, Heikki Melekhov, Iaroslav Kannala, Juho Manninen, Petri Kukko, Antero Hyyppä, Juha |
| contents | Slippery road weather conditions are prevalent in many regions and cause a regular risk for traffic. Still, there has been less research on how autonomous vehicles could detect slippery driving conditions on the road to drive safely. In this work, we propose a method to predict a dense grip map from the area in front of the car, based on postprocessed multimodal sensor data. We trained a convolutional neural network to predict pixelwise grip values from fused RGB camera, thermal camera, and LiDAR reflectance images, based on weakly supervised ground truth from an optical road weather sensor.
The experiments show that it is possible to predict dense grip values with good accuracy from the used data modalities as the produced grip map follows both ground truth measurements and local weather conditions, such as snowy areas on the road. The model using only the RGB camera or LiDAR reflectance modality provided good baseline results for grip prediction accuracy while using models fusing the RGB camera, thermal camera, and LiDAR modalities improved the grip predictions significantly. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_17324 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Dense Road Surface Grip Map Prediction from Multimodal Image Data Maanpää, Jyri Pesonen, Julius Hyyti, Heikki Melekhov, Iaroslav Kannala, Juho Manninen, Petri Kukko, Antero Hyyppä, Juha Computer Vision and Pattern Recognition Slippery road weather conditions are prevalent in many regions and cause a regular risk for traffic. Still, there has been less research on how autonomous vehicles could detect slippery driving conditions on the road to drive safely. In this work, we propose a method to predict a dense grip map from the area in front of the car, based on postprocessed multimodal sensor data. We trained a convolutional neural network to predict pixelwise grip values from fused RGB camera, thermal camera, and LiDAR reflectance images, based on weakly supervised ground truth from an optical road weather sensor. The experiments show that it is possible to predict dense grip values with good accuracy from the used data modalities as the produced grip map follows both ground truth measurements and local weather conditions, such as snowy areas on the road. The model using only the RGB camera or LiDAR reflectance modality provided good baseline results for grip prediction accuracy while using models fusing the RGB camera, thermal camera, and LiDAR modalities improved the grip predictions significantly. |
| title | Dense Road Surface Grip Map Prediction from Multimodal Image Data |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.17324 |