Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hu, Hairuo, Cong, Haiyong, Shao, Zhuyu, Bi, Yubo, Liu, Jinghao
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2411.00499
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912147060031488
author Hu, Hairuo
Cong, Haiyong
Shao, Zhuyu
Bi, Yubo
Liu, Jinghao
author_facet Hu, Hairuo
Cong, Haiyong
Shao, Zhuyu
Bi, Yubo
Liu, Jinghao
contents In the context of firefighting and rescue operations, a cross-modal semantic segmentation model based on a single-chip millimeter-wave (mmWave) radar for indoor environmental perception is proposed and discussed. To efficiently obtain high-quality labels, an automatic label generation method utilizing LiDAR point clouds and occupancy grid maps is introduced. The proposed segmentation model is based on U-Net. A spatial attention module is incorporated, which enhanced the performance of the mode. The results demonstrate that cross-modal semantic segmentation provides a more intuitive and accurate representation of indoor environments. Unlike traditional methods, the model's segmentation performance is minimally affected by azimuth. Although performance declines with increasing distance, this can be mitigated by a well-designed model. Additionally, it was found that using raw ADC data as input is ineffective; compared to RA tensors, RD tensors are more suitable for the proposed model.
format Preprint
id arxiv_https___arxiv_org_abs_2411_00499
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Cross-modal semantic segmentation for indoor environmental perception using single-chip millimeter-wave radar raw data
Hu, Hairuo
Cong, Haiyong
Shao, Zhuyu
Bi, Yubo
Liu, Jinghao
Computer Vision and Pattern Recognition
Emerging Technologies
Machine Learning
Signal Processing
In the context of firefighting and rescue operations, a cross-modal semantic segmentation model based on a single-chip millimeter-wave (mmWave) radar for indoor environmental perception is proposed and discussed. To efficiently obtain high-quality labels, an automatic label generation method utilizing LiDAR point clouds and occupancy grid maps is introduced. The proposed segmentation model is based on U-Net. A spatial attention module is incorporated, which enhanced the performance of the mode. The results demonstrate that cross-modal semantic segmentation provides a more intuitive and accurate representation of indoor environments. Unlike traditional methods, the model's segmentation performance is minimally affected by azimuth. Although performance declines with increasing distance, this can be mitigated by a well-designed model. Additionally, it was found that using raw ADC data as input is ineffective; compared to RA tensors, RD tensors are more suitable for the proposed model.
title Cross-modal semantic segmentation for indoor environmental perception using single-chip millimeter-wave radar raw data
topic Computer Vision and Pattern Recognition
Emerging Technologies
Machine Learning
Signal Processing
url https://arxiv.org/abs/2411.00499