Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Junzhou, Zhang, Zirui, Yu, Jing, Huang, Heqiang, Zhang, Ronghui, Xu, Xuemiao, Sheng, Bin, Yan, Hong
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2409.05587
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913497906937856
author Chen, Junzhou
Zhang, Zirui
Yu, Jing
Huang, Heqiang
Zhang, Ronghui
Xu, Xuemiao
Sheng, Bin
Yan, Hong
author_facet Chen, Junzhou
Zhang, Zirui
Yu, Jing
Huang, Heqiang
Zhang, Ronghui
Xu, Xuemiao
Sheng, Bin
Yan, Hong
contents Driver distraction remains a leading cause of traffic accidents, posing a critical threat to road safety globally. As intelligent transportation systems evolve, accurate and real-time identification of driver distraction has become essential. However, existing methods struggle to capture both global contextual and fine-grained local features while contending with noisy labels in training datasets. To address these challenges, we propose DSDFormer, a novel framework that integrates the strengths of Transformer and Mamba architectures through a Dual State Domain Attention (DSDA) mechanism, enabling a balance between long-range dependencies and detailed feature extraction for robust driver behavior recognition. Additionally, we introduce Temporal Reasoning Confident Learning (TRCL), an unsupervised approach that refines noisy labels by leveraging spatiotemporal correlations in video sequences. Our model achieves state-of-the-art performance on the AUC-V1, AUC-V2, and 100-Driver datasets and demonstrates real-time processing efficiency on the NVIDIA Jetson AGX Orin platform. Extensive experimental results confirm that DSDFormer and TRCL significantly improve both the accuracy and robustness of driver distraction detection, offering a scalable solution to enhance road safety.
format Preprint
id arxiv_https___arxiv_org_abs_2409_05587
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification
Chen, Junzhou
Zhang, Zirui
Yu, Jing
Huang, Heqiang
Zhang, Ronghui
Xu, Xuemiao
Sheng, Bin
Yan, Hong
Computer Vision and Pattern Recognition
Driver distraction remains a leading cause of traffic accidents, posing a critical threat to road safety globally. As intelligent transportation systems evolve, accurate and real-time identification of driver distraction has become essential. However, existing methods struggle to capture both global contextual and fine-grained local features while contending with noisy labels in training datasets. To address these challenges, we propose DSDFormer, a novel framework that integrates the strengths of Transformer and Mamba architectures through a Dual State Domain Attention (DSDA) mechanism, enabling a balance between long-range dependencies and detailed feature extraction for robust driver behavior recognition. Additionally, we introduce Temporal Reasoning Confident Learning (TRCL), an unsupervised approach that refines noisy labels by leveraging spatiotemporal correlations in video sequences. Our model achieves state-of-the-art performance on the AUC-V1, AUC-V2, and 100-Driver datasets and demonstrates real-time processing efficiency on the NVIDIA Jetson AGX Orin platform. Extensive experimental results confirm that DSDFormer and TRCL significantly improve both the accuracy and robustness of driver distraction detection, offering a scalable solution to enhance road safety.
title DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.05587