Exploring Video-Based Driver Activity Recognition under Noisy Labels
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908483267330048 |
|---|---|
| author | Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer |
| author_facet | Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer |
| contents | As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://github.com/ilonafan/DAR-noisy-labels. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_11966 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exploring Video-Based Driver Activity Recognition under Noisy Labels Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer Computer Vision and Pattern Recognition Machine Learning Robotics Image and Video Processing As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://github.com/ilonafan/DAR-noisy-labels. |
| title | Exploring Video-Based Driver Activity Recognition under Noisy Labels |
| topic | Computer Vision and Pattern Recognition Machine Learning Robotics Image and Video Processing |
| url | https://arxiv.org/abs/2504.11966 |