Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2510.11907 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909843679346688 |
|---|---|
| author | Kyem, Blessing Agyei Owor, Neema Jakisa Danyo, Andrews Asamoah, Joshua Kofi Denteh, Eugene Muturi, Tanner Dontoh, Anthony Adu-Gyamfi, Yaw Aboah, Armstrong |
| author_facet | Kyem, Blessing Agyei Owor, Neema Jakisa Danyo, Andrews Asamoah, Joshua Kofi Denteh, Eugene Muturi, Tanner Dontoh, Anthony Adu-Gyamfi, Yaw Aboah, Armstrong |
| contents | Traffic safety analysis requires complex video understanding to capture fine-grained behavioral patterns and generate comprehensive descriptions for accident prevention. In this work, we present a unique dual-model framework that strategically utilizes the complementary strengths of VideoLLaMA and Qwen2.5-VL through task-specific optimization to address this issue. The core insight behind our approach is that separating training for captioning and visual question answering (VQA) tasks minimizes task interference and allows each model to specialize more effectively. Experimental results demonstrate that VideoLLaMA is particularly effective in temporal reasoning, achieving a CIDEr score of 1.1001, while Qwen2.5-VL excels in visual understanding with a VQA accuracy of 60.80\%. Through extensive experiments on the WTS dataset, our method achieves an S2 score of 45.7572 in the 2025 AI City Challenge Track 2, placing 10th on the challenge leaderboard. Ablation studies validate that our separate training strategy outperforms joint training by 8.6\% in VQA accuracy while maintaining captioning quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_11907 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Task-Specific Dual-Model Framework for Comprehensive Traffic Safety Video Description and Analysis Kyem, Blessing Agyei Owor, Neema Jakisa Danyo, Andrews Asamoah, Joshua Kofi Denteh, Eugene Muturi, Tanner Dontoh, Anthony Adu-Gyamfi, Yaw Aboah, Armstrong Computer Vision and Pattern Recognition Traffic safety analysis requires complex video understanding to capture fine-grained behavioral patterns and generate comprehensive descriptions for accident prevention. In this work, we present a unique dual-model framework that strategically utilizes the complementary strengths of VideoLLaMA and Qwen2.5-VL through task-specific optimization to address this issue. The core insight behind our approach is that separating training for captioning and visual question answering (VQA) tasks minimizes task interference and allows each model to specialize more effectively. Experimental results demonstrate that VideoLLaMA is particularly effective in temporal reasoning, achieving a CIDEr score of 1.1001, while Qwen2.5-VL excels in visual understanding with a VQA accuracy of 60.80\%. Through extensive experiments on the WTS dataset, our method achieves an S2 score of 45.7572 in the 2025 AI City Challenge Track 2, placing 10th on the challenge leaderboard. Ablation studies validate that our separate training strategy outperforms joint training by 8.6\% in VQA accuracy while maintaining captioning quality. |
| title | Task-Specific Dual-Model Framework for Comprehensive Traffic Safety Video Description and Analysis |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.11907 |