CNN+ViT+SigLiP: A Real-Time Framework for Smart Urban Mobility

Fuente: Zenodo
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Chowdhury, Koushik
Format: Recurso digital
Veröffentlicht: Zenodo 2025
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866901862560563200
author Chowdhury, Koushik
author_facet Chowdhury, Koushik
contents <p>Smart city technology development demands new approaches for improving road safety by detecting the various causes of driver distraction which leads to accidents. The research presents a deep learning combination that unites Convolutional Neural Networks (CNN), Vision Transformer (ViT), and SigLIP (Sigmoid Labeled Image Processor) for handling this issue. The three components including CNN (ResNet18) for spatial feature extraction and ViT for contextual relationship processing and SigLIP for feature representation produce an accurate behavior classification framework. The State Farm Distracted Driver Detection dataset\cite{b11} was used and the hybrid model accomplishes 97.35\% validation accuracy through its 25th training epoch which surpasses conventional single-method approaches. ViT reaches high success rates through its ability to perform multi-modal feature fusion and backbone-freezing techniques alongside dropout regularization for overfitting prevention. The paper proposes a prototype for smart city integration architecture which also includes algorithmic innovations for practical implementation. The system distributes processing tasks across edge devices which perform camera feeds analysis while the cloud system collects excessive information for complex analysis and alerts traffic officials about identified distractions through automation. The proposed architecture enables system resilience and compatibility with current smart city infrastructure. The project integrates current computer vision innovations with IoT deployment realities to show that artificial intelligence solutions boost traffic safety and accident reduction and enable real-time traffic control.</p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_15604536
institution Zenodo
language
publishDate 2025
publisher Zenodo
record_format zenodo
spellingShingle CNN+ViT+SigLiP: A Real-Time Framework for Smart Urban Mobility
Chowdhury, Koushik
<p>Smart city technology development demands new approaches for improving road safety by detecting the various causes of driver distraction which leads to accidents. The research presents a deep learning combination that unites Convolutional Neural Networks (CNN), Vision Transformer (ViT), and SigLIP (Sigmoid Labeled Image Processor) for handling this issue. The three components including CNN (ResNet18) for spatial feature extraction and ViT for contextual relationship processing and SigLIP for feature representation produce an accurate behavior classification framework. The State Farm Distracted Driver Detection dataset\cite{b11} was used and the hybrid model accomplishes 97.35\% validation accuracy through its 25th training epoch which surpasses conventional single-method approaches. ViT reaches high success rates through its ability to perform multi-modal feature fusion and backbone-freezing techniques alongside dropout regularization for overfitting prevention. The paper proposes a prototype for smart city integration architecture which also includes algorithmic innovations for practical implementation. The system distributes processing tasks across edge devices which perform camera feeds analysis while the cloud system collects excessive information for complex analysis and alerts traffic officials about identified distractions through automation. The proposed architecture enables system resilience and compatibility with current smart city infrastructure. The project integrates current computer vision innovations with IoT deployment realities to show that artificial intelligence solutions boost traffic safety and accident reduction and enable real-time traffic control.</p>
title CNN+ViT+SigLiP: A Real-Time Framework for Smart Urban Mobility
url https://doi.org/10.5281/zenodo.15604536