Identity documents recognition and detection using semantic segmentation with convolutional neural network

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kozlenko, Mykola, Sendetskyi, Volodymyr, Simkiv, Oleksiy, Savchenko, Nazar, Bosyi, Andy
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916639417565184
author Kozlenko, Mykola
Sendetskyi, Volodymyr
Simkiv, Oleksiy
Savchenko, Nazar
Bosyi, Andy
author_facet Kozlenko, Mykola
Sendetskyi, Volodymyr
Simkiv, Oleksiy
Savchenko, Nazar
Bosyi, Andy
contents Object recognition and detection are well-studied problems with a developed set of almost standard solutions. Identity documents recognition, classification, detection, and localization are the tasks required in a number of applications, particularly, in physical access control security systems at critical infrastructure premises. In this paper, we propose the new original architecture of a model based on an artificial convolutional neural network and semantic segmentation approach for the recognition and detection of identity documents in images. The challenge with the processing of such images is the limited computational performance and the limited amount of memory when such an application is running on industrial oneboard microcomputer hardware. The aim of this research is to prove the feasibility of the proposed technique and to obtain quality metrics. The methodology of the research is to evaluate the deep learning detection model trained on the mobile identity document video dataset. The dataset contains five hundred video clips for fifty different identity document types. The numerical results from simulations are used to evaluate the quality metrics. We present the results as accuracy versus threshold of the intersection over union value. The paper reports an accuracy above 0.75 for the intersection over union (IoU) threshold value of 0.8. Besides, we assessed the size of the model and proved the feasibility of running the model on an industrial one-board microcomputer or smartphone hardware.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01085
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Identity documents recognition and detection using semantic segmentation with convolutional neural network
Kozlenko, Mykola
Sendetskyi, Volodymyr
Simkiv, Oleksiy
Savchenko, Nazar
Bosyi, Andy
Computer Vision and Pattern Recognition
Machine Learning
68T45
I.4.6
Object recognition and detection are well-studied problems with a developed set of almost standard solutions. Identity documents recognition, classification, detection, and localization are the tasks required in a number of applications, particularly, in physical access control security systems at critical infrastructure premises. In this paper, we propose the new original architecture of a model based on an artificial convolutional neural network and semantic segmentation approach for the recognition and detection of identity documents in images. The challenge with the processing of such images is the limited computational performance and the limited amount of memory when such an application is running on industrial oneboard microcomputer hardware. The aim of this research is to prove the feasibility of the proposed technique and to obtain quality metrics. The methodology of the research is to evaluate the deep learning detection model trained on the mobile identity document video dataset. The dataset contains five hundred video clips for fifty different identity document types. The numerical results from simulations are used to evaluate the quality metrics. We present the results as accuracy versus threshold of the intersection over union value. The paper reports an accuracy above 0.75 for the intersection over union (IoU) threshold value of 0.8. Besides, we assessed the size of the model and proved the feasibility of running the model on an industrial one-board microcomputer or smartphone hardware.
title Identity documents recognition and detection using semantic segmentation with convolutional neural network
topic Computer Vision and Pattern Recognition
Machine Learning
68T45
I.4.6
url https://arxiv.org/abs/2503.01085