Saved in:
Bibliographic Details
Main Authors: Cani, Jorgen, Mademlis, Ioannis, Chrysochoou, Adamantia Anna Rebolledo, Papadopoulos, Georgios Th.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.19043
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916612548853760
author Cani, Jorgen
Mademlis, Ioannis
Chrysochoou, Adamantia Anna Rebolledo
Papadopoulos, Georgios Th.
author_facet Cani, Jorgen
Mademlis, Ioannis
Chrysochoou, Adamantia Anna Rebolledo
Papadopoulos, Georgios Th.
contents Illicit object detection is a critical task performed at various high-security locations, including airports, train stations, subways, and ports. The continuous and tedious work of examining thousands of X-ray images per hour can be mentally taxing. Thus, Deep Neural Networks (DNNs) can be used to automate the X-ray image analysis process, improve efficiency and alleviate the security officers' inspection burden. The neural architectures typically utilized in relevant literature are Convolutional Neural Networks (CNNs), with Vision Transformers (ViTs) rarely employed. In order to address this gap, this paper conducts a comprehensive evaluation of relevant ViT architectures on illicit item detection in X-ray images. This study utilizes both Transformer and hybrid backbones, such as SWIN and NextViT, and detectors, such as DINO and RT-DETR. The results demonstrate the remarkable accuracy of the DINO Transformer detector in the low-data regime, the impressive real-time performance of YOLOv8, and the effectiveness of the hybrid NextViT backbone.
format Preprint
id arxiv_https___arxiv_org_abs_2403_19043
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Illicit object detection in X-ray images using Vision Transformers
Cani, Jorgen
Mademlis, Ioannis
Chrysochoou, Adamantia Anna Rebolledo
Papadopoulos, Georgios Th.
Computer Vision and Pattern Recognition
Illicit object detection is a critical task performed at various high-security locations, including airports, train stations, subways, and ports. The continuous and tedious work of examining thousands of X-ray images per hour can be mentally taxing. Thus, Deep Neural Networks (DNNs) can be used to automate the X-ray image analysis process, improve efficiency and alleviate the security officers' inspection burden. The neural architectures typically utilized in relevant literature are Convolutional Neural Networks (CNNs), with Vision Transformers (ViTs) rarely employed. In order to address this gap, this paper conducts a comprehensive evaluation of relevant ViT architectures on illicit item detection in X-ray images. This study utilizes both Transformer and hybrid backbones, such as SWIN and NextViT, and detectors, such as DINO and RT-DETR. The results demonstrate the remarkable accuracy of the DINO Transformer detector in the low-data regime, the impressive real-time performance of YOLOv8, and the effectiveness of the hybrid NextViT backbone.
title Illicit object detection in X-ray images using Vision Transformers
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.19043