Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Manzoor, Anam, Singh, Aryan, Sistu, Ganesh, Mohandas, Reenu, Grua, Eoin, Scanlan, Anthony, Eising, Ciarán
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910626267267072
author Manzoor, Anam
Singh, Aryan
Sistu, Ganesh
Mohandas, Reenu
Grua, Eoin
Scanlan, Anthony
Eising, Ciarán
author_facet Manzoor, Anam
Singh, Aryan
Sistu, Ganesh
Mohandas, Reenu
Grua, Eoin
Scanlan, Anthony
Eising, Ciarán
contents This study investigates the effectiveness of modern Deformable Convolutional Neural Networks (DCNNs) for semantic segmentation tasks, particularly in autonomous driving scenarios with fisheye images. These images, providing a wide field of view, pose unique challenges for extracting spatial and geometric information due to dynamic changes in object attributes. Our experiments focus on segmenting the WoodScape fisheye image dataset into ten distinct classes, assessing the Deformable Networks' ability to capture intricate spatial relationships and improve segmentation accuracy. Additionally, we explore different loss functions to address class imbalance issues and compare the performance of conventional CNN architectures with Deformable Convolution-based CNNs, including Vanilla U-Net and Residual U-Net architectures. The significant improvement in mIoU score resulting from integrating Deformable CNNs demonstrates their effectiveness in handling the geometric distortions present in fisheye imagery, exceeding the performance of traditional CNN architectures. This underscores the significant role of Deformable convolution in enhancing semantic segmentation performance for fisheye imagery.
format Preprint
id arxiv_https___arxiv_org_abs_2407_16647
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving
Manzoor, Anam
Singh, Aryan
Sistu, Ganesh
Mohandas, Reenu
Grua, Eoin
Scanlan, Anthony
Eising, Ciarán
Computer Vision and Pattern Recognition
This study investigates the effectiveness of modern Deformable Convolutional Neural Networks (DCNNs) for semantic segmentation tasks, particularly in autonomous driving scenarios with fisheye images. These images, providing a wide field of view, pose unique challenges for extracting spatial and geometric information due to dynamic changes in object attributes. Our experiments focus on segmenting the WoodScape fisheye image dataset into ten distinct classes, assessing the Deformable Networks' ability to capture intricate spatial relationships and improve segmentation accuracy. Additionally, we explore different loss functions to address class imbalance issues and compare the performance of conventional CNN architectures with Deformable Convolution-based CNNs, including Vanilla U-Net and Residual U-Net architectures. The significant improvement in mIoU score resulting from integrating Deformable CNNs demonstrates their effectiveness in handling the geometric distortions present in fisheye imagery, exceeding the performance of traditional CNN architectures. This underscores the significant role of Deformable convolution in enhancing semantic segmentation performance for fisheye imagery.
title Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.16647