Improving Classification of Occluded Objects through Scene Context

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: King, Courtney M., Leeds, Daniel D., Lyons, Damian, Kalaitzis, George
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909878630481920
author King, Courtney M.
Leeds, Daniel D.
Lyons, Damian
Kalaitzis, George
author_facet King, Courtney M.
Leeds, Daniel D.
Lyons, Damian
Kalaitzis, George
contents The presence of occlusions has provided substantial challenges to typically-powerful object recognition algorithms. Additional sources of information can be extremely valuable to reduce errors caused by occlusions. Scene context is known to aid in object recognition in biological vision. In this work, we attempt to add robustness into existing Region Proposal Network-Deep Convolutional Neural Network (RPN-DCNN) object detection networks through two distinct scene-based information fusion techniques. We present one algorithm under each methodology: the first operates prior to prediction, selecting a custom object network to use based on the identified background scene, and the second operates after detection, fusing scene knowledge into initial object scores output by the RPN. We demonstrate our algorithms on challenging datasets featuring partial occlusions, which show overall improvement in both recall and precision against baseline methods. In addition, our experiments contrast multiple training methodologies for occlusion handling, finding that training on a combination of both occluded and unoccluded images demonstrates an improvement over the others. Our method is interpretable and can easily be adapted to other datasets, offering many future directions for research and practical applications.
format Preprint
id arxiv_https___arxiv_org_abs_2510_26681
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving Classification of Occluded Objects through Scene Context
King, Courtney M.
Leeds, Daniel D.
Lyons, Damian
Kalaitzis, George
Computer Vision and Pattern Recognition
The presence of occlusions has provided substantial challenges to typically-powerful object recognition algorithms. Additional sources of information can be extremely valuable to reduce errors caused by occlusions. Scene context is known to aid in object recognition in biological vision. In this work, we attempt to add robustness into existing Region Proposal Network-Deep Convolutional Neural Network (RPN-DCNN) object detection networks through two distinct scene-based information fusion techniques. We present one algorithm under each methodology: the first operates prior to prediction, selecting a custom object network to use based on the identified background scene, and the second operates after detection, fusing scene knowledge into initial object scores output by the RPN. We demonstrate our algorithms on challenging datasets featuring partial occlusions, which show overall improvement in both recall and precision against baseline methods. In addition, our experiments contrast multiple training methodologies for occlusion handling, finding that training on a combination of both occluded and unoccluded images demonstrates an improvement over the others. Our method is interpretable and can easily be adapted to other datasets, offering many future directions for research and practical applications.
title Improving Classification of Occluded Objects through Scene Context
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.26681