Saved in:
Bibliographic Details
Main Authors: Santos, Paulo Henrique dos, Santos, Valéria de Carvalho, Luz, Eduardo José da Silva
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2404.13002
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909175853875200
author Santos, Paulo Henrique dos
Santos, Valéria de Carvalho
Luz, Eduardo José da Silva
author_facet Santos, Paulo Henrique dos
Santos, Valéria de Carvalho
Luz, Eduardo José da Silva
contents In the steel production domain, recycling ferrous scrap is essential for environmental and economic sustainability, as it reduces both energy consumption and greenhouse gas emissions. However, the classification of scrap materials poses a significant challenge, requiring advancements in automation technology. Additionally, building trust among human operators is a major obstacle. Traditional approaches often fail to quantify uncertainty and lack clarity in model decision-making, which complicates acceptance. In this article, we describe how conformal prediction can be employed to quantify uncertainty and add robustness in scrap classification. We have adapted the Split Conformal Prediction technique to seamlessly integrate with state-of-the-art computer vision models, such as the Vision Transformer (ViT), Swin Transformer, and ResNet-50, while also incorporating Explainable Artificial Intelligence (XAI) methods. We evaluate the approach using a comprehensive dataset of 8147 images spanning nine ferrous scrap classes. The application of the Split Conformal Prediction method allowed for the quantification of each model's uncertainties, which enhanced the understanding of predictions and increased the reliability of the results. Specifically, the Swin Transformer model demonstrated more reliable outcomes than the others, as evidenced by its smaller average size of prediction sets and achieving an average classification accuracy exceeding 95%. Furthermore, the Score-CAM method proved highly effective in clarifying visual features, significantly enhancing the explainability of the classification decisions.
format Preprint
id arxiv_https___arxiv_org_abs_2404_13002
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Robust Ferrous Scrap Material Classification with Deep Learning and Conformal Prediction
Santos, Paulo Henrique dos
Santos, Valéria de Carvalho
Luz, Eduardo José da Silva
Computer Vision and Pattern Recognition
Machine Learning
In the steel production domain, recycling ferrous scrap is essential for environmental and economic sustainability, as it reduces both energy consumption and greenhouse gas emissions. However, the classification of scrap materials poses a significant challenge, requiring advancements in automation technology. Additionally, building trust among human operators is a major obstacle. Traditional approaches often fail to quantify uncertainty and lack clarity in model decision-making, which complicates acceptance. In this article, we describe how conformal prediction can be employed to quantify uncertainty and add robustness in scrap classification. We have adapted the Split Conformal Prediction technique to seamlessly integrate with state-of-the-art computer vision models, such as the Vision Transformer (ViT), Swin Transformer, and ResNet-50, while also incorporating Explainable Artificial Intelligence (XAI) methods. We evaluate the approach using a comprehensive dataset of 8147 images spanning nine ferrous scrap classes. The application of the Split Conformal Prediction method allowed for the quantification of each model's uncertainties, which enhanced the understanding of predictions and increased the reliability of the results. Specifically, the Swin Transformer model demonstrated more reliable outcomes than the others, as evidenced by its smaller average size of prediction sets and achieving an average classification accuracy exceeding 95%. Furthermore, the Score-CAM method proved highly effective in clarifying visual features, significantly enhancing the explainability of the classification decisions.
title Towards Robust Ferrous Scrap Material Classification with Deep Learning and Conformal Prediction
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2404.13002