From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Forest, Florent, Porta, Hugo, Tuia, Devis, Fink, Olga
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909221392482304
author Forest, Florent
Porta, Hugo
Tuia, Devis
Fink, Olga
author_facet Forest, Florent
Porta, Hugo
Tuia, Devis
Fink, Olga
contents Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically require large annotated datasets for supervised training. Once a crack is detected, monitoring its severity often demands precise segmentation of the damage. However, pixel-level annotation of images for segmentation is labor-intensive. To mitigate this cost, one can leverage explainable artificial intelligence (XAI) to derive segmentations from the explanations of a classifier, requiring only weak image-level supervision. This paper proposes applying this methodology to segment and monitor surface cracks. We evaluate the performance of various XAI methods and examine how this approach facilitates severity quantification and growth monitoring. Results reveal that while the resulting segmentation masks may exhibit lower quality than those produced by supervised methods, they remain meaningful and enable severity monitoring, thus reducing substantial labeling costs.
format Preprint
id arxiv_https___arxiv_org_abs_2309_11267
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring
Forest, Florent
Porta, Hugo
Tuia, Devis
Fink, Olga
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically require large annotated datasets for supervised training. Once a crack is detected, monitoring its severity often demands precise segmentation of the damage. However, pixel-level annotation of images for segmentation is labor-intensive. To mitigate this cost, one can leverage explainable artificial intelligence (XAI) to derive segmentations from the explanations of a classifier, requiring only weak image-level supervision. This paper proposes applying this methodology to segment and monitor surface cracks. We evaluate the performance of various XAI methods and examine how this approach facilitates severity quantification and growth monitoring. Results reveal that while the resulting segmentation masks may exhibit lower quality than those produced by supervised methods, they remain meaningful and enable severity monitoring, thus reducing substantial labeling costs.
title From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2309.11267