Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ouda, Eman, Salah, Mohammed, Chulkov, Arsenii O., Gargiulo, Gianfranco, Tartaglia, Gian Luca, Sfarra, Stefano, Abdulrahman, Yusra
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914392533106688
author Ouda, Eman
Salah, Mohammed
Chulkov, Arsenii O.
Gargiulo, Gianfranco
Tartaglia, Gian Luca
Sfarra, Stefano
Abdulrahman, Yusra
author_facet Ouda, Eman
Salah, Mohammed
Chulkov, Arsenii O.
Gargiulo, Gianfranco
Tartaglia, Gian Luca
Sfarra, Stefano
Abdulrahman, Yusra
contents Authenticity and condition assessment are central to conservation decision-making, yet interpretation and reporting of thermographic output remain largely bespoke and expert-dependent, complicating comparison across collections and limiting systematic integration into conservation documentation. Pulsed Active Infrared Thermography (AIRT) is sensitive to subsurface features such as material heterogeneity, voids, and past interventions; however, its broader adoption is constrained by artifact misinterpretation, inter-laboratory variability, and the absence of standardized, explainable reporting frameworks. Although multi-modal thermographic processing techniques are established, their integration with structured natural-language interpretation has not been explored in cultural heritage. A fully automated thermography-vision-language model (VLM) framework is presented. It combines multi-modal AIRT analysis with modality-aware textual reporting, without human intervention during inference. Thermal sequences are processed using Principal Component Thermography (PCT), Thermographic Signal Reconstruction (TSR), and Pulsed Phase Thermography (PPT), and the resulting anomaly masks are fused into a consensus segmentation that emphasizes regions supported by multiple thermal indicators while mitigating boundary artifacts. The fused evidence is provided to a VLM, which generates structured reports describing the location of the anomaly, thermal behavior, and plausible physical interpretations while explicitly acknowledging the uncertainty and diagnostic limitations. Evaluation on two marquetries demonstrates consistent anomaly detection and stable structured interpretations, indicating reproducibility and generalizability across samples.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13437
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection
Ouda, Eman
Salah, Mohammed
Chulkov, Arsenii O.
Gargiulo, Gianfranco
Tartaglia, Gian Luca
Sfarra, Stefano
Abdulrahman, Yusra
Computer Vision and Pattern Recognition
Signal Processing
Authenticity and condition assessment are central to conservation decision-making, yet interpretation and reporting of thermographic output remain largely bespoke and expert-dependent, complicating comparison across collections and limiting systematic integration into conservation documentation. Pulsed Active Infrared Thermography (AIRT) is sensitive to subsurface features such as material heterogeneity, voids, and past interventions; however, its broader adoption is constrained by artifact misinterpretation, inter-laboratory variability, and the absence of standardized, explainable reporting frameworks. Although multi-modal thermographic processing techniques are established, their integration with structured natural-language interpretation has not been explored in cultural heritage. A fully automated thermography-vision-language model (VLM) framework is presented. It combines multi-modal AIRT analysis with modality-aware textual reporting, without human intervention during inference. Thermal sequences are processed using Principal Component Thermography (PCT), Thermographic Signal Reconstruction (TSR), and Pulsed Phase Thermography (PPT), and the resulting anomaly masks are fused into a consensus segmentation that emphasizes regions supported by multiple thermal indicators while mitigating boundary artifacts. The fused evidence is provided to a VLM, which generates structured reports describing the location of the anomaly, thermal behavior, and plausible physical interpretations while explicitly acknowledging the uncertainty and diagnostic limitations. Evaluation on two marquetries demonstrates consistent anomaly detection and stable structured interpretations, indicating reproducibility and generalizability across samples.
title Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection
topic Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2603.13437