A Survey on Interpretability in Visual Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wan, Qiyang, Gao, Chengzhi, Wang, Ruiping, Chen, Xilin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912959664488448
author Wan, Qiyang
Gao, Chengzhi
Wang, Ruiping
Chen, Xilin
author_facet Wan, Qiyang
Gao, Chengzhi
Wang, Ruiping
Chen, Xilin
contents Visual recognition models have achieved unprecedented success in various tasks. While researchers aim to understand the underlying mechanisms of these models, the growing demand for deployment in safety-critical areas like autonomous driving and medical diagnostics has accelerated the development of eXplainable AI (XAI). Distinct from generic XAI, visual recognition XAI is positioned at the intersection of vision and language, which represent the two most fundamental human modalities and form the cornerstones of multimodal intelligence. This paper provides a systematic survey of XAI in visual recognition by establishing a multi-dimensional taxonomy from a human-centered perspective based on intent, object, presentation, and methodology. Beyond categorization, we summarize critical evaluation desiderata and metrics, conducting an extensive qualitative assessment across different categories and demonstrating quantitative benchmarks within specific dimensions. Furthermore, we explore the interpretability of Multimodal Large Language Models and practical applications, identifying emerging trends and opportunities. By synthesizing these diverse perspectives, this survey provides an insightful roadmap to inspire future research on the interpretability of visual recognition models.
format Preprint
id arxiv_https___arxiv_org_abs_2507_11099
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey on Interpretability in Visual Recognition
Wan, Qiyang
Gao, Chengzhi
Wang, Ruiping
Chen, Xilin
Computer Vision and Pattern Recognition
Visual recognition models have achieved unprecedented success in various tasks. While researchers aim to understand the underlying mechanisms of these models, the growing demand for deployment in safety-critical areas like autonomous driving and medical diagnostics has accelerated the development of eXplainable AI (XAI). Distinct from generic XAI, visual recognition XAI is positioned at the intersection of vision and language, which represent the two most fundamental human modalities and form the cornerstones of multimodal intelligence. This paper provides a systematic survey of XAI in visual recognition by establishing a multi-dimensional taxonomy from a human-centered perspective based on intent, object, presentation, and methodology. Beyond categorization, we summarize critical evaluation desiderata and metrics, conducting an extensive qualitative assessment across different categories and demonstrating quantitative benchmarks within specific dimensions. Furthermore, we explore the interpretability of Multimodal Large Language Models and practical applications, identifying emerging trends and opportunities. By synthesizing these diverse perspectives, this survey provides an insightful roadmap to inspire future research on the interpretability of visual recognition models.
title A Survey on Interpretability in Visual Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.11099