Visual Evaluative AI: A Hypothesis-Driven Tool with Concept-Based Explanations and Weight of Evidence

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Le, Thao, Miller, Tim, Zhang, Ruihan, Sonenberg, Liz, Singh, Ronal
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911117650952192
author Le, Thao
Miller, Tim
Zhang, Ruihan
Sonenberg, Liz
Singh, Ronal
author_facet Le, Thao
Miller, Tim
Zhang, Ruihan
Sonenberg, Liz
Singh, Ronal
contents This paper presents Visual Evaluative AI, a decision aid that provides positive and negative evidence from image data for a given hypothesis. This tool finds high-level human concepts in an image and generates the Weight of Evidence (WoE) for each hypothesis in the decision-making process. We apply and evaluate this tool in the skin cancer domain by building a web-based application that allows users to upload a dermatoscopic image, select a hypothesis and analyse their decisions by evaluating the provided evidence. Further, we demonstrate the effectiveness of Visual Evaluative AI on different concept-based explanation approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04710
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Visual Evaluative AI: A Hypothesis-Driven Tool with Concept-Based Explanations and Weight of Evidence
Le, Thao
Miller, Tim
Zhang, Ruihan
Sonenberg, Liz
Singh, Ronal
Computer Vision and Pattern Recognition
Artificial Intelligence
Human-Computer Interaction
This paper presents Visual Evaluative AI, a decision aid that provides positive and negative evidence from image data for a given hypothesis. This tool finds high-level human concepts in an image and generates the Weight of Evidence (WoE) for each hypothesis in the decision-making process. We apply and evaluate this tool in the skin cancer domain by building a web-based application that allows users to upload a dermatoscopic image, select a hypothesis and analyse their decisions by evaluating the provided evidence. Further, we demonstrate the effectiveness of Visual Evaluative AI on different concept-based explanation approaches.
title Visual Evaluative AI: A Hypothesis-Driven Tool with Concept-Based Explanations and Weight of Evidence
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2407.04710