Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bassan, Shahaf, Eliav, Ron, Gur, Shlomit
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910853403508736
author Bassan, Shahaf
Eliav, Ron
Gur, Shlomit
author_facet Bassan, Shahaf
Eliav, Ron
Gur, Shlomit
contents *Minimal sufficient reasons* represent a prevalent form of explanation - the smallest subset of input features which, when held constant at their corresponding values, ensure that the prediction remains unchanged. Previous *post-hoc* methods attempt to obtain such explanations but face two main limitations: (1) Obtaining these subsets poses a computational challenge, leading most scalable methods to converge towards suboptimal, less meaningful subsets; (2) These methods heavily rely on sampling out-of-distribution input assignments, potentially resulting in counterintuitive behaviors. To tackle these limitations, we propose in this work a self-supervised training approach, which we term *sufficient subset training* (SST). Using SST, we train models to generate concise sufficient reasons for their predictions as an integral part of their output. Our results indicate that our framework produces succinct and faithful subsets substantially more efficiently than competing post-hoc methods, while maintaining comparable predictive performance.
format Preprint
id arxiv_https___arxiv_org_abs_2502_03391
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons
Bassan, Shahaf
Eliav, Ron
Gur, Shlomit
Machine Learning
Logic in Computer Science
*Minimal sufficient reasons* represent a prevalent form of explanation - the smallest subset of input features which, when held constant at their corresponding values, ensure that the prediction remains unchanged. Previous *post-hoc* methods attempt to obtain such explanations but face two main limitations: (1) Obtaining these subsets poses a computational challenge, leading most scalable methods to converge towards suboptimal, less meaningful subsets; (2) These methods heavily rely on sampling out-of-distribution input assignments, potentially resulting in counterintuitive behaviors. To tackle these limitations, we propose in this work a self-supervised training approach, which we term *sufficient subset training* (SST). Using SST, we train models to generate concise sufficient reasons for their predictions as an integral part of their output. Our results indicate that our framework produces succinct and faithful subsets substantially more efficiently than competing post-hoc methods, while maintaining comparable predictive performance.
title Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons
topic Machine Learning
Logic in Computer Science
url https://arxiv.org/abs/2502.03391