Feature Responsiveness Scores: Model-Agnostic Explanations for Recourse

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cheon, Harry, Wernerfelt, Anneke, Friedler, Sorelle A., Ustun, Berk
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908735703613440
author Cheon, Harry
Wernerfelt, Anneke
Friedler, Sorelle A.
Ustun, Berk
author_facet Cheon, Harry
Wernerfelt, Anneke
Friedler, Sorelle A.
Ustun, Berk
contents Consumer protection rules require companies that deploy models to automate decisions in high-stakes settings to explain predictions to decision subjects. These rules are motivated, in part, by the belief that explanations can promote recourse by revealing information that decision subjects can use to contest or overturn their predictions. In practice, companies provide individuals with a list of principal reasons based on feature importance derived from methods like SHAP and LIME. In this work, we show how common practices can fail to provide recourse and propose to highlight features based on their responsiveness -- the probability that a decision subject can attain a target prediction through an arbitrary intervention on the feature. We develop efficient methods to compute responsiveness scores for any model and actionability constraints. We show that standard practices in lending can undermine decision subjects by highlighting unresponsive features and explaining predictions that are fixed.
format Preprint
id arxiv_https___arxiv_org_abs_2410_22598
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Feature Responsiveness Scores: Model-Agnostic Explanations for Recourse
Cheon, Harry
Wernerfelt, Anneke
Friedler, Sorelle A.
Ustun, Berk
Machine Learning
Consumer protection rules require companies that deploy models to automate decisions in high-stakes settings to explain predictions to decision subjects. These rules are motivated, in part, by the belief that explanations can promote recourse by revealing information that decision subjects can use to contest or overturn their predictions. In practice, companies provide individuals with a list of principal reasons based on feature importance derived from methods like SHAP and LIME. In this work, we show how common practices can fail to provide recourse and propose to highlight features based on their responsiveness -- the probability that a decision subject can attain a target prediction through an arbitrary intervention on the feature. We develop efficient methods to compute responsiveness scores for any model and actionability constraints. We show that standard practices in lending can undermine decision subjects by highlighting unresponsive features and explaining predictions that are fixed.
title Feature Responsiveness Scores: Model-Agnostic Explanations for Recourse
topic Machine Learning
url https://arxiv.org/abs/2410.22598