Learning Recourse Costs from Pairwise Feature Comparisons

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rawal, Kaivalya, Lakkaraju, Himabindu
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909321962455040
author Rawal, Kaivalya
Lakkaraju, Himabindu
author_facet Rawal, Kaivalya
Lakkaraju, Himabindu
contents This paper presents a novel technique for incorporating user input when learning and inferring user preferences. When trying to provide users of black-box machine learning models with actionable recourse, we often wish to incorporate their personal preferences about the ease of modifying each individual feature. These recourse finding algorithms usually require an exhaustive set of tuples associating each feature to its cost of modification. Since it is hard to obtain such costs by directly surveying humans, in this paper, we propose the use of the Bradley-Terry model to automatically infer feature-wise costs using non-exhaustive human comparison surveys. We propose that users only provide inputs comparing entire recourses, with all candidate feature modifications, determining which recourses are easier to implement relative to others, without explicit quantification of their costs. We demonstrate the efficient learning of individual feature costs using MAP estimates, and show that these non-exhaustive human surveys, which do not necessarily contain data for each feature pair comparison, are sufficient to learn an exhaustive set of feature costs, where each feature is associated with a modification cost.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13940
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Recourse Costs from Pairwise Feature Comparisons
Rawal, Kaivalya
Lakkaraju, Himabindu
Machine Learning
Artificial Intelligence
Computers and Society
This paper presents a novel technique for incorporating user input when learning and inferring user preferences. When trying to provide users of black-box machine learning models with actionable recourse, we often wish to incorporate their personal preferences about the ease of modifying each individual feature. These recourse finding algorithms usually require an exhaustive set of tuples associating each feature to its cost of modification. Since it is hard to obtain such costs by directly surveying humans, in this paper, we propose the use of the Bradley-Terry model to automatically infer feature-wise costs using non-exhaustive human comparison surveys. We propose that users only provide inputs comparing entire recourses, with all candidate feature modifications, determining which recourses are easier to implement relative to others, without explicit quantification of their costs. We demonstrate the efficient learning of individual feature costs using MAP estimates, and show that these non-exhaustive human surveys, which do not necessarily contain data for each feature pair comparison, are sufficient to learn an exhaustive set of feature costs, where each feature is associated with a modification cost.
title Learning Recourse Costs from Pairwise Feature Comparisons
topic Machine Learning
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2409.13940