A Sim2Real Approach for Identifying Task-Relevant Properties in Interpretable Machine Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910610840616960 |
|---|---|
| author | Nofshin, Eura Brown, Esther Lim, Brian Pan, Weiwei Doshi-Velez, Finale |
| author_facet | Nofshin, Eura Brown, Esther Lim, Brian Pan, Weiwei Doshi-Velez, Finale |
| contents | Explanations of an AI's function can assist human decision-makers, but the most useful explanation depends on the decision's context, referred to as the downstream task. User studies are necessary to determine the best explanations for each task. Unfortunately, testing every explanation and task combination is impractical, especially considering the many factors influencing human+AI collaboration beyond the explanation's content. This work leverages two insights to streamline finding the most effective explanation. First, explanations can be characterized by properties, such as faithfulness or complexity, which indicate if they contain the right information for the task. Second, we introduce XAIsim2real, a pipeline for running synthetic user studies. In our validation study, XAIsim2real accurately predicts user preferences across three tasks, making it a valuable tool for refining explanation choices before full studies. Additionally, it uncovers nuanced relationships, like how cognitive budget limits a user's engagement with complex explanations -- a trend confirmed with real users. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_00116 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Sim2Real Approach for Identifying Task-Relevant Properties in Interpretable Machine Learning Nofshin, Eura Brown, Esther Lim, Brian Pan, Weiwei Doshi-Velez, Finale Human-Computer Interaction Machine Learning Explanations of an AI's function can assist human decision-makers, but the most useful explanation depends on the decision's context, referred to as the downstream task. User studies are necessary to determine the best explanations for each task. Unfortunately, testing every explanation and task combination is impractical, especially considering the many factors influencing human+AI collaboration beyond the explanation's content. This work leverages two insights to streamline finding the most effective explanation. First, explanations can be characterized by properties, such as faithfulness or complexity, which indicate if they contain the right information for the task. Second, we introduce XAIsim2real, a pipeline for running synthetic user studies. In our validation study, XAIsim2real accurately predicts user preferences across three tasks, making it a valuable tool for refining explanation choices before full studies. Additionally, it uncovers nuanced relationships, like how cognitive budget limits a user's engagement with complex explanations -- a trend confirmed with real users. |
| title | A Sim2Real Approach for Identifying Task-Relevant Properties in Interpretable Machine Learning |
| topic | Human-Computer Interaction Machine Learning |
| url | https://arxiv.org/abs/2406.00116 |