From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2022
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914881786085376 |
|---|---|
| author | Nguyen, Van Bach Schlötterer, Jörg Seifert, Christin |
| author_facet | Nguyen, Van Bach Schlötterer, Jörg Seifert, Christin |
| contents | The goal of Explainable AI (XAI) is to design methods to provide insights into the reasoning process of black-box models, such as deep neural networks, in order to explain them to humans. Social science research states that such explanations should be conversational, similar to human-to-human explanations. In this work, we show how to incorporate XAI in a conversational agent, using a standard design for the agent comprising natural language understanding and generation components. We build upon an XAI question bank, which we extend by quality-controlled paraphrases, to understand the user's information needs. We further systematically survey the literature for suitable explanation methods that provide the information to answer those questions, and present a comprehensive list of suggestions. Our work is the first step towards truly natural conversations about machine learning models with an explanation agent. The comprehensive list of XAI questions and the corresponding explanation methods may support other researchers in providing the necessary information to address users' demands. To facilitate future work, we release our source code and data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2209_02552 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent Nguyen, Van Bach Schlötterer, Jörg Seifert, Christin Artificial Intelligence Computation and Language The goal of Explainable AI (XAI) is to design methods to provide insights into the reasoning process of black-box models, such as deep neural networks, in order to explain them to humans. Social science research states that such explanations should be conversational, similar to human-to-human explanations. In this work, we show how to incorporate XAI in a conversational agent, using a standard design for the agent comprising natural language understanding and generation components. We build upon an XAI question bank, which we extend by quality-controlled paraphrases, to understand the user's information needs. We further systematically survey the literature for suitable explanation methods that provide the information to answer those questions, and present a comprehensive list of suggestions. Our work is the first step towards truly natural conversations about machine learning models with an explanation agent. The comprehensive list of XAI questions and the corresponding explanation methods may support other researchers in providing the necessary information to address users' demands. To facilitate future work, we release our source code and data. |
| title | From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2209.02552 |