Saved in:
Bibliographic Details
Main Authors: Mansi, Gennie, Karusala, Naveena, Riedl, Mark
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.10708
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910911703285760
author Mansi, Gennie
Karusala, Naveena
Riedl, Mark
author_facet Mansi, Gennie
Karusala, Naveena
Riedl, Mark
contents Explanations for artificial intelligence (AI) systems are intended to support the people who are impacted by AI systems in high-stakes decision-making environments, such as doctors, patients, teachers, students, housing applicants, and many others. To protect people and support the responsible development of AI, explanations need to be actionable--helping people take pragmatic action in response to an AI system--and contestable--enabling people to push back against an AI system and its determinations. For many high-stakes domains, such as healthcare, education, and finance, the sociotechnical environment includes significant legal implications that impact how people use AI explanations. For example, physicians who use AI decision support systems may need information on how accepting or rejecting an AI determination will protect them from lawsuits or help them advocate for their patients. In this paper, we make the case for Legally-Informed Explainable AI, responding to the need to integrate and design for legal considerations when creating AI explanations. We describe three stakeholder groups with different informational and actionability needs, and provide practical recommendations to tackle design challenges around the design of explainable AI systems that incorporate legal considerations.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10708
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Legally-Informed Explainable AI
Mansi, Gennie
Karusala, Naveena
Riedl, Mark
Human-Computer Interaction
Explanations for artificial intelligence (AI) systems are intended to support the people who are impacted by AI systems in high-stakes decision-making environments, such as doctors, patients, teachers, students, housing applicants, and many others. To protect people and support the responsible development of AI, explanations need to be actionable--helping people take pragmatic action in response to an AI system--and contestable--enabling people to push back against an AI system and its determinations. For many high-stakes domains, such as healthcare, education, and finance, the sociotechnical environment includes significant legal implications that impact how people use AI explanations. For example, physicians who use AI decision support systems may need information on how accepting or rejecting an AI determination will protect them from lawsuits or help them advocate for their patients. In this paper, we make the case for Legally-Informed Explainable AI, responding to the need to integrate and design for legal considerations when creating AI explanations. We describe three stakeholder groups with different informational and actionability needs, and provide practical recommendations to tackle design challenges around the design of explainable AI systems that incorporate legal considerations.
title Legally-Informed Explainable AI
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.10708