Saved in:
Bibliographic Details
Main Authors: Laufer, Benjamin, Raghavan, Manish, Barocas, Solon
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.18138
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912290865938432
author Laufer, Benjamin
Raghavan, Manish
Barocas, Solon
author_facet Laufer, Benjamin
Raghavan, Manish
Barocas, Solon
contents Disparate impact doctrine offers an important legal apparatus for targeting discriminatory data-driven algorithmic decisions. A recent body of work has focused on conceptualizing one particular construct from this doctrine: the less discriminatory alternative, an alternative policy that reduces disparities while meeting the same business needs of a status quo or baseline policy. However, attempts to operationalize this construct in the algorithmic setting must grapple with some thorny challenges and ambiguities. In this paper, we attempt to raise and resolve important questions about less discriminatory algorithms (LDAs). How should we formally define LDAs, and how does this interact with different societal goals they might serve? And how feasible is it for firms or plaintiffs to computationally search for candidate LDAs? We find that formal LDA definitions face fundamental challenges when they attempt to evaluate and compare predictive models in the absence of held-out data. As a result, we argue that LDA definitions cannot be purely quantitative, and must rely on standards of "reasonableness." We then identify both mathematical and computational constraints on firms' ability to efficiently conduct a proactive search for LDAs, but we provide evidence that these limits are "weak" in a formal sense. By defining LDAs formally, we put forward a framework in which both firms and plaintiffs can search for alternative models that comport with societal goals.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18138
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle What Constitutes a Less Discriminatory Algorithm?
Laufer, Benjamin
Raghavan, Manish
Barocas, Solon
Computers and Society
Machine Learning
Disparate impact doctrine offers an important legal apparatus for targeting discriminatory data-driven algorithmic decisions. A recent body of work has focused on conceptualizing one particular construct from this doctrine: the less discriminatory alternative, an alternative policy that reduces disparities while meeting the same business needs of a status quo or baseline policy. However, attempts to operationalize this construct in the algorithmic setting must grapple with some thorny challenges and ambiguities. In this paper, we attempt to raise and resolve important questions about less discriminatory algorithms (LDAs). How should we formally define LDAs, and how does this interact with different societal goals they might serve? And how feasible is it for firms or plaintiffs to computationally search for candidate LDAs? We find that formal LDA definitions face fundamental challenges when they attempt to evaluate and compare predictive models in the absence of held-out data. As a result, we argue that LDA definitions cannot be purely quantitative, and must rely on standards of "reasonableness." We then identify both mathematical and computational constraints on firms' ability to efficiently conduct a proactive search for LDAs, but we provide evidence that these limits are "weak" in a formal sense. By defining LDAs formally, we put forward a framework in which both firms and plaintiffs can search for alternative models that comport with societal goals.
title What Constitutes a Less Discriminatory Algorithm?
topic Computers and Society
Machine Learning
url https://arxiv.org/abs/2412.18138