The Cost of Arbitrariness for Individuals: Examining the Legal and Technical Challenges of Model Multiplicity

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ganesh, Prakhar, Daldaban, Ihsan Ibrahim, Cofone, Ignacio, Farnadi, Golnoosh
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929499460861952
author Ganesh, Prakhar
Daldaban, Ihsan Ibrahim
Cofone, Ignacio
Farnadi, Golnoosh
author_facet Ganesh, Prakhar
Daldaban, Ihsan Ibrahim
Cofone, Ignacio
Farnadi, Golnoosh
contents Model multiplicity, the phenomenon where multiple models achieve similar performance despite different underlying learned functions, introduces arbitrariness in model selection. While this arbitrariness may seem inconsequential in expectation, its impact on individuals can be severe. This paper explores various individual concerns stemming from multiplicity, including the effects of arbitrariness beyond final predictions, disparate arbitrariness for individuals belonging to protected groups, and the challenges associated with the arbitrariness of a single algorithmic system creating a monopoly across various contexts. It provides both an empirical examination of these concerns and a comprehensive analysis from the legal standpoint, addressing how these issues are perceived in the anti-discrimination law in Canada. We conclude the discussion with technical challenges in the current landscape of model multiplicity to meet legal requirements and the legal gap between current law and the implications of arbitrariness in model selection, highlighting relevant future research directions for both disciplines.
format Preprint
id arxiv_https___arxiv_org_abs_2407_13070
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Cost of Arbitrariness for Individuals: Examining the Legal and Technical Challenges of Model Multiplicity
Ganesh, Prakhar
Daldaban, Ihsan Ibrahim
Cofone, Ignacio
Farnadi, Golnoosh
Computers and Society
Artificial Intelligence
Machine Learning
Model multiplicity, the phenomenon where multiple models achieve similar performance despite different underlying learned functions, introduces arbitrariness in model selection. While this arbitrariness may seem inconsequential in expectation, its impact on individuals can be severe. This paper explores various individual concerns stemming from multiplicity, including the effects of arbitrariness beyond final predictions, disparate arbitrariness for individuals belonging to protected groups, and the challenges associated with the arbitrariness of a single algorithmic system creating a monopoly across various contexts. It provides both an empirical examination of these concerns and a comprehensive analysis from the legal standpoint, addressing how these issues are perceived in the anti-discrimination law in Canada. We conclude the discussion with technical challenges in the current landscape of model multiplicity to meet legal requirements and the legal gap between current law and the implications of arbitrariness in model selection, highlighting relevant future research directions for both disciplines.
title The Cost of Arbitrariness for Individuals: Examining the Legal and Technical Challenges of Model Multiplicity
topic Computers and Society
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2407.13070