Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ganesh, Prakhar, Taik, Afaf, Farnadi, Golnoosh
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912526364573696
author Ganesh, Prakhar
Taik, Afaf
Farnadi, Golnoosh
author_facet Ganesh, Prakhar
Taik, Afaf
Farnadi, Golnoosh
contents Algorithmic modeling relies on limited information in data to extrapolate outcomes for unseen scenarios, often embedding an element of arbitrariness in its decisions. A perspective on this arbitrariness that has recently gained interest is multiplicity-the study of arbitrariness across a set of "good models", i.e., those likely to be deployed in practice. In this work, we systemize the literature on multiplicity by: (a) formalizing the terminology around model design choices and their contribution to arbitrariness, (b) expanding the definition of multiplicity to incorporate underrepresented forms beyond just predictions and explanations, (c) clarifying the distinction between multiplicity and other lenses of arbitrariness, i.e., uncertainty and variance, and (d) distilling the benefits and potential risks of multiplicity into overarching trends, situating it within the broader landscape of responsible AI. We conclude by identifying open research questions and highlighting emerging trends in this young but rapidly growing area of research.
format Preprint
id arxiv_https___arxiv_org_abs_2501_14959
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learning
Ganesh, Prakhar
Taik, Afaf
Farnadi, Golnoosh
Machine Learning
Artificial Intelligence
Algorithmic modeling relies on limited information in data to extrapolate outcomes for unseen scenarios, often embedding an element of arbitrariness in its decisions. A perspective on this arbitrariness that has recently gained interest is multiplicity-the study of arbitrariness across a set of "good models", i.e., those likely to be deployed in practice. In this work, we systemize the literature on multiplicity by: (a) formalizing the terminology around model design choices and their contribution to arbitrariness, (b) expanding the definition of multiplicity to incorporate underrepresented forms beyond just predictions and explanations, (c) clarifying the distinction between multiplicity and other lenses of arbitrariness, i.e., uncertainty and variance, and (d) distilling the benefits and potential risks of multiplicity into overarching trends, situating it within the broader landscape of responsible AI. We conclude by identifying open research questions and highlighting emerging trends in this young but rapidly growing area of research.
title Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2501.14959