Accounting for AI and Users Shaping One Another: The Role of Mathematical Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Dean, Sarah, Dong, Evan, Jagadeesan, Meena, Leqi, Liu
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910414740127744
author Dean, Sarah
Dong, Evan
Jagadeesan, Meena
Leqi, Liu
author_facet Dean, Sarah
Dong, Evan
Jagadeesan, Meena
Leqi, Liu
contents As AI systems enter into a growing number of societal domains, these systems increasingly shape and are shaped by user preferences, opinions, and behaviors. However, the design of AI systems rarely accounts for how AI and users shape one another. In this position paper, we argue for the development of formal interaction models which mathematically specify how AI and users shape one another. Formal interaction models can be leveraged to (1) specify interactions for implementation, (2) monitor interactions through empirical analysis, (3) anticipate societal impacts via counterfactual analysis, and (4) control societal impacts via interventions. The design space of formal interaction models is vast, and model design requires careful consideration of factors such as style, granularity, mathematical complexity, and measurability. Using content recommender systems as a case study, we critically examine the nascent literature of formal interaction models with respect to these use-cases and design axes. More broadly, we call for the community to leverage formal interaction models when designing, evaluating, or auditing any AI system which interacts with users.
format Preprint
id arxiv_https___arxiv_org_abs_2404_12366
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Accounting for AI and Users Shaping One Another: The Role of Mathematical Models
Dean, Sarah
Dong, Evan
Jagadeesan, Meena
Leqi, Liu
Machine Learning
Computers and Society
Computer Science and Game Theory
Information Retrieval
As AI systems enter into a growing number of societal domains, these systems increasingly shape and are shaped by user preferences, opinions, and behaviors. However, the design of AI systems rarely accounts for how AI and users shape one another. In this position paper, we argue for the development of formal interaction models which mathematically specify how AI and users shape one another. Formal interaction models can be leveraged to (1) specify interactions for implementation, (2) monitor interactions through empirical analysis, (3) anticipate societal impacts via counterfactual analysis, and (4) control societal impacts via interventions. The design space of formal interaction models is vast, and model design requires careful consideration of factors such as style, granularity, mathematical complexity, and measurability. Using content recommender systems as a case study, we critically examine the nascent literature of formal interaction models with respect to these use-cases and design axes. More broadly, we call for the community to leverage formal interaction models when designing, evaluating, or auditing any AI system which interacts with users.
title Accounting for AI and Users Shaping One Another: The Role of Mathematical Models
topic Machine Learning
Computers and Society
Computer Science and Game Theory
Information Retrieval
url https://arxiv.org/abs/2404.12366