Epistemic Injustice in Generative AI

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kay, Jackie, Kasirzadeh, Atoosa, Mohamed, Shakir
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913475636232192
author Kay, Jackie
Kasirzadeh, Atoosa
Mohamed, Shakir
author_facet Kay, Jackie
Kasirzadeh, Atoosa
Mohamed, Shakir
contents This paper investigates how generative AI can potentially undermine the integrity of collective knowledge and the processes we rely on to acquire, assess, and trust information, posing a significant threat to our knowledge ecosystem and democratic discourse. Grounded in social and political philosophy, we introduce the concept of \emph{generative algorithmic epistemic injustice}. We identify four key dimensions of this phenomenon: amplified and manipulative testimonial injustice, along with hermeneutical ignorance and access injustice. We illustrate each dimension with real-world examples that reveal how generative AI can produce or amplify misinformation, perpetuate representational harm, and create epistemic inequities, particularly in multilingual contexts. By highlighting these injustices, we aim to inform the development of epistemically just generative AI systems, proposing strategies for resistance, system design principles, and two approaches that leverage generative AI to foster a more equitable information ecosystem, thereby safeguarding democratic values and the integrity of knowledge production.
format Preprint
id arxiv_https___arxiv_org_abs_2408_11441
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Epistemic Injustice in Generative AI
Kay, Jackie
Kasirzadeh, Atoosa
Mohamed, Shakir
Artificial Intelligence
This paper investigates how generative AI can potentially undermine the integrity of collective knowledge and the processes we rely on to acquire, assess, and trust information, posing a significant threat to our knowledge ecosystem and democratic discourse. Grounded in social and political philosophy, we introduce the concept of \emph{generative algorithmic epistemic injustice}. We identify four key dimensions of this phenomenon: amplified and manipulative testimonial injustice, along with hermeneutical ignorance and access injustice. We illustrate each dimension with real-world examples that reveal how generative AI can produce or amplify misinformation, perpetuate representational harm, and create epistemic inequities, particularly in multilingual contexts. By highlighting these injustices, we aim to inform the development of epistemically just generative AI systems, proposing strategies for resistance, system design principles, and two approaches that leverage generative AI to foster a more equitable information ecosystem, thereby safeguarding democratic values and the integrity of knowledge production.
title Epistemic Injustice in Generative AI
topic Artificial Intelligence
url https://arxiv.org/abs/2408.11441