Saved in:
Bibliographic Details
Main Authors: Hutiri, Wiebke, Papakyriakopoulos, Oresiti, Xiang, Alice
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.01708
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916247707320320
author Hutiri, Wiebke
Papakyriakopoulos, Oresiti
Xiang, Alice
author_facet Hutiri, Wiebke
Papakyriakopoulos, Oresiti
Xiang, Alice
contents The rapid and wide-scale adoption of AI to generate human speech poses a range of significant ethical and safety risks to society that need to be addressed. For example, a growing number of speech generation incidents are associated with swatting attacks in the United States, where anonymous perpetrators create synthetic voices that call police officers to close down schools and hospitals, or to violently gain access to innocent citizens' homes. Incidents like this demonstrate that multimodal generative AI risks and harms do not exist in isolation, but arise from the interactions of multiple stakeholders and technical AI systems. In this paper we analyse speech generation incidents to study how patterns of specific harms arise. We find that specific harms can be categorised according to the exposure of affected individuals, that is to say whether they are a subject of, interact with, suffer due to, or are excluded from speech generation systems. Similarly, specific harms are also a consequence of the motives of the creators and deployers of the systems. Based on these insights we propose a conceptual framework for modelling pathways to ethical and safety harms of AI, which we use to develop a taxonomy of harms of speech generators. Our relational approach captures the complexity of risks and harms in sociotechnical AI systems, and yields a taxonomy that can support appropriate policy interventions and decision making for the responsible development and release of speech generation models.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01708
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators
Hutiri, Wiebke
Papakyriakopoulos, Oresiti
Xiang, Alice
Computation and Language
Artificial Intelligence
Computers and Society
Audio and Speech Processing
The rapid and wide-scale adoption of AI to generate human speech poses a range of significant ethical and safety risks to society that need to be addressed. For example, a growing number of speech generation incidents are associated with swatting attacks in the United States, where anonymous perpetrators create synthetic voices that call police officers to close down schools and hospitals, or to violently gain access to innocent citizens' homes. Incidents like this demonstrate that multimodal generative AI risks and harms do not exist in isolation, but arise from the interactions of multiple stakeholders and technical AI systems. In this paper we analyse speech generation incidents to study how patterns of specific harms arise. We find that specific harms can be categorised according to the exposure of affected individuals, that is to say whether they are a subject of, interact with, suffer due to, or are excluded from speech generation systems. Similarly, specific harms are also a consequence of the motives of the creators and deployers of the systems. Based on these insights we propose a conceptual framework for modelling pathways to ethical and safety harms of AI, which we use to develop a taxonomy of harms of speech generators. Our relational approach captures the complexity of risks and harms in sociotechnical AI systems, and yields a taxonomy that can support appropriate policy interventions and decision making for the responsible development and release of speech generation models.
title Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators
topic Computation and Language
Artificial Intelligence
Computers and Society
Audio and Speech Processing
url https://arxiv.org/abs/2402.01708