_version_ 1866916226399207424
author Gabriel, Iason
Manzini, Arianna
Keeling, Geoff
Hendricks, Lisa Anne
Rieser, Verena
Iqbal, Hasan
Tomašev, Nenad
Ktena, Ira
Kenton, Zachary
Rodriguez, Mikel
El-Sayed, Seliem
Brown, Sasha
Akbulut, Canfer
Trask, Andrew
Hughes, Edward
Bergman, A. Stevie
Shelby, Renee
Marchal, Nahema
Griffin, Conor
Mateos-Garcia, Juan
Weidinger, Laura
Street, Winnie
Lange, Benjamin
Ingerman, Alex
Lentz, Alison
Enger, Reed
Barakat, Andrew
Krakovna, Victoria
Siy, John Oliver
Kurth-Nelson, Zeb
McCroskery, Amanda
Bolina, Vijay
Law, Harry
Shanahan, Murray
Alberts, Lize
Balle, Borja
de Haas, Sarah
Ibitoye, Yetunde
Dafoe, Allan
Goldberg, Beth
Krier, Sébastien
Reese, Alexander
Witherspoon, Sims
Hawkins, Will
Rauh, Maribeth
Wallace, Don
Franklin, Matija
Goldstein, Josh A.
Lehman, Joel
Klenk, Michael
Vallor, Shannon
Biles, Courtney
Morris, Meredith Ringel
King, Helen
Arcas, Blaise Agüera y
Isaac, William
Manyika, James
author_facet Gabriel, Iason
Manzini, Arianna
Keeling, Geoff
Hendricks, Lisa Anne
Rieser, Verena
Iqbal, Hasan
Tomašev, Nenad
Ktena, Ira
Kenton, Zachary
Rodriguez, Mikel
El-Sayed, Seliem
Brown, Sasha
Akbulut, Canfer
Trask, Andrew
Hughes, Edward
Bergman, A. Stevie
Shelby, Renee
Marchal, Nahema
Griffin, Conor
Mateos-Garcia, Juan
Weidinger, Laura
Street, Winnie
Lange, Benjamin
Ingerman, Alex
Lentz, Alison
Enger, Reed
Barakat, Andrew
Krakovna, Victoria
Siy, John Oliver
Kurth-Nelson, Zeb
McCroskery, Amanda
Bolina, Vijay
Law, Harry
Shanahan, Murray
Alberts, Lize
Balle, Borja
de Haas, Sarah
Ibitoye, Yetunde
Dafoe, Allan
Goldberg, Beth
Krier, Sébastien
Reese, Alexander
Witherspoon, Sims
Hawkins, Will
Rauh, Maribeth
Wallace, Don
Franklin, Matija
Goldstein, Josh A.
Lehman, Joel
Klenk, Michael
Vallor, Shannon
Biles, Courtney
Morris, Meredith Ringel
King, Helen
Arcas, Blaise Agüera y
Isaac, William
Manyika, James
contents This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user, across one or more domains, in line with the user's expectations. The paper starts by considering the technology itself, providing an overview of AI assistants, their technical foundations and potential range of applications. It then explores questions around AI value alignment, well-being, safety and malicious uses. Extending the circle of inquiry further, we next consider the relationship between advanced AI assistants and individual users in more detail, exploring topics such as manipulation and persuasion, anthropomorphism, appropriate relationships, trust and privacy. With this analysis in place, we consider the deployment of advanced assistants at a societal scale, focusing on cooperation, equity and access, misinformation, economic impact, the environment and how best to evaluate advanced AI assistants. Finally, we conclude by providing a range of recommendations for researchers, developers, policymakers and public stakeholders.
format Preprint
id arxiv_https___arxiv_org_abs_2404_16244
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Ethics of Advanced AI Assistants
Gabriel, Iason
Manzini, Arianna
Keeling, Geoff
Hendricks, Lisa Anne
Rieser, Verena
Iqbal, Hasan
Tomašev, Nenad
Ktena, Ira
Kenton, Zachary
Rodriguez, Mikel
El-Sayed, Seliem
Brown, Sasha
Akbulut, Canfer
Trask, Andrew
Hughes, Edward
Bergman, A. Stevie
Shelby, Renee
Marchal, Nahema
Griffin, Conor
Mateos-Garcia, Juan
Weidinger, Laura
Street, Winnie
Lange, Benjamin
Ingerman, Alex
Lentz, Alison
Enger, Reed
Barakat, Andrew
Krakovna, Victoria
Siy, John Oliver
Kurth-Nelson, Zeb
McCroskery, Amanda
Bolina, Vijay
Law, Harry
Shanahan, Murray
Alberts, Lize
Balle, Borja
de Haas, Sarah
Ibitoye, Yetunde
Dafoe, Allan
Goldberg, Beth
Krier, Sébastien
Reese, Alexander
Witherspoon, Sims
Hawkins, Will
Rauh, Maribeth
Wallace, Don
Franklin, Matija
Goldstein, Josh A.
Lehman, Joel
Klenk, Michael
Vallor, Shannon
Biles, Courtney
Morris, Meredith Ringel
King, Helen
Arcas, Blaise Agüera y
Isaac, William
Manyika, James
Computers and Society
This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user, across one or more domains, in line with the user's expectations. The paper starts by considering the technology itself, providing an overview of AI assistants, their technical foundations and potential range of applications. It then explores questions around AI value alignment, well-being, safety and malicious uses. Extending the circle of inquiry further, we next consider the relationship between advanced AI assistants and individual users in more detail, exploring topics such as manipulation and persuasion, anthropomorphism, appropriate relationships, trust and privacy. With this analysis in place, we consider the deployment of advanced assistants at a societal scale, focusing on cooperation, equity and access, misinformation, economic impact, the environment and how best to evaluate advanced AI assistants. Finally, we conclude by providing a range of recommendations for researchers, developers, policymakers and public stakeholders.
title The Ethics of Advanced AI Assistants
topic Computers and Society
url https://arxiv.org/abs/2404.16244