Saved in:
Bibliographic Details
Main Authors: Mitchell, Margaret, Ghosh, Avijit, Luccioni, Alexandra Sasha, Pistilli, Giada
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.02649
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915562212294656
author Mitchell, Margaret
Ghosh, Avijit
Luccioni, Alexandra Sasha
Pistilli, Giada
author_facet Mitchell, Margaret
Ghosh, Avijit
Luccioni, Alexandra Sasha
Pistilli, Giada
contents This paper argues that fully autonomous AI agents should not be developed. In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels and detail the ethical values at play in each, documenting trade-offs in potential benefits and risks. Our analysis reveals that risks to people increase with the autonomy of a system: The more control a user cedes to an AI agent, the more risks to people arise. Particularly concerning are safety risks, which affect human life and impact further values.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02649
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fully Autonomous AI Agents Should Not be Developed
Mitchell, Margaret
Ghosh, Avijit
Luccioni, Alexandra Sasha
Pistilli, Giada
Artificial Intelligence
This paper argues that fully autonomous AI agents should not be developed. In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels and detail the ethical values at play in each, documenting trade-offs in potential benefits and risks. Our analysis reveals that risks to people increase with the autonomy of a system: The more control a user cedes to an AI agent, the more risks to people arise. Particularly concerning are safety risks, which affect human life and impact further values.
title Fully Autonomous AI Agents Should Not be Developed
topic Artificial Intelligence
url https://arxiv.org/abs/2502.02649