(Ir)rationality in AI: State of the Art, Research Challenges and Open Questions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Macmillan-Scott, Olivia, Musolesi, Mirco
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908518039158784
author Macmillan-Scott, Olivia
Musolesi, Mirco
author_facet Macmillan-Scott, Olivia
Musolesi, Mirco
contents The concept of rationality is central to the field of artificial intelligence (AI). Whether we are seeking to simulate human reasoning, or trying to achieve bounded optimality, our goal is generally to make artificial agents as rational as possible. Despite the centrality of the concept within AI, there is no unified definition of what constitutes a rational agent. This article provides a survey of rationality and irrationality in AI, and sets out the open questions in this area. We consider how the understanding of rationality in other fields has influenced its conception within AI, in particular work in economics, philosophy and psychology. Focusing on the behaviour of artificial agents, we examine irrational behaviours that can prove to be optimal in certain scenarios. Some methods have been developed to deal with irrational agents, both in terms of identification and interaction, however work in this area remains limited. Methods that have up to now been developed for other purposes, namely adversarial scenarios, may be adapted to suit interactions with artificial agents. We further discuss the interplay between human and artificial agents, and the role that rationality plays within this interaction; many questions remain in this area, relating to potentially irrational behaviour of both humans and artificial agents.
format Preprint
id arxiv_https___arxiv_org_abs_2311_17165
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle (Ir)rationality in AI: State of the Art, Research Challenges and Open Questions
Macmillan-Scott, Olivia
Musolesi, Mirco
Artificial Intelligence
Computers and Society
Human-Computer Interaction
Machine Learning
Multiagent Systems
The concept of rationality is central to the field of artificial intelligence (AI). Whether we are seeking to simulate human reasoning, or trying to achieve bounded optimality, our goal is generally to make artificial agents as rational as possible. Despite the centrality of the concept within AI, there is no unified definition of what constitutes a rational agent. This article provides a survey of rationality and irrationality in AI, and sets out the open questions in this area. We consider how the understanding of rationality in other fields has influenced its conception within AI, in particular work in economics, philosophy and psychology. Focusing on the behaviour of artificial agents, we examine irrational behaviours that can prove to be optimal in certain scenarios. Some methods have been developed to deal with irrational agents, both in terms of identification and interaction, however work in this area remains limited. Methods that have up to now been developed for other purposes, namely adversarial scenarios, may be adapted to suit interactions with artificial agents. We further discuss the interplay between human and artificial agents, and the role that rationality plays within this interaction; many questions remain in this area, relating to potentially irrational behaviour of both humans and artificial agents.
title (Ir)rationality in AI: State of the Art, Research Challenges and Open Questions
topic Artificial Intelligence
Computers and Society
Human-Computer Interaction
Machine Learning
Multiagent Systems
url https://arxiv.org/abs/2311.17165