Salvato in:
Dettagli Bibliografici
Autori principali: Kolker, Simon, Dennis, Louise A., Pereira, Ramon Fraga, Xu, Mengwei
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2505.04352
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915276214239232
author Kolker, Simon
Dennis, Louise A.
Pereira, Ramon Fraga
Xu, Mengwei
author_facet Kolker, Simon
Dennis, Louise A.
Pereira, Ramon Fraga
Xu, Mengwei
contents Machine Ethics decisions should consider the implications of uncertainty over decisions. Decisions should be made over sequences of actions to reach preferable outcomes long term. The evaluation of outcomes, however, may invoke one or more moral theories, which might have conflicting judgements. Each theory will require differing representations of the ethical situation. For example, Utilitarianism measures numerical values, Deontology analyses duties, and Virtue Ethics emphasises moral character. While balancing potentially conflicting moral considerations, decisions may need to be made, for example, to achieve morally neutral goals with minimal costs. In this paper, we formalise the problem as a Multi-Moral Markov Decision Process and a Multi-Moral Stochastic Shortest Path Problem. We develop a heuristic algorithm based on Multi-Objective AO*, utilising Sven-Ove Hansson's Hypothetical Retrospection procedure for ethical reasoning under uncertainty. Our approach is validated by a case study from Machine Ethics literature: the problem of whether to steal insulin for someone who needs it.
format Preprint
id arxiv_https___arxiv_org_abs_2505_04352
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Uncertain Machine Ethics Planning
Kolker, Simon
Dennis, Louise A.
Pereira, Ramon Fraga
Xu, Mengwei
Artificial Intelligence
Computers and Society
Machine Ethics decisions should consider the implications of uncertainty over decisions. Decisions should be made over sequences of actions to reach preferable outcomes long term. The evaluation of outcomes, however, may invoke one or more moral theories, which might have conflicting judgements. Each theory will require differing representations of the ethical situation. For example, Utilitarianism measures numerical values, Deontology analyses duties, and Virtue Ethics emphasises moral character. While balancing potentially conflicting moral considerations, decisions may need to be made, for example, to achieve morally neutral goals with minimal costs. In this paper, we formalise the problem as a Multi-Moral Markov Decision Process and a Multi-Moral Stochastic Shortest Path Problem. We develop a heuristic algorithm based on Multi-Objective AO*, utilising Sven-Ove Hansson's Hypothetical Retrospection procedure for ethical reasoning under uncertainty. Our approach is validated by a case study from Machine Ethics literature: the problem of whether to steal insulin for someone who needs it.
title Uncertain Machine Ethics Planning
topic Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2505.04352