Acting for the Right Reasons: Creating Reason-Sensitive Artificial Moral Agents
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912430800502784 |
|---|---|
| author | Baum, Kevin Dargasz, Lisa Jahn, Felix Gros, Timo P. Wolf, Verena |
| author_facet | Baum, Kevin Dargasz, Lisa Jahn, Felix Gros, Timo P. Wolf, Verena |
| contents | We propose an extension of the reinforcement learning architecture that enables moral decision-making of reinforcement learning agents based on normative reasons. Central to this approach is a reason-based shield generator yielding a moral shield that binds the agent to actions that conform with recognized normative reasons so that our overall architecture restricts the agent to actions that are (internally) morally justified. In addition, we describe an algorithm that allows to iteratively improve the reason-based shield generator through case-based feedback from a moral judge. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_15014 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Acting for the Right Reasons: Creating Reason-Sensitive Artificial Moral Agents Baum, Kevin Dargasz, Lisa Jahn, Felix Gros, Timo P. Wolf, Verena Artificial Intelligence Computers and Society Machine Learning We propose an extension of the reinforcement learning architecture that enables moral decision-making of reinforcement learning agents based on normative reasons. Central to this approach is a reason-based shield generator yielding a moral shield that binds the agent to actions that conform with recognized normative reasons so that our overall architecture restricts the agent to actions that are (internally) morally justified. In addition, we describe an algorithm that allows to iteratively improve the reason-based shield generator through case-based feedback from a moral judge. |
| title | Acting for the Right Reasons: Creating Reason-Sensitive Artificial Moral Agents |
| topic | Artificial Intelligence Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2409.15014 |