Learning in Multi-Objective Public Goods Games with Non-Linear Utilities

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Orzan, Nicole, Acar, Erman, Grossi, Davide, Mannion, Patrick, Rădulescu, Roxana
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910550843195392
author Orzan, Nicole
Acar, Erman
Grossi, Davide
Mannion, Patrick
Rădulescu, Roxana
author_facet Orzan, Nicole
Acar, Erman
Grossi, Davide
Mannion, Patrick
Rădulescu, Roxana
contents Addressing the question of how to achieve optimal decision-making under risk and uncertainty is crucial for enhancing the capabilities of artificial agents that collaborate with or support humans. In this work, we address this question in the context of Public Goods Games. We study learning in a novel multi-objective version of the Public Goods Game where agents have different risk preferences, by means of multi-objective reinforcement learning. We introduce a parametric non-linear utility function to model risk preferences at the level of individual agents, over the collective and individual reward components of the game. We study the interplay between such preference modelling and environmental uncertainty on the incentive alignment level in the game. We demonstrate how different combinations of individual preferences and environmental uncertainties sustain the emergence of cooperative patterns in non-cooperative environments (i.e., where competitive strategies are dominant), while others sustain competitive patterns in cooperative environments (i.e., where cooperative strategies are dominant).
format Preprint
id arxiv_https___arxiv_org_abs_2408_00682
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning in Multi-Objective Public Goods Games with Non-Linear Utilities
Orzan, Nicole
Acar, Erman
Grossi, Davide
Mannion, Patrick
Rădulescu, Roxana
Multiagent Systems
Artificial Intelligence
Computer Science and Game Theory
Addressing the question of how to achieve optimal decision-making under risk and uncertainty is crucial for enhancing the capabilities of artificial agents that collaborate with or support humans. In this work, we address this question in the context of Public Goods Games. We study learning in a novel multi-objective version of the Public Goods Game where agents have different risk preferences, by means of multi-objective reinforcement learning. We introduce a parametric non-linear utility function to model risk preferences at the level of individual agents, over the collective and individual reward components of the game. We study the interplay between such preference modelling and environmental uncertainty on the incentive alignment level in the game. We demonstrate how different combinations of individual preferences and environmental uncertainties sustain the emergence of cooperative patterns in non-cooperative environments (i.e., where competitive strategies are dominant), while others sustain competitive patterns in cooperative environments (i.e., where cooperative strategies are dominant).
title Learning in Multi-Objective Public Goods Games with Non-Linear Utilities
topic Multiagent Systems
Artificial Intelligence
Computer Science and Game Theory
url https://arxiv.org/abs/2408.00682