Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914658654355456 |
|---|---|
| author | Gao, Yiming Liu, Feiyu Wang, Liang Lian, Zhenjie Zheng, Dehua Wang, Weixuan Yang, Wenjin Li, Siqin Wang, Xianliang Chen, Wenhui Dai, Jing Fu, Qiang Yang, Wei Huang, Lanxiao Liu, Wei |
| author_facet | Gao, Yiming Liu, Feiyu Wang, Liang Lian, Zhenjie Zheng, Dehua Wang, Weixuan Yang, Wenjin Li, Siqin Wang, Xianliang Chen, Wenhui Dai, Jing Fu, Qiang Yang, Wei Huang, Lanxiao Liu, Wei |
| contents | Existing game AI research mainly focuses on enhancing agents' abilities to win games, but this does not inherently make humans have a better experience when collaborating with these agents. For example, agents may dominate the collaboration and exhibit unintended or detrimental behaviors, leading to poor experiences for their human partners. In other words, most game AI agents are modeled in a "self-centered" manner. In this paper, we propose a "human-centered" modeling scheme for collaborative agents that aims to enhance the experience of humans. Specifically, we model the experience of humans as the goals they expect to achieve during the task. We expect that agents should learn to enhance the extent to which humans achieve these goals while maintaining agents' original abilities (e.g., winning games). To achieve this, we propose the Reinforcement Learning from Human Gain (RLHG) approach. The RLHG approach introduces a "baseline", which corresponds to the extent to which humans primitively achieve their goals, and encourages agents to learn behaviors that can effectively enhance humans in achieving their goals better. We evaluate the RLHG agent in the popular Multi-player Online Battle Arena (MOBA) game, Honor of Kings, by conducting real-world human-agent tests. Both objective performance and subjective preference results show that the RLHG agent provides participants better gaming experience. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_16444 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain Gao, Yiming Liu, Feiyu Wang, Liang Lian, Zhenjie Zheng, Dehua Wang, Weixuan Yang, Wenjin Li, Siqin Wang, Xianliang Chen, Wenhui Dai, Jing Fu, Qiang Yang, Wei Huang, Lanxiao Liu, Wei Human-Computer Interaction Artificial Intelligence Existing game AI research mainly focuses on enhancing agents' abilities to win games, but this does not inherently make humans have a better experience when collaborating with these agents. For example, agents may dominate the collaboration and exhibit unintended or detrimental behaviors, leading to poor experiences for their human partners. In other words, most game AI agents are modeled in a "self-centered" manner. In this paper, we propose a "human-centered" modeling scheme for collaborative agents that aims to enhance the experience of humans. Specifically, we model the experience of humans as the goals they expect to achieve during the task. We expect that agents should learn to enhance the extent to which humans achieve these goals while maintaining agents' original abilities (e.g., winning games). To achieve this, we propose the Reinforcement Learning from Human Gain (RLHG) approach. The RLHG approach introduces a "baseline", which corresponds to the extent to which humans primitively achieve their goals, and encourages agents to learn behaviors that can effectively enhance humans in achieving their goals better. We evaluate the RLHG agent in the popular Multi-player Online Battle Arena (MOBA) game, Honor of Kings, by conducting real-world human-agent tests. Both objective performance and subjective preference results show that the RLHG agent provides participants better gaming experience. |
| title | Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2401.16444 |