Symmetry-Breaking Augmentations for Ad Hoc Teamwork
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908327173160960 |
|---|---|
| author | Hammond, Ravi Craggs, Dustin Guo, Mingyu Foerster, Jakob Reid, Ian |
| author_facet | Hammond, Ravi Craggs, Dustin Guo, Mingyu Foerster, Jakob Reid, Ian |
| contents | In dynamic collaborative settings, for artificial intelligence (AI) agents to better align with humans, they must adapt to novel teammates who utilise unforeseen strategies. While adaptation is often simple for humans, it can be challenging for AI agents. Our work introduces symmetry-breaking augmentations (SBA) as a novel approach to this challenge. By applying a symmetry-flipping operation to increase behavioural diversity among training teammates, SBA encourages agents to learn robust responses to unknown strategies, highlighting how social conventions impact human-AI alignment. We demonstrate this experimentally in two settings, showing that our approach outperforms previous ad hoc teamwork results in the challenging card game Hanabi. In addition, we propose a general metric for estimating symmetry dependency amongst a given set of policies. Our findings provide insights into how AI systems can better adapt to diverse human conventions and the core mechanics of alignment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_09984 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Symmetry-Breaking Augmentations for Ad Hoc Teamwork Hammond, Ravi Craggs, Dustin Guo, Mingyu Foerster, Jakob Reid, Ian Machine Learning Artificial Intelligence In dynamic collaborative settings, for artificial intelligence (AI) agents to better align with humans, they must adapt to novel teammates who utilise unforeseen strategies. While adaptation is often simple for humans, it can be challenging for AI agents. Our work introduces symmetry-breaking augmentations (SBA) as a novel approach to this challenge. By applying a symmetry-flipping operation to increase behavioural diversity among training teammates, SBA encourages agents to learn robust responses to unknown strategies, highlighting how social conventions impact human-AI alignment. We demonstrate this experimentally in two settings, showing that our approach outperforms previous ad hoc teamwork results in the challenging card game Hanabi. In addition, we propose a general metric for estimating symmetry dependency amongst a given set of policies. Our findings provide insights into how AI systems can better adapt to diverse human conventions and the core mechanics of alignment. |
| title | Symmetry-Breaking Augmentations for Ad Hoc Teamwork |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2402.09984 |