Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913894102990848 |
|---|---|
| author | Zhang, Zhaowei Bai, Fengshuo Wang, Mingzhi Ye, Haoyang Ma, Chengdong Yang, Yaodong |
| author_facet | Zhang, Zhaowei Bai, Fengshuo Wang, Mingzhi Ye, Haoyang Ma, Chengdong Yang, Yaodong |
| contents | The burgeoning integration of artificial intelligence (AI) into human society brings forth significant implications for societal governance and safety. While considerable strides have been made in addressing AI alignment challenges, existing methodologies primarily focus on technical facets, often neglecting the intricate sociotechnical nature of AI systems, which can lead to a misalignment between the development and deployment contexts. To this end, we posit a new problem worth exploring: Incentive Compatibility Sociotechnical Alignment Problem (ICSAP). We hope this can call for more researchers to explore how to leverage the principles of Incentive Compatibility (IC) from game theory to bridge the gap between technical and societal components to maintain AI consensus with human societies in different contexts. We further discuss three classical game problems for achieving IC: mechanism design, contract theory, and Bayesian persuasion, in addressing the perspectives, potentials, and challenges of solving ICSAP, and provide preliminary implementation conceptions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_12907 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems Zhang, Zhaowei Bai, Fengshuo Wang, Mingzhi Ye, Haoyang Ma, Chengdong Yang, Yaodong Artificial Intelligence Computers and Society Computer Science and Game Theory Human-Computer Interaction I.2.m; K.4.m The burgeoning integration of artificial intelligence (AI) into human society brings forth significant implications for societal governance and safety. While considerable strides have been made in addressing AI alignment challenges, existing methodologies primarily focus on technical facets, often neglecting the intricate sociotechnical nature of AI systems, which can lead to a misalignment between the development and deployment contexts. To this end, we posit a new problem worth exploring: Incentive Compatibility Sociotechnical Alignment Problem (ICSAP). We hope this can call for more researchers to explore how to leverage the principles of Incentive Compatibility (IC) from game theory to bridge the gap between technical and societal components to maintain AI consensus with human societies in different contexts. We further discuss three classical game problems for achieving IC: mechanism design, contract theory, and Bayesian persuasion, in addressing the perspectives, potentials, and challenges of solving ICSAP, and provide preliminary implementation conceptions. |
| title | Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems |
| topic | Artificial Intelligence Computers and Society Computer Science and Game Theory Human-Computer Interaction I.2.m; K.4.m |
| url | https://arxiv.org/abs/2402.12907 |