The Sample Complexity of Online Strategic Decision Making with Information Asymmetry and Knowledge Transportability
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913889405370368 |
|---|---|
| author | Hu, Jiachen Ai, Rui Zhong, Han Chen, Xiaoyu Wang, Liwei Wang, Zhaoran Yang, Zhuoran |
| author_facet | Hu, Jiachen Ai, Rui Zhong, Han Chen, Xiaoyu Wang, Liwei Wang, Zhaoran Yang, Zhuoran |
| contents | Information asymmetry is a pervasive feature of multi-agent systems, especially evident in economics and social sciences. In these settings, agents tailor their actions based on private information to maximize their rewards. These strategic behaviors often introduce complexities due to confounding variables. Simultaneously, knowledge transportability poses another significant challenge, arising from the difficulties of conducting experiments in target environments. It requires transferring knowledge from environments where empirical data is more readily available. Against these backdrops, this paper explores a fundamental question in online learning: Can we employ non-i.i.d. actions to learn about confounders even when requiring knowledge transfer? We present a sample-efficient algorithm designed to accurately identify system dynamics under information asymmetry and to navigate the challenges of knowledge transfer effectively in reinforcement learning, framed within an online strategic interaction model. Our method provably achieves learning of an $ε$-optimal policy with a tight sample complexity of $O(1/ε^2)$. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_09940 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Sample Complexity of Online Strategic Decision Making with Information Asymmetry and Knowledge Transportability Hu, Jiachen Ai, Rui Zhong, Han Chen, Xiaoyu Wang, Liwei Wang, Zhaoran Yang, Zhuoran Machine Learning Artificial Intelligence Information asymmetry is a pervasive feature of multi-agent systems, especially evident in economics and social sciences. In these settings, agents tailor their actions based on private information to maximize their rewards. These strategic behaviors often introduce complexities due to confounding variables. Simultaneously, knowledge transportability poses another significant challenge, arising from the difficulties of conducting experiments in target environments. It requires transferring knowledge from environments where empirical data is more readily available. Against these backdrops, this paper explores a fundamental question in online learning: Can we employ non-i.i.d. actions to learn about confounders even when requiring knowledge transfer? We present a sample-efficient algorithm designed to accurately identify system dynamics under information asymmetry and to navigate the challenges of knowledge transfer effectively in reinforcement learning, framed within an online strategic interaction model. Our method provably achieves learning of an $ε$-optimal policy with a tight sample complexity of $O(1/ε^2)$. |
| title | The Sample Complexity of Online Strategic Decision Making with Information Asymmetry and Knowledge Transportability |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2506.09940 |