Saved in:
Bibliographic Details
Main Authors: Xu, Manjie, Yang, Xinyi, Zhan, Jiayu, Liang, Wei, Zhang, Chi, Zhu, Yixin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.18407
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909861197905920
author Xu, Manjie
Yang, Xinyi
Zhan, Jiayu
Liang, Wei
Zhang, Chi
Zhu, Yixin
author_facet Xu, Manjie
Yang, Xinyi
Zhan, Jiayu
Liang, Wei
Zhang, Chi
Zhu, Yixin
contents Self-play constitutes a fundamental paradigm for autonomous skill acquisition, whereby agents iteratively enhance their capabilities through self-directed environmental exploration. Conventional self-play frameworks exploit agent symmetry within zero-sum competitive settings, yet this approach proves inadequate for open-ended learning scenarios characterized by inherent asymmetry. Human pedagogical systems exemplify asymmetric instructional frameworks wherein educators systematically construct challenges calibrated to individual learners' developmental trajectories. The principal challenge resides in operationalizing these asymmetric, adaptive pedagogical mechanisms within artificial systems capable of autonomously synthesizing appropriate curricula without predetermined task hierarchies. Here we present Heterogeneous Adversarial Play (HAP), an adversarial Automatic Curriculum Learning framework that formalizes teacher-student interactions as a minimax optimization wherein task-generating instructor and problem-solving learner co-evolve through adversarial dynamics. In contrast to prevailing ACL methodologies that employ static curricula or unidirectional task selection mechanisms, HAP establishes a bidirectional feedback system wherein instructors continuously recalibrate task complexity in response to real-time learner performance metrics. Experimental validation across multi-task learning domains demonstrates that our framework achieves performance parity with SOTA baselines while generating curricula that enhance learning efficacy in both artificial agents and human subjects.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18407
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Heterogeneous Adversarial Play in Interactive Environments
Xu, Manjie
Yang, Xinyi
Zhan, Jiayu
Liang, Wei
Zhang, Chi
Zhu, Yixin
Artificial Intelligence
Self-play constitutes a fundamental paradigm for autonomous skill acquisition, whereby agents iteratively enhance their capabilities through self-directed environmental exploration. Conventional self-play frameworks exploit agent symmetry within zero-sum competitive settings, yet this approach proves inadequate for open-ended learning scenarios characterized by inherent asymmetry. Human pedagogical systems exemplify asymmetric instructional frameworks wherein educators systematically construct challenges calibrated to individual learners' developmental trajectories. The principal challenge resides in operationalizing these asymmetric, adaptive pedagogical mechanisms within artificial systems capable of autonomously synthesizing appropriate curricula without predetermined task hierarchies. Here we present Heterogeneous Adversarial Play (HAP), an adversarial Automatic Curriculum Learning framework that formalizes teacher-student interactions as a minimax optimization wherein task-generating instructor and problem-solving learner co-evolve through adversarial dynamics. In contrast to prevailing ACL methodologies that employ static curricula or unidirectional task selection mechanisms, HAP establishes a bidirectional feedback system wherein instructors continuously recalibrate task complexity in response to real-time learner performance metrics. Experimental validation across multi-task learning domains demonstrates that our framework achieves performance parity with SOTA baselines while generating curricula that enhance learning efficacy in both artificial agents and human subjects.
title Heterogeneous Adversarial Play in Interactive Environments
topic Artificial Intelligence
url https://arxiv.org/abs/2510.18407