Human-Aligned Procedural Level Generation Reinforcement Learning via Text-Level-Sketch Shared Representation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909735902511104 |
|---|---|
| author | Baek, In-Chang Lee, Seoyoung Kim, Sung-Hyun Hwang, Geumhwan Kim, KyungJoong |
| author_facet | Baek, In-Chang Lee, Seoyoung Kim, Sung-Hyun Hwang, Geumhwan Kim, KyungJoong |
| contents | Human-aligned AI is a critical component of co-creativity, as it enables models to accurately interpret human intent and generate controllable outputs that align with design goals in collaborative content creation. This direction is especially relevant in procedural content generation via reinforcement learning (PCGRL), which is intended to serve as a tool for human designers. However, existing systems often fall short of exhibiting human-centered behavior, limiting the practical utility of AI-driven generation tools in real-world design workflows. In this paper, we propose VIPCGRL (Vision-Instruction PCGRL), a novel deep reinforcement learning framework that incorporates three modalities-text, level, and sketches-to extend control modality and enhance human-likeness. We introduce a shared embedding space trained via quadruple contrastive learning across modalities and human-AI styles, and align the policy using an auxiliary reward based on embedding similarity. Experimental results show that VIPCGRL outperforms existing baselines in human-likeness, as validated by both quantitative metrics and human evaluations. The code and dataset will be available upon publication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_09860 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Human-Aligned Procedural Level Generation Reinforcement Learning via Text-Level-Sketch Shared Representation Baek, In-Chang Lee, Seoyoung Kim, Sung-Hyun Hwang, Geumhwan Kim, KyungJoong Artificial Intelligence Human-aligned AI is a critical component of co-creativity, as it enables models to accurately interpret human intent and generate controllable outputs that align with design goals in collaborative content creation. This direction is especially relevant in procedural content generation via reinforcement learning (PCGRL), which is intended to serve as a tool for human designers. However, existing systems often fall short of exhibiting human-centered behavior, limiting the practical utility of AI-driven generation tools in real-world design workflows. In this paper, we propose VIPCGRL (Vision-Instruction PCGRL), a novel deep reinforcement learning framework that incorporates three modalities-text, level, and sketches-to extend control modality and enhance human-likeness. We introduce a shared embedding space trained via quadruple contrastive learning across modalities and human-AI styles, and align the policy using an auxiliary reward based on embedding similarity. Experimental results show that VIPCGRL outperforms existing baselines in human-likeness, as validated by both quantitative metrics and human evaluations. The code and dataset will be available upon publication. |
| title | Human-Aligned Procedural Level Generation Reinforcement Learning via Text-Level-Sketch Shared Representation |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2508.09860 |