ChatGPT4PCG 2 Competition: Prompt Engineering for Science Birds Level Generation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914702291894272 |
|---|---|
| author | Taveekitworachai, Pittawat Abdullah, Febri Dewantoro, Mury F. Xia, Yi Suntichaikul, Pratch Thawonmas, Ruck Togelius, Julian Renz, Jochen |
| author_facet | Taveekitworachai, Pittawat Abdullah, Febri Dewantoro, Mury F. Xia, Yi Suntichaikul, Pratch Thawonmas, Ruck Togelius, Julian Renz, Jochen |
| contents | This paper presents the second ChatGPT4PCG competition at the 2024 IEEE Conference on Games. In this edition of the competition, we follow the first edition, but make several improvements and changes. We introduce a new evaluation metric along with allowing a more flexible format for participants' submissions and making several improvements to the evaluation pipeline. Continuing from the first edition, we aim to foster and explore the realm of prompt engineering (PE) for procedural content generation (PCG). While the first competition saw success, it was hindered by various limitations; we aim to mitigate these limitations in this edition. We introduce diversity as a new metric to discourage submissions aimed at producing repetitive structures. Furthermore, we allow submission of a Python program instead of a prompt text file for greater flexibility in implementing advanced PE approaches, which may require control flow, including conditions and iterations. We also make several improvements to the evaluation pipeline with a better classifier for similarity evaluation and better-performing function signatures. We thoroughly evaluate the effectiveness of the new metric and the improved classifier. Additionally, we perform an ablation study to select a function signature to instruct ChatGPT for level generation. Finally, we provide implementation examples of various PE techniques in Python and evaluate their preliminary performance. We hope this competition serves as a resource and platform for learning about PE and PCG in general. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_02610 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ChatGPT4PCG 2 Competition: Prompt Engineering for Science Birds Level Generation Taveekitworachai, Pittawat Abdullah, Febri Dewantoro, Mury F. Xia, Yi Suntichaikul, Pratch Thawonmas, Ruck Togelius, Julian Renz, Jochen Artificial Intelligence I.2.7; I.2.8 This paper presents the second ChatGPT4PCG competition at the 2024 IEEE Conference on Games. In this edition of the competition, we follow the first edition, but make several improvements and changes. We introduce a new evaluation metric along with allowing a more flexible format for participants' submissions and making several improvements to the evaluation pipeline. Continuing from the first edition, we aim to foster and explore the realm of prompt engineering (PE) for procedural content generation (PCG). While the first competition saw success, it was hindered by various limitations; we aim to mitigate these limitations in this edition. We introduce diversity as a new metric to discourage submissions aimed at producing repetitive structures. Furthermore, we allow submission of a Python program instead of a prompt text file for greater flexibility in implementing advanced PE approaches, which may require control flow, including conditions and iterations. We also make several improvements to the evaluation pipeline with a better classifier for similarity evaluation and better-performing function signatures. We thoroughly evaluate the effectiveness of the new metric and the improved classifier. Additionally, we perform an ablation study to select a function signature to instruct ChatGPT for level generation. Finally, we provide implementation examples of various PE techniques in Python and evaluate their preliminary performance. We hope this competition serves as a resource and platform for learning about PE and PCG in general. |
| title | ChatGPT4PCG 2 Competition: Prompt Engineering for Science Birds Level Generation |
| topic | Artificial Intelligence I.2.7; I.2.8 |
| url | https://arxiv.org/abs/2403.02610 |