Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Study

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cao, Yining, Huang, Yiyi, Truong, Anh, Shin, Hijung Valentina, Xia, Haijun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917946940456960
author Cao, Yining
Huang, Yiyi
Truong, Anh
Shin, Hijung Valentina
Xia, Haijun
author_facet Cao, Yining
Huang, Yiyi
Truong, Anh
Shin, Hijung Valentina
Xia, Haijun
contents It has been increasingly recognized that effective human-AI co-creation requires more than prompts and results, but an environment with empowering structures that facilitate exploration, planning, iteration, as well as control and inspection of AI generation. Yet, a concrete design approach to such an environment has not been established. Our literature analysis highlights that compositional structures-which organize and visualize individual elements into meaningful wholes-are highly effective in granting creators control over the essential aspects of their content. However, efficiently aggregating and connecting these structures to support the full creation process remains challenging. Therefore, we propose a design approach of leveraging compositional structures as the substrates and infusing AI within and across these structures to enable a controlled and fluid creation process. We evaluate this approach through a case study of developing a video co-creation environment using this approach. User evaluation shows that such an environment allowed users to stay oriented in their creation activity, remain aware and in control of AI's generation, and enable flexible human-AI collaborative workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2503_04103
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Study
Cao, Yining
Huang, Yiyi
Truong, Anh
Shin, Hijung Valentina
Xia, Haijun
Human-Computer Interaction
It has been increasingly recognized that effective human-AI co-creation requires more than prompts and results, but an environment with empowering structures that facilitate exploration, planning, iteration, as well as control and inspection of AI generation. Yet, a concrete design approach to such an environment has not been established. Our literature analysis highlights that compositional structures-which organize and visualize individual elements into meaningful wholes-are highly effective in granting creators control over the essential aspects of their content. However, efficiently aggregating and connecting these structures to support the full creation process remains challenging. Therefore, we propose a design approach of leveraging compositional structures as the substrates and infusing AI within and across these structures to enable a controlled and fluid creation process. We evaluate this approach through a case study of developing a video co-creation environment using this approach. User evaluation shows that such an environment allowed users to stay oriented in their creation activity, remain aware and in control of AI's generation, and enable flexible human-AI collaborative workflows.
title Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Study
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.04103