SoundScape: A Human-AI Co-Creation System Making Your Memories Heard

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhong, Chongjun, Yu, Jiaxing, Cao, Yingping, Wu, Songruoyao, Wu, Wenqi, Zhang, Kejun
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914969521487872
author Zhong, Chongjun
Yu, Jiaxing
Cao, Yingping
Wu, Songruoyao
Wu, Wenqi
Zhang, Kejun
author_facet Zhong, Chongjun
Yu, Jiaxing
Cao, Yingping
Wu, Songruoyao
Wu, Wenqi
Zhang, Kejun
contents Sound plays a significant role in human memory, yet it is often overlooked by mainstream life-recording methods. Most current UGC (User-Generated Content) creation tools emphasize visual content while lacking user-friendly sound design features. This paper introduces SoundScape, a human-AI co-creation system that allows users to easily create sound memories on mobile devices through innovative interaction. By integrating sound effects and music with visual scenes, SoundScape encourages users to enrich their creations with immersive sound elements, enhancing the atmosphere of their works. To support public creation, SoundScape incorporates a conversational agent and AI music generation technology. User studies indicate that our approach is effective for sound memory creation, with SoundScape outperforming existing tools in terms of user experience and the perceived quality of produced works.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08136
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SoundScape: A Human-AI Co-Creation System Making Your Memories Heard
Zhong, Chongjun
Yu, Jiaxing
Cao, Yingping
Wu, Songruoyao
Wu, Wenqi
Zhang, Kejun
Human-Computer Interaction
Sound plays a significant role in human memory, yet it is often overlooked by mainstream life-recording methods. Most current UGC (User-Generated Content) creation tools emphasize visual content while lacking user-friendly sound design features. This paper introduces SoundScape, a human-AI co-creation system that allows users to easily create sound memories on mobile devices through innovative interaction. By integrating sound effects and music with visual scenes, SoundScape encourages users to enrich their creations with immersive sound elements, enhancing the atmosphere of their works. To support public creation, SoundScape incorporates a conversational agent and AI music generation technology. User studies indicate that our approach is effective for sound memory creation, with SoundScape outperforming existing tools in terms of user experience and the perceived quality of produced works.
title SoundScape: A Human-AI Co-Creation System Making Your Memories Heard
topic Human-Computer Interaction
url https://arxiv.org/abs/2410.08136