A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866907984082239488 |
|---|---|
| author | Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick |
| author_facet | Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick |
| contents | This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's latent space. To demonstrate how this mapping strategy can turn high-dimensional sensor data into control mechanisms of a deep generative model, we present a proof-of-concept system that uses visual sketches to control an audio synthesis model. We draw on emerging discourses in XAIxArts to discuss how this approach can contribute to XAI in artistic and creative contexts, we also discuss its current limitations and propose future research directions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_04379 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick Sound Human-Computer Interaction Audio and Speech Processing This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's latent space. To demonstrate how this mapping strategy can turn high-dimensional sensor data into control mechanisms of a deep generative model, we present a proof-of-concept system that uses visual sketches to control an audio synthesis model. We draw on emerging discourses in XAIxArts to discuss how this approach can contribute to XAI in artistic and creative contexts, we also discuss its current limitations and propose future research directions. |
| title | A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials |
| topic | Sound Human-Computer Interaction Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.04379 |