A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866907984082239488 |
|---|---|
| author | Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick |
| author_facet | Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick |
| contents | This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's latent space. To demonstrate how this mapping strategy can turn high-dimensional sensor data into control mechanisms of a deep generative model, we present a proof-of-concept system that uses visual sketches to control an audio synthesis model. We draw on emerging discourses in XAIxArts to discuss how this approach can contribute to XAI in artistic and creative contexts, we also discuss its current limitations and propose future research directions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_04379 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials Zheng, Shuoyang Sedó, Anna Xambó Bryan-Kinns, Nick Sound Human-Computer Interaction Audio and Speech Processing This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's latent space. To demonstrate how this mapping strategy can turn high-dimensional sensor data into control mechanisms of a deep generative model, we present a proof-of-concept system that uses visual sketches to control an audio synthesis model. We draw on emerging discourses in XAIxArts to discuss how this approach can contribute to XAI in artistic and creative contexts, we also discuss its current limitations and propose future research directions. |
| title | A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials |
| topic | Sound Human-Computer Interaction Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.04379 |