Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911987409092608 |
|---|---|
| author | Allison, Jesse Farrar, Drew Nash, Treya Román, Carlos Weeks, Morgan Ju, Fiona Xue |
| author_facet | Allison, Jesse Farrar, Drew Nash, Treya Román, Carlos Weeks, Morgan Ju, Fiona Xue |
| contents | This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative potential of these tools and have sought to understand and evaluate them from perspectives of prompt creation, control, usability, understandability, explainability of the AI process, and overall aesthetic effectiveness of the results. One of the challenges we have identified that is not explicitly addressed by these tools is the inherent semantic gap in using text-based tools to describe something as abstract as music. Other gaps include explainability vs. useability, and user control and input vs. the human creative process. The aim of this pictorial is to raise questions for discussion and make a few general suggestions on the kinds of improvements we would like to see in generative AI music tools. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_07224 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music Allison, Jesse Farrar, Drew Nash, Treya Román, Carlos Weeks, Morgan Ju, Fiona Xue Sound Artificial Intelligence Audio and Speech Processing This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative potential of these tools and have sought to understand and evaluate them from perspectives of prompt creation, control, usability, understandability, explainability of the AI process, and overall aesthetic effectiveness of the results. One of the challenges we have identified that is not explicitly addressed by these tools is the inherent semantic gap in using text-based tools to describe something as abstract as music. Other gaps include explainability vs. useability, and user control and input vs. the human creative process. The aim of this pictorial is to raise questions for discussion and make a few general suggestions on the kinds of improvements we would like to see in generative AI music tools. |
| title | Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music |
| topic | Sound Artificial Intelligence Audio and Speech Processing |
| url | https://arxiv.org/abs/2408.07224 |