Computer Audition: From Task-Specific Machine Learning to Foundation Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912503315824640 |
|---|---|
| author | Triantafyllopoulos, Andreas Tsangko, Iosif Gebhard, Alexander Mesaros, Annamaria Virtanen, Tuomas Schuller, Björn |
| author_facet | Triantafyllopoulos, Andreas Tsangko, Iosif Gebhard, Alexander Mesaros, Annamaria Virtanen, Tuomas Schuller, Björn |
| contents | Foundation models (FMs) are increasingly spearheading recent advances on a variety of tasks that fall under the purview of computer audition -- the use of machines to understand sounds. They feature several advantages over traditional pipelines: among others, the ability to consolidate multiple tasks in a single model, the option to leverage knowledge from other modalities, and the readily-available interaction with human users. Naturally, these promises have created substantial excitement in the audio community, and have led to a wave of early attempts to build new, general-purpose foundation models for audio. In the present contribution, we give an overview of computational audio analysis as it transitions from traditional pipelines towards auditory foundation models. Our work highlights the key operating principles that underpin those models, and showcases how they can accommodate multiple tasks that the audio community previously tackled separately. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_15672 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Computer Audition: From Task-Specific Machine Learning to Foundation Models Triantafyllopoulos, Andreas Tsangko, Iosif Gebhard, Alexander Mesaros, Annamaria Virtanen, Tuomas Schuller, Björn Sound Audio and Speech Processing Foundation models (FMs) are increasingly spearheading recent advances on a variety of tasks that fall under the purview of computer audition -- the use of machines to understand sounds. They feature several advantages over traditional pipelines: among others, the ability to consolidate multiple tasks in a single model, the option to leverage knowledge from other modalities, and the readily-available interaction with human users. Naturally, these promises have created substantial excitement in the audio community, and have led to a wave of early attempts to build new, general-purpose foundation models for audio. In the present contribution, we give an overview of computational audio analysis as it transitions from traditional pipelines towards auditory foundation models. Our work highlights the key operating principles that underpin those models, and showcases how they can accommodate multiple tasks that the audio community previously tackled separately. |
| title | Computer Audition: From Task-Specific Machine Learning to Foundation Models |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.15672 |