Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.23008 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910791560593408 |
|---|---|
| author | Choi, Ryuhaerang Chatterjee, Soumyajit Spathis, Dimitris Lee, Sung-Ju Kawsar, Fahim Malekzadeh, Mohammad |
| author_facet | Choi, Ryuhaerang Chatterjee, Soumyajit Spathis, Dimitris Lee, Sung-Ju Kawsar, Fahim Malekzadeh, Mohammad |
| contents | Developing new machine learning applications often requires the collection of new datasets. However, existing datasets may already contain relevant information to train models for new purposes. We propose SoundCollage: a framework to discover new classes within audio datasets by incorporating (1) an audio pre-processing pipeline to decompose different sounds in audio samples, and (2) an automated model-based annotation mechanism to identify the discovered classes. Furthermore, we introduce the clarity measure to assess the coherence of the discovered classes for better training new downstream applications. Our evaluations show that the accuracy of downstream audio classifiers within discovered class samples and a held-out dataset improves over the baseline by up to 34.7% and 4.5%, respectively. These results highlight the potential of SoundCollage in making datasets reusable by labeling with newly discovered classes. To encourage further research in this area, we open-source our code at https://github.com/nokia-bell-labs/audio-class-discovery. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23008 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SoundCollage: Automated Discovery of New Classes in Audio Datasets Choi, Ryuhaerang Chatterjee, Soumyajit Spathis, Dimitris Lee, Sung-Ju Kawsar, Fahim Malekzadeh, Mohammad Sound Audio and Speech Processing Developing new machine learning applications often requires the collection of new datasets. However, existing datasets may already contain relevant information to train models for new purposes. We propose SoundCollage: a framework to discover new classes within audio datasets by incorporating (1) an audio pre-processing pipeline to decompose different sounds in audio samples, and (2) an automated model-based annotation mechanism to identify the discovered classes. Furthermore, we introduce the clarity measure to assess the coherence of the discovered classes for better training new downstream applications. Our evaluations show that the accuracy of downstream audio classifiers within discovered class samples and a held-out dataset improves over the baseline by up to 34.7% and 4.5%, respectively. These results highlight the potential of SoundCollage in making datasets reusable by labeling with newly discovered classes. To encourage further research in this area, we open-source our code at https://github.com/nokia-bell-labs/audio-class-discovery. |
| title | SoundCollage: Automated Discovery of New Classes in Audio Datasets |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2410.23008 |