Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.09790 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908526674182144 |
|---|---|
| author | Ru, Ganghui Wang, Jieying Zhao, Jiahao Wu, Yulun Yu, Yi Jiang, Nannan Wang, Wei Li, Wei |
| author_facet | Ru, Ganghui Wang, Jieying Zhao, Jiahao Wu, Yulun Yu, Yi Jiang, Nannan Wang, Wei Li, Wei |
| contents | Beat tracking is a widely researched topic in music information retrieval. However, current beat tracking methods face challenges due to the scarcity of labeled data, which limits their ability to generalize across diverse musical styles and accurately capture complex rhythmic structures. To overcome these challenges, we propose a novel beat tracking paradigm BeatFM, which introduces a pre-trained music foundation model and leverages its rich semantic knowledge to improve beat tracking performance. Pre-training on diverse music datasets endows music foundation models with a robust understanding of music, thereby effectively addressing these challenges. To further adapt it for beat tracking, we design a plug-and-play multi-dimensional semantic aggregation module, which is composed of three parallel sub-modules, each focusing on semantic aggregation in the temporal, frequency, and channel domains, respectively. Extensive experiments demonstrate that our method achieves state-of-the-art performance in beat and downbeat tracking across multiple benchmark datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_09790 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | BeatFM: Improving Beat Tracking with Pre-trained Music Foundation Model Ru, Ganghui Wang, Jieying Zhao, Jiahao Wu, Yulun Yu, Yi Jiang, Nannan Wang, Wei Li, Wei Sound Beat tracking is a widely researched topic in music information retrieval. However, current beat tracking methods face challenges due to the scarcity of labeled data, which limits their ability to generalize across diverse musical styles and accurately capture complex rhythmic structures. To overcome these challenges, we propose a novel beat tracking paradigm BeatFM, which introduces a pre-trained music foundation model and leverages its rich semantic knowledge to improve beat tracking performance. Pre-training on diverse music datasets endows music foundation models with a robust understanding of music, thereby effectively addressing these challenges. To further adapt it for beat tracking, we design a plug-and-play multi-dimensional semantic aggregation module, which is composed of three parallel sub-modules, each focusing on semantic aggregation in the temporal, frequency, and channel domains, respectively. Extensive experiments demonstrate that our method achieves state-of-the-art performance in beat and downbeat tracking across multiple benchmark datasets. |
| title | BeatFM: Improving Beat Tracking with Pre-trained Music Foundation Model |
| topic | Sound |
| url | https://arxiv.org/abs/2508.09790 |