Saved in:
Bibliographic Details
Main Authors: Ahn, Jaehoon, Jung, Moon-Ryul
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.14391
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917020759490560
author Ahn, Jaehoon
Jung, Moon-Ryul
author_facet Ahn, Jaehoon
Jung, Moon-Ryul
contents Recent beat and downbeat tracking models (e.g., RNNs, TCNs, Transformers) output frame-level activations. We propose reframing this task as object detection, where beats and downbeats are modeled as temporal "objects." Adapting the FCOS detector from computer vision to 1D audio, we replace its original backbone with WaveBeat's temporal feature extractor and add a Feature Pyramid Network to capture multi-scale temporal patterns. The model predicts overlapping beat/downbeat intervals with confidence scores, followed by non-maximum suppression (NMS) to select final predictions. This NMS step serves a similar role to DBNs in traditional trackers, but is simpler and less heuristic. Evaluated on standard music datasets, our approach achieves competitive results, showing that object detection techniques can effectively model musical beats with minimal adaptation.
format Preprint
id arxiv_https___arxiv_org_abs_2510_14391
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Beat Tracking as Object Detection
Ahn, Jaehoon
Jung, Moon-Ryul
Sound
Artificial Intelligence
Machine Learning
Recent beat and downbeat tracking models (e.g., RNNs, TCNs, Transformers) output frame-level activations. We propose reframing this task as object detection, where beats and downbeats are modeled as temporal "objects." Adapting the FCOS detector from computer vision to 1D audio, we replace its original backbone with WaveBeat's temporal feature extractor and add a Feature Pyramid Network to capture multi-scale temporal patterns. The model predicts overlapping beat/downbeat intervals with confidence scores, followed by non-maximum suppression (NMS) to select final predictions. This NMS step serves a similar role to DBNs in traditional trackers, but is simpler and less heuristic. Evaluated on standard music datasets, our approach achieves competitive results, showing that object detection techniques can effectively model musical beats with minimal adaptation.
title Beat Tracking as Object Detection
topic Sound
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2510.14391