Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916956593979392 |
|---|---|
| author | Park, Junhyung Kim, Yonghyun Bae, Joonhyung Kim, Kirak Kwon, Taegyun Lerch, Alexander Nam, Juhan |
| author_facet | Park, Junhyung Kim, Yonghyun Bae, Joonhyung Kim, Kirak Kwon, Taegyun Lerch, Alexander Nam, Juhan |
| contents | Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laborious process of acquiring large-scale multimodal data remains a significant bottleneck, hindering further progress in this field. To overcome this barrier, we present an integrated web toolkit comprising two graphical user interfaces (GUIs): (i) PiaRec, which supports the synchronized acquisition of audio, video, MIDI, and performance metadata. (ii) ASDF, which enables the efficient annotation of performer fingering from the visual data. Collectively, this system can streamline the acquisition of multimodal piano performance datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_15222 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation Park, Junhyung Kim, Yonghyun Bae, Joonhyung Kim, Kirak Kwon, Taegyun Lerch, Alexander Nam, Juhan Sound Computer Vision and Pattern Recognition Multimedia Audio and Speech Processing Image and Video Processing Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laborious process of acquiring large-scale multimodal data remains a significant bottleneck, hindering further progress in this field. To overcome this barrier, we present an integrated web toolkit comprising two graphical user interfaces (GUIs): (i) PiaRec, which supports the synchronized acquisition of audio, video, MIDI, and performance metadata. (ii) ASDF, which enables the efficient annotation of performer fingering from the visual data. Collectively, this system can streamline the acquisition of multimodal piano performance datasets. |
| title | Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation |
| topic | Sound Computer Vision and Pattern Recognition Multimedia Audio and Speech Processing Image and Video Processing |
| url | https://arxiv.org/abs/2509.15222 |