Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-Supervised Pre-Training
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908687515254784 |
|---|---|
| author | You, Hong-Jie Shao, Jie-Jing Yang, Xiao-Wen Jia, Lin-Han Guo, Lan-Zhe Li, Yu-Feng |
| author_facet | You, Hong-Jie Shao, Jie-Jing Yang, Xiao-Wen Jia, Lin-Han Guo, Lan-Zhe Li, Yu-Feng |
| contents | Existing methods for expressive music performance rendering rely on supervised learning over small labeled datasets, which limits scaling of both data volume and model size, despite the availability of vast unlabeled music, as in vision and language. To address this gap, we introduce Pianist Transformer, with four key contributions: 1) a unified Musical Instrument Digital Interface (MIDI) data representation for learning the shared principles of musical structure and expression without explicit annotation; 2) an efficient asymmetric architecture, enabling longer contexts and faster inference without sacrificing rendering quality; 3) a self-supervised pre-training pipeline with 10B tokens and 135M-parameter model, unlocking data and model scaling advantages for expressive performance rendering; 4) a state-of-the-art performance model, which achieves strong objective metrics and human-level subjective ratings. Overall, Pianist Transformer establishes a scalable path toward human-like performance synthesis in the music domain. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_02652 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-Supervised Pre-Training You, Hong-Jie Shao, Jie-Jing Yang, Xiao-Wen Jia, Lin-Han Guo, Lan-Zhe Li, Yu-Feng Sound Artificial Intelligence Multimedia Existing methods for expressive music performance rendering rely on supervised learning over small labeled datasets, which limits scaling of both data volume and model size, despite the availability of vast unlabeled music, as in vision and language. To address this gap, we introduce Pianist Transformer, with four key contributions: 1) a unified Musical Instrument Digital Interface (MIDI) data representation for learning the shared principles of musical structure and expression without explicit annotation; 2) an efficient asymmetric architecture, enabling longer contexts and faster inference without sacrificing rendering quality; 3) a self-supervised pre-training pipeline with 10B tokens and 135M-parameter model, unlocking data and model scaling advantages for expressive performance rendering; 4) a state-of-the-art performance model, which achieves strong objective metrics and human-level subjective ratings. Overall, Pianist Transformer establishes a scalable path toward human-like performance synthesis in the music domain. |
| title | Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-Supervised Pre-Training |
| topic | Sound Artificial Intelligence Multimedia |
| url | https://arxiv.org/abs/2512.02652 |