NeoLightning: A Modern Reimagination of Gesture-Based Sound Design
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910947166126080 |
|---|---|
| author | Kim, Yonghyun Park, Sangheon Parker, Marcus Seu, Donghoon Smith, Alexandria |
| author_facet | Kim, Yonghyun Park, Sangheon Parker, Marcus Seu, Donghoon Smith, Alexandria |
| contents | This paper introduces NeoLightning, a modern reinterpretation of the Buchla Lightning. NeoLightning preserves the innovative spirit of Don Buchla's "Buchla Lightning" (introduced in the 1990s) while making its gesture-based interaction accessible to contemporary users. While the original Buchla Lightning and many other historical instruments were groundbreaking in their time, they are now largely unsupported, limiting user interaction to indirect experiences. To address this, NeoLightning leverages MediaPipe for deep learning-based gesture recognition and employs Max/MSP and Processing for real-time multimedia processing. The redesigned system offers precise, low-latency gesture recognition and immersive 3D interaction. By merging the creative spirit of the original Lightning with modern advancements, NeoLightning redefines gesture-based musical interaction, expanding possibilities for expressive performance and interactive sound design. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_10686 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NeoLightning: A Modern Reimagination of Gesture-Based Sound Design Kim, Yonghyun Park, Sangheon Parker, Marcus Seu, Donghoon Smith, Alexandria Human-Computer Interaction Multimedia Sound Audio and Speech Processing This paper introduces NeoLightning, a modern reinterpretation of the Buchla Lightning. NeoLightning preserves the innovative spirit of Don Buchla's "Buchla Lightning" (introduced in the 1990s) while making its gesture-based interaction accessible to contemporary users. While the original Buchla Lightning and many other historical instruments were groundbreaking in their time, they are now largely unsupported, limiting user interaction to indirect experiences. To address this, NeoLightning leverages MediaPipe for deep learning-based gesture recognition and employs Max/MSP and Processing for real-time multimedia processing. The redesigned system offers precise, low-latency gesture recognition and immersive 3D interaction. By merging the creative spirit of the original Lightning with modern advancements, NeoLightning redefines gesture-based musical interaction, expanding possibilities for expressive performance and interactive sound design. |
| title | NeoLightning: A Modern Reimagination of Gesture-Based Sound Design |
| topic | Human-Computer Interaction Multimedia Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2505.10686 |