Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.05773 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917819131625472 |
|---|---|
| author | Greer, Ross Fleig, Laura Dubnov, Shlomo |
| author_facet | Greer, Ross Fleig, Laura Dubnov, Shlomo |
| contents | This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a "Guided Harmony" musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_05773 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera Greer, Ross Fleig, Laura Dubnov, Shlomo Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition Robotics This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a "Guided Harmony" musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings. |
| title | Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera |
| topic | Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2409.05773 |