Soundify: Matching Sound Effects to Video
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2021
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929399160373248 |
|---|---|
| author | Lin, David Chuan-En Germanidis, Anastasis Valenzuela, Cristóbal Shi, Yining Martelaro, Nikolas |
| author_facet | Lin, David Chuan-En Germanidis, Anastasis Valenzuela, Cristóbal Shi, Yining Martelaro, Nikolas |
| contents | In the art of video editing, sound helps add character to an object and immerse the viewer within a space. Through formative interviews with professional editors (N=10), we found that the task of adding sounds to video can be challenging. This paper presents Soundify, a system that assists editors in matching sounds to video. Given a video, Soundify identifies matching sounds, synchronizes the sounds to the video, and dynamically adjusts panning and volume to create spatial audio. In a human evaluation study (N=889), we show that Soundify is capable of matching sounds to video out-of-the-box for a diverse range of audio categories. In a within-subjects expert study (N=12), we demonstrate the usefulness of Soundify in helping video editors match sounds to video with lighter workload, reduced task completion time, and improved usability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2112_09726 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Soundify: Matching Sound Effects to Video Lin, David Chuan-En Germanidis, Anastasis Valenzuela, Cristóbal Shi, Yining Martelaro, Nikolas Sound Computer Vision and Pattern Recognition Human-Computer Interaction Multimedia Audio and Speech Processing In the art of video editing, sound helps add character to an object and immerse the viewer within a space. Through formative interviews with professional editors (N=10), we found that the task of adding sounds to video can be challenging. This paper presents Soundify, a system that assists editors in matching sounds to video. Given a video, Soundify identifies matching sounds, synchronizes the sounds to the video, and dynamically adjusts panning and volume to create spatial audio. In a human evaluation study (N=889), we show that Soundify is capable of matching sounds to video out-of-the-box for a diverse range of audio categories. In a within-subjects expert study (N=12), we demonstrate the usefulness of Soundify in helping video editors match sounds to video with lighter workload, reduced task completion time, and improved usability. |
| title | Soundify: Matching Sound Effects to Video |
| topic | Sound Computer Vision and Pattern Recognition Human-Computer Interaction Multimedia Audio and Speech Processing |
| url | https://arxiv.org/abs/2112.09726 |