Event2Audio: Event-Based Optical Vibration Sensing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908773750145024 |
|---|---|
| author | Cai, Mingxuan Galor, Dekel Kohli, Amit Pal Singh Yates, Jacob L. Waller, Laura |
| author_facet | Cai, Mingxuan Galor, Dekel Kohli, Amit Pal Singh Yates, Jacob L. Waller, Laura |
| contents | Small vibrations observed in video can unveil information beyond what is visual, such as sound and material properties. It is possible to passively record these vibrations when they are visually perceptible, or actively amplify their visual contribution with a laser beam when they are not perceptible. In this paper, we improve upon the active sensing approach by leveraging event-based cameras, which are designed to efficiently capture fast motion. We demonstrate our method experimentally by recovering audio from vibrations, even for multiple simultaneous sources, and in the presence of environmental distortions. Our approach matches the state-of-the-art reconstruction quality at much faster speeds, approaching real-time processing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_03273 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Event2Audio: Event-Based Optical Vibration Sensing Cai, Mingxuan Galor, Dekel Kohli, Amit Pal Singh Yates, Jacob L. Waller, Laura Image and Video Processing Computer Vision and Pattern Recognition Audio and Speech Processing Small vibrations observed in video can unveil information beyond what is visual, such as sound and material properties. It is possible to passively record these vibrations when they are visually perceptible, or actively amplify their visual contribution with a laser beam when they are not perceptible. In this paper, we improve upon the active sensing approach by leveraging event-based cameras, which are designed to efficiently capture fast motion. We demonstrate our method experimentally by recovering audio from vibrations, even for multiple simultaneous sources, and in the presence of environmental distortions. Our approach matches the state-of-the-art reconstruction quality at much faster speeds, approaching real-time processing. |
| title | Event2Audio: Event-Based Optical Vibration Sensing |
| topic | Image and Video Processing Computer Vision and Pattern Recognition Audio and Speech Processing |
| url | https://arxiv.org/abs/2507.03273 |