SpikeStereoNet: A Brain-Inspired Framework for Stereo Depth Estimation from Spike Streams
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910101609119744 |
|---|---|
| author | Gao, Zhuoheng Li, Yihao Zhang, Jiyao Zhao, Rui Wu, Tong Tang, Hao Yu, Zhaofei Dong, Hao Chen, Guozhang Huang, Tiejun |
| author_facet | Gao, Zhuoheng Li, Yihao Zhang, Jiyao Zhao, Rui Wu, Tong Tang, Hao Yu, Zhaofei Dong, Hao Chen, Guozhang Huang, Tiejun |
| contents | Conventional frame-based cameras often struggle with stereo depth estimation in rapidly changing scenes. In contrast, bio-inspired spike cameras emit asynchronous events at microsecond-level resolution, providing an alternative sensing modality. However, existing methods lack specialized stereo algorithms and benchmarks tailored to the spike data. To address this gap, we propose SpikeStereoNet, a brain-inspired framework and the first to estimate stereo depth directly from raw spike streams. The model fuses raw spike streams from two viewpoints and iteratively refines depth estimation through a recurrent spiking neural network (RSNN) update module. To benchmark our approach, we introduce a large-scale synthetic spike stream dataset and a real-world stereo spike dataset with dense depth annotations. SpikeStereoNet outperforms existing methods on both datasets by leveraging spike streams' ability to capture subtle edges and intensity shifts in challenging regions such as textureless surfaces and extreme lighting conditions. Furthermore, our framework exhibits strong data efficiency, maintaining high accuracy even with substantially reduced training data. The source code and datasets will be publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_19487 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SpikeStereoNet: A Brain-Inspired Framework for Stereo Depth Estimation from Spike Streams Gao, Zhuoheng Li, Yihao Zhang, Jiyao Zhao, Rui Wu, Tong Tang, Hao Yu, Zhaofei Dong, Hao Chen, Guozhang Huang, Tiejun Computer Vision and Pattern Recognition Conventional frame-based cameras often struggle with stereo depth estimation in rapidly changing scenes. In contrast, bio-inspired spike cameras emit asynchronous events at microsecond-level resolution, providing an alternative sensing modality. However, existing methods lack specialized stereo algorithms and benchmarks tailored to the spike data. To address this gap, we propose SpikeStereoNet, a brain-inspired framework and the first to estimate stereo depth directly from raw spike streams. The model fuses raw spike streams from two viewpoints and iteratively refines depth estimation through a recurrent spiking neural network (RSNN) update module. To benchmark our approach, we introduce a large-scale synthetic spike stream dataset and a real-world stereo spike dataset with dense depth annotations. SpikeStereoNet outperforms existing methods on both datasets by leveraging spike streams' ability to capture subtle edges and intensity shifts in challenging regions such as textureless surfaces and extreme lighting conditions. Furthermore, our framework exhibits strong data efficiency, maintaining high accuracy even with substantially reduced training data. The source code and datasets will be publicly available. |
| title | SpikeStereoNet: A Brain-Inspired Framework for Stereo Depth Estimation from Spike Streams |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.19487 |