The FlEye camera: Sampling the joint distribution of natural scenes and motion
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910766856142848 |
|---|---|
| author | Edelson, Charles J. Smith, Paul Setayeshgar, Sima Bialek, William van Steveninck, Rob R. de Ruyter |
| author_facet | Edelson, Charles J. Smith, Paul Setayeshgar, Sima Bialek, William van Steveninck, Rob R. de Ruyter |
| contents | To make efficient use of limited physical resources, the brain must match its coding and computational strategies to the statistical structure of input signals. An attractive testing ground for these principles is the problem of motion estimation in the fly visual system: we understand the optics of the compound eye, have a quantitative description of input signals and noise from the retina, and can record from output neurons that encode estimates of different velocity components. Furthermore, recent work provides a nearly complete wiring diagram of the intervening circuitry. What is missing is a characterization of the visual signals and motions that flies encounter in a natural context. We attack this directly with the development of a specialized camera that matches the high temporal resolution, optical properties, and spectral sensitivity of the fly's eye; inertial motion sensors provide ground truth about rotations and translations through the world. We describe the design, construction, and performance characteristics of this FlEye camera. To illustrate the opportunities created by this instrument we use data on movies and motion to construct optimal local motion estimators that can be compared with the responses of the fly's motion sensitive neurons. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_21081 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The FlEye camera: Sampling the joint distribution of natural scenes and motion Edelson, Charles J. Smith, Paul Setayeshgar, Sima Bialek, William van Steveninck, Rob R. de Ruyter Neurons and Cognition Disordered Systems and Neural Networks To make efficient use of limited physical resources, the brain must match its coding and computational strategies to the statistical structure of input signals. An attractive testing ground for these principles is the problem of motion estimation in the fly visual system: we understand the optics of the compound eye, have a quantitative description of input signals and noise from the retina, and can record from output neurons that encode estimates of different velocity components. Furthermore, recent work provides a nearly complete wiring diagram of the intervening circuitry. What is missing is a characterization of the visual signals and motions that flies encounter in a natural context. We attack this directly with the development of a specialized camera that matches the high temporal resolution, optical properties, and spectral sensitivity of the fly's eye; inertial motion sensors provide ground truth about rotations and translations through the world. We describe the design, construction, and performance characteristics of this FlEye camera. To illustrate the opportunities created by this instrument we use data on movies and motion to construct optimal local motion estimators that can be compared with the responses of the fly's motion sensitive neurons. |
| title | The FlEye camera: Sampling the joint distribution of natural scenes and motion |
| topic | Neurons and Cognition Disordered Systems and Neural Networks |
| url | https://arxiv.org/abs/2412.21081 |