Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tiwary, Kushagra, Young, Aaron, Tasneem, Zaid, Klinghoffer, Tzofi, Dave, Akshat, Poggio, Tomaso, Nilsson, Dan-Eric, Cheung, Brian, Raskar, Ramesh
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2501.15001
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910823950057472
author Tiwary, Kushagra
Young, Aaron
Tasneem, Zaid
Klinghoffer, Tzofi
Dave, Akshat
Poggio, Tomaso
Nilsson, Dan-Eric
Cheung, Brian
Raskar, Ramesh
author_facet Tiwary, Kushagra
Young, Aaron
Tasneem, Zaid
Klinghoffer, Tzofi
Dave, Akshat
Poggio, Tomaso
Nilsson, Dan-Eric
Cheung, Brian
Raskar, Ramesh
contents Vision systems in nature show remarkable diversity, from simple light-sensitive patches to complex camera eyes with lenses. While natural selection has produced these eyes through countless mutations over millions of years, they represent just one set of realized evolutionary paths. Testing hypotheses about how environmental pressures shaped eye evolution remains challenging since we cannot experimentally isolate individual factors. Computational evolution offers a way to systematically explore alternative trajectories. Here we show how environmental demands drive three fundamental aspects of visual evolution through an artificial evolution framework that co-evolves both physical eye structure and neural processing in embodied agents. First, we demonstrate computational evidence that task specific selection drives bifurcation in eye evolution - orientation tasks like navigation in a maze leads to distributed compound-type eyes while an object discrimination task leads to the emergence of high-acuity camera-type eyes. Second, we reveal how optical innovations like lenses naturally emerge to resolve fundamental tradeoffs between light collection and spatial precision. Third, we uncover systematic scaling laws between visual acuity and neural processing, showing how task complexity drives coordinated evolution of sensory and computational capabilities. Our work introduces a novel paradigm that illuminates evolutionary principles shaping vision by creating targeted single-player games where embodied agents must simultaneously evolve visual systems and learn complex behaviors. Through our unified genetic encoding framework, these embodied agents serve as next-generation hypothesis testing machines while providing a foundation for designing manufacturable bio-inspired vision systems. Website: http://eyes.mit.edu/
format Preprint
id arxiv_https___arxiv_org_abs_2501_15001
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle What if Eye...? Computationally Recreating Vision Evolution
Tiwary, Kushagra
Young, Aaron
Tasneem, Zaid
Klinghoffer, Tzofi
Dave, Akshat
Poggio, Tomaso
Nilsson, Dan-Eric
Cheung, Brian
Raskar, Ramesh
Artificial Intelligence
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
Neurons and Cognition
Vision systems in nature show remarkable diversity, from simple light-sensitive patches to complex camera eyes with lenses. While natural selection has produced these eyes through countless mutations over millions of years, they represent just one set of realized evolutionary paths. Testing hypotheses about how environmental pressures shaped eye evolution remains challenging since we cannot experimentally isolate individual factors. Computational evolution offers a way to systematically explore alternative trajectories. Here we show how environmental demands drive three fundamental aspects of visual evolution through an artificial evolution framework that co-evolves both physical eye structure and neural processing in embodied agents. First, we demonstrate computational evidence that task specific selection drives bifurcation in eye evolution - orientation tasks like navigation in a maze leads to distributed compound-type eyes while an object discrimination task leads to the emergence of high-acuity camera-type eyes. Second, we reveal how optical innovations like lenses naturally emerge to resolve fundamental tradeoffs between light collection and spatial precision. Third, we uncover systematic scaling laws between visual acuity and neural processing, showing how task complexity drives coordinated evolution of sensory and computational capabilities. Our work introduces a novel paradigm that illuminates evolutionary principles shaping vision by creating targeted single-player games where embodied agents must simultaneously evolve visual systems and learn complex behaviors. Through our unified genetic encoding framework, these embodied agents serve as next-generation hypothesis testing machines while providing a foundation for designing manufacturable bio-inspired vision systems. Website: http://eyes.mit.edu/
title What if Eye...? Computationally Recreating Vision Evolution
topic Artificial Intelligence
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
Neurons and Cognition
url https://arxiv.org/abs/2501.15001