Saved in:
Bibliographic Details
Main Authors: Zhang, Junjie, Zong, Zhimin, Gu, Lin, Su, Shenghan, Cui, Ziteng, Pu, Yan, Chen, Zirui, Lu, Jing, Kojima, Daisuke, Harada, Tatsuya, Fang, Ruogu
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.19439
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913627602157568
author Zhang, Junjie
Zong, Zhimin
Gu, Lin
Su, Shenghan
Cui, Ziteng
Pu, Yan
Chen, Zirui
Lu, Jing
Kojima, Daisuke
Harada, Tatsuya
Fang, Ruogu
author_facet Zhang, Junjie
Zong, Zhimin
Gu, Lin
Su, Shenghan
Cui, Ziteng
Pu, Yan
Chen, Zirui
Lu, Jing
Kojima, Daisuke
Harada, Tatsuya
Fang, Ruogu
contents The evolution of colour vision is captivating, as it reveals the adaptive strategies of extinct species while simultaneously inspiring innovations in modern imaging technology. In this study, we present a simplified model of visual transduction in the retina, introducing a novel opsin layer. We quantify evolutionary pressures by measuring machine vision recognition accuracy on colour images shaped by specific opsins. Building on this, we develop an evolutionary conservation optimisation algorithm to reconstruct the spectral sensitivity of opsins, enabling mutation-driven adaptations to to more effectively spot fruits or predators. This model condenses millions of years of evolution within seconds on GPU, providing an experimental framework to test long-standing hypotheses in evolutionary biology , such as vision of early mammals, primate trichromacy from gene duplication, retention of colour blindness, blue-shift of fish rod and multiple rod opsins with bioluminescence. Moreover, the model enables speculative explorations of hypothetical species, such as organisms with eyes adapted to the conditions on Mars. Our findings suggest a minimalist yet effective approach to task-specific camera filter design, optimising the spectral response function to meet application-driven demands. The code will be made publicly available upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2412_19439
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Paleoinspired Vision: From Exploring Colour Vision Evolution to Inspiring Camera Design
Zhang, Junjie
Zong, Zhimin
Gu, Lin
Su, Shenghan
Cui, Ziteng
Pu, Yan
Chen, Zirui
Lu, Jing
Kojima, Daisuke
Harada, Tatsuya
Fang, Ruogu
Computer Vision and Pattern Recognition
The evolution of colour vision is captivating, as it reveals the adaptive strategies of extinct species while simultaneously inspiring innovations in modern imaging technology. In this study, we present a simplified model of visual transduction in the retina, introducing a novel opsin layer. We quantify evolutionary pressures by measuring machine vision recognition accuracy on colour images shaped by specific opsins. Building on this, we develop an evolutionary conservation optimisation algorithm to reconstruct the spectral sensitivity of opsins, enabling mutation-driven adaptations to to more effectively spot fruits or predators. This model condenses millions of years of evolution within seconds on GPU, providing an experimental framework to test long-standing hypotheses in evolutionary biology , such as vision of early mammals, primate trichromacy from gene duplication, retention of colour blindness, blue-shift of fish rod and multiple rod opsins with bioluminescence. Moreover, the model enables speculative explorations of hypothetical species, such as organisms with eyes adapted to the conditions on Mars. Our findings suggest a minimalist yet effective approach to task-specific camera filter design, optimising the spectral response function to meet application-driven demands. The code will be made publicly available upon acceptance.
title Paleoinspired Vision: From Exploring Colour Vision Evolution to Inspiring Camera Design
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.19439