Do vision models perceive illusory motion in static images like humans?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rosario, Isabella Elaine, Cheng, Fan L., Sun, Zitang, Kriegeskorte, Nikolaus
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908963937714176
author Rosario, Isabella Elaine
Cheng, Fan L.
Sun, Zitang
Kriegeskorte, Nikolaus
author_facet Rosario, Isabella Elaine
Cheng, Fan L.
Sun, Zitang
Kriegeskorte, Nikolaus
contents Understanding human motion processing is essential for building reliable, human-centered computer vision systems. Although deep neural networks (DNNs) achieve strong performance in optical flow estimation, they remain less robust than humans and rely on fundamentally different computational strategies. Visual motion illusions provide a powerful probe into these mechanisms, revealing how human and machine vision align or diverge. While recent DNN-based motion models can reproduce dynamic illusions such as reverse-phi, it remains unclear whether they can perceive illusory motion in static images, exemplified by the Rotating Snakes illusion. We evaluate several representative optical flow models on Rotating Snakes and show that most fail to generate flow fields consistent with human perception. Under simulated conditions mimicking saccadic eye movements, only the human-inspired Dual-Channel model exhibits the expected rotational motion, with the closest correspondence emerging during the saccade simulation. Ablation analyses further reveal that both luminance-based and higher-order color--feature--based motion signals contribute to this behavior and that a recurrent attention mechanism is critical for integrating local cues. Our results highlight a substantial gap between current optical-flow models and human visual motion processing, and offer insights for developing future motion-estimation systems with improved correspondence to human perception and human-centric AI.
format Preprint
id arxiv_https___arxiv_org_abs_2604_09853
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Do vision models perceive illusory motion in static images like humans?
Rosario, Isabella Elaine
Cheng, Fan L.
Sun, Zitang
Kriegeskorte, Nikolaus
Computer Vision and Pattern Recognition
Understanding human motion processing is essential for building reliable, human-centered computer vision systems. Although deep neural networks (DNNs) achieve strong performance in optical flow estimation, they remain less robust than humans and rely on fundamentally different computational strategies. Visual motion illusions provide a powerful probe into these mechanisms, revealing how human and machine vision align or diverge. While recent DNN-based motion models can reproduce dynamic illusions such as reverse-phi, it remains unclear whether they can perceive illusory motion in static images, exemplified by the Rotating Snakes illusion. We evaluate several representative optical flow models on Rotating Snakes and show that most fail to generate flow fields consistent with human perception. Under simulated conditions mimicking saccadic eye movements, only the human-inspired Dual-Channel model exhibits the expected rotational motion, with the closest correspondence emerging during the saccade simulation. Ablation analyses further reveal that both luminance-based and higher-order color--feature--based motion signals contribute to this behavior and that a recurrent attention mechanism is critical for integrating local cues. Our results highlight a substantial gap between current optical-flow models and human visual motion processing, and offer insights for developing future motion-estimation systems with improved correspondence to human perception and human-centric AI.
title Do vision models perceive illusory motion in static images like humans?
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.09853