SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Long, Yancheng, Yang, Yankai, Wei, Hongyang, Chen, Wei, Zhang, Tianke, fan, Haonan, Liu, Changyi, Jiang, Kaiyu, Chen, Jiankang, Tang, Kaiyu, Wen, Bin, Yang, Fan, Gao, Tingting, Li, Han, Yang, Shuo
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914562275540992
author Long, Yancheng
Yang, Yankai
Wei, Hongyang
Chen, Wei
Zhang, Tianke
fan, Haonan
Liu, Changyi
Jiang, Kaiyu
Chen, Jiankang
Tang, Kaiyu
Wen, Bin
Yang, Fan
Gao, Tingting
Li, Han
Yang, Shuo
author_facet Long, Yancheng
Yang, Yankai
Wei, Hongyang
Chen, Wei
Zhang, Tianke
fan, Haonan
Liu, Changyi
Jiang, Kaiyu
Chen, Jiankang
Tang, Kaiyu
Wen, Bin
Yang, Fan
Gao, Tingting
Li, Han
Yang, Shuo
contents Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical perception gap we term "Attention Collapse," where models neglect cross-image comparisons and fail to capture fine-grained details, resulting in inaccurate perception and miscalibrated scores. To address these limitations, we propose SpatialReward, a reward model that enforces precise verification via explicit spatial reasoning. By anchoring reasoning to predicted edit regions, SpatialReward grounds semantic judgments in pixel-level evidence, significantly enhancing evaluative accuracy. Trained on a curated 260k spatial-aware dataset, our model achieves state-of-the-art performance on MMRB2 and EditReward-Bench, and outperforms proprietary evaluators on our proposed MultiEditReward-Bench. Furthermore, SpatialReward serves as a robust signal in online RL, boosting OmniGen2 by +0.90 on GEdit-Bench--surpassing the leading discriminative model and doubling the gain of GPT-4.1 (+0.45). These results demonstrate that spatial reasoning is essential for unlocking effective alignment in image editing.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07458
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
Long, Yancheng
Yang, Yankai
Wei, Hongyang
Chen, Wei
Zhang, Tianke
fan, Haonan
Liu, Changyi
Jiang, Kaiyu
Chen, Jiankang
Tang, Kaiyu
Wen, Bin
Yang, Fan
Gao, Tingting
Li, Han
Yang, Shuo
Computer Vision and Pattern Recognition
Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical perception gap we term "Attention Collapse," where models neglect cross-image comparisons and fail to capture fine-grained details, resulting in inaccurate perception and miscalibrated scores. To address these limitations, we propose SpatialReward, a reward model that enforces precise verification via explicit spatial reasoning. By anchoring reasoning to predicted edit regions, SpatialReward grounds semantic judgments in pixel-level evidence, significantly enhancing evaluative accuracy. Trained on a curated 260k spatial-aware dataset, our model achieves state-of-the-art performance on MMRB2 and EditReward-Bench, and outperforms proprietary evaluators on our proposed MultiEditReward-Bench. Furthermore, SpatialReward serves as a robust signal in online RL, boosting OmniGen2 by +0.90 on GEdit-Bench--surpassing the leading discriminative model and doubling the gain of GPT-4.1 (+0.45). These results demonstrate that spatial reasoning is essential for unlocking effective alignment in image editing.
title SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.07458