Artemis: Structured Visual Reasoning for Perception Policy Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tang, Wei, Sun, Yanpeng, Zhang, Shan, Bo, Weihao, Li, Xiaofan, Koniusz, Piotr, Li, Wei, Zhao, Na, Li, Zechao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913167771172864
author Tang, Wei
Sun, Yanpeng
Zhang, Shan
Bo, Weihao
Li, Xiaofan
Koniusz, Piotr
Li, Wei
Zhao, Na
Li, Zechao
author_facet Tang, Wei
Sun, Yanpeng
Zhang, Shan
Bo, Weihao
Li, Xiaofan
Koniusz, Piotr
Li, Wei
Zhao, Na
Li, Zechao
contents Recent reinforcement-learning frameworks for visual perception policy usually incorporate intermediate reasoning chains expressed in natural language. Empirical observations indicate that such purely linguistic intermediate reasoning often reduces performance on perception tasks. We argue that the core issue lies not in reasoning per se but in the form of reasoning: while these chains perform semantic reasoning in an unstructured linguistic space, \textbf{visual perception requires reasoning in a spatial and object-centric space}. In response, we introduce \textbf{Artemis}, a perception-policy learning method that performs structured visual reasoning, where each intermediate step is represented as a (label, bounding-box) pair capturing a verifiable visual state. This design enables explicit tracking of intermediate states, direct supervision for proposal quality, and avoids ambiguity introduced by language-based reasoning. Building upon verifiable and spatially grounded reasoning chains, Artemis provides a unified architecture for diverse perceptual tasks, without requiring the task-specific designs relied upon by prior perceptual policy models. Trained using grounding and detection sampeles in natural image domains, Artemis generalizes to counting and geometric perception tasks. At its core, a spatially grounded, object-centric chain rule provides a principled foundation for scalable and general perceptual policies.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01988
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Artemis: Structured Visual Reasoning for Perception Policy Learning
Tang, Wei
Sun, Yanpeng
Zhang, Shan
Bo, Weihao
Li, Xiaofan
Koniusz, Piotr
Li, Wei
Zhao, Na
Li, Zechao
Computer Vision and Pattern Recognition
Recent reinforcement-learning frameworks for visual perception policy usually incorporate intermediate reasoning chains expressed in natural language. Empirical observations indicate that such purely linguistic intermediate reasoning often reduces performance on perception tasks. We argue that the core issue lies not in reasoning per se but in the form of reasoning: while these chains perform semantic reasoning in an unstructured linguistic space, \textbf{visual perception requires reasoning in a spatial and object-centric space}. In response, we introduce \textbf{Artemis}, a perception-policy learning method that performs structured visual reasoning, where each intermediate step is represented as a (label, bounding-box) pair capturing a verifiable visual state. This design enables explicit tracking of intermediate states, direct supervision for proposal quality, and avoids ambiguity introduced by language-based reasoning. Building upon verifiable and spatially grounded reasoning chains, Artemis provides a unified architecture for diverse perceptual tasks, without requiring the task-specific designs relied upon by prior perceptual policy models. Trained using grounding and detection sampeles in natural image domains, Artemis generalizes to counting and geometric perception tasks. At its core, a spatially grounded, object-centric chain rule provides a principled foundation for scalable and general perceptual policies.
title Artemis: Structured Visual Reasoning for Perception Policy Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.01988