Canvas-of-Thought: Grounding Reasoning via Mutable Structured States

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sun, Lingzhuang, Zhu, Yuxia, Liu, Ruitong, Liang, Hao, Sun, Zheng, Jia, Caijun, He, Honghao, Wu, Yuchen, Li, Siyuan, Wei, Jingxuan, Zhang, Xiangxiang, Yu, Bihui, Zhang, Wentao
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910018726526976
author Sun, Lingzhuang
Zhu, Yuxia
Liu, Ruitong
Liang, Hao
Sun, Zheng
Jia, Caijun
He, Honghao
Wu, Yuchen
Li, Siyuan
Wei, Jingxuan
Zhang, Xiangxiang
Yu, Bihui
Zhang, Wentao
author_facet Sun, Lingzhuang
Zhu, Yuxia
Liu, Ruitong
Liang, Hao
Sun, Zheng
Jia, Caijun
He, Honghao
Wu, Yuchen
Li, Siyuan
Wei, Jingxuan
Zhang, Xiangxiang
Yu, Bihui
Zhang, Wentao
contents While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even when auxiliary visual elements are interleaved, they are often treated as static snapshots within a one-dimensional, unstructured reasoning chain. We argue that such approaches treat reasoning history as an immutable stream: correcting a local error necessitates either generating verbose downstream corrections or regenerating the entire context. This forces the model to implicitly maintain and track state updates, significantly increasing token consumption and cognitive load. This limitation is particularly acute in high-dimensional domains, such as geometry and SVG design, where the textual expression of CoT lacks explicit visual guidance, further constraining the model's reasoning precision. To bridge this gap, we introduce \textbf{Canvas-of-Thought (Canvas-CoT)}. By leveraging a HTML Canvas as an external reasoning substrate, Canvas-CoT empowers the model to perform atomic, DOM-based CRUD operations. This architecture enables in-place state revisions without disrupting the surrounding context, allowing the model to explicitly maintain the "ground truth". Furthermore, we integrate a rendering-based critique loop that serves as a hard constraint validator, providing explicit visual feedback to resolve complex tasks that are difficult to articulate through text alone. Extensive experiments on VCode, RBench-V, and MathVista demonstrate that Canvas-CoT significantly outperforms existing baselines, establishing a new paradigm for context-efficient multimodal reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2602_10494
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Canvas-of-Thought: Grounding Reasoning via Mutable Structured States
Sun, Lingzhuang
Zhu, Yuxia
Liu, Ruitong
Liang, Hao
Sun, Zheng
Jia, Caijun
He, Honghao
Wu, Yuchen
Li, Siyuan
Wei, Jingxuan
Zhang, Xiangxiang
Yu, Bihui
Zhang, Wentao
Computation and Language
While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even when auxiliary visual elements are interleaved, they are often treated as static snapshots within a one-dimensional, unstructured reasoning chain. We argue that such approaches treat reasoning history as an immutable stream: correcting a local error necessitates either generating verbose downstream corrections or regenerating the entire context. This forces the model to implicitly maintain and track state updates, significantly increasing token consumption and cognitive load. This limitation is particularly acute in high-dimensional domains, such as geometry and SVG design, where the textual expression of CoT lacks explicit visual guidance, further constraining the model's reasoning precision. To bridge this gap, we introduce \textbf{Canvas-of-Thought (Canvas-CoT)}. By leveraging a HTML Canvas as an external reasoning substrate, Canvas-CoT empowers the model to perform atomic, DOM-based CRUD operations. This architecture enables in-place state revisions without disrupting the surrounding context, allowing the model to explicitly maintain the "ground truth". Furthermore, we integrate a rendering-based critique loop that serves as a hard constraint validator, providing explicit visual feedback to resolve complex tasks that are difficult to articulate through text alone. Extensive experiments on VCode, RBench-V, and MathVista demonstrate that Canvas-CoT significantly outperforms existing baselines, establishing a new paradigm for context-efficient multimodal reasoning.
title Canvas-of-Thought: Grounding Reasoning via Mutable Structured States
topic Computation and Language
url https://arxiv.org/abs/2602.10494