From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Wenxin, Chen, Andong, Song, Yuchen, Chen, Kehai, Zhu, Conghui, Chen, Ziyan, Zhao, Tiejun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915641802358784
author Zhu, Wenxin
Chen, Andong
Song, Yuchen
Chen, Kehai
Zhu, Conghui
Chen, Ziyan
Zhao, Tiejun
author_facet Zhu, Wenxin
Chen, Andong
Song, Yuchen
Chen, Kehai
Zhu, Conghui
Chen, Ziyan
Zhao, Tiejun
contents With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as opaque reasoning paths and insufficient generalization ability. Chain-of-Thought (CoT) reasoning, which has demonstrated significant efficacy in language models by enhancing reasoning transparency and output interpretability, holds promise for improving model reasoning capabilities when extended to the multimodal domain. This paper provides a systematic review centered on "Multimodal Chain-of-Thought" (MCoT). First, it analyzes the background and theoretical motivations for its inception from the perspectives of technical evolution and task demands. Then, it introduces mainstream MCoT methods from three aspects: CoT paradigms, the post-training stage, and the inference stage, while also analyzing their underlying mechanisms. Furthermore, the paper summarizes existing evaluation benchmarks and metrics, and discusses the application scenarios of MCoT. Finally, it analyzes the challenges currently facing MCoT and provides an outlook on its future research directions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12861
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
Zhu, Wenxin
Chen, Andong
Song, Yuchen
Chen, Kehai
Zhu, Conghui
Chen, Ziyan
Zhao, Tiejun
Computation and Language
Computer Vision and Pattern Recognition
With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as opaque reasoning paths and insufficient generalization ability. Chain-of-Thought (CoT) reasoning, which has demonstrated significant efficacy in language models by enhancing reasoning transparency and output interpretability, holds promise for improving model reasoning capabilities when extended to the multimodal domain. This paper provides a systematic review centered on "Multimodal Chain-of-Thought" (MCoT). First, it analyzes the background and theoretical motivations for its inception from the perspectives of technical evolution and task demands. Then, it introduces mainstream MCoT methods from three aspects: CoT paradigms, the post-training stage, and the inference stage, while also analyzing their underlying mechanisms. Furthermore, the paper summarizes existing evaluation benchmarks and metrics, and discusses the application scenarios of MCoT. Finally, it analyzes the challenges currently facing MCoT and provides an outlook on its future research directions.
title From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
topic Computation and Language
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.12861