Guardado en:
| Autores principales: | , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2512.19135 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917271678484480 |
|---|---|
| author | Li, Chenghao Zhang, Chaoning Lu, Yi Chen, Shuxu Wang, Xudong Zhang, Jiaquan Wang, Zhicheng Jin, Zhengxun Liu, Kuien Bae, Sung-Ho Wang, Guoqing Yang, Yang Shen, Heng Tao |
| author_facet | Li, Chenghao Zhang, Chaoning Lu, Yi Chen, Shuxu Wang, Xudong Zhang, Jiaquan Wang, Zhicheng Jin, Zhengxun Liu, Kuien Bae, Sung-Ho Wang, Guoqing Yang, Yang Shen, Heng Tao |
| contents | With the development of large language models (LLMs), particularly with the introduction of the long reasoning chain technique, the reasoning ability of LLMs in complex problem-solving has been significantly enhanced. While acknowledging the power of long reasoning chains, we cannot help but wonder: Why do different reasoning chains perform differently in reasoning? What components of the reasoning chains play a key role? Existing studies mainly focus on evaluating reasoning chains from a functional perspective, with little attention paid to their structural mechanisms. To address this gap, this work is the first to analyze and evaluate the quality of the reasoning chain from a structural perspective. We apply persistent homology from Topological Data Analysis (TDA) to map reasoning steps into semantic space, extract topological features, and analyze structural changes. These changes reveal semantic coherence, logical redundancy, and identify logical breaks and gaps. By calculating homology groups, we assess connectivity and redundancy at various scales, using barcode and persistence diagrams to quantify stability and consistency. Our results show that the topological structural complexity of reasoning chains correlates positively with accuracy. More complex chains identify correct answers sooner, while successful reasoning exhibits simpler topologies, reducing redundancy and cycles, enhancing efficiency and interpretability. This work provides a new perspective on reasoning chain quality assessment and offers guidance for future optimization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_19135 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Understanding Chain-of-Thought in Large Language Models via Topological Data Analysis Li, Chenghao Zhang, Chaoning Lu, Yi Chen, Shuxu Wang, Xudong Zhang, Jiaquan Wang, Zhicheng Jin, Zhengxun Liu, Kuien Bae, Sung-Ho Wang, Guoqing Yang, Yang Shen, Heng Tao Artificial Intelligence With the development of large language models (LLMs), particularly with the introduction of the long reasoning chain technique, the reasoning ability of LLMs in complex problem-solving has been significantly enhanced. While acknowledging the power of long reasoning chains, we cannot help but wonder: Why do different reasoning chains perform differently in reasoning? What components of the reasoning chains play a key role? Existing studies mainly focus on evaluating reasoning chains from a functional perspective, with little attention paid to their structural mechanisms. To address this gap, this work is the first to analyze and evaluate the quality of the reasoning chain from a structural perspective. We apply persistent homology from Topological Data Analysis (TDA) to map reasoning steps into semantic space, extract topological features, and analyze structural changes. These changes reveal semantic coherence, logical redundancy, and identify logical breaks and gaps. By calculating homology groups, we assess connectivity and redundancy at various scales, using barcode and persistence diagrams to quantify stability and consistency. Our results show that the topological structural complexity of reasoning chains correlates positively with accuracy. More complex chains identify correct answers sooner, while successful reasoning exhibits simpler topologies, reducing redundancy and cycles, enhancing efficiency and interpretability. This work provides a new perspective on reasoning chain quality assessment and offers guidance for future optimization. |
| title | Understanding Chain-of-Thought in Large Language Models via Topological Data Analysis |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2512.19135 |