Interactive Reasoning: Visualizing and Controlling Chain-of-Thought Reasoning in Large Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912457583230976 |
|---|---|
| author | Pang, Rock Yuren Feng, K. J. Kevin Feng, Shangbin Li, Chu Shi, Weijia Tsvetkov, Yulia Heer, Jeffrey Reinecke, Katharina |
| author_facet | Pang, Rock Yuren Feng, K. J. Kevin Feng, Shangbin Li, Chu Shi, Weijia Tsvetkov, Yulia Heer, Jeffrey Reinecke, Katharina |
| contents | The output quality of large language models (LLMs) can be improved via "reasoning": generating segments of chain-of-thought (CoT) content to further condition the model prior to producing user-facing output. While these chains contain valuable information, they are verbose and lack explicit organization, making them tedious to review. Moreover, they lack opportunities for user feedback, such as to remove unwanted considerations, add desired ones, or clarify unclear assumptions. We introduce Interactive Reasoning, an interaction design that visualizes chain-of-thought outputs as a hierarchy of topics and enables user review and modification. We implement interactive reasoning in Hippo, a prototype for AI-assisted decision making in the face of uncertain trade-offs. In a user study with 16 participants, we find that interactive reasoning in Hippo allows users to quickly identify and interrupt erroneous generations, efficiently steer the model towards customized responses, and better understand both model reasoning and model outputs. Our work contributes to a new paradigm that incorporates user oversight into LLM reasoning processes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_23678 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Interactive Reasoning: Visualizing and Controlling Chain-of-Thought Reasoning in Large Language Models Pang, Rock Yuren Feng, K. J. Kevin Feng, Shangbin Li, Chu Shi, Weijia Tsvetkov, Yulia Heer, Jeffrey Reinecke, Katharina Human-Computer Interaction Artificial Intelligence The output quality of large language models (LLMs) can be improved via "reasoning": generating segments of chain-of-thought (CoT) content to further condition the model prior to producing user-facing output. While these chains contain valuable information, they are verbose and lack explicit organization, making them tedious to review. Moreover, they lack opportunities for user feedback, such as to remove unwanted considerations, add desired ones, or clarify unclear assumptions. We introduce Interactive Reasoning, an interaction design that visualizes chain-of-thought outputs as a hierarchy of topics and enables user review and modification. We implement interactive reasoning in Hippo, a prototype for AI-assisted decision making in the face of uncertain trade-offs. In a user study with 16 participants, we find that interactive reasoning in Hippo allows users to quickly identify and interrupt erroneous generations, efficiently steer the model towards customized responses, and better understand both model reasoning and model outputs. Our work contributes to a new paradigm that incorporates user oversight into LLM reasoning processes. |
| title | Interactive Reasoning: Visualizing and Controlling Chain-of-Thought Reasoning in Large Language Models |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2506.23678 |