ReTrace: Interactive Visualizations for Reasoning Traces of Large Reasoning Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Felder, Ludwig, Miller, Jacob, Wallinger, Markus, Kobourov, Stephen, Chen, Chunyang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915618393948160
author Felder, Ludwig
Miller, Jacob
Wallinger, Markus
Kobourov, Stephen
Chen, Chunyang
author_facet Felder, Ludwig
Miller, Jacob
Wallinger, Markus
Kobourov, Stephen
Chen, Chunyang
contents Recent advances in Large Language Models have led to Large Reasoning Models, which produce step-by-step reasoning traces. These traces offer insight into how models think and their goals, improving explainability and helping users follow the logic, learn the process, and even debug errors. These traces, however, are often verbose and complex, making them cognitively demanding to comprehend. We address this challenge with ReTrace, an interactive system that structures and visualizes textual reasoning traces to support understanding. We use a validated reasoning taxonomy to produce structured reasoning data and investigate two types of interactive visualizations thereof. In a controlled user study, both visualizations enabled users to comprehend the model's reasoning more accurately and with less perceived effort than a raw text baseline. The results of this study could have design implications for making long and complex machine-generated reasoning processes more usable and transparent, an important step in AI explainability.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11187
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ReTrace: Interactive Visualizations for Reasoning Traces of Large Reasoning Models
Felder, Ludwig
Miller, Jacob
Wallinger, Markus
Kobourov, Stephen
Chen, Chunyang
Human-Computer Interaction
Recent advances in Large Language Models have led to Large Reasoning Models, which produce step-by-step reasoning traces. These traces offer insight into how models think and their goals, improving explainability and helping users follow the logic, learn the process, and even debug errors. These traces, however, are often verbose and complex, making them cognitively demanding to comprehend. We address this challenge with ReTrace, an interactive system that structures and visualizes textual reasoning traces to support understanding. We use a validated reasoning taxonomy to produce structured reasoning data and investigate two types of interactive visualizations thereof. In a controlled user study, both visualizations enabled users to comprehend the model's reasoning more accurately and with less perceived effort than a raw text baseline. The results of this study could have design implications for making long and complex machine-generated reasoning processes more usable and transparent, an important step in AI explainability.
title ReTrace: Interactive Visualizations for Reasoning Traces of Large Reasoning Models
topic Human-Computer Interaction
url https://arxiv.org/abs/2511.11187