H-Probes: Extracting Hierarchical Structures From Latent Representations of Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dawes, Cutter, Sharma, Aryan, Lagos, Angelos Ioannis, Raval, Shivam
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915985897816064
author Dawes, Cutter
Sharma, Aryan
Lagos, Angelos Ioannis
Raval, Shivam
author_facet Dawes, Cutter
Sharma, Aryan
Lagos, Angelos Ioannis
Raval, Shivam
contents Representing and navigating hierarchy is a fundamental primitive of reasoning. Large language models have demonstrated proficiency in a wide variety of tasks requiring hierarchical reasoning, but there exists limited analysis on how the models geometrically represent the necessary latent constructions for such thinking. To this end, we develop H-probes, a collection of linear probes that extract hierarchical structure, specifically depth and pairwise distance, from latent representations. In synthetic tree traversal tasks, the H-probes robustly find the subspaces containing hierarchical structure necessary to complete the tasks; furthermore, in comprehensive ablation experiments, we show that these hierarchy-containing subspaces are low-dimensional, causally important for high task performance, and generalize within- and out-of-domain. Furthermore, we find analogous, though weaker, hierarchical structure in real-world hierarchical contexts such as mathematical reasoning traces. These results demonstrate that models represent hierarchy not only at the level of syntax and concepts, but at deeper levels of abstraction -- including the reasoning process itself.
format Preprint
id arxiv_https___arxiv_org_abs_2605_00847
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle H-Probes: Extracting Hierarchical Structures From Latent Representations of Language Models
Dawes, Cutter
Sharma, Aryan
Lagos, Angelos Ioannis
Raval, Shivam
Computation and Language
Artificial Intelligence
Machine Learning
Representing and navigating hierarchy is a fundamental primitive of reasoning. Large language models have demonstrated proficiency in a wide variety of tasks requiring hierarchical reasoning, but there exists limited analysis on how the models geometrically represent the necessary latent constructions for such thinking. To this end, we develop H-probes, a collection of linear probes that extract hierarchical structure, specifically depth and pairwise distance, from latent representations. In synthetic tree traversal tasks, the H-probes robustly find the subspaces containing hierarchical structure necessary to complete the tasks; furthermore, in comprehensive ablation experiments, we show that these hierarchy-containing subspaces are low-dimensional, causally important for high task performance, and generalize within- and out-of-domain. Furthermore, we find analogous, though weaker, hierarchical structure in real-world hierarchical contexts such as mathematical reasoning traces. These results demonstrate that models represent hierarchy not only at the level of syntax and concepts, but at deeper levels of abstraction -- including the reasoning process itself.
title H-Probes: Extracting Hierarchical Structures From Latent Representations of Language Models
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2605.00847