Cover Image

Uncovering Graph Reasoning in Decoder-only Transformers with Circuit Tracing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dai, Xinnan, Lo, Chung-Hsiang, Guo, Kai, Zeng, Shenglai, Luo, Dongsheng, Tang, Jiliang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

GraphGhost: Tracing Structures Behind Large Language Models
by: Dai, Xinnan, et al.
Published: (2025)

When Do Hallucinations Arise? A Graph Perspective on the Evolution of Path Reuse and Path Compression
by: Dai, Xinnan, et al.
Published: (2026)

From Sequence to Structure: Uncovering Substructure Reasoning in Transformers
by: Dai, Xinnan, et al.
Published: (2025)

Unveiling Mode Connectivity in Graph Neural Networks
by: Li, Bingheng, et al.
Published: (2025)

How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension
by: Dai, Xinnan, et al.
Published: (2024)

Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAG
by: Guo, Kai, et al.
Published: (2025)

Why Retrieval-Augmented Generation Fails: A Graph Perspective
by: Guo, Kai, et al.
Published: (2026)

Uncovering the Representation Geometry of Minimal Cores in Overcomplete Reasoning Traces
by: Chowdhury, Sanjoy, et al.
Published: (2026)

Empowering GraphRAG with Knowledge Filtering and Integration
by: Guo, Kai, et al.
Published: (2025)

Revisiting the Graph Reasoning Ability of Large Language Models: Case Studies in Translation, Connectivity and Shortest Path
by: Dai, Xinnan, et al.
Published: (2024)

Are Expressive Encoders Necessary for Discrete Graph Generation?
by: Revolinsky, Jay, et al.
Published: (2026)

Towards Better Benchmark Datasets for Inductive Knowledge Graph Completion
by: Shomer, Harry, et al.
Published: (2024)

Shape-aware Graph Spectral Learning
by: Xu, Junjie, et al.
Published: (2023)

Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustness
by: Guo, Kai, et al.
Published: (2024)

Circuit Complexity of Hierarchical Knowledge Tracing and Implications for Log-Precision Transformers
by: Liu, Naiming, et al.
Published: (2026)

Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspective
by: Guo, Kai, et al.
Published: (2024)

Exploring Memorization in Fine-tuned Language Models
by: Zeng, Shenglai, et al.
Published: (2023)

SA-GDA: Spectral Augmentation for Graph Domain Adaptation
by: Pang, Jinhui, et al.
Published: (2024)

Towards Neural Scaling Laws on Graphs
by: Liu, Jingzhe, et al.
Published: (2024)

Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2025)

A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration
by: Cui, Yingqian, et al.
Published: (2024)

Is Your Explanation Reliable: Confidence-Aware Explanation on Graph Neural Networks
by: Zhang, Jiaxing, et al.
Published: (2025)

Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation
by: Wen, Hongzhi, et al.
Published: (2023)

Attention Dispersion in Dynamic Graph Transformers: Diagnosis and a Transferable Fix
by: Zhang, Jinhao, et al.
Published: (2026)

GTAC: A Generative Transformer for Approximate Circuits
by: Wang, Jingxin, et al.
Published: (2025)

Adaptive Test-Time Reasoning via Reward-Guided Dual-Phase Search
by: Cui, Yingqian, et al.
Published: (2025)

Uncovering mesa-optimization algorithms in Transformers
by: von Oswald, Johannes, et al.
Published: (2023)

Towards Understanding Link Predictor Generalizability Under Distribution Shifts
by: Revolinsky, Jay, et al.
Published: (2024)

Subgraph Generation for Generalizing on Out-of-Distribution Links
by: Revolinsky, Jay, et al.
Published: (2025)

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models
by: Cui, Yingqian, et al.
Published: (2025)

Understanding Reasoning in LLMs through Strategic Information Allocation under Uncertainty
by: Kim, Jeonghye, et al.
Published: (2026)

Representation Learning on Hyper-Relational and Numeric Knowledge Graphs with Transformers
by: Chung, Chanyoung, et al.
Published: (2023)

Decoupled Graph Energy-based Model for Node Out-of-Distribution Detection on Heterophilic Graphs
by: Chen, Yuhan, et al.
Published: (2025)

Resurrecting Label Propagation for Graphs with Heterophily and Label Noise
by: Cheng, Yao, et al.
Published: (2023)

Graph Tokenization for Bridging Graphs and Transformers
by: Guo, Zeyuan, et al.
Published: (2026)

Understanding Transformer Reasoning Capabilities via Graph Algorithms
by: Sanford, Clayton, et al.
Published: (2024)

One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphs
by: Liu, Jingzhe, et al.
Published: (2024)

Distance-Misaligned Training in Graph Transformers and Adaptive Graph-Aware Control
by: Hou, Qinhan, et al.
Published: (2026)

LauraTSE: Target Speaker Extraction using Auto-Regressive Decoder-Only Language Models
by: Tang, Beilong, et al.
Published: (2025)

Supercharging Graph Transformers with Advective Diffusion
by: Wu, Qitian, et al.
Published: (2023)