Cover Image

Circuit Complexity of Hierarchical Knowledge Tracing and Implications for Log-Precision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Naiming, Baraniuk, Richard, Sonkar, Shashank
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Imitation Game for Educational AI
by: Sonkar, Shashank, et al.
Published: (2025)

LLM-based Cognitive Models of Students with Misconceptions
by: Sonkar, Shashank, et al.
Published: (2024)

MetaCLASS: Metacognitive Coaching for Learning with Adaptive Self-regulation Support
by: Liu, Naiming, et al.
Published: (2026)

CLEAR-3K: Assessing Causal Explanatory Capabilities in Language Models
by: Liu, Naiming, et al.
Published: (2025)

MalAlgoQA: Pedagogical Evaluation of Counterfactual Reasoning in Large Language Models and Implications for AI in Education
by: Liu, Naiming, et al.
Published: (2024)

Do LLMs Make Mistakes Like Students? Exploring Natural Alignment between Language Models and Human Error Patterns
by: Liu, Naiming, et al.
Published: (2025)

Student Data Paradox and Curious Case of Single Student-Tutor Model: Regressive Side Effects of Training LLMs for Personalized Learning
by: Sonkar, Shashank, et al.
Published: (2024)

Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators
by: Do, Heejin, et al.
Published: (2026)

HLogformer: A Hierarchical Transformer for Representing Log Data
by: Hou, Zhichao, et al.
Published: (2024)

Synthetic Context Generation for Question Generation
by: Liu, Naiming, et al.
Published: (2024)

Uncovering Graph Reasoning in Decoder-only Transformers with Circuit Tracing
by: Dai, Xinnan, et al.
Published: (2025)

Neon: Negative Extrapolation From Self-Training Improves Image Generation
by: Alemohammad, Sina, et al.
Published: (2025)

DHP: Discrete Hierarchical Planning for Hierarchical Reinforcement Learning Agents
by: Sharma, Shashank, et al.
Published: (2025)

HH-SAE: Discovering and Steering Hierarchical Knowledge of Complex Manifolds
by: Wu, Honghan, et al.
Published: (2026)

Minimizing Collateral Damage in Activation Steering
by: Nguyen, Tam, et al.
Published: (2026)

Misconception Acquisition Dynamics in Large Language Models
by: Liu, Naiming, et al.
Published: (2026)

Marking: Visual Grading with Highlighting Errors and Annotating Missing Bits
by: Sonkar, Shashank, et al.
Published: (2024)

Self-Improving Diffusion Models with Synthetic Data
by: Alemohammad, Sina, et al.
Published: (2024)

FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMs
by: Worden, Eamon, et al.
Published: (2026)

MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics
by: Chen, Xinghe, et al.
Published: (2026)

Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verification
by: Cornelio, Cristina, et al.
Published: (2025)

Not All Synthetic Data Is Yours to Learn From
by: Alemohammad, Sina, et al.
Published: (2026)

Leakage and Second-Order Dynamics Improve Hippocampal RNN Replay
by: Casco-Rodriguez, Josue, et al.
Published: (2026)

Deep Networks Always Grok and Here is Why
by: Humayun, Ahmed Imtiaz, et al.
Published: (2024)

On the Geometry of Deep Learning
by: Balestriero, Randall, et al.
Published: (2024)

Quantifying LLM Attention-Head Stability: Implications for Circuit Universality
by: Bali, Karan, et al.
Published: (2026)

Circuits, Features, and Heuristics in Molecular Transformers
by: Varadi, Kristof, et al.
Published: (2025)

Latent Knowledge Scalpel: Precise and Massive Knowledge Editing for Large Language Models
by: Liu, Xin, et al.
Published: (2025)

Intrinsic Structure as a Proxy for Saliency: SVD-Based Weight Preservation for Mixed-Precision Quantization in Large Language Models
by: Landge, Shashank, et al.
Published: (2025)

Sparse Attention Decomposition Applied to Circuit Tracing
by: Franco, Gabriel, et al.
Published: (2024)

Towards Robust Knowledge Tracing Models via k-Sparse Attention
by: Huang, Shuyan, et al.
Published: (2024)

Atomic Learning Objectives Labeling: A High-Resolution Approach for Physics Education
by: Liu, Naiming, et al.
Published: (2024)

PAHQ: Accelerating Automated Circuit Discovery through Mixed-Precision Inference Optimization
by: Wang, Xinhai, et al.
Published: (2025)

HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
by: Feng, Shibo, et al.
Published: (2025)

Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement
by: Liu, Hengjie, et al.
Published: (2026)

Enhancing Knowledge Tracing with Concept Map and Response Disentanglement
by: Park, Soonwook, et al.
Published: (2024)

STaMP: Sequence Transformation and Mixed Precision for Low-Precision Activation Quantization
by: Federici, Marco, et al.
Published: (2025)

Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objective
by: Watanabe, Shuhei
Published: (2024)

Spectral Probe-Circuits: A Three-Step Recipe for Identifying Attention-Head Circuits in Pretrained Transformers
by: Xu, Yongzhong
Published: (2026)

From Noise to Narrative: Tracing the Origins of Hallucinations in Transformers
by: Suresh, Praneet, et al.
Published: (2025)