Image de couverture de livre

Mechanistic Interpretability of Binary and Ternary Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Li, Jason
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Binary Autoencoder for Mechanistic Interpretability of Large Language Models
par: Cho, Hakaze, et autres
Publié: (2025)

How Do Transformers Learn to Associate Tokens: Gradient Leading Terms Bring Mechanistic Interpretability
par: Im, Shawn, et autres
Publié: (2026)

Triangulation as an Acceptance Rule for Multilingual Mechanistic Interpretability
par: Long, Yanan
Publié: (2025)

Tracking Equivalent Mechanistic Interpretations Across Neural Networks
par: Sun, Alan, et autres
Publié: (2026)

MIB: A Mechanistic Interpretability Benchmark
par: Mueller, Aaron, et autres
Publié: (2025)

HyperDAS: Towards Automating Mechanistic Interpretability with Hypernetworks
par: Sun, Jiuding, et autres
Publié: (2025)

Mechanistic Interpretability of GPT-like Models on Summarization Tasks
par: Mishra, Anurag
Publié: (2025)

Mechanistic Interpretability as Statistical Estimation: A Variance Analysis
par: Méloux, Maxime, et autres
Publié: (2025)

Everything, Everywhere, All at Once: Is Mechanistic Interpretability Identifiable?
par: Méloux, Maxime, et autres
Publié: (2025)

Detecting and Understanding Vulnerabilities in Language Models via Mechanistic Interpretability
par: García-Carrasco, Jorge, et autres
Publié: (2024)

Position: Mechanistic Interpretability Should Prioritize Feature Consistency in SAEs
par: Song, Xiangchen, et autres
Publié: (2025)

Beyond Transcription: Mechanistic Interpretability in ASR
par: Glazer, Neta, et autres
Publié: (2025)

Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
par: Kim, Geonhee, et autres
Publié: (2024)

Mechanistic Data Attribution: Tracing the Training Origins of Interpretable LLM Units
par: Chen, Jianhui, et autres
Publié: (2026)

The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Research
par: Bai, Xiaoyan, et autres
Publié: (2026)

Finite State Automata Inside Transformers with Chain-of-Thought: A Mechanistic Study on State Tracking
par: Zhang, Yifan, et autres
Publié: (2025)

Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization
par: Guo, Phillip, et autres
Publié: (2024)

Intrinsic Self-Correction in LLMs: Towards Explainable Prompting via Mechanistic Interpretability
par: Lee, Yu-Ting, et autres
Publié: (2025)

DLM-Scope: Mechanistic Interpretability of Diffusion Language Models via Sparse Autoencoders
par: Wang, Xu, et autres
Publié: (2026)

Beyond Accuracy: Introducing a Symbolic-Mechanistic Approach to Interpretable Evaluation
par: Habibi, Reza, et autres
Publié: (2026)

Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers
par: Anagnostidis, Sotiris, et autres
Publié: (2023)

How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective
par: Liu, Qi, et autres
Publié: (2025)

A Mathematical Philosophy of Explanations in Mechanistic Interpretability -- The Strange Science Part I.i
par: Ayonrinde, Kola, et autres
Publié: (2025)

From Indirect Object Identification to Syllogisms: Exploring Binary Mechanisms in Transformer Circuits
par: Saraipour, Karim, et autres
Publié: (2025)

Adaptive Circuit Behavior and Generalization in Mechanistic Interpretability
par: Nainani, Jatin, et autres
Publié: (2024)

Weights to Code: Extracting Interpretable Algorithms from the Discrete Transformer
par: Zhang, Yifan, et autres
Publié: (2026)

LLMs Explain't: A Post-Mortem on Semantic Interpretability in Transformer Models
par: Abdelhalim, Alhassan, et autres
Publié: (2026)

On Mechanistic Circuits for Extractive Question-Answering
par: Basu, Samyadeep, et autres
Publié: (2025)

Learning and Transferring Sparse Contextual Bigrams with Linear Transformers
par: Ren, Yunwei, et autres
Publié: (2024)

Mechanistic?
par: Saphra, Naomi, et autres
Publié: (2024)

Transformers with Selective Access to Early Representations
par: Gunasekaran, Skye, et autres
Publié: (2026)

Spurious Rewards Paradox: Mechanistically Understanding How RLVR Activates Memorization Shortcuts in LLMs
par: Yan, Lecheng, et autres
Publié: (2026)

Eliminating Position Bias of Language Models: A Mechanistic Approach
par: Wang, Ziqi, et autres
Publié: (2024)

Does Transformer Interpretability Transfer to RNNs?
par: Paulo, Gonçalo, et autres
Publié: (2024)

Mechanistic Insights into Grokking from the Embedding Layer
par: AlquBoj, H. V., et autres
Publié: (2025)

Mechanistic Anomaly Detection for "Quirky" Language Models
par: Johnston, David O., et autres
Publié: (2025)

Simple Mechanistic Explanations for Out-Of-Context Reasoning
par: Wang, Atticus, et autres
Publié: (2025)

Adaptive Two Sided Laplace Transforms: A Learnable, Interpretable, and Scalable Replacement for Self-Attention
par: Kiruluta, Andrew
Publié: (2025)

Discovering Interpretable Algorithms by Decompiling Transformers to RASP
par: Huang, Xinting, et autres
Publié: (2026)

Tracking the Feature Dynamics in LLM Training: A Mechanistic Study
par: Xu, Yang, et autres
Publié: (2024)