Cover Image

Language Model Circuits Are Sparse in the Neuron Basis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Arora, Aryaman, Wu, Zhengxuan, Steinhardt, Jacob, Schwettmann, Sarah
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ADAG: Automatically Describing Attribution Graphs
by: Arora, Aryaman, et al.
Published: (2026)

AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoders
by: Wu, Zhengxuan, et al.
Published: (2025)

CausalGym: Benchmarking causal interpretability methods on linguistic tasks
by: Arora, Aryaman, et al.
Published: (2024)

Mechanistic evaluation of Transformers and state space models
by: Arora, Aryaman, et al.
Published: (2025)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
by: Peters, Sydney, et al.
Published: (2025)

RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs
by: Saji, Alan, et al.
Published: (2025)

Presumed Cultural Identity: How Names Shape LLM Responses
by: Pawar, Siddhesh, et al.
Published: (2025)

Beyond Prefixes: Graph-as-Memory Cross-Attention for Knowledge Graph Completion with Large Language Models
by: Liu, Ruitong, et al.
Published: (2025)

SD$^2$: Self-Distilled Sparse Drafters
by: Lasby, Mike, et al.
Published: (2025)

Demystifying Instruction Mixing for Fine-tuning Large Language Models
by: Wang, Renxi, et al.
Published: (2023)

Large Language Model (LLM) Bias Index -- LLMBI
by: Oketunji, Abiodun Finbarrs, et al.
Published: (2023)

Bayesian scaling laws for in-context learning
by: Arora, Aryaman, et al.
Published: (2024)

Robustness of Large Language Models to Perturbations in Text
by: Singh, Ayush, et al.
Published: (2024)

Language Models are Crossword Solvers
by: Saha, Soumadeep, et al.
Published: (2024)

Super Tiny Language Models
by: Hillier, Dylan, et al.
Published: (2024)

Egalitarian Language Representation in Language Models: It All Begins with Tokenizers
by: Velayuthan, Menan, et al.
Published: (2024)

Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models
by: Wu, Canhui, et al.
Published: (2025)

Adaptive Focus Memory for Language Models
by: Cruz, Christopher
Published: (2025)

Evaluating the Efficacy of Hybrid Deep Learning Models in Distinguishing AI-Generated Text
by: Oketunji, Abiodun Finbarrs
Published: (2023)

Integrating Emotional and Linguistic Models for Ethical Compliance in Large Language Models
by: Chang, Edward Y.
Published: (2024)

Inference to the Best Explanation in Large Language Models
by: Dalal, Dhairya, et al.
Published: (2024)

Bielik 11B v3: Multilingual Large Language Model for European Languages
by: Ociepa, Krzysztof, et al.
Published: (2025)

Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models
by: Benkirane, Kenza, et al.
Published: (2024)

Future Language Modeling from Temporal Document History
by: Li, Changmao, et al.
Published: (2024)

Streamlining Redundant Layers to Compress Large Language Models
by: Chen, Xiaodong, et al.
Published: (2024)

Exploring Graph Representations of Logical Forms for Language Modeling
by: Sullivan, Michael
Published: (2025)

A comprehensive taxonomy of hallucinations in Large Language Models
by: Cossio, Manuel
Published: (2025)

Component-Aware Self-Speculative Decoding in Hybrid Language Models
by: Borobia, Hector, et al.
Published: (2026)

Prompt-Time Symbolic Knowledge Capture with Large Language Models
by: Çöplü, Tolga, et al.
Published: (2024)

Artificial Phantasia: Emergent Mental Imagery in Large Language Models
by: McCarty, Morgan, et al.
Published: (2025)

Argumentative Large Language Models for Explainable and Contestable Claim Verification
by: Freedman, Gabriel, et al.
Published: (2024)

Enigme: Generative Text Puzzles for Evaluating Reasoning in Language Models
by: Hawkins, John
Published: (2025)

PatentGPT: A Large Language Model for Intellectual Property
by: Bai, Zilong, et al.
Published: (2024)

Reasoning over Uncertain Text by Generative Large Language Models
by: Nafar, Aliakbar, et al.
Published: (2024)

Partially Recentralization Softmax Loss for Vision-Language Models Robustness
by: Wang, Hao, et al.
Published: (2024)

Multi-Turn Interactions for Text-to-SQL with Large Language Models
by: Xiong, Guanming, et al.
Published: (2024)

EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models
by: Paech, Samuel J.
Published: (2023)

UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning
by: Ovcharov, Volodymyr
Published: (2026)

Predictive Simultaneous Interpretation: Harnessing Large Language Models for Democratizing Real-Time Multilingual Communication
by: Iida, Kurando, et al.
Published: (2024)

Bielik-Minitron-7B: Compressing Large Language Models via Structured Pruning and Knowledge Distillation for the Polish Language
by: Kinas, Remigiusz, et al.
Published: (2026)