Cover Image

A Review of Developmental Interpretability in Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kendiukhov, Ihor
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exhaustive Circuit Mapping of a Single-Cell Foundation Model Reveals Massive Redundancy, Heavy-Tailed Hub Architecture, and Layer-Dependent Differentiation Control
by: Kendiukhov, Ihor
Published: (2026)

Causal Circuit Tracing Reveals Distinct Computational Architectures in Single-Cell Foundation Models: Inhibitory Dominance, Biological Coherence, and Cross-Model Convergence
by: Kendiukhov, Ihor
Published: (2026)

What Topological and Geometric Structure Do Biological Foundation Models Learn? Evidence from 141 Hypotheses
by: Kendiukhov, Ihor
Published: (2026)

Discovery of a Hematopoietic Manifold in scGPT Yields a Method for Extracting Performant Algorithms from Biological Foundation Model Internals
by: Kendiukhov, Ihor
Published: (2026)

Scaling Laws for Masked-Reconstruction Transformers on Single-Cell Transcriptomics
by: Kendiukhov, Ihor
Published: (2026)

Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking
by: Kendiukhov, Ihor
Published: (2026)

Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
by: Kendiukhov, Ihor
Published: (2026)

Sparse autoencoders reveal organized biological knowledge but minimal regulatory logic in single-cell foundation models: a comparative atlas of Geneformer and scGPT
by: Kendiukhov, Ihor
Published: (2026)

Crafting Large Language Models for Enhanced Interpretability
by: Sun, Chung-En, et al.
Published: (2024)

Automatically Interpreting Millions of Features in Large Language Models
by: Paulo, Gonçalo, et al.
Published: (2024)

Ergodicity Library: A Python Toolkit for Stochastic-Process Simulation, Time-Average Diagnostics, and Agent-Based Experiments
by: Kendiukhov, Ihor
Published: (2026)

How Attention Sinks Emerge in Large Language Models: An Interpretability Perspective
by: Peng, Runyu, et al.
Published: (2026)

Efficacy of Large Language Models in Systematic Reviews
by: Shah, Aaditya, et al.
Published: (2024)

Rethinking Interpretability in the Era of Large Language Models
by: Singh, Chandan, et al.
Published: (2024)

A Critical Review of Causal Reasoning Benchmarks for Large Language Models
by: Yang, Linying, et al.
Published: (2024)

Capability-Guided Compression: Toward Interpretability-Aware Budget Allocation for Large Language Models
by: Gupta, Rishaank
Published: (2026)

Binary Autoencoder for Mechanistic Interpretability of Large Language Models
by: Cho, Hakaze, et al.
Published: (2025)

CrossTrafficLLM: A Human-Centric Framework for Interpretable Traffic Intelligence via Large Language Model
by: Du, Zeming, et al.
Published: (2025)

GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction
by: Stepanov, Ihor, et al.
Published: (2026)

Opir: Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content
by: Stepanov, Ihor, et al.
Published: (2026)

Fine-Grained Interpretation of Political Opinions in Large Language Models
by: Hu, Jingyu, et al.
Published: (2025)

SelfIE: Self-Interpretation of Large Language Model Embeddings
by: Chen, Haozhe, et al.
Published: (2024)

TracrBench: Generating Interpretability Testbeds with Large Language Models
by: Thurnherr, Hannes, et al.
Published: (2024)

Large Language Models For Text Classification: Case Study And Comprehensive Review
by: Kostina, Arina, et al.
Published: (2025)

GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks
by: Stepanov, Ihor, et al.
Published: (2024)

A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
by: Garcia, Gabriel Lino, et al.
Published: (2024)

Systematic Evaluation of Single-Cell Foundation Model Interpretability Reveals Attention Captures Co-Expression Rather Than Unique Regulatory Signal
by: Kendiukhov, Ihor
Published: (2026)

TeleTables: A Benchmark for Large Language Models in Telecom Table Interpretation
by: Ezzakri, Anas, et al.
Published: (2025)

A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models
by: Shu, Dong, et al.
Published: (2025)

Focus-LIME: Surgical Interpretation of Long-Context Large Language Models via Proxy-Based Neighborhood Selection
by: Liu, Junhao, et al.
Published: (2026)

The Million-Label NER: Breaking Scale Barriers with GLiNER bi-encoder
by: Stepanov, Ihor, et al.
Published: (2026)

Interpretable Steering of Large Language Models with Feature Guided Activation Additions
by: Soo, Samuel, et al.
Published: (2025)

SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
by: Karvonen, Adam, et al.
Published: (2025)

How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective
by: Liu, Qi, et al.
Published: (2025)

Analyze Feature Flow to Enhance Interpretation and Steering in Language Models
by: Laptev, Daniil, et al.
Published: (2025)

Improving Neuron-level Interpretability with White-box Language Models
by: Bai, Hao, et al.
Published: (2024)

RAVEL: Evaluating Interpretability Methods on Disentangling Language Model Representations
by: Huang, Jing, et al.
Published: (2024)

Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Models
by: Lan, Michael, et al.
Published: (2023)

Interpreting the Repeated Token Phenomenon in Large Language Models
by: Yona, Itay, et al.
Published: (2025)

Towards Incremental Learning in Large Language Models: A Critical Review
by: Jovanovic, Mladjan, et al.
Published: (2024)