Imagen de Portada

DLM-Scope: Mechanistic Interpretability of Diffusion Language Models via Sparse Autoencoders

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Xu, Jiang, Bingqing, Wan, Yu, Yang, Baosong, Kong, Lingpeng, Zou, Difan
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Memorization of Consistency Distillation for Diffusion Models
por: Jiang, Bingqing, et al.
Publicado: (2026)

Does higher interpretability imply better utility? A Pairwise Analysis on Sparse Autoencoders
por: Wang, Xu, et al.
Publicado: (2025)

Binary Autoencoder for Mechanistic Interpretability of Large Language Models
por: Cho, Hakaze, et al.
Publicado: (2025)

Structured Role-Aware Policy Optimization for Multimodal Reasoning
por: Jiang, Bingqing, et al.
Publicado: (2026)

Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
por: Fu, Yonggan, et al.
Publicado: (2025)

TabDLM: Free-Form Tabular Data Generation via Joint Numerical-Language Diffusion
por: Cai, Donghong, et al.
Publicado: (2026)

A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models
por: Xie, Chengxing, et al.
Publicado: (2024)

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models
por: He, Zirui, et al.
Publicado: (2025)

Teaching Language Models to Critique via Reinforcement Learning
por: Xie, Zhihui, et al.
Publicado: (2025)

A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models
por: Shu, Dong, et al.
Publicado: (2025)

Temporal Sparse Autoencoders: Leveraging the Sequential Nature of Language for Interpretability
por: Bhalla, Usha, et al.
Publicado: (2025)

DLM-SWAI: Steering Diffusion Language Models Before They Unmask
por: An, Hyeseon, et al.
Publicado: (2026)

Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
por: Ye, Jiacheng, et al.
Publicado: (2024)

PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models
por: Zhao, Xueliang, et al.
Publicado: (2025)

Safe-SAIL: Towards a Fine-grained Safety Landscape of Large Language Models via Sparse Autoencoder Interpretation Framework
por: Weng, Jiaqi, et al.
Publicado: (2025)

Mechanistic Interpretability with Sparse Autoencoder Neural Operators
por: Tolooshams, Bahareh, et al.
Publicado: (2025)

Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
por: Lieberum, Tom, et al.
Publicado: (2024)

Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
por: Muhamed, Aashiq, et al.
Publicado: (2024)

Quantifying Feature Space Universality Across Large Language Models via Sparse Autoencoders
por: Lan, Michael, et al.
Publicado: (2024)

Model Unlearning via Sparse Autoencoder Subspace Guided Projections
por: Wang, Xu, et al.
Publicado: (2025)

Residualized Temporal Sparse Autoencoders for Interpreting Diffusion Models
por: Yeung, Calvin, et al.
Publicado: (2026)

Diversity-driven Data Selection for Language Model Tuning through Sparse Autoencoder
por: Yang, Xianjun, et al.
Publicado: (2025)

Scaling Reasoning without Attention
por: Zhao, Xueliang, et al.
Publicado: (2025)

InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders
por: Simon, Elana, et al.
Publicado: (2024)

Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
por: Kim, Geonhee, et al.
Publicado: (2024)

How does Chain of Thought Think? Mechanistic Interpretability of Chain-of-Thought Reasoning with Sparse Autoencoding
por: Chen, Xi, et al.
Publicado: (2025)

SAEMark: Steering Personalized Multilingual LLM Watermarks with Sparse Autoencoders
por: Yu, Zhuohao, et al.
Publicado: (2025)

Sparse Shift Autoencoders for Identifying Concepts from Large Language Model Activations
por: Joshi, Shruti, et al.
Publicado: (2025)

Intrinsic Self-Correction in LLMs: Towards Explainable Prompting via Mechanistic Interpretability
por: Lee, Yu-Ting, et al.
Publicado: (2025)

Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling
por: Prange, Jakob, et al.
Publicado: (2021)

Position: Mechanistic Interpretability Should Prioritize Feature Consistency in SAEs
por: Song, Xiangchen, et al.
Publicado: (2025)

Unveiling Language-Specific Features in Large Language Models via Sparse Autoencoders
por: Deng, Boyi, et al.
Publicado: (2025)

ProtSAE: Disentangling and Interpreting Protein Language Models via Semantically-Guided Sparse Autoencoders
por: Liu, Xiangyu, et al.
Publicado: (2025)

Towards Understanding Fine-Tuning Mechanisms of LLMs via Circuit Analysis
por: Wang, Xu, et al.
Publicado: (2025)

Mechanistic Interpretability of GPT-like Models on Summarization Tasks
por: Mishra, Anurag
Publicado: (2025)

SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders
por: Cywiński, Bartosz, et al.
Publicado: (2025)

Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models
por: Zhou, Hanhan, et al.
Publicado: (2026)

Stochastic Parrots or ICU Experts? Large Language Models in Critical Care Medicine: A Scoping Review
por: Shi, Tongyue, et al.
Publicado: (2024)

Sparse Autoencoder Features for Classifications and Transferability
por: Gallifant, Jack, et al.
Publicado: (2025)

MIB: A Mechanistic Interpretability Benchmark
por: Mueller, Aaron, et al.
Publicado: (2025)