Imagen de Portada

BatchTopK Sparse Autoencoders

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bussmann, Bart, Leask, Patrick, Nanda, Neel
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Sparse Autoencoders Do Not Find Canonical Units of Analysis
por: Leask, Patrick, et al.
Publicado: (2025)

Learning Multi-Level Features with Matryoshka Sparse Autoencoders
por: Bussmann, Bart, et al.
Publicado: (2025)

Are Sparse Autoencoders Useful? A Case Study in Sparse Probing
por: Kantamneni, Subhash, et al.
Publicado: (2025)

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit
por: Jiang, Nick, et al.
Publicado: (2025)

Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs
por: Bozoukov, Matthew, et al.
Publicado: (2025)

Improving Dictionary Learning with Gated Sparse Autoencoders
por: Rajamanoharan, Senthooran, et al.
Publicado: (2024)

AbsTopK: Rethinking Sparse Autoencoders For Bidirectional Features
por: Zhu, Xudong, et al.
Publicado: (2025)

ReSAE: Residualized Sparse Autoencoders for Multi-Layer Transformer Interventions
por: Poduval, Prathyush, et al.
Publicado: (2026)

Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models
por: Leask, Patrick, et al.
Publicado: (2025)

Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
por: Lieberum, Tom, et al.
Publicado: (2024)

Explorations of Self-Repair in Language Models
por: Rushing, Cody, et al.
Publicado: (2024)

Towards Best Practices of Activation Patching in Language Models: Metrics and Methods
por: Zhang, Fred, et al.
Publicado: (2023)

Bidirectional Variational Autoencoders
por: Kosko, Bart, et al.
Publicado: (2025)

Towards Principled Evaluations of Sparse Autoencoders for Interpretability and Control
por: Makelov, Aleksandar, et al.
Publicado: (2024)

Convergent Linear Representations of Emergent Misalignment
por: Soligo, Anna, et al.
Publicado: (2025)

Sparse Autoencoders, Again?
por: Lu, Yin, et al.
Publicado: (2025)

Are Sparse Autoencoder Benchmarks Reliable?
por: Chanin, David
Publicado: (2026)

Model Organisms for Emergent Misalignment
por: Turner, Edward, et al.
Publicado: (2025)

Understanding Reasoning in Thinking Language Models via Steering Vectors
por: Venhoff, Constantin, et al.
Publicado: (2025)

Base Models Know How to Reason, Thinking Models Learn When
por: Venhoff, Constantin, et al.
Publicado: (2025)

Improving Sparse Autoencoder with Dynamic Attention
por: Wang, Dongsheng, et al.
Publicado: (2026)

Decoding as Optimisation on the Probability Simplex: From Top-K to Top-P (Nucleus) to Best-of-K Samplers
por: Ji, Xiaotong, et al.
Publicado: (2026)

Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models
por: Ferrando, Javier, et al.
Publicado: (2024)

Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoders
por: Ayonrinde, Kola
Publicado: (2024)

Empirical Evaluation of Progressive Coding for Sparse Autoencoders
por: Peter, Hans, et al.
Publicado: (2025)

Do Sparse Autoencoders Capture Concept Manifolds?
por: Bhalla, Usha, et al.
Publicado: (2026)

On the transferability of Sparse Autoencoders for interpreting compressed models
por: Gupte, Suchit, et al.
Publicado: (2025)

Data Whitening Improves Sparse Autoencoder Learning
por: Saraswatula, Ashwin, et al.
Publicado: (2025)

Improving Robustness In Sparse Autoencoders via Masked Regularization
por: Narayanaswamy, Vivek, et al.
Publicado: (2026)

Evaluating and Designing Sparse Autoencoders by Approximating Quasi-Orthogonality
por: Lee, Sewoong, et al.
Publicado: (2025)

Graph-Regularized Sparse Autoencoders for LLM Safety Steering
por: Yeon, Jehyeok, et al.
Publicado: (2025)

Thought Branches: Interpreting LLM Reasoning Requires Resampling
por: Macar, Uzay, et al.
Publicado: (2025)

Thought Anchors: Which LLM Reasoning Steps Matter?
por: Bogdan, Paul C., et al.
Publicado: (2025)

Evaluating Sparse Autoencoders on Targeted Concept Erasure Tasks
por: Karvonen, Adam, et al.
Publicado: (2024)

Beyond Redundancy: Diverse and Specialized Multi-Expert Sparse Autoencoder
por: Xu, Zhen, et al.
Publicado: (2025)

Projecting Assumptions: The Duality Between Sparse Autoencoders and Concept Geometry
por: Hindupur, Sai Sumedh R., et al.
Publicado: (2025)

Don't Forget It! Conditional Sparse Autoencoder Clamping Works for Unlearning
por: Khoriaty, Matthew, et al.
Publicado: (2025)

Interpreting Attention Layer Outputs with Sparse Autoencoders
por: Kissane, Connor, et al.
Publicado: (2024)

What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation and question answering
por: Maar, Jim, et al.
Publicado: (2026)

Scaling sparse feature circuit finding for in-context learning
por: Kharlapenko, Dmitrii, et al.
Publicado: (2025)