Imagen de Portada

Scaling sparse feature circuit finding for in-context learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kharlapenko, Dmitrii, Shabalin, Stepan, Barez, Fazl, Conmy, Arthur, Nanda, Neel
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Thought Anchors: Which LLM Reasoning Steps Matter?
por: Bogdan, Paul C., et al.
Publicado: (2025)

SafetyNet: Detecting Harmful Outputs in LLMs by Modeling and Monitoring Deceptive Behaviors
por: Chaudhary, Maheep, et al.
Publicado: (2025)

Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness
por: Fu, Tingchen, et al.
Publicado: (2025)

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful
por: Arcuschin, Iván, et al.
Publicado: (2025)

Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Models
por: Lan, Michael, et al.
Publicado: (2023)

Building Production-Ready Probes For Gemini
por: Kramár, János, et al.
Publicado: (2026)

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions
por: Neo, Clement, et al.
Publicado: (2024)

Interpreting Large Text-to-Image Diffusion Models with Dictionary Learning
por: Shabalin, Stepan, et al.
Publicado: (2025)

Beyond Linear Steering: Unified Multi-Attribute Control for Language Models
por: Oozeer, Narmeen, et al.
Publicado: (2025)

Explorations of Self-Repair in Language Models
por: Rushing, Cody, et al.
Publicado: (2024)

Towards Best Practices of Activation Patching in Language Models: Metrics and Methods
por: Zhang, Fred, et al.
Publicado: (2023)

Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
por: Lieberum, Tom, et al.
Publicado: (2024)

Quantifying Feature Space Universality Across Large Language Models via Sparse Autoencoders
por: Lan, Michael, et al.
Publicado: (2024)

Improving Steering Vectors by Targeting Sparse Autoencoder Features
por: Chalnev, Sviatoslav, et al.
Publicado: (2024)

Understanding Addition in Transformers
por: Quirke, Philip, et al.
Publicado: (2023)

Understanding Reasoning in Thinking Language Models via Steering Vectors
por: Venhoff, Constantin, et al.
Publicado: (2025)

Base Models Know How to Reason, Thinking Models Learn When
por: Venhoff, Constantin, et al.
Publicado: (2025)

Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models
por: Ferrando, Javier, et al.
Publicado: (2024)

Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries
por: Ceraolo, Roberto, et al.
Publicado: (2024)

Thought Branches: Interpreting LLM Reasoning Requires Resampling
por: Macar, Uzay, et al.
Publicado: (2025)

Is Value Functions Estimation with Classification Plug-and-play for Offline Reinforcement Learning?
por: Tarasov, Denis, et al.
Publicado: (2024)

Best-of-N Jailbreaking
por: Hughes, John, et al.
Publicado: (2024)

Applying sparse autoencoders to unlearn knowledge in language models
por: Farrell, Eoin, et al.
Publicado: (2024)

Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning
por: Minder, Julian, et al.
Publicado: (2025)

What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation and question answering
por: Maar, Jim, et al.
Publicado: (2026)

How do LLMs Compute Verbal Confidence
por: Kumaran, Dharshan, et al.
Publicado: (2026)

Understanding Addition and Subtraction in Transformers
por: Quirke, Philip, et al.
Publicado: (2024)

Competition Report: Finding Universal Jailbreak Backdoors in Aligned LLMs
por: Rando, Javier, et al.
Publicado: (2024)

VAL-Bench: Belief Consistency as a measure for Value Alignment in Language Models
por: Gupta, Aman, et al.
Publicado: (2025)

Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuning
por: Casademunt, Helena, et al.
Publicado: (2025)

Real-Time Detection of Hallucinated Entities in Long-Form Generation
por: Obeso, Oscar, et al.
Publicado: (2025)

Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation
por: Casademunt, Helena, et al.
Publicado: (2026)

Confidence Regulation Neurons in Language Models
por: Stolfo, Alessandro, et al.
Publicado: (2024)

Refusal in Language Models Is Mediated by a Single Direction
por: Arditi, Andy, et al.
Publicado: (2024)

Jailbreak Defense in a Narrow Domain: Limitations of Existing Methods and a New Transcript-Classifier Approach
por: Wang, Tony T., et al.
Publicado: (2024)

Fluid Representations in Reasoning Models
por: Kharlapenko, Dmitrii, et al.
Publicado: (2026)

Towards Understanding Subliminal Learning: When and How Hidden Biases Transfer
por: Schrodi, Simon, et al.
Publicado: (2025)

Visualizing Neural Network Imagination
por: Wichers, Nevan, et al.
Publicado: (2024)

Improving Dictionary Learning with Gated Sparse Autoencoders
por: Rajamanoharan, Senthooran, et al.
Publicado: (2024)

Universal Neurons in GPT2 Language Models
por: Gurnee, Wes, et al.
Publicado: (2024)