Image de couverture de livre

Understanding Addition in Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Quirke, Philip, Barez, Fazl
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Understanding Addition and Subtraction in Transformers
par: Quirke, Philip, et autres
Publié: (2024)

Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Models
par: Lan, Michael, et autres
Publié: (2023)

SafetyNet: Detecting Harmful Outputs in LLMs by Modeling and Monitoring Deceptive Behaviors
par: Chaudhary, Maheep, et autres
Publié: (2025)

Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness
par: Fu, Tingchen, et autres
Publié: (2025)

Towards Understanding Subliminal Learning: When and How Hidden Biases Transfer
par: Schrodi, Simon, et autres
Publié: (2025)

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions
par: Neo, Clement, et autres
Publié: (2024)

Visualizing Neural Network Imagination
par: Wichers, Nevan, et autres
Publié: (2024)

Quantifying Feature Space Universality Across Large Language Models via Sparse Autoencoders
par: Lan, Michael, et autres
Publié: (2024)

Beyond Linear Steering: Unified Multi-Attribute Control for Language Models
par: Oozeer, Narmeen, et autres
Publié: (2025)

Scaling sparse feature circuit finding for in-context learning
par: Kharlapenko, Dmitrii, et autres
Publié: (2025)

Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
par: Kim, Minseon, et autres
Publié: (2025)

Query Circuits: Explaining How Language Models Answer User Prompts
par: Wu, Tung-Yu, et autres
Publié: (2025)

TinySQL: A Progressive Text-to-SQL Dataset for Mechanistic Interpretability Research
par: Harrasse, Abir, et autres
Publié: (2025)

Best-of-N Jailbreaking
par: Hughes, John, et autres
Publié: (2024)

Do Sparse Autoencoders Generalize? A Case Study of Answerability
par: Heindrich, Lovis, et autres
Publié: (2025)

Planning in a recurrent neural network that plays Sokoban
par: Taufeeque, Mohammad, et autres
Publié: (2024)

Rethinking AI Cultural Alignment
par: Bravansky, Michal, et autres
Publié: (2025)

Large Language Models Relearn Removed Concepts
par: Lo, Michelle, et autres
Publié: (2024)

Jailbreak Defense in a Narrow Domain: Limitations of Existing Methods and a New Transcript-Classifier Approach
par: Wang, Tony T., et autres
Publié: (2024)

VAL-Bench: Belief Consistency as a measure for Value Alignment in Language Models
par: Gupta, Aman, et autres
Publié: (2025)

Understanding In-context Learning of Addition via Activation Subspaces
par: Hu, Xinyan, et autres
Publié: (2025)

Beyond Linear Probes: Dynamic Safety Monitoring for Language Models
par: Oldfield, James, et autres
Publié: (2025)

The Data Addition Dilemma
par: Shen, Judy Hanwen, et autres
Publié: (2024)

Enhancing Neural Network Interpretability with Feature-Aligned Sparse Autoencoders
par: Marks, Luke, et autres
Publié: (2024)

Understanding Transformer from the Perspective of Associative Memory
par: Zhong, Shu, et autres
Publié: (2025)

Understanding Transformer Reasoning Capabilities via Graph Algorithms
par: Sanford, Clayton, et autres
Publié: (2024)

Understanding the Training and Generalization of Pretrained Transformer for Sequential Decision Making
par: Wang, Hanzhao, et autres
Publié: (2024)

Interpretability Can Be Actionable
par: Orgad, Hadas, et autres
Publié: (2026)

Open Problems in Machine Unlearning for AI Safety
par: Barez, Fazl, et autres
Publié: (2025)

Chain-of-Thought Hijacking
par: Zhao, Jianli, et autres
Publié: (2025)

Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibility
par: Yu, Annan, et autres
Publié: (2025)

Principled Understanding of Generalization for Generative Transformer Models in Arithmetic Reasoning Tasks
par: Xu, Xingcheng, et autres
Publié: (2024)

Task Addition in Multi-Task Learning by Geometrical Alignment
par: Yim, Soorin, et autres
Publié: (2024)

AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulation
par: Deiseroth, Björn, et autres
Publié: (2023)

Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model
par: Khona, Mikail, et autres
Publié: (2024)

Explaining the Explainer: Understanding the Inner Workings of Transformer-based Symbolic Regression Models
par: van Breda, Arco, et autres
Publié: (2026)

Understanding Reasoning in Thinking Language Models via Steering Vectors
par: Venhoff, Constantin, et autres
Publié: (2025)

It Ain't That Bad: Understanding the Mysterious Performance Drop in OOD Generalization for Generative Transformer Models
par: Xu, Xingcheng, et autres
Publié: (2023)

Towards Theoretical Understanding of Transformer Test-Time Computing: Investigation on In-Context Linear Regression
par: Chen, Xingwu, et autres
Publié: (2025)

Uncovering a Universal Abstract Algorithm for Modular Addition in Neural Networks
par: McCracken, Gavin, et autres
Publié: (2025)