Cover Image

In-Context Learning Without Copying

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sahin, Kerem, Feucht, Sheridan, Belfki, Adam, Brinkmann, Jannik, Mueller, Aaron, Bau, David, Wendler, Chris
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages
by: Brinkmann, Jannik, et al.
Published: (2025)

Vector Arithmetic in Concept and Token Subspaces
by: Feucht, Sheridan, et al.
Published: (2025)

In-Context Algebra
by: Todd, Eric, et al.
Published: (2025)

Erasing Conceptual Knowledge from Language Models
by: Gandikota, Rohit, et al.
Published: (2024)

Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs
by: Feucht, Sheridan, et al.
Published: (2024)

The Dual-Route Model of Induction
by: Feucht, Sheridan, et al.
Published: (2025)

Mechanisms of AI Protein Folding in ESMFold
by: Lu, Kevin, et al.
Published: (2026)

Discovering Forbidden Topics in Language Models
by: Rager, Can, et al.
Published: (2025)

Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models
by: Karvonen, Adam, et al.
Published: (2024)

Measuring Mechanistic Independence: Can Bias Be Removed Without Erasing Demographics?
by: Shan, Zhengyang, et al.
Published: (2025)

NSA: Neuro-symbolic ARC Challenge
by: Batorski, Paweł, et al.
Published: (2025)

Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspect
by: Klerings, Alina, et al.
Published: (2025)

Position-aware Automatic Circuit Discovery
by: Haklay, Tal, et al.
Published: (2025)

In-Context Learning Learns Label Relationships but Is Not Conventional Learning
by: Kossen, Jannik, et al.
Published: (2023)

Mitigating Copy Bias in In-Context Learning through Neuron Pruning
by: Ali, Ameen, et al.
Published: (2024)

Controllable Context Sensitivity and the Knob Behind It
by: Minder, Julian, et al.
Published: (2024)

Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models
by: Marks, Samuel, et al.
Published: (2024)

To Copy or Not to Copy: Copying Is Easier to Induce Than Recall
by: Farahani, Mehrdad, et al.
Published: (2026)

Function Vectors in Large Language Models
by: Todd, Eric, et al.
Published: (2023)

Byte BPE Tokenization as an Inverse string Homomorphism
by: Geng, Saibo, et al.
Published: (2024)

Do Llamas Work in English? On the Latent Language of Multilingual Transformers
by: Wendler, Chris, et al.
Published: (2024)

Resona: Improving Context Copying in Linear Recurrence Models with Retrieval
by: Wang, Xinyu, et al.
Published: (2025)

Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networks
by: Mueller, Aaron
Published: (2024)

Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics
by: Nikankin, Yaniv, et al.
Published: (2024)

Discourse-Aware In-Context Learning for Temporal Expression Normalization
by: Gautam, Akash Kumar, et al.
Published: (2024)

CopySpec: Accelerating LLMs with Speculative Copy-and-Paste Without Compromising Quality
by: Dumitru, Razvan-Gabriel, et al.
Published: (2025)

Incremental Sentence Processing Mechanisms in Autoregressive Transformer Language Models
by: Hanna, Michael, et al.
Published: (2024)

Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access
by: Geng, Saibo, et al.
Published: (2024)

CopyNE: Better Contextual ASR by Copying Named Entities
by: Zhou, Shilin, et al.
Published: (2023)

Context Copying Modulation: The Role of Entropy Neurons in Managing Parametric and Contextual Knowledge Conflicts
by: Tighidet, Zineddine, et al.
Published: (2025)

In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax
by: Mueller, Aaron, et al.
Published: (2023)

Locating and Editing Factual Associations in Mamba
by: Sharma, Arnab Sen, et al.
Published: (2024)

Multilingual Contrastive Decoding via Language-Agnostic Layers Skipping
by: Zhu, Wenhao, et al.
Published: (2024)

Self-Refinement Strategies for LLM-based Product Attribute Value Extraction
by: Brinkmann, Alexander, et al.
Published: (2025)

Separating Tongue from Thought: Activation Patching Reveals Language-Agnostic Concept Representations in Transformers
by: Dumas, Clément, et al.
Published: (2024)

LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti
by: Prama, Tabia Tanzin, et al.
Published: (2025)

Do explanations generalize across large reasoning models?
by: Pal, Koyena, et al.
Published: (2026)

Pointer-Generator Networks for Low-Resource Machine Translation: Don't Copy That!
by: Bafna, Niyati, et al.
Published: (2024)

Characterizing the Role of Similarity in the Property Inferences of Language Models
by: Rodriguez, Juan Diego, et al.
Published: (2024)

Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning
by: Yin, Qingyu, et al.
Published: (2024)