Cover Image

Selective Induction Heads: How Transformers Select Causal Structures In Context

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	D'Angelo, Francesco, Croce, Francesco, Flammarion, Nicolas
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Methodology
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformers Learn Latent Mixture Models In-Context via Mirror Descent
by: D'Angelo, Francesco, et al.
Published: (2026)

Exact Learning of Arithmetic with Differentiable Agents
by: Papazov, Hristo, et al.
Published: (2025)

Why Do We Need Weight Decay in Modern Deep Learning?
by: D'Angelo, Francesco, et al.
Published: (2023)

Is In-Context Learning Sufficient for Instruction Following in LLMs?
by: Zhao, Hao, et al.
Published: (2024)

Towards a holistic understanding of Selection Bias for Causal Effect Identification
by: Qiu, Yiwen, et al.
Published: (2026)

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks
by: Andriushchenko, Maksym, et al.
Published: (2024)

Causally-Aware Unsupervised Feature Selection Learning
by: Shen, Zongxin, et al.
Published: (2024)

Foundations of Structural Causal Models with Latent Selection
by: Chen, Leihao, et al.
Published: (2024)

Regression-Based Estimation of Causal Effects in the Presence of Selection Bias and Confounding
by: Hafer, Marlies, et al.
Published: (2025)

Agglomerative Hierarchical Clustering for Selecting Valid Instrumental Variables
by: Apfel, Nicolas, et al.
Published: (2021)

FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens
by: Schlarmann, Christian, et al.
Published: (2025)

On the Out-of-Distribution Generalization of Reasoning in Multimodal LLMs for Simple Visual Planning Tasks
by: Neuhaus, Yannic, et al.
Published: (2026)

Detecting Changes in Causal Dependence with Kernels and Copulas
by: Gavioli-Akilagun, Shakeel, et al.
Published: (2026)

Double Machine Learning for Conditional Moment Restrictions: IV Regression, Proximal Causal Learning and Beyond
by: Shao, Daqian, et al.
Published: (2025)

PCM Selector: Penalized Covariate-Mediator Selection Operator for Evaluating Linear Causal Effects
by: Nanmo, Hisayoshi, et al.
Published: (2024)

Characterization and Learning of Causal Graphs with Latent Confounders and Post-treatment Selection from Interventional Data
by: Luo, Gongxu, et al.
Published: (2025)

A finite-infinite shared atoms nested model for the Bayesian analysis of large grouped data
by: D'Angelo, Laura, et al.
Published: (2024)

Causal Unit Selection using Tractable Arithmetic Circuits
by: Huang, Haiying, et al.
Published: (2024)

CausalFormer: An Interpretable Transformer for Temporal Causal Discovery
by: Kong, Lingbai, et al.
Published: (2024)

Self-Compatibility: Evaluating Causal Discovery without Ground Truth
by: Faller, Philipp M., et al.
Published: (2023)

Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimation
by: Mahajan, Divyat, et al.
Published: (2022)

Model Class Selection
by: Cecil, Ryan, et al.
Published: (2025)

Context-Aware Reasoning On Parametric Knowledge for Inferring Causal Variables
by: Sheth, Ivaxi, et al.
Published: (2024)

2D Stability Selection: Design Jittering for Doubly Stable Feature Selection
by: Nouraie, Mahdi, et al.
Published: (2026)

Robust Ultra-High-Dimensional Variable Selection With Correlated Structure Using Group Testing
by: Guo, Wanru, et al.
Published: (2026)

High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach
by: Zhao, Boxin, et al.
Published: (2021)

Extracting the Multiscale Causal Backbone of Brain Dynamics
by: D'Acunto, Gabriele, et al.
Published: (2023)

On the Selection Stability of Stability Selection and Its Applications
by: Nouraie, Mahdi, et al.
Published: (2024)

Nearly Optimal Subdata Selection
by: Yang, Min, et al.
Published: (2026)

Penalized Generative Variable Selection
by: Wang, Tong, et al.
Published: (2024)

Selection of the Most Probable Best
by: Kim, Taeho, et al.
Published: (2022)

MMM: Clustering Multivariate Longitudinal Mixed-type Data
by: Amato, Francesco, et al.
Published: (2025)

Additive Distributionally Robust Ranking and Selection
by: Li, Zaile, et al.
Published: (2025)

Optimizing Feature Selection in Causal Inference: A Three-Stage Computational Framework for Unbiased Estimation
by: Yang, Tianyu, et al.
Published: (2025)

Robustness of Algorithms for Causal Structure Learning to Hyperparameter Choice
by: Machlanski, Damian, et al.
Published: (2023)

Structural Causality-based Generalizable Concept Discovery Models
by: Sinha, Sanchit, et al.
Published: (2024)

Introducing Diminutive Causal Structure into Graph Representation Learning
by: Gao, Hang, et al.
Published: (2024)

Optimal Model Selection for Conformalized Robust Optimization
by: Bao, Yajie, et al.
Published: (2025)

Diffusion-Driven High-Dimensional Variable Selection
by: Wang, Minjie, et al.
Published: (2025)

Linear Models, Variable Selection, Artificial Intelligence
by: Alrawkan, By Riyadh, et al.
Published: (2026)