Cover Image

How Few-Shot Examples Add Up: A Causal Decomposition of Function Vectors in In-Context Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Entang, Wang, Yiwei, Bakalova, Aleksandra, Hahn, Michael
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Discovering Interpretable Algorithms by Decompiling Transformers to RASP
by: Huang, Xinting, et al.
Published: (2026)

Few-Shot Causal Representation Learning for Out-of-Distribution Generalization on Heterogeneous Graphs
by: Ding, Pengfei, et al.
Published: (2024)

Context-aware Graph Causality Inference for Few-Shot Molecular Property Prediction
by: Hoang, Van Thuy, et al.
Published: (2026)

Revisiting Few-Shot Learning from a Causal Perspective
by: Lin, Guoliang, et al.
Published: (2022)

Quantum Diffusion Models for Few-Shot Learning
by: Wang, Ruhan, et al.
Published: (2024)

Causal-Symbolic Meta-Learning (CSML): Inducing Causal World Models for Few-Shot Generalization
by: S, Mohamed Zayaan
Published: (2025)

Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B
by: Bakalova, Aleksandra, et al.
Published: (2025)

Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs
by: Liu, Ran, et al.
Published: (2024)

Fast Graph Sharpness-Aware Minimization for Enhancing and Accelerating Few-Shot Node Classification
by: Luo, Yihong, et al.
Published: (2024)

Meta-Task: A Method-Agnostic Framework for Learning to Regularize in Few-Shot Learning
by: Rostami, Mohammad, et al.
Published: (2024)

Meta-Learning Based Few-Shot Graph-Level Anomaly Detection
by: Li, Liting, et al.
Published: (2025)

In-Context and Few-Shots Learning for Forecasting Time Series Data based on Large Language Models
by: Gopali, Saroj, et al.
Published: (2025)

Does Prior Data Matter? Exploring Joint Training in the Context of Few-Shot Class-Incremental Learning
by: Kim, Shiwon, et al.
Published: (2025)

A Strong Baseline for Molecular Few-Shot Learning
by: Formont, Philippe, et al.
Published: (2024)

Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction
by: Wang, Liang, et al.
Published: (2024)

Many-Shot In-Context Learning
by: Agarwal, Rishabh, et al.
Published: (2024)

How to Marginalize in Causal Structure Learning?
by: Zhao, William, et al.
Published: (2025)

In-Context Unlearning: Language Models as Few Shot Unlearners
by: Pawelczyk, Martin, et al.
Published: (2023)

A Recursive Decomposition Framework for Causal Structure Learning in the Presence of Latent Variables
by: Li, Zheng, et al.
Published: (2026)

A New Spatiotemporal Correlation Anomaly Detection Method that Integrates Contrastive Learning and Few-Shot Learning in Wireless Sensor Networks
by: Ye, Miao, et al.
Published: (2025)

A Survey of Few-Shot Learning for Biomedical Time Series
by: Li, Chenqi, et al.
Published: (2024)

SGPT: Few-Shot Prompt Tuning for Signed Graphs
by: Zhai, Zian, et al.
Published: (2024)

Few-Shot Class-Incremental Learning with Prior Knowledge
by: Jiang, Wenhao, et al.
Published: (2024)

An experimental approach on Few Shot Class Incremental Learning
by: Adam, Marinela
Published: (2025)

NTK-Guided Few-Shot Class Incremental Learning
by: Liu, Jingren, et al.
Published: (2024)

Federated Few-Shot Learning for Epileptic Seizure Detection Under Privacy Constraints
by: Sysoykova, Ekaterina, et al.
Published: (2025)

Belief or Circuitry? Causal Evidence for In-Context Graph Learning
by: Kowalyshyn, Katharine, et al.
Published: (2026)

A Framework for Quantifying How Pre-Training and Context Benefit In-Context Learning
by: Song, Bingqing, et al.
Published: (2025)

Boosting Meta-Learning for Few-Shot Text Classification via Label-guided Distance Scaling
by: Gao, Yunlong, et al.
Published: (2026)

Language-Guided Reinforcement Learning for Hard Attention in Few-Shot Learning
by: Nikpour, Bahareh, et al.
Published: (2023)

PACIA: Parameter-Efficient Adapter for Few-Shot Molecular Property Prediction
by: Wu, Shiguang, et al.
Published: (2023)

Compressing Many-Shots in In-Context Learning
by: Khatri, Devvrit, et al.
Published: (2025)

Toward Temporal Causal Representation Learning with Tensor Decomposition
by: Chen, Jianhong, et al.
Published: (2025)

Where to Add PDE Diffusion in Transformers
by: Zhang, Yukun, et al.
Published: (2025)

MoEMeta: Mixture-of-Experts Meta Learning for Few-Shot Relational Learning
by: Wu, Han, et al.
Published: (2025)

Active Few-Shot Fine-Tuning
by: Hübotter, Jonas, et al.
Published: (2024)

Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition
by: Zhao, Guanqun, et al.
Published: (2026)

Cross-Domain Few-Shot Learning via Adaptive Transformer Networks
by: Paeedeh, Naeem, et al.
Published: (2024)

Few-Shot Class-Incremental Learning with Non-IID Decentralized Data
by: Liu, Cuiwei, et al.
Published: (2024)

Few-Shot Class Incremental Learning via Robust Transformer Approach
by: Paeedeh, Naeem, et al.
Published: (2024)