Cover Image

Towards Understanding Layer Contributions in Tabular In-Context Learning Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Balef, Amir Rezaei, Koshil, Mykhailo, Eggensperger, Katharina
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Is One Layer Enough? Understanding Inference Dynamics in Tabular Foundation Models
by: Balef, Amir Rezaei, et al.
Published: (2026)

In-Context Decision Making for Optimizing Complex AutoML Pipelines
by: Balef, Amir Rezaei, et al.
Published: (2025)

Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learning
by: Balef, Amir Rezaei, et al.
Published: (2025)

TabICL: A Tabular Foundation Model for In-Context Learning on Large Data
by: Qu, Jingang, et al.
Published: (2025)

Orion-Bix: Bi-Axial Attention for Tabular In-Context Learning
by: Bouadi, Mohamed, et al.
Published: (2025)

LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models
by: Ipas, Oroel, et al.
Published: (2026)

Orion-MSP: Multi-Scale Sparse Attention for Tabular In-Context Learning
by: Bouadi, Mohamed, et al.
Published: (2025)

Improving LLM Group Fairness on Tabular Data via In-Context Learning
by: Cherepanova, Valeriia, et al.
Published: (2024)

Mitigating Label Shift in Tabular In-Context Learning via Test-Time Posterior Adjustment
by: Lee, Seunghan
Published: (2026)

Towards Context-Aware Domain Generalization: Understanding the Benefits and Limits of Marginal Transfer Learning
by: Müller, Jens, et al.
Published: (2023)

Noise Immunity in In-Context Tabular Learning: An Empirical Robustness Analysis of TabPFN's Attention Mechanisms
by: Hu, James, et al.
Published: (2026)

Multi-Layer Attention-Based Explainability via Transformers for Tabular Data
by: Gavito, Andrea Treviño, et al.
Published: (2023)

Position: Foundation Models for Tabular Data within Systemic Contexts Need Grounding
by: Klein, Tassilo, et al.
Published: (2025)

Learning to Attack: A Bandit Approach to Adversarial Context Poisoning
by: Telikani, Ray, et al.
Published: (2026)

Benchmarking Counterfactual Interpretability in Deep Learning Models for Time Series Classification
by: Kan, Ziwen, et al.
Published: (2024)

ConTextTab: A Semantics-Aware Tabular In-Context Learner
by: Spinaci, Marco, et al.
Published: (2025)

Tabular Learning: Encoding for Entity and Context Embeddings
by: Reusser, Fredy
Published: (2024)

DP-TabICL: In-Context Learning with Differentially Private Tabular Data
by: Carey, Alycia N., et al.
Published: (2024)

Understanding the Dynamics of Demonstration Conflict in In-Context Learning
by: Jiao, Difan, et al.
Published: (2026)

In-context Learning of Evolving Data Streams with Tabular Foundational Models
by: Lourenço, Afonso, et al.
Published: (2025)

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
by: Schnake, Thomas, et al.
Published: (2024)

Robust Tabular Foundation Models
by: Peroni, Matthew, et al.
Published: (2025)

TabPFN-MT: A Natively Multitask In-Context Learner for Tabular Data
by: Cureton, Cormac, et al.
Published: (2026)

Understanding Prompt Tuning and In-Context Learning via Meta-Learning
by: Genewein, Tim, et al.
Published: (2025)

TabularMath: Evaluating Computational Extrapolation in Tabular Learning via Program-Verified Synthesis
by: Cheng, Zerui, et al.
Published: (2026)

On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning
by: Sun, Haoyuan, et al.
Published: (2025)

A Survey on Deep Tabular Learning
by: Somvanshi, Shriyank, et al.
Published: (2024)

Tabular and Deep Learning for the Whittle Index
by: Relaño, Francisco Robledo, et al.
Published: (2024)

Membership Inference over Diffusion-models-based Synthetic Tabular Data
by: Cheng, Peini, et al.
Published: (2025)

Graph of Agents: Principled Long Context Modeling by Emergent Multi-Agent Collaboration
by: Joo, Taejong, et al.
Published: (2025)

Boosting Relational Deep Learning with Pretrained Tabular Models
by: Lachi, Veronica, et al.
Published: (2025)

Tabular Foundation Models Can Learn Association Rules
by: Karabulut, Erkan, et al.
Published: (2026)

ReTabAD: A Benchmark for Restoring Semantic Context in Tabular Anomaly Detection
by: Yoon, Sanghyu, et al.
Published: (2025)

TabGen-ICL: Residual-Aware In-Context Example Selection for Tabular Data Generation
by: Fang, Liancheng, et al.
Published: (2025)

Automated Model Selection for Tabular Data
by: Amballa, Avinash, et al.
Published: (2024)

Towards Monotonic Improvement in In-Context Reinforcement Learning
by: Zhang, Wenhao, et al.
Published: (2025)

Disentangling Tabular Data Towards Better One-Class Anomaly Detection
by: Ye, Jianan, et al.
Published: (2024)

Towards Theoretical Understanding of Transformer Test-Time Computing: Investigation on In-Context Linear Regression
by: Chen, Xingwu, et al.
Published: (2025)

GPT and Prejudice: A Sparse Approach to Understanding Learned Representations in Large Language Models
by: Mahran, Mariam, et al.
Published: (2025)

LLM Embeddings for Deep Learning on Tabular Data
by: Koloski, Boshko, et al.
Published: (2025)