Cover Image

How Does the Pretraining Distribution Shape In-Context Learning? Task Selection, Generalization, and Robustness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Azizian, Waïss, Hasan, Ali
Format:	Preprint
Published:	2025
Subjects:	Machine Learning G.3; I.2.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

$\texttt{skwdro}$: a library for Wasserstein distributionally robust machine learning
by: Vincent, Florian, et al.
Published: (2024)

The Role of Causal Features in Strategic Classification for Robustness and Alignment
by: Gois, Antonio, et al.
Published: (2026)

Enhanced Random Subspace Local Projections for High-Dimensional Time Series Analysis
by: Khalid, Eman, et al.
Published: (2026)

Variational Search Distributions
by: Steinberg, Daniel M., et al.
Published: (2024)

SmallML: Bayesian Transfer Learning for Small-Data Predictive Analytics
by: Leontev, Semen
Published: (2025)

TrajGPT: Controlled Synthetic Trajectory Generation Using a Multitask Transformer-Based Spatiotemporal Model
by: Hsu, Shang-Ling, et al.
Published: (2024)

Blind-Spot Mass: A Good-Turing Framework for Quantifying Deployment Coverage Risk in Machine Learning Systems
by: Pal, Biplab, et al.
Published: (2026)

Uncertainty Propagation Networks for Neural Ordinary Differential Equations
by: Jahanshahi, Hadi, et al.
Published: (2025)

HAPEns: Hardware-Aware Post-Hoc Ensembling for Tabular Data
by: Maier, Jannis, et al.
Published: (2026)

Bayesian Optimization in Linear Time
by: Schneider, Jesse, et al.
Published: (2026)

EXCODER: EXplainable Classification Of DiscretE time series Representations
by: Hahn, Yannik, et al.
Published: (2026)

Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices
by: Nickelsen, Daniel, et al.
Published: (2024)

From Theory to Practice with RAVEN-UCB: Addressing Non-Stationarity in Multi-Armed Bandits through Variance Adaptation
by: Fang, Junyi, et al.
Published: (2025)

Improving ML Training Data with Gold-Standard Quality Metrics
by: Barrett, Leslie, et al.
Published: (2025)

Front-door Reducibility: Reducing ADMGs to the Standard Front-door Setting via a Graphical Criterion
by: Mao, Jianqiao, et al.
Published: (2025)

Modeling and Controlling Deployment Reliability under Temporal Distribution Shift
by: Rahman, Naimur, et al.
Published: (2026)

Unified Unbiased Variance Estimation for Maximum Mean Discrepancy: Robust Finite-Sample Performance with Imbalanced Data and Exact Acceleration under Null and Alternative Hypotheses
by: Zhong, Shijie, et al.
Published: (2026)

Off-policy Evaluation with Deeply-abstracted States
by: Hao, Meiling, et al.
Published: (2024)

Kernel-Smoothed Scores for Denoising Diffusion: A Bias-Variance Study
by: Gabriel, Franck, et al.
Published: (2025)

A Survey of Methods, Challenges and Perspectives in Causality
by: Gendron, Gaël, et al.
Published: (2023)

JANUS: Structured Bidirectional Generation for Guaranteed Constraints and Analytical Uncertainty
by: Racicot, Taha
Published: (2026)

Learning Nonlinear Regime Transitions via Semi-Parametric State-Space Models
by: Hiremath, Prakul Sunil
Published: (2026)

Randomized Approach to Matrix Completion: Applications in Recommendation Systems and Image Inpainting
by: Krajewska, Antonina, et al.
Published: (2024)

A Survey on Data-Dependent Worst-Case Generalization Bounds
by: Leroux, Hubert, et al.
Published: (2026)

Optimizing Latent Dimension Allocation in Hierarchical VAEs: Balancing Attenuation and Information Retention for OOD Detection
by: Williamson, Dane, et al.
Published: (2025)

Aggregating Direct and Indirect Neighbors through Graph Linear Transformations
by: Rosenhoover, Marshall, et al.
Published: (2025)

Bayesian X-Learner: Calibrated Posterior Inference for Heterogeneous Treatment Effects under Heavy-Tailed Outcomes
by: Uehara, Eichi
Published: (2026)

Contrastive and Multi-Task Learning on Noisy Brain Signals with Nonlinear Dynamical Signatures
by: Ghosh, Sucheta, et al.
Published: (2026)

A Benchmark of Classical and Deep Learning Models for Agricultural Commodity Price Forecasting on A Novel Bangladeshi Market Price Dataset
by: Muhammad, Tashreef, et al.
Published: (2026)

A Practical Upper Bound on Selection Bias Effects in Medical Prediction Models
by: Liu, Kara, et al.
Published: (2026)

LABO: LLM-Accelerated Bayesian Optimization through Broad Exploration and Selective Experimentation
by: Chen, Zhuo, et al.
Published: (2026)

MINERVA: Mutual Information Neural Estimation for Supervised Feature Selection
by: Muvunza, Taurai, et al.
Published: (2025)

Sinusoidal Initialization, Time for a New Start
by: Fernández-Hernández, Alberto, et al.
Published: (2025)

Closing the Curvature Gap: Full Transformer Hessians and Their Implications for Scaling Laws
by: Petrov, Egor, et al.
Published: (2025)

Task Adaptation from Skills: Information Geometry, Disentanglement, and New Objectives for Unsupervised Reinforcement Learning
by: Yang, Yucheng, et al.
Published: (2025)

The Reasoning-Creativity Trade-off: Toward Creativity-Driven Problem Solving
by: Luyten, Max Ruiz, et al.
Published: (2026)

Uncertainty Quantification for Scientific Machine Learning using Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)
by: Ju, Y. Sungtaek
Published: (2025)

Assessing the Performance-Efficiency Trade-off of Foundation Models in Probabilistic Electricity Price Forecasting
by: Lettner, Jan Niklas, et al.
Published: (2026)

Transfer Learning for Matrix Completion
by: Liu, Dali, et al.
Published: (2025)

Causal Discovery in Semi-Stationary Time Series
by: Gao, Shanyun, et al.
Published: (2024)