Cover Image

Transformers Learn Robust In-Context Regression under Distributional Uncertainty

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cao, Hoang T. H., Trinh, Hai D. V., Quan, Tho, Truong, Lan V.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformers Don't In-Context Learn Least Squares Regression
by: Hill, Joshua, et al.
Published: (2025)

Robust Uncertainty Estimation under Distribution Shift via Difference Reconstruction
by: Xu, Xinran, et al.
Published: (2026)

How Transformers Learn In-Context Recall Tasks? Optimality, Training Dynamics and Generalization
by: Nguyen, Quan, et al.
Published: (2025)

Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning
by: Li, Yanjie, et al.
Published: (2024)

Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship
by: Nguyen, Nang Hung, et al.
Published: (2026)

DR-SAC: Distributionally Robust Soft Actor-Critic for Reinforcement Learning under Uncertainty
by: Cui, Mingxuan, et al.
Published: (2025)

In-Context Symbolic Regression for Robustness-Improved Kolmogorov-Arnold Networks
by: Sovrano, Francesco, et al.
Published: (2026)

Detecting Neurovascular Instability from Multimodal Physiological Signals Using Wearable-Compatible Edge AI: A Responsible Computational Framework
by: Hoa, Truong Quynh, et al.
Published: (2026)

On the Robustness of Transformers against Context Hijacking for Linear Classification
by: Li, Tianle, et al.
Published: (2025)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
by: Nguyen, Anh B. H., et al.
Published: (2026)

Robust Regularized Policy Iteration under Transition Uncertainty
by: Lin, Hongqiang, et al.
Published: (2026)

Learning Displacement-Robust Representations for Landslide Early Warning under Rainfall Forecast Uncertainty
by: Ozeki, Ren, et al.
Published: (2026)

Uncertainty Regularized Evidential Regression
by: Ye, Kai, et al.
Published: (2024)

Learning Scenario Reduction for Two-Stage Robust Optimization with Discrete Uncertainty
by: Lin, Tianjue, et al.
Published: (2026)

Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression
by: Fu, Deqing, et al.
Published: (2023)

UncertaintyZoo: A Unified Toolkit for Quantifying Predictive Uncertainty in Deep Learning Systems
by: Wu, Xianzong, et al.
Published: (2025)

Wasserstein Distributionally Robust Bayesian Optimization with Continuous Context
by: Micheli, Francesco, et al.
Published: (2025)

Uncertainty-based Offline Variational Bayesian Reinforcement Learning for Robustness under Diverse Data Corruptions
by: Yang, Rui, et al.
Published: (2024)

Towards Theoretical Understanding of Transformer Test-Time Computing: Investigation on In-Context Linear Regression
by: Chen, Xingwu, et al.
Published: (2025)

Efficient Modular Learning through Naive LoRA Summation: Leveraging Orthogonality in High-Dimensional Models
by: Cao, Zhanhao, et al.
Published: (2025)

Transformers Handle Endogeneity in In-Context Linear Regression
by: Liang, Haodong, et al.
Published: (2024)

Graph Diffusion Transformers are In-Context Molecular Designers
by: Liu, Gang, et al.
Published: (2025)

Investigation into In-Context Learning Capabilities of Transformers
by: Chandrupatla, Rushil, et al.
Published: (2026)

Learning under Quantization for High-Dimensional Linear Regression
by: Zhang, Dechen, et al.
Published: (2025)

Revisiting Kernel Attention with Correlated Gaussian Process Representation
by: Bui, Long Minh, et al.
Published: (2025)

Adaptive Conformal Guidance for Learning under Uncertainty
by: Liu, Rui, et al.
Published: (2025)

Adjusting Regression Models for Conditional Uncertainty Calibration
by: Gao, Ruijiang, et al.
Published: (2024)

Few-Shot Class Incremental Learning via Robust Transformer Approach
by: Paeedeh, Naeem, et al.
Published: (2024)

Understanding Social Perception, Interactions, and Safety Aspects of Sidewalk Delivery Robots Using Sentiment Analysis
by: Du, Yuchen, et al.
Published: (2024)

SLogic: Subgraph-Informed Logical Rule Learning for Knowledge Graph Completion
by: Le, Trung Hoang, et al.
Published: (2025)

The Impact of Machine Learning Uncertainty on the Robustness of Counterfactual Explanations
by: Christodoulou, Leonidas, et al.
Published: (2026)

Uncertainty Estimation using Variance-Gated Distributions
by: Gillis, H. Martin, et al.
Published: (2025)

Whom to Trust? Elective Learning for Distributed Gaussian Process Regression
by: Yang, Zewen, et al.
Published: (2024)

Long-Context Attention Benchmark: From Kernel Efficiency to Distributed Context Parallelism
by: Bu, Tao, et al.
Published: (2025)

Norm-Hierarchy Transitions in Representation Learning: When and Why Neural Networks Abandon Shortcuts
by: Khanh, Truong Xuan, et al.
Published: (2026)

Meta-Learning Transformers to Improve In-Context Generalization
by: Braccaioli, Lorenzo, et al.
Published: (2025)

Learning to Solve Job Shop Scheduling under Uncertainty
by: Infantes, Guillaume, et al.
Published: (2024)

Unimodal Distributions for Ordinal Regression
by: Cardoso, Jaime S., et al.
Published: (2023)

Bridging Distributional and Risk-sensitive Reinforcement Learning with Provable Regret Bounds
by: Liang, Hao, et al.
Published: (2022)

Coded Robust Aggregation for Distributed Learning under Byzantine Attacks
by: Li, Chengxi, et al.
Published: (2025)