Cover Image

Implicit Statistical Inference in Transformers: Approximating Likelihood-Ratio Tests In-Context

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chaudhry, Faris, Gadkari, Siddhant
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Feature Starvation as Geometric Instability in Sparse Autoencoders
by: Chaudhry, Faris, et al.
Published: (2026)

Conformal Inference under High-Dimensional Covariate Shifts via Likelihood-Ratio Regularization
by: Joshi, Sunay, et al.
Published: (2025)

Approximated Likelihood Ratio: A Forward-Only and Parallel Framework for Boosting Neural Network Training
by: Zhang, Zeliang, et al.
Published: (2024)

Generalized Graph Transformer Variational Autoencoder
by: Karki, Siddhant
Published: (2025)

ExpTest: Automating Learning Rate Searching and Tuning with Insights from Linearized Neural Networks
by: Chaudhry, Zan, et al.
Published: (2024)

Know When to Abstain: Optimal Selective Classification with Likelihood Ratios
by: Heng, Alvin, et al.
Published: (2025)

Towards Universal Neural Likelihood Inference
by: Brahmavar, Shreyas Bhat, et al.
Published: (2025)

Multi-Step Likelihood-Ratio Correction for Reinforcement Learning with Verifiable Rewards
by: Yoon, Deokgyu, et al.
Published: (2026)

Non-Interfering Weight Fields: Treating Model Parameters as a Continuously Extensible Function
by: Chaudhry, Sarim
Published: (2026)

Implicit Maximum Likelihood Estimation for Real-time Generative Model Predictive Control
by: Lee, Grayson, et al.
Published: (2026)

Likelihood-based Sensor Calibration using Affine Transformation
by: Machhamer, Rüdiger, et al.
Published: (2023)

Fast and Robust Likelihood-Guided Diffusion Posterior Sampling with Amortized Variational Inference
by: Zheng, Léon, et al.
Published: (2026)

Recursive Concept Evolution for Compositional Reasoning in Large Language Models
by: Chaudhry, Sarim
Published: (2026)

The Geometry of Projection Heads: Conditioning, Invariance, and Collapse
by: Chaudhry, Faris
Published: (2026)

Asymptotic and Finite-Time Guarantees for Langevin-Based Temperature Annealing in InfoNCE
by: Chaudhry, Faris
Published: (2026)

IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation
by: Rana, Krishan, et al.
Published: (2025)

Towards Theoretical Understanding of Transformer Test-Time Computing: Investigation on In-Context Linear Regression
by: Chen, Xingwu, et al.
Published: (2025)

Comet: A Communication-efficient and Performant Approximation for Private Transformer Inference
by: Xu, Xiangrui, et al.
Published: (2024)

Linear Transformers Implicitly Discover Unified Numerical Algorithms
by: Lutz, Patrick, et al.
Published: (2025)

Circular Belief Propagation for Approximate Probabilistic Inference
by: Bouttier, Vincent, et al.
Published: (2024)

Scaling Laws and Pathologies of Single-Layer PINNs: Network Width and PDE Nonlinearity
by: Chaudhry, Faris
Published: (2026)

Class Incremental Learning via Likelihood Ratio Based Task Prediction
by: Lin, Haowei, et al.
Published: (2023)

Probably Approximately Correct Maximum A Posteriori Inference
by: Shorvon, Matthew, et al.
Published: (2026)

Transformer Approximations from ReLUs
by: Hu, Jerry Yao-Chieh, et al.
Published: (2026)

Local Causal Discovery for Statistically Efficient Causal Inference
by: Schubert, Mátyás, et al.
Published: (2025)

Statistical Context Detection for Deep Lifelong Reinforcement Learning
by: Dick, Jeffery, et al.
Published: (2024)

Inference Time Context Sparsity: Illusion or Opportunity?
by: Joshi, Sahil, et al.
Published: (2026)

In-Context Parametric Inference: Point or Distribution Estimators?
by: Mittal, Sarthak, et al.
Published: (2025)

On the Statistical Efficiency of Mean-Field Reinforcement Learning with General Function Approximation
by: Huang, Jiawei, et al.
Published: (2023)

Specialty detection in the context of telemedicine in a highly imbalanced multi-class distribution
by: Alomari, Alaa, et al.
Published: (2024)

On Statistical Rates of Conditional Diffusion Transformers: Approximation, Estimation and Minimax Optimality
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Training Implicit Generative Models via an Invariant Statistical Loss
by: de Frutos, José Manuel, et al.
Published: (2024)

Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
by: Havrilla, Alex, et al.
Published: (2024)

The Approximate Fisher Influence Function: Faster Estimation of Data Influence in Statistical Models
by: Lev, Omri, et al.
Published: (2024)

Calibrated Test-Time Guidance for Bayesian Inference
by: Geyfman, Daniel, et al.
Published: (2026)

Investigation into In-Context Learning Capabilities of Transformers
by: Chandrupatla, Rushil, et al.
Published: (2026)

Universal Approximation Theorem for a Single-Layer Transformer
by: Gumaan, Esmail
Published: (2025)

2-Cats: 2D Copula Approximating Transforms
by: Figueiredo, Flavio, et al.
Published: (2023)

Half-order Fine-Tuning for Diffusion Model: A Recursive Likelihood Ratio Optimizer
by: Ren, Tao, et al.
Published: (2025)

Relative Density Ratio Optimization for Stable and Statistically Consistent Model Alignment
by: Takahashi, Hiroshi, et al.
Published: (2026)