Cover Image

Iterative Amortized Inference: Unifying In-Context Learning and Learned Optimizers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mittal, Sarthak, Mahajan, Divyat, Lajoie, Guillaume, Pezeshki, Mohammad
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Amortized In-Context Bayesian Posterior Estimation
by: Mittal, Sarthak, et al.
Published: (2025)

In-Context Parametric Inference: Point or Distribution Estimators?
by: Mittal, Sarthak, et al.
Published: (2025)

Beyond Distribution Sharpening: The Importance of Task Rewards
by: Mittal, Sarthak, et al.
Published: (2026)

Compositional Risk Minimization
by: Mahajan, Divyat, et al.
Published: (2024)

Next-Token Prediction Should be Ambiguity-Sensitive: A Meta-Learning Perspective
by: Gagnon, Leo, et al.
Published: (2025)

Amortized Inference of Causal Models via Conditional Fixed-Point Iterations
by: Mahajan, Divyat, et al.
Published: (2024)

Beyond Multi-Token Prediction: Pretraining LLMs with Future Summaries
by: Mahajan, Divyat, et al.
Published: (2025)

Does learning the right latent variables necessarily improve in-context learning?
by: Mittal, Sarthak, et al.
Published: (2024)

Towards efficient representation identification in supervised learning
by: Ahuja, Kartik, et al.
Published: (2022)

In-context learning and Occam's razor
by: Elmoznino, Eric, et al.
Published: (2024)

Learning to Defer for Causal Discovery with Imperfect Experts
by: Clivio, Oscar, et al.
Published: (2025)

Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimation
by: Mahajan, Divyat, et al.
Published: (2022)

A Compression Perspective on Simplicity Bias
by: Marty, Tom, et al.
Published: (2026)

Iterative Amortized Hierarchical VAE
by: Penninga, Simon W., et al.
Published: (2026)

Enhancing Unimodal Latent Representations in Multimodal VAEs through Iterative Amortized Inference
by: Oshima, Yuta, et al.
Published: (2024)

MAVRL: Learning Reward Functions from Multiple Feedback Types with Amortized Variational Inference
by: Baur, Raphaël, et al.
Published: (2026)

Instance-Adaptive Parametrization for Amortized Variational Inference
by: Pollastro, Andrea, et al.
Published: (2026)

Evaluating Interventional Reasoning Capabilities of Large Language Models
by: Kasetty, Tejas, et al.
Published: (2024)

JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference
by: Bracher, Niels, et al.
Published: (2025)

JEDI: Jointly Embedded Inference of Neural Dynamics
by: Jamkhandi, Anirudh, et al.
Published: (2026)

Amortized Active Causal Induction with Deep Reinforcement Learning
by: Annadani, Yashas, et al.
Published: (2024)

It Just Takes Two: Scaling Amortized Inference to Large Sets
by: Wehenkel, Antoine, et al.
Published: (2026)

Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inference
by: Schmitt, Marvin, et al.
Published: (2023)

PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimization
by: Hottung, André, et al.
Published: (2024)

Bayesian Program Learning by Decompiling Amortized Knowledge
by: Palmarini, Alessandro B., et al.
Published: (2023)

Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigation
by: Schmitt, Marvin, et al.
Published: (2024)

Fast and Robust Likelihood-Guided Diffusion Posterior Sampling with Amortized Variational Inference
by: Zheng, Léon, et al.
Published: (2026)

Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference
by: Lee, Jaewoo, et al.
Published: (2026)

Amortized Latent Steering: Low-Cost Alternative to Test-Time Optimization
by: Egbuna, Nathan, et al.
Published: (2025)

Scaling Laws and In-Context Learning: A Unified Theoretical Framework
by: Mehta, Sushant, et al.
Published: (2025)

A Complexity-Based Theory of Compositionality
by: Elmoznino, Eric, et al.
Published: (2024)

Reflective Context Learning: Studying the Optimization Primitives of Context Space
by: Vassilyev, Nikita, et al.
Published: (2026)

Accelerating Training with Neuron Interaction and Nowcasting Networks
by: Knyazev, Boris, et al.
Published: (2024)

Steering Large Language Model Activations in Sparse Spaces
by: Bayat, Reza, et al.
Published: (2025)

The Pitfalls of Memorization: When Memorization Hurts Generalization
by: Bayat, Reza, et al.
Published: (2024)

Interventional Causal Representation Learning
by: Ahuja, Kartik, et al.
Published: (2022)

KV Admission: Learning What to Write for Efficient Long-Context Inference
by: Huang, Yen-Chieh, et al.
Published: (2025)

Amortized Sampling with Transferable Normalizing Flows
by: Tan, Charlie B., et al.
Published: (2025)

BoxRL-NNV: Boxed Refinement of Latin Hypercube Samples for Neural Network Verification
by: Das, Sarthak
Published: (2025)

Inference and Verbalization Functions During In-Context Learning
by: Tao, Junyi, et al.
Published: (2024)