Imagen de Portada

Meta-Learning Transformers to Improve In-Context Generalization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Braccaioli, Lorenzo, Vettoruzzo, Anna, Singh, Prabhant, Vanschoren, Joaquin, Bouguelia, Mohamed-Rafik, Conci, Nicola
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Unsupervised Meta-Learning via In-Context Learning
por: Vettoruzzo, Anna, et al.
Publicado: (2024)

Meta-Learning for Unsupervised Outlier Detection with Optimal Transport
por: Singh, Prabhant, et al.
Publicado: (2022)

Advances and Challenges in Meta-Learning: A Technical Review
por: Vettoruzzo, Anna, et al.
Publicado: (2023)

Learning to Learn without Forgetting using Attention
por: Vettoruzzo, Anna, et al.
Publicado: (2024)

How NOT to benchmark your SITE metric: Beyond Static Leaderboards and Towards Realistic Evaluation
por: Singh, Prabhant, et al.
Publicado: (2025)

Occam's model: Selecting simpler representations for better transferability estimation
por: Singh, Prabhant, et al.
Publicado: (2025)

On Supernet Transfer Learning for Effective Task Adaptation
por: Singh, Prabhant, et al.
Publicado: (2024)

CLAMS: A System for Zero-Shot Model Selection for Clustering
por: Singh, Prabhant, et al.
Publicado: (2024)

Robustness of AutoML on Dirty Categorical Data
por: Bueno, Marcos L. P., et al.
Publicado: (2026)

Automatic Combination of Sample Selection Strategies for Few-Shot Learning
por: Pecher, Branislav, et al.
Publicado: (2024)

General-Purpose In-Context Learning by Meta-Learning Transformers
por: Kirsch, Louis, et al.
Publicado: (2022)

Automated Machine Learning for Unsupervised Tabular Tasks
por: Singh, Prabhant, et al.
Publicado: (2025)

Automated Reinforcement Learning: An Overview
por: Afshar, Reza Refaei, et al.
Publicado: (2022)

Domain-Generalization to Improve Learning in Meta-Learning Algorithms
por: Anjum, Usman, et al.
Publicado: (2025)

Causal-Symbolic Meta-Learning (CSML): Inducing Causal World Models for Few-Shot Generalization
por: S, Mohamed Zayaan
Publicado: (2025)

Think Then Embed: Generative Context Improves Multimodal Embedding
por: Cui, Xuanming, et al.
Publicado: (2025)

Understanding Prompt Tuning and In-Context Learning via Meta-Learning
por: Genewein, Tim, et al.
Publicado: (2025)

Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning
por: Ndir, Tidiane Camaret, et al.
Publicado: (2024)

Investigation into In-Context Learning Capabilities of Transformers
por: Chandrupatla, Rushil, et al.
Publicado: (2026)

How Transformers Learn In-Context Recall Tasks? Optimality, Training Dynamics and Generalization
por: Nguyen, Quan, et al.
Publicado: (2025)

Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning
por: Li, Yanjie, et al.
Publicado: (2024)

Integrating Meta-Features with Knowledge Graph Embeddings for Meta-Learning
por: Klironomos, Antonis, et al.
Publicado: (2026)

Transformers Don't In-Context Learn Least Squares Regression
por: Hill, Joshua, et al.
Publicado: (2025)

Heuristic Transformer: Belief Augmented In-Context Reinforcement Learning
por: Dippel, Oliver, et al.
Publicado: (2025)

On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recovery
por: Liu, Renpu, et al.
Publicado: (2024)

Towards Large-Scale In-Context Reinforcement Learning by Meta-Training in Randomized Worlds
por: Wang, Fan, et al.
Publicado: (2025)

Rapid Word Learning Through Meta In-Context Learning
por: Wang, Wentao, et al.
Publicado: (2025)

How to Turn Your Knowledge Graph Embeddings into Generative Models
por: Loconte, Lorenzo, et al.
Publicado: (2023)

Meta-Sel: Efficient Demonstration Selection for In-Context Learning via Supervised Meta-Learning
por: Wang, Xubin, et al.
Publicado: (2026)

On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning
por: Sun, Haoyuan, et al.
Publicado: (2025)

Transformers Learn Robust In-Context Regression under Distributional Uncertainty
por: Cao, Hoang T. H., et al.
Publicado: (2026)

Transformers Provably Implement In-Context Reinforcement Learning with Policy Improvement
por: Liang, Haodong, et al.
Publicado: (2026)

Benchmarking General-Purpose In-Context Learning
por: Wang, Fan, et al.
Publicado: (2024)

One for All: A Non-Linear Transformer can Enable Cross-Domain Generalization for In-Context Reinforcement Learning
por: He, Bowen, et al.
Publicado: (2026)

HATSolver: Learning Groebner Bases with Hierarchical Attention Transformers
por: Malhou, Mohamed, et al.
Publicado: (2025)

Orion-Bix: Bi-Axial Attention for Tabular In-Context Learning
por: Bouadi, Mohamed, et al.
Publicado: (2025)

MetaLLMix : An XAI Aided LLM-Meta-learning Based Approach for Hyper-parameters Optimization
por: Bal-Ghaoui, Mohamed, et al.
Publicado: (2025)

MLDGG: Meta-Learning for Domain Generalization on Graphs
por: Tian, Qin, et al.
Publicado: (2024)

Improving LLM Group Fairness on Tabular Data via In-Context Learning
por: Cherepanova, Valeriia, et al.
Publicado: (2024)

Integrating Temporal and Structural Context in Graph Transformers for Relational Deep Learning
por: Lachi, Divyansha, et al.
Publicado: (2025)