Copertina

Probing In-Context Learning: Impact of Task Complexity and Model Architecture on Generalization and Efficiency

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Binwen, Xu, Peiyu, Yuan, Quan, Chen, Yihong
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How Transformers Learn In-Context Recall Tasks? Optimality, Training Dynamics and Generalization
di: Nguyen, Quan, et al.
Pubblicazione: (2025)

Can Custom Models Learn In-Context? An Exploration of Hybrid Architecture Performance on In-Context Learning Tasks
di: Campbell, Ryan, et al.
Pubblicazione: (2024)

ComplexityNet: Increasing LLM Inference Efficiency by Learning Task Complexity
di: Bae, Henry, et al.
Pubblicazione: (2023)

Investigating the Impact of Data Selection Strategies on Language Model Performance
di: Gu, Jiayao, et al.
Pubblicazione: (2025)

Pretrain-Test Task Alignment Governs Generalization in In-Context Learning
di: Letey, Mary I., et al.
Pubblicazione: (2025)

Learning to Flow from Generative Pretext Tasks for Neural Architecture Encoding
di: Kim, Sunwoo, et al.
Pubblicazione: (2025)

IM-Context: In-Context Learning for Imbalanced Regression Tasks
di: Nejjar, Ismail, et al.
Pubblicazione: (2024)

Context-Scaling versus Task-Scaling in In-Context Learning
di: Abedsoltan, Amirhesam, et al.
Pubblicazione: (2024)

Mimic In-Context Learning for Multimodal Tasks
di: Jiang, Yuchu, et al.
Pubblicazione: (2025)

Task Vectors in In-Context Learning: Emergence, Formation, and Benefit
di: Yang, Liu, et al.
Pubblicazione: (2025)

MOBODY: Model Based Off-Dynamics Offline Reinforcement Learning
di: Guo, Yihong, et al.
Pubblicazione: (2025)

Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning
di: Yang, Yu, et al.
Pubblicazione: (2026)

GFPL: Generative Federated Prototype Learning for Resource-Constrained and Data-Imbalanced Vision Task
di: Lu, Shiwei, et al.
Pubblicazione: (2026)

Understanding the Generalization of In-Context Learning in Transformers: An Empirical Study
di: Zhang, Xingxuan, et al.
Pubblicazione: (2025)

Towards Zero-Shot Task-Generalizable Learning on fMRI
di: Wang, Jiyao, et al.
Pubblicazione: (2025)

Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning
di: Wang, Jiyao, et al.
Pubblicazione: (2026)

Learning a High-quality Robotic Wiping Policy Using Systematic Reward Analysis and Visual-Language Model Based Curriculum
di: Liu, Yihong, et al.
Pubblicazione: (2025)

Learning to Order: Task Sequencing as In-Context Optimization
di: Kobiolka, Jan, et al.
Pubblicazione: (2026)

Technical Debt in In-Context Learning: Diminishing Efficiency in Long Context
di: Joo, Taejong, et al.
Pubblicazione: (2025)

PyGALAX: An Open-Source Python Toolkit for Advanced Explainable Geospatial Machine Learning
di: Wang, Pingping, et al.
Pubblicazione: (2026)

Fast-PGM: Fast Probabilistic Graphical Model Learning and Inference
di: Jiang, Jiantong, et al.
Pubblicazione: (2024)

In-Context Language Learning: Architectures and Algorithms
di: Akyürek, Ekin, et al.
Pubblicazione: (2024)

ReAugment: Model Zoo-Guided RL for Few-Shot Time Series Augmentation and Forecasting
di: Yuan, Haochen, et al.
Pubblicazione: (2024)

How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?
di: Wu, Jingfeng, et al.
Pubblicazione: (2023)

Task Aware Dreamer for Task Generalization in Reinforcement Learning
di: Ying, Chengyang, et al.
Pubblicazione: (2023)

In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks
di: Wang, Dingzirui, et al.
Pubblicazione: (2024)

Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability
di: Lee, Ivan, et al.
Pubblicazione: (2023)

AMOSL: Adaptive Modality-wise Structure Learning in Multi-view Graph Neural Networks For Enhanced Unified Representation
di: Liang, Peiyu, et al.
Pubblicazione: (2024)

Learning Task Representations from In-Context Learning
di: Saglam, Baturay, et al.
Pubblicazione: (2025)

Distributionally Robust Policy Evaluation under General Covariate Shift in Contextual Bandits
di: Guo, Yihong, et al.
Pubblicazione: (2024)

RoboCoder: Robotic Learning from Basic Skills to General Tasks with Large Language Models
di: Li, Jingyao, et al.
Pubblicazione: (2024)

DimGrow: Memory-Efficient Field-level Embedding Dimension Search
di: Huang, Yihong, et al.
Pubblicazione: (2025)

What Do Language Models Learn in Context? The Structured Task Hypothesis
di: Li, Jiaoda, et al.
Pubblicazione: (2024)

Understanding Task Vectors in In-Context Learning: Emergence, Functionality, and Limitations
di: Dong, Yuxin, et al.
Pubblicazione: (2025)

AsEP: Benchmarking Deep Learning Methods for Antibody-specific Epitope Prediction
di: Liu, Chunan, et al.
Pubblicazione: (2024)

Shielded Deep Reinforcement Learning for Complex Spacecraft Tasking
di: Reed, Robert, et al.
Pubblicazione: (2024)

Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs
di: Yu, Xingtong, et al.
Pubblicazione: (2023)

Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Models
di: Baillargeon, Jean-Thomas, et al.
Pubblicazione: (2022)

Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
di: Weitekamp, Daniel, et al.
Pubblicazione: (2025)

Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks
di: Park, Jongho, et al.
Pubblicazione: (2024)