Image de couverture de livre

From Unstructured Data to In-Context Learning: Exploring What Tasks Can Be Learned and When

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wibisono, Kevin Christian, Wang, Yixin
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Theoretical Understanding of In-Context Learning in Shallow Transformers with Unstructured Data
par: Xing, Yue, et autres
Publié: (2024)

What Do Language Models Learn in Context? The Structured Task Hypothesis
par: Li, Jiaoda, et autres
Publié: (2024)

Exponential Family Attention
par: Wibisono, Kevin Christian, et autres
Publié: (2025)

Learning Task Representations from In-Context Learning
par: Saglam, Baturay, et autres
Publié: (2025)

Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning
par: Wang, Xiaolei, et autres
Publié: (2024)

Mining Unstructured Medical Texts With Conformal Active Learning
par: Genari, Juliano, et autres
Publié: (2025)

Can MLLMs Perform Text-to-Image In-Context Learning?
par: Zeng, Yuchen, et autres
Publié: (2024)

Exploring Imbalanced Annotations for Effective In-Context Learning
par: Gao, Hongfu, et autres
Publié: (2025)

In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks
par: Wang, Dingzirui, et autres
Publié: (2024)

Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?
par: Zverev, Egor, et autres
Publié: (2024)

What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models
par: Awobade, Busayo, et autres
Publié: (2024)

Learning When to Attend: Conditional Memory Access for Long-Context LLMs
par: Choudhary, Sakshi, et autres
Publié: (2026)

Can we Soft Prompt LLMs for Graph Learning Tasks?
par: Liu, Zheyuan, et autres
Publié: (2024)

LegalLens Shared Task 2024: Legal Violation Identification in Unstructured Text
par: Hagag, Ben, et autres
Publié: (2024)

When and How Unlabeled Data Provably Improve In-Context Learning
par: Li, Yingcong, et autres
Publié: (2025)

Task Schema and Binding: A Double Dissociation Study of In-Context Learning
par: Kim, Chaeha
Publié: (2025)

LLMForecaster: Improving Seasonal Event Forecasts with Unstructured Textual Data
par: Zhang, Hanyu, et autres
Publié: (2024)

When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning
par: Deng, Mengyi, et autres
Publié: (2025)

AdaptThink: Reasoning Models Can Learn When to Think
par: Zhang, Jiajie, et autres
Publié: (2025)

Language Models Improve When Pretraining Data Matches Target Tasks
par: Mizrahi, David, et autres
Publié: (2025)

Towards Understanding Multi-Task Learning (Generalization) of LLMs via Detecting and Exploring Task-Specific Neurons
par: Leng, Yongqi, et autres
Publié: (2024)

Exploring Explanations Improves the Robustness of In-Context Learning
par: Honda, Ukyo, et autres
Publié: (2025)

Value Alignment from Unstructured Text
par: Padhi, Inkit, et autres
Publié: (2024)

In-Context Language Learning: Architectures and Algorithms
par: Akyürek, Ekin, et autres
Publié: (2024)

Quiet Feature Learning in Algorithmic Tasks
par: Naidu, Prudhviraj, et autres
Publié: (2025)

Mix Data or Merge Models? Optimizing for Diverse Multi-Task Learning
par: Aakanksha, et autres
Publié: (2024)

Learning When to Quit in Sales Conversations
par: Manzoor, Emaad, et autres
Publié: (2025)

Spoken Language Understanding on Unseen Tasks With In-Context Learning
par: Agrawal, Neeraj, et autres
Publié: (2025)

Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective
par: Han, Seungwook, et autres
Publié: (2024)

End-To-End Causal Effect Estimation from Unstructured Natural Language Data
par: Dhawan, Nikita, et autres
Publié: (2024)

Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning
par: Li, Chengye, et autres
Publié: (2025)

When Do "More Contexts" Help with Sarcasm Recognition?
par: Nimase, Ojas, et autres
Publié: (2024)

Can Language Models Compose Skills In-Context?
par: Liu, Zidong, et autres
Publié: (2025)

Does RLHF Scale? Exploring the Impacts From Data, Model, and Method
par: Hou, Zhenyu, et autres
Publié: (2024)

Context-Parametric Inversion: Why Instruction Finetuning Can Worsen Context Reliance
par: Goyal, Sachin, et autres
Publié: (2024)

Can Generative AI Solve Your In-Context Learning Problem? A Martingale Perspective
par: Jesson, Andrew, et autres
Publié: (2024)

Is In-Context Learning Learning?
par: de Wynter, Adrian
Publié: (2025)

When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Framework
par: Xu, Zhen, et autres
Publié: (2025)

Stronger Random Baselines for In-Context Learning
par: Yauney, Gregory, et autres
Publié: (2024)

In-Context Learning through the Bayesian Prism
par: Panwar, Madhur, et autres
Publié: (2023)