Cover Image

Improving In-Context Learning with Small Language Model Ensembles

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mojarradi, M. Mehdi, Yang, Lingyi, McCraith, Robert, Mahdi, Adam
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating Fine-Tuning Efficiency of Human-Inspired Learning Strategies in Medical Question Answering
by: Yang, Yushi, et al.
Published: (2024)

Do Large Language Models have Shared Weaknesses in Medical Question Answering?
by: Bean, Andrew M., et al.
Published: (2023)

Tolerance Principle and Small Language Model Learning
by: Friedman, Adam E., et al.
Published: (2026)

Resonance RoPE: Improving Context Length Generalization of Large Language Models
by: Wang, Suyuchen, et al.
Published: (2024)

Purifying Large Language Models by Ensembling a Small Language Model
by: Li, Tianlin, et al.
Published: (2024)

Improving Lexical Difficulty Prediction with Context-Aligned Contrastive Learning and Ridge Ensembling
by: Muhamad, Wicaksono Leksono, et al.
Published: (2026)

Layer-wise Positional Bias in Short-Context Language Modeling
by: Rahimi, Maryam, et al.
Published: (2026)

Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning
by: Zhang, Tianhui, et al.
Published: (2024)

Improving In-Context Learning with Reasoning Distillation
by: Sadeq, Nafis, et al.
Published: (2025)

EL4NER: Ensemble Learning for Named Entity Recognition via Multiple Small-Parameter Large Language Models
by: Xiao, Yuzhen, et al.
Published: (2025)

Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaboration
by: Huang, Yichong, et al.
Published: (2024)

Towards Automated Functional Equation Proving: A Benchmark Dataset and A Domain-Specific In-Context Agent
by: Buali, Mahdi, et al.
Published: (2024)

Agentic Reinforcement Learning for Search is Unsafe
by: Yang, Yushi, et al.
Published: (2025)

Iterative Forward Tuning Boosts In-Context Learning in Language Models
by: Yang, Jiaxi, et al.
Published: (2023)

LiFT: Does Instruction Fine-Tuning Improve In-Context Learning for Longitudinal Modelling by Large Language Models?
by: Ali, Iqra, et al.
Published: (2026)

Analyzing the Role of Context in Forecasting with Large Language Models
by: Mutschlechner, Gerrit, et al.
Published: (2025)

Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text
by: Yang, Lingyi, et al.
Published: (2023)

Small Language Models Improve Giants by Rewriting Their Outputs
by: Vernikos, Giorgos, et al.
Published: (2023)

Improving Small Language Models for Code Generation with Reinforcement Learning from Verification Feedback
by: Skopin, Egor, et al.
Published: (2026)

Improving In-Context Learning with Prediction Feedback for Sentiment Analysis
by: Xu, Hongling, et al.
Published: (2024)

Learning to Retrieve In-Context Examples for Large Language Models
by: Wang, Liang, et al.
Published: (2023)

Ensemble Watermarks for Large Language Models
by: Niess, Georg, et al.
Published: (2024)

Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning
by: Sang, Jitao, et al.
Published: (2024)

A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detection
by: Hachmeier, Simon, et al.
Published: (2024)

ELPO: Ensemble Learning Based Prompt Optimization for Large Language Models
by: Zhang, Qing, et al.
Published: (2025)

Chain-of-Thought Reasoning Improves Context-Aware Translation with Large Language Models
by: Ataee, Shabnam, et al.
Published: (2025)

Context Convergence Improves Answering Inferential Questions
by: Mozafari, Jamshid, et al.
Published: (2026)

Improving Context-Aware Preference Modeling for Language Models
by: Pitis, Silviu, et al.
Published: (2024)

VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization
by: Paqaleh, Mohammad Mahdi Samiei, et al.
Published: (2025)

Teaching Small Language Models to Learn Logic through Meta-Learning
by: Bertolazzi, Leonardo, et al.
Published: (2025)

Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling
by: Hou, Bairu, et al.
Published: (2023)

Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
by: Zhang, Qizheng, et al.
Published: (2025)

P-ICL: Point In-Context Learning for Named Entity Recognition with Large Language Models
by: Jiang, Guochao, et al.
Published: (2024)

Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision
by: Zhu, Dawei, et al.
Published: (2025)

SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Models
by: Yang, Ziyi, et al.
Published: (2025)

Context-level Language Modeling by Learning Predictive Context Embeddings
by: Dai, Beiya, et al.
Published: (2025)

Improving Phishing Email Detection Performance of Small Large Language Models
by: Lin, Zijie, et al.
Published: (2025)

LINGOLY-TOO: Disentangling Reasoning from Knowledge with Templatised Orthographic Obfuscation
by: Khouja, Jude, et al.
Published: (2025)

Small Language Model as Data Prospector for Large Language Model
by: Ni, Shiwen, et al.
Published: (2024)

Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models
by: Wang, Xindi, et al.
Published: (2024)