Cover Image

Can Small Language Models Use What They Retrieve? An Empirical Study of Retrieval Utilization Across Model Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Pandey, Sanchit
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Quecto-V1: Empirical Analysis of 8-bit Quantized Small Language Models for On-Device Legal Retrieval
by: Dikshit, Subrit
Published: (2026)

Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs
by: Tan, Jiejun, et al.
Published: (2024)

Retrieve, Generate, Evaluate: A Case Study for Medical Paraphrases Generation with Small Language Models
by: Buhnila, Ioana, et al.
Published: (2024)

Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models
by: Ahuja, Sanchit, et al.
Published: (2026)

Retrieving Counterfactuals Improves Visual In-Context Learning
by: Xiong, Guangzhi, et al.
Published: (2026)

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks
by: Ahuja, Sanchit, et al.
Published: (2023)

Dense X Retrieval: What Retrieval Granularity Should We Use?
by: Chen, Tong, et al.
Published: (2023)

An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought
by: Zhao, Yuetong, et al.
Published: (2024)

Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment
by: Luo, Kun, et al.
Published: (2024)

Toward Faithful Retrieval-Augmented Generation with Sparse Autoencoders
by: Xiong, Guangzhi, et al.
Published: (2025)

MarsRetrieval: Benchmarking Vision-Language Models for Planetary-Scale Geospatial Retrieval on Mars
by: Wang, Shuoyuan, et al.
Published: (2026)

A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generation
by: Yuan, Xujie, et al.
Published: (2025)

When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively
by: Labruna, Tiziano, et al.
Published: (2024)

Characterizing Model Behavior Under Synthetic Data Training: An Empirical Study Across Scales and Mixing Ratios
by: Du, Y., et al.
Published: (2025)

Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
by: Weller, Orion, et al.
Published: (2024)

An Empirical Study of SFT-DPO Interaction and Parameterization in Small Language Models
by: Feng, Yuming, et al.
Published: (2026)

To Case or Not to Case: An Empirical Study in Learned Sparse Retrieval
by: Lionis, Emmanouil Georgios, et al.
Published: (2026)

Enhancing Test-Time Scaling of Large Language Models with Hierarchical Retrieval-Augmented MCTS
by: Dou, Alex ZH, et al.
Published: (2025)

Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding
by: Zhang, Kaiyan, et al.
Published: (2024)

TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Models
by: Cheng, Pengzhou, et al.
Published: (2024)

Can Language Model Understand Word Semantics as A Chatbot? An Empirical Study of Language Model Internal External Mismatch
by: Zhao, Jinman, et al.
Published: (2024)

Toward Robust RALMs: Revealing the Impact of Imperfect Retrieval on Retrieval-Augmented Language Models
by: Park, Seong-Il, et al.
Published: (2024)

Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models
by: Maekawa, Seiji, et al.
Published: (2024)

R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models
by: Zhang, Taolin, et al.
Published: (2024)

On Retrieval Augmentation and the Limitations of Language Model Training
by: Chiang, Ting-Rui, et al.
Published: (2023)

MINERS: Multilingual Language Models as Semantic Retrievers
by: Winata, Genta Indra, et al.
Published: (2024)

The Compressor-Retriever Architecture for Language Model OS
by: Yang, Yuan, et al.
Published: (2024)

Scaling Laws for Multilingual Language Models
by: He, Yifei, et al.
Published: (2024)

A MapReduce Approach to Effectively Utilize Long Context Information in Retrieval Augmented Language Models
by: Zhang, Gongbo, et al.
Published: (2024)

Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models
by: Li, Mingda, et al.
Published: (2024)

Large Language Model Can Be a Foundation for Hidden Rationale-Based Retrieval
by: Ji, Luo, et al.
Published: (2024)

Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
by: Lee, Jinhyuk, et al.
Published: (2024)

Byte-Exact Deduplication in Retrieval-Augmented Generation: A Three-Regime Empirical Analysis Across Public Benchmarks
by: Schelpe, Sietse
Published: (2026)

Distilling LLM Agent into Small Models with Retrieval and Code Tools
by: Kang, Minki, et al.
Published: (2025)

Big Reasoning with Small Models: Instruction Retrieval at Inference Time
by: Alkiek, Kenan, et al.
Published: (2025)

Large Language Models as Universal Predictors? An Empirical Study on Small Tabular Datasets
by: Pavlidis, Nikolaos, et al.
Published: (2025)

Groundedness in Retrieval-augmented Long-form Generation: An Empirical Study
by: Stolfo, Alessandro
Published: (2024)

What Drives Cross-lingual Ranking? Retrieval Approaches with Multilingual Language Models
by: Goworek, Roksana, et al.
Published: (2025)

What's the Best Way to Retrieve Slides? A Comparative Study of Multimodal, Caption-Based, and Hybrid Retrieval Techniques
by: Giouroukis, Petros Stylianos, et al.
Published: (2025)

More Room for Language: Investigating the Effect of Retrieval on Language Models
by: Samuel, David, et al.
Published: (2024)