Cover Image

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shao, Rulin, He, Jacqueline, Asai, Akari, Shi, Weijia, Dettmers, Tim, Min, Sewon, Zettlemoyer, Luke, Koh, Pang Wei
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Information Retrieval Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
by: Liu, Jiacheng, et al.
Published: (2024)

Frustratingly Simple Retrieval Improves Challenging, Reasoning-Intensive Benchmarks
by: Lyu, Xinxi, et al.
Published: (2025)

ReasonIR: Training Retrievers for Reasoning Tasks
by: Shao, Rulin, et al.
Published: (2025)

SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
by: Min, Sewon, et al.
Published: (2023)

DS SERVE: A Framework for Efficient and Scalable Neural Retrieval
by: Liu, Jinjian, et al.
Published: (2025)

OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
by: Asai, Akari, et al.
Published: (2024)

Reliable, Adaptable, and Attributable Language Models with Retrieval
by: Asai, Akari, et al.
Published: (2024)

Differentially Private Datastore Generation for Retrieval-Augmented Inference
by: Abouelenein, Abdelrahman, et al.
Published: (2026)

CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
by: Chen, Tong, et al.
Published: (2024)

Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
by: Chen, Tong, et al.
Published: (2025)

Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations
by: Zhai, Jiaqi, et al.
Published: (2024)

LLMs as Better Recommenders with Natural Language Collaborative Signals: A Self-Assessing Retrieval Approach
by: Xin, Haoran, et al.
Published: (2025)

HeceTokenizer: A Syllable-Based Tokenization Approach for Turkish Retrieval
by: Gulgonul, Senol
Published: (2026)

A Theory for Token-Level Harmonization in Retrieval-Augmented Generation
by: Xu, Shicheng, et al.
Published: (2024)

XR: Cross-Modal Agents for Composed Image Retrieval
by: Yang, Zhongyu, et al.
Published: (2026)

Massive Memorization with Hundreds of Trillions of Parameters for Sequential Transducer Generative Recommenders
by: Chen, Zhimin, et al.
Published: (2025)

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval
by: Huang, Suyuan, et al.
Published: (2024)

Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
by: Lee, Jinhyuk, et al.
Published: (2023)

Large Scale Retrieval for the LinkedIn Feed using Causal Language Models
by: Ramanujam, Sudarshan Srinivasa, et al.
Published: (2025)

RAG over Thinking Traces Can Improve Reasoning Tasks
by: Arabzadeh, Negar, et al.
Published: (2026)

Incorporating Token Importance in Multi-Vector Retrieval
by: S, Archish, et al.
Published: (2025)

Harnessing the Power of Reinforcement Learning for Language-Model-Based Information Retriever via Query-Document Co-Augmentation
by: Liu, Jingming, et al.
Published: (2025)

PinRec: Outcome-Conditioned, Multi-Token Generative Retrieval for Industry-Scale Recommendation Systems
by: Agarwal, Prabhat, et al.
Published: (2025)

Efficient Retrieval Scaling with Hierarchical Indexing for Large Scale Recommendation
by: Fu, Dongqi, et al.
Published: (2026)

KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
by: Chen, Weijie, et al.
Published: (2024)

Discrimination Is Generation: Unifying Ranking and Retrieval from a Tokenizer Perspective
by: Wang, Shuli
Published: (2026)

PerSRV: Personalized Sticker Retrieval with Vision-Language Model
by: Chee, Heng Er Metilda, et al.
Published: (2024)

Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality
by: Ma, Xueguang, et al.
Published: (2025)

Semi-Parametric Retrieval via Binary Bag-of-Tokens Index
by: Zhou, Jiawei, et al.
Published: (2024)

External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation
by: Liang, Mingfu, et al.
Published: (2025)

ComLQ: Benchmarking Complex Logical Queries in Information Retrieval
by: Xu, Ganlin, et al.
Published: (2025)

On the Scaling of Robustness and Effectiveness in Dense Retrieval
by: Liu, Yu-An, et al.
Published: (2025)

Retrieval Feedback Memory Enhancement Large Model Retrieval Generation Method
by: Li, Leqian, et al.
Published: (2025)

Context-Aware Search and Retrieval Under Token Erasure
by: Ghasvarianjahromi, Sara, et al.
Published: (2026)

TeraHAC: Hierarchical Agglomerative Clustering of Trillion-Edge Graphs
by: Dhulipala, Laxman, et al.
Published: (2023)

Generative Retrieval and Alignment Model: A New Paradigm for E-commerce Retrieval
by: Pang, Ming, et al.
Published: (2025)

Anchored Decoding: Provably Reducing Copyright Risk for Any Language Model
by: He, Jacqueline, et al.
Published: (2026)

Large Language Model as Universal Retriever in Industrial-Scale Recommender System
by: Jiang, Junguang, et al.
Published: (2025)

DocReLM: Mastering Document Retrieval with Language Model
by: Wei, Gengchen, et al.
Published: (2024)

Contrastive Retrieval Heads Improve Attention-Based Re-Ranking
by: Tran, Linh, et al.
Published: (2025)