Image de couverture de livre

RA-DIT: Retrieval-Augmented Dual Instruction Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lin, Xi Victoria, Chen, Xilun, Chen, Mingda, Shi, Weijia, Lomeli, Maria, James, Rich, Rodriguez, Pedro, Kahn, Jacob, Szilvasy, Gergely, Lewis, Mike, Zettlemoyer, Luke, Yih, Scott
Format:	Preprint
Publié:	2023
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

In-context Pretraining: Language Modeling Beyond Document Boundaries
par: Shi, Weijia, et autres
Publié: (2023)

Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering
par: Chen, Mingda, et autres
Publié: (2023)

ImpRAG: Retrieval-Augmented Generation with Implicit Queries
par: Zhang, Wenzheng, et autres
Publié: (2025)

DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers
par: Ma, Xueguang, et autres
Publié: (2025)

FACTORY: A Challenging Human-Verified Prompt Set for Long-Form Factuality
par: Chen, Mingda, et autres
Publié: (2025)

Self-Pruned Key-Value Attention: Learning When to Write by Predicting Future Utility
par: Szilvasy, Gergely, et autres
Publié: (2026)

Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
par: Chen, Tong, et autres
Publié: (2025)

Improving Factuality with Explicit Working Memory
par: Chen, Mingda, et autres
Publié: (2024)

Self-Alignment with Instruction Backtranslation
par: Li, Xian, et autres
Publié: (2023)

Reliable, Adaptable, and Attributable Language Models with Retrieval
par: Asai, Akari, et autres
Publié: (2024)

Vector search with small radiuses
par: Szilvasy, Gergely, et autres
Publié: (2024)

Nearest Neighbor Speculative Decoding for LLM Generation and Attribution
par: Li, Minghan, et autres
Publié: (2024)

Inference-time sparse attention with asymmetric indexing
par: Mazaré, Pierre-Emmanuel, et autres
Publié: (2025)

Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
par: Liang, Weixin, et autres
Publié: (2024)

MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
par: Lin, Xi Victoria, et autres
Publié: (2024)

LMFusion: Adapting Pretrained Language Models for Multimodal Generation
par: Shi, Weijia, et autres
Publié: (2024)

Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?
par: Singh, Aaditya K., et autres
Publié: (2024)

Livcornelissen/DIT_mooringdata: Processing and Quality Control Code for DIT Mooring Data
par: Livcornelissen
Publié: (2026)

Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models
par: Li, Mingda, et autres
Publié: (2024)

ReasonIR: Training Retrievers for Reasoning Tasks
par: Shao, Rulin, et autres
Publié: (2025)

Instruction-tuned Language Models are Better Knowledge Learners
par: Jiang, Zhengbao, et autres
Publié: (2024)

The Faiss library
par: Douze, Matthijs, et autres
Publié: (2024)

Short window attention enables long-term memorization
par: Cabannes, Loïc, et autres
Publié: (2025)

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore
par: Shao, Rulin, et autres
Publié: (2024)

InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining
par: Wang, Boxin, et autres
Publié: (2023)

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation
par: Jiao, YiHan, et autres
Publié: (2025)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
par: Tahir, Anique, et autres
Publié: (2024)

Procedural Knowledge at Scale Improves Reasoning
par: Wu, Di, et autres
Publié: (2026)

CID-GraphRAG: Enhancing Multi-Turn Dialogue Systems through Dual-Pathway Retrieval of Conversation Flow and Context Semantics
par: Zhu, Ziqi, et autres
Publié: (2025)

SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuning
par: Wang, Ziqi, et autres
Publié: (2024)

Retrieval Augmented Instruction Tuning for Open NER with Large Language Models
par: Xie, Tingyu, et autres
Publié: (2024)

RA-LWLM: Retrieval-Augmented In-Context Localization with Wireless Foundation Models
par: Pan, Guangjin, et autres
Publié: (2026)

Stochastic activations
par: Lomeli, Maria, et autres
Publié: (2025)

Multimodal Instruction Tuning with Conditional Mixture of LoRA
par: Shen, Ying, et autres
Publié: (2024)

Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
par: Ge, Chendi, et autres
Publié: (2025)

Anchored Decoding: Provably Reducing Copyright Risk for Any Language Model
par: He, Jacqueline, et autres
Publié: (2026)

Memory Layers at Scale
par: Berges, Vincent-Pierre, et autres
Publié: (2024)

SlangDIT: Benchmarking LLMs in Interpretative Slang Translation
par: Liang, Yunlong, et autres
Publié: (2025)

MENTAL HEALTH IN MEDICAL STUDENTS AND DOCTORS‐IN‐TRAINING (DIT)
Publié: (2024)

Learning Facts at Scale with Active Reading
par: Lin, Jessy, et autres
Publié: (2025)