Imagen de Portada

Adam: Dense Retrieval Distillation with Adaptive Dark Examples

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tao, Chongyang, Liu, Chang, Shen, Tao, Xu, Can, Geng, Xiubo, Jiao, Binxing, Jiang, Daxin
Formato:	Preprint
Publicado:	2022
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

WizardLM: Empowering large pre-trained language models to follow complex instructions
por: Xu, Can, et al.
Publicado: (2023)

WizardCoder: Empowering Code Large Language Models with Evol-Instruct
por: Luo, Ziyang, et al.
Publicado: (2023)

A Survey on Knowledge Distillation of Large Language Models
por: Xu, Xiaohan, et al.
Publicado: (2024)

Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
por: Zhang, Shunyu, et al.
Publicado: (2023)

Learning to Compress: Unlocking the Potential of Large Language Models for Text Representation
por: Zhang, Yeqin, et al.
Publicado: (2025)

CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification
por: Li, Yang, et al.
Publicado: (2022)

WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct
por: Luo, Haipeng, et al.
Publicado: (2023)

Re-Reading Improves Reasoning in Large Language Models
por: Xu, Xiaohan, et al.
Publicado: (2023)

Text Embeddings by Weakly-Supervised Contrastive Pre-training
por: Wang, Liang, et al.
Publicado: (2022)

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
por: Li, Zhen, et al.
Publicado: (2024)

PairDistill: Pairwise Relevance Distillation for Dense Retrieval
por: Huang, Chao-Wei, et al.
Publicado: (2024)

Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation
por: Yang, Eugene, et al.
Publicado: (2024)

LLMs are Also Effective Embedding Models: An In-depth Overview
por: Tao, Chongyang, et al.
Publicado: (2024)

Chain-based Distillation for Effective Initialization of Variable-Sized Small Language Models
por: Shi, Boyu, et al.
Publicado: (2026)

Retrieval-Augmented Linguistic Calibration
por: Yeh, Yi-Fan, et al.
Publicado: (2026)

Meta-Task Prompting Elicits Embeddings from Large Language Models
por: Lei, Yibin, et al.
Publicado: (2024)

Index Light, Reason Deep: Deferred Visual Ingestion for Visual-Dense Document Question Answering
por: Xu, Tao
Publicado: (2026)

Playing 20 Question Game with Policy-Based Reinforcement Learning
por: Hu, Huang, et al.
Publicado: (2018)

Revisiting Knowledge Distillation for Autoregressive Language Models
por: Zhong, Qihuang, et al.
Publicado: (2024)

Dense Passage Retrieval: Is it Retrieving?
por: Reichman, Benjamin, et al.
Publicado: (2024)

QAEA-DR: A Unified Text Augmentation Framework for Dense Retrieval
por: Tan, Hongming, et al.
Publicado: (2024)

Cognitive-Level Adaptive Generation via Capability-Aware Retrieval and Style Adaptation
por: Wang, Qingsong, et al.
Publicado: (2025)

iACOS: Advancing Implicit Sentiment Extraction with Informative and Adaptive Negative Examples
por: Xu, Xiancai, et al.
Publicado: (2023)

Scaling Laws For Dense Retrieval
por: Fang, Yan, et al.
Publicado: (2024)

AIR: Post-training Data Selection for Reasoning via Attention Head Influence
por: Liu, Jinrui, et al.
Publicado: (2025)

Guided Navigation in Knowledge-Dense Environments: Structured Semantic Exploration with Guidance Graphs
por: Tao, Dehao, et al.
Publicado: (2025)

OVD: On-policy Verbal Distillation
por: Xiong, Jing, et al.
Publicado: (2026)

Boolean-aware Attention for Dense Retrieval
por: Mai, Quan, et al.
Publicado: (2025)

Improve Dense Passage Retrieval with Entailment Tuning
por: Dai, Lu, et al.
Publicado: (2024)

Bidirectional End-to-End Learning of Retriever-Reader Paradigm for Entity Linking
por: Li, Yinghui, et al.
Publicado: (2023)

Cohort Retrieval using Dense Passage Retrieval
por: Jadhav, Pranav
Publicado: (2025)

XAMPLER: Learning to Retrieve Cross-Lingual In-Context Examples
por: Lin, Peiqin, et al.
Publicado: (2024)

EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis
por: Pan, Xuanguang, et al.
Publicado: (2026)

Dynamic Injection of Entity Knowledge into Dense Retrievers
por: Yamada, Ikuya, et al.
Publicado: (2025)

Multilingual Entity Linking Using Dense Retrieval
por: Farhan, Dominik
Publicado: (2024)

DReSD: Dense Retrieval for Speculative Decoding
por: Gritta, Milan, et al.
Publicado: (2025)

RARe: Retrieval Augmented Retrieval with In-Context Examples
por: Tejaswi, Atula, et al.
Publicado: (2024)

Mixture-of-Experts Can Surpass Dense LLMs Under Strictly Equal Resource
por: Li, Houyi, et al.
Publicado: (2025)

Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision
por: He, Yinghui, et al.
Publicado: (2026)

Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment
por: Li, Jie, et al.
Publicado: (2024)