Image de couverture de livre

Improving embedding with contrastive fine-tuning on small datasets with expert-augmented scores

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lu, Jun, Li, David, Ding, Bill, Kang, Yu
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Rethinking harmless refusals when fine-tuning foundation models
par: Pop, Florin, et autres
Publié: (2024)

Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
par: Balabanov, Oleksandr, et autres
Publié: (2024)

LaFFi: Leveraging Hybrid Natural Language Feedback for Fine-tuning Language Models
par: Li, Qianxi, et autres
Publié: (2023)

Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
par: Tan, Qitao, et autres
Publié: (2025)

Investigating the performance of Retrieval-Augmented Generation and fine-tuning for the development of AI-driven knowledge-based systems
par: Lakatos, Robert, et autres
Publié: (2024)

Outlier-weighed Layerwise Sampling for LLM Fine-tuning
par: Li, Pengxiang, et autres
Publié: (2024)

Retrieval-augmented GUI Agents with Generative Guidelines
par: Xu, Ran, et autres
Publié: (2025)

Learning to Reason Over Time: Timeline Self-Reflection for Improved Temporal Reasoning in Language Models
par: Bazaga, Adrián, et autres
Publié: (2025)

What explains the success of cross-modal fine-tuning with ORCA?
par: García-de-Herreros, Paloma, et autres
Publié: (2024)

TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning
par: Xu, Zhangchen, et autres
Publié: (2025)

Automated test generation to evaluate tool-augmented LLMs as conversational AI agents
par: Arcadinho, Samuel, et autres
Publié: (2024)

MixAtlas: Uncertainty-aware Data Mixture Optimization for Multimodal LLM Midtraining
par: Wen, Bingbing, et autres
Publié: (2026)

RuAG: Learned-rule-augmented Generation for Large Language Models
par: Zhang, Yudi, et autres
Publié: (2024)

Improving Value-based Process Verifier via Structural Prior Injection
par: Sun, Zetian, et autres
Publié: (2025)

Efficient End-to-end Language Model Fine-tuning on Graphs
par: Xue, Rui, et autres
Publié: (2023)

Fine-tuning Language Models with Generative Adversarial Reward Modelling
par: Yu, Zhang Ze, et autres
Publié: (2023)

How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
par: Dong, Guanting, et autres
Publié: (2023)

Improving Data Efficiency for LLM Reinforcement Fine-tuning Through Difficulty-targeted Online Data Selection and Rollout Replay
par: Sun, Yifan, et autres
Publié: (2025)

Learning Rate Matters: Vanilla LoRA May Suffice for LLM Fine-tuning
par: Lee, Yu-Ang, et autres
Publié: (2026)

Exploring Memorization in Fine-tuned Language Models
par: Zeng, Shenglai, et autres
Publié: (2023)

Classification EM-PCA for clustering and embedding
par: Tighidet, Zineddine, et autres
Publié: (2025)

On the limits and opportunities of AI reviewers: Reviewing the reviews of Nature-family papers with 45 expert scientists
par: Kim, Seungone, et autres
Publié: (2026)

Fundamental Safety-Capability Trade-offs in Fine-tuning Large Language Models
par: Chen, Pin-Yu, et autres
Publié: (2025)

Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
par: Lyu, Kaifeng, et autres
Publié: (2024)

SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
par: Shen, Han, et autres
Publié: (2024)

Mechanistic Fine-tuning for In-context Learning
par: Cho, Hakaze, et autres
Publié: (2025)

A Framework to Implement 1+N Multi-task Fine-tuning Pattern in LLMs Using the CGC-LORA Algorithm
par: Song, Chao, et autres
Publié: (2024)

RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answering
par: Arasteh, Soroosh Tayebi, et autres
Publié: (2024)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
par: Song, Weixi, et autres
Publié: (2023)

DefSent+: Improving sentence embeddings of language models by projecting definition sentences into a quasi-isotropic or isotropic vector space of unlimited dictionary entries
par: Liu, Xiaodong
Publié: (2024)

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
par: Dong, Guanting, et autres
Publié: (2024)

Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning
par: Zou, Jiaru, et autres
Publié: (2025)

Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning
par: Zhang, Hengyuan, et autres
Publié: (2024)

From communities to interpretable network and word embedding: an unified approach
par: Prouteau, Thibault, et autres
Publié: (2024)

Instruction-tuned Language Models are Better Knowledge Learners
par: Jiang, Zhengbao, et autres
Publié: (2024)

Information Guided Regularization for Fine-tuning Language Models
par: Sharma, Mandar, et autres
Publié: (2024)

Efficient Model Development through Fine-tuning Transfer
par: Lin, Pin-Jie, et autres
Publié: (2025)

Packing Analysis: Packing Is More Appropriate for Large Models or Datasets in Supervised Fine-tuning
par: Wang, Shuhe, et autres
Publié: (2024)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
par: Lin, Haowei, et autres
Publié: (2024)

Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models
par: Zhou, Chenxi, et autres
Publié: (2025)