Cover Image

Contrastive Learning in Distilled Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lim, Valerie, Ng, Kai Wen, Lim, Kenneth
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Atomic Instruction Gap: Instruction-Tuned LLMs Struggle with Simple, Self-Contained Directives
by: Lim, Henry, et al.
Published: (2025)

From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification
by: Liu, Junhua, et al.
Published: (2024)

RLCD: Reinforcement Learning from Contrastive Distillation for Language Model Alignment
by: Yang, Kevin, et al.
Published: (2023)

Language Models Don't Learn the Physical Manifestation of Language
by: Lee, Bruce W., et al.
Published: (2024)

PRISM: Prompt-Refined In-Context System Modelling for Financial Retrieval
by: Ng, Chun Chet, et al.
Published: (2025)

A Novel Interpretability Metric for Explaining Bias in Language Models: Applications on Multilingual Models from Southeast Asia
by: Gamboa, Lance Calvin Lim, et al.
Published: (2024)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
by: Phan, Phuc, et al.
Published: (2024)

Distillation versus Contrastive Learning: How to Train Your Rerankers
by: Xu, Zhichao, et al.
Published: (2025)

NeedleChain: Measuring Intact Context Comprehension Capability of Large Language Models
by: Moon, Hyeonseok, et al.
Published: (2025)

Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses
by: Eo, Sugyeong, et al.
Published: (2026)

KDMCSE: Knowledge Distillation Multimodal Sentence Embeddings with Adaptive Angular margin Contrastive Learning
by: Nguyen, Cong-Duy, et al.
Published: (2024)

Evolutionary Contrastive Distillation for Language Model Alignment
by: Katz-Samuels, Julian, et al.
Published: (2024)

ProtoMed-LLM: An Automatic Evaluation Framework for Large Language Models in Medical Protocol Formulation
by: Yi, Seungjun, et al.
Published: (2024)

Filipino Benchmarks for Measuring Sexist and Homophobic Bias in Multilingual Language Models from Southeast Asia
by: Gamboa, Lance Calvin Lim, et al.
Published: (2024)

Enhancing Contrastive Demonstration Selection with Semantic Diversity for Robust In-Context Machine Translation
by: Patterson, Owen, et al.
Published: (2025)

Topic Modeling as Multi-Objective Contrastive Optimization
by: Nguyen, Thong, et al.
Published: (2024)

Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineering
by: Lim, Sue, et al.
Published: (2022)

The effect of source disclosure on evaluation of AI-generated messages: A two-part study
by: Lim, Sue, et al.
Published: (2023)

Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding
by: Qu, Fanyi, et al.
Published: (2024)

Efficiently Distilling LLMs for Edge Applications
by: Kundu, Achintya, et al.
Published: (2024)

Enhancing AI-Driven Psychological Consultation: Layered Prompts with Large Language Models
by: Souza, Rafael, et al.
Published: (2024)

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models
by: Wang, Wei, et al.
Published: (2024)

Social Bias in Multilingual Language Models: A Survey
by: Gamboa, Lance Calvin Lim, et al.
Published: (2025)

Large Language Models can Contrastively Refine their Generation for Better Sentence Representation Learning
by: Wang, Huiming, et al.
Published: (2023)

Cross-Lingual Optimization for Language Transfer in Large Language Models
by: Lee, Jungseob, et al.
Published: (2025)

Gender Bias in Emotion Recognition by Large Language Models
by: Herbert, Maureen, et al.
Published: (2025)

Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation
by: Liu, Aiwei, et al.
Published: (2024)

The Impact of Negated Text on Hallucination with Large Language Models
by: Seo, Jaehyung, et al.
Published: (2025)

Mufu: Multilingual Fused Learning for Low-Resource Translation with LLM
by: Lim, Zheng Wei, et al.
Published: (2024)

Model Attribution in LLM-Generated Disinformation: A Domain Generalization Approach with Supervised Contrastive Learning
by: Beigi, Alimohammad, et al.
Published: (2024)

ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Models
by: Shim, Jeonghoon, et al.
Published: (2025)

EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models
by: Cheong, Minsoo, et al.
Published: (2026)

Metric Calculating Benchmark: Code-Verifiable Complicate Instruction Following Benchmark for Large Language Models
by: Moon, Hyeonseok, et al.
Published: (2025)

Distilling Rule-based Knowledge into Large Language Models
by: Yang, Wenkai, et al.
Published: (2023)

Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages
by: Gamboa, Lance Calvin Lim, et al.
Published: (2025)

Robust Bias Evaluation with FilBBQ: A Filipino Bias Benchmark for Question-Answering Language Models
by: Gamboa, Lance Calvin Lim, et al.
Published: (2026)

Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights
by: Ballout, Mohamad, et al.
Published: (2024)

Educational Personalized Learning Path Planning with Large Language Models
by: Ng, Chee, et al.
Published: (2024)

Measuring Agreeableness Bias in Multimodal Models
by: Lim, Jaehyuk, et al.
Published: (2024)

Learning Constituent Headedness
by: Qi, Zeyao, et al.
Published: (2026)