Image de couverture de livre

Contrastive Decoding for Synthetic Data Generation in Low-Resource Language Modeling

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ulm, Jannek, Du, Kevin, Snæbjarnarson, Vésteinn
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Gumbel Counterfactual Generation From Language Models
par: Ravfogel, Shauli, et autres
Publié: (2024)

Activation Scaling for Steering and Interpreting Language Models
par: Stoehr, Niklas, et autres
Publié: (2024)

TharuChat: Bootstrapping Large Language Models for a Low-Resource Language via Synthetic Data and Human Validation
par: Panth, Prajwal, et autres
Publié: (2026)

LoQT: Low-Rank Adapters for Quantized Pretraining
par: Loeschcke, Sebastian, et autres
Publié: (2024)

Active Layer-Contrastive Decoding Reduces Hallucination in Large Language Model Generation
par: Zhang, Hongxiang, et autres
Publié: (2025)

Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification
par: Pecher, Branislav, et autres
Publié: (2026)

ConLID: Supervised Contrastive Learning for Low-Resource Language Identification
par: Foroutan, Negar, et autres
Publié: (2025)

Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages
par: Guan, Kevin, et autres
Publié: (2026)

LexC-Gen: Generating Data for Extremely Low-Resource Languages with Large Language Models and Bilingual Lexicons
par: Yong, Zheng-Xin, et autres
Publié: (2024)

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
par: Chuang, Yung-Sung, et autres
Publié: (2023)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
par: Phan, Phuc, et autres
Publié: (2024)

BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation
par: Zhu, Alan, et autres
Publié: (2025)

DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
par: Zhou, Ying, et autres
Publié: (2024)

Text2Data: Low-Resource Data Generation with Textual Control
par: Wang, Shiyu, et autres
Publié: (2024)

Kakugo: Distillation of Low-Resource Languages into Small Language Models
par: Devine, Peter, et autres
Publié: (2026)

Fill In The Gaps: Model Calibration and Generalization with Synthetic Data
par: Ba, Yang, et autres
Publié: (2024)

A Multi-Faceted Evaluation Framework for Assessing Synthetic Data Generated by Large Language Models
par: Yuan, Yefeng, et autres
Publié: (2024)

Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Models
par: Ghanadian, Hamideh, et autres
Publié: (2024)

Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages
par: Li, Zihao, et autres
Publié: (2024)

Large Multimodal Models for Low-Resource Languages: A Survey
par: Lupascu, Marian, et autres
Publié: (2025)

CodecLM: Aligning Language Models with Tailored Synthetic Data
par: Wang, Zifeng, et autres
Publié: (2024)

RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
par: Huang, Jie, et autres
Publié: (2023)

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
par: Somayajula, Sai Ashish, et autres
Publié: (2024)

Small Language Models for Privacy-Preserving Clinical Information Extraction in Low-Resource Languages
par: Ghaffarzadeh-Esfahani, Mohammadreza, et autres
Publié: (2026)

Emotion Classification in Low and Moderate Resource Languages
par: Tafreshi, Shabnam, et autres
Publié: (2024)

AI-Generated Text Detection in Low-Resource Languages: A Case Study on Urdu
par: Ammar, Muhammad, et autres
Publié: (2025)

Few-Shot Cross-Lingual Transfer for Prompting Large Language Models in Low-Resource Languages
par: Toukmaji, Christopher
Publié: (2024)

When Every Token Counts: Optimal Segmentation for Low-Resource Language Models
par: Raj, Bharath, et autres
Publié: (2024)

Reasoning-Driven Synthetic Data Generation and Evaluation
par: Davidson, Tim R., et autres
Publié: (2026)

Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation
par: Lu, Yen-Ju, et autres
Publié: (2025)

Enhancing Clinical Documentation with Synthetic Data: Leveraging Generative Models for Improved Accuracy
par: Biswas, Anjanava, et autres
Publié: (2024)

TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation
par: Uludoğan, Gökçe, et autres
Publié: (2024)

Decoding-time Realignment of Language Models
par: Liu, Tianlin, et autres
Publié: (2024)

Controlled Decoding from Language Models
par: Mudgal, Sidharth, et autres
Publié: (2023)

Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling
par: Ganescu, Bianca-Mihaela, et autres
Publié: (2025)

How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
par: Seddik, Mohamed El Amine, et autres
Publié: (2024)

Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
par: Havrilla, Alex, et autres
Publié: (2024)

CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation
par: Hsu, I-Hung, et autres
Publié: (2024)

Out-of-Distribution Detection using Synthetic Data Generation
par: Abbas, Momin, et autres
Publié: (2025)

Dynamic Context Evolution for Scalable Synthetic Data Generation
par: Lingo, Ryan, et autres
Publié: (2026)