Copertina

Contrastive Decoding for Synthetic Data Generation in Low-Resource Language Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ulm, Jannek, Du, Kevin, Snæbjarnarson, Vésteinn
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Gumbel Counterfactual Generation From Language Models
di: Ravfogel, Shauli, et al.
Pubblicazione: (2024)

Activation Scaling for Steering and Interpreting Language Models
di: Stoehr, Niklas, et al.
Pubblicazione: (2024)

TharuChat: Bootstrapping Large Language Models for a Low-Resource Language via Synthetic Data and Human Validation
di: Panth, Prajwal, et al.
Pubblicazione: (2026)

LoQT: Low-Rank Adapters for Quantized Pretraining
di: Loeschcke, Sebastian, et al.
Pubblicazione: (2024)

Active Layer-Contrastive Decoding Reduces Hallucination in Large Language Model Generation
di: Zhang, Hongxiang, et al.
Pubblicazione: (2025)

Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification
di: Pecher, Branislav, et al.
Pubblicazione: (2026)

ConLID: Supervised Contrastive Learning for Low-Resource Language Identification
di: Foroutan, Negar, et al.
Pubblicazione: (2025)

Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages
di: Guan, Kevin, et al.
Pubblicazione: (2026)

LexC-Gen: Generating Data for Extremely Low-Resource Languages with Large Language Models and Bilingual Lexicons
di: Yong, Zheng-Xin, et al.
Pubblicazione: (2024)

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
di: Chuang, Yung-Sung, et al.
Pubblicazione: (2023)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
di: Phan, Phuc, et al.
Pubblicazione: (2024)

BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation
di: Zhu, Alan, et al.
Pubblicazione: (2025)

DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
di: Zhou, Ying, et al.
Pubblicazione: (2024)

Text2Data: Low-Resource Data Generation with Textual Control
di: Wang, Shiyu, et al.
Pubblicazione: (2024)

Kakugo: Distillation of Low-Resource Languages into Small Language Models
di: Devine, Peter, et al.
Pubblicazione: (2026)

Fill In The Gaps: Model Calibration and Generalization with Synthetic Data
di: Ba, Yang, et al.
Pubblicazione: (2024)

A Multi-Faceted Evaluation Framework for Assessing Synthetic Data Generated by Large Language Models
di: Yuan, Yefeng, et al.
Pubblicazione: (2024)

Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Models
di: Ghanadian, Hamideh, et al.
Pubblicazione: (2024)

Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages
di: Li, Zihao, et al.
Pubblicazione: (2024)

Large Multimodal Models for Low-Resource Languages: A Survey
di: Lupascu, Marian, et al.
Pubblicazione: (2025)

CodecLM: Aligning Language Models with Tailored Synthetic Data
di: Wang, Zifeng, et al.
Pubblicazione: (2024)

RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
di: Huang, Jie, et al.
Pubblicazione: (2023)

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
di: Somayajula, Sai Ashish, et al.
Pubblicazione: (2024)

Small Language Models for Privacy-Preserving Clinical Information Extraction in Low-Resource Languages
di: Ghaffarzadeh-Esfahani, Mohammadreza, et al.
Pubblicazione: (2026)

Emotion Classification in Low and Moderate Resource Languages
di: Tafreshi, Shabnam, et al.
Pubblicazione: (2024)

AI-Generated Text Detection in Low-Resource Languages: A Case Study on Urdu
di: Ammar, Muhammad, et al.
Pubblicazione: (2025)

Few-Shot Cross-Lingual Transfer for Prompting Large Language Models in Low-Resource Languages
di: Toukmaji, Christopher
Pubblicazione: (2024)

When Every Token Counts: Optimal Segmentation for Low-Resource Language Models
di: Raj, Bharath, et al.
Pubblicazione: (2024)

Reasoning-Driven Synthetic Data Generation and Evaluation
di: Davidson, Tim R., et al.
Pubblicazione: (2026)

Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation
di: Lu, Yen-Ju, et al.
Pubblicazione: (2025)

Enhancing Clinical Documentation with Synthetic Data: Leveraging Generative Models for Improved Accuracy
di: Biswas, Anjanava, et al.
Pubblicazione: (2024)

TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation
di: Uludoğan, Gökçe, et al.
Pubblicazione: (2024)

Decoding-time Realignment of Language Models
di: Liu, Tianlin, et al.
Pubblicazione: (2024)

Controlled Decoding from Language Models
di: Mudgal, Sidharth, et al.
Pubblicazione: (2023)

Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling
di: Ganescu, Bianca-Mihaela, et al.
Pubblicazione: (2025)

How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
di: Seddik, Mohamed El Amine, et al.
Pubblicazione: (2024)

Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
di: Havrilla, Alex, et al.
Pubblicazione: (2024)

CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation
di: Hsu, I-Hung, et al.
Pubblicazione: (2024)

Out-of-Distribution Detection using Synthetic Data Generation
di: Abbas, Momin, et al.
Pubblicazione: (2025)

Dynamic Context Evolution for Scalable Synthetic Data Generation
di: Lingo, Ryan, et al.
Pubblicazione: (2026)