Image de couverture de livre

Synthetic Eggs in Many Baskets: The Impact of Synthetic Data Diversity on LLM Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Schaffelder, Max, Gatt, Albert
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics
par: Du, Yupei, et autres
Publié: (2023)

Context-aware Visual Storytelling with Visual Prefix Tuning and Contrastive Learning
par: Song, Yingjin, et autres
Publié: (2024)

On the Diversity of Synthetic Data and its Impact on Training Large Language Models
par: Chen, Hao, et autres
Publié: (2024)

Diverse and Fine-Grained Instruction-Following Ability Exploration with Synthetic Data
par: Gu, Zihui, et autres
Publié: (2024)

Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting
par: Kambhatla, Gauri, et autres
Publié: (2025)

LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documents
par: Patel, Hitesh Laxmichand, et autres
Publié: (2024)

Evaluating LLM-Generated Versus Human-Authored Responses in Role-Play Dialogues
par: Lu, Dongxu, et autres
Publié: (2025)

VAQUUM: Are Vague Quantifiers Grounded in Visual Data?
par: Wong, Hugh Mee, et autres
Publié: (2025)

Synthetic Dataset Creation and Fine-Tuning of Transformer Models for Question Answering in Serbian
par: Cvetanović, Aleksa, et autres
Publié: (2024)

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation
par: Chen, Zihong, et autres
Publié: (2025)

Domain-Adaptation through Synthetic Data: Fine-Tuning Large Language Models for German Law
par: Bashir, Ali Hamza, et autres
Publié: (2026)

Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models
par: Kaddour, Jean, et autres
Publié: (2023)

Morphological Analysis for the Maltese Language: The Challenges of a Hybrid System
par: Borg, Claudia, et autres
Publié: (2017)

Configurable Preference Tuning with Rubric-Guided Synthetic Data
par: Gallego, Víctor
Publié: (2025)

DP-RFT: Learning to Generate Synthetic Text via Differentially Private Reinforcement Fine-Tuning
par: Xu, Fangyuan, et autres
Publié: (2026)

A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences
par: Bertolazzi, Leonardo, et autres
Publié: (2024)

CV-Probes: Studying the interplay of lexical and world knowledge in visually grounded verb understanding
par: Beňová, Ivana, et autres
Publié: (2024)

Probing Omissions and Distortions in Transformer-based RDF-to-Text Models
par: Faille, Juliette, et autres
Publié: (2024)

Measuring Diversity in Synthetic Datasets
par: Zhu, Yuchang, et autres
Publié: (2025)

CantonMT: Cantonese to English NMT Platform with Fine-Tuned Models Using Synthetic Back-Translation Data
par: Hong, Kung Yin, et autres
Publié: (2024)

LLaVA-Video: Video Instruction Tuning With Synthetic Data
par: Zhang, Yuanhan, et autres
Publié: (2024)

What Matters in LLM-generated Data: Diversity and Its Effect on Model Fine-Tuning
par: Zhu, Yuchang, et autres
Publié: (2025)

Configurable Safety Tuning of Language Models with Synthetic Preference Data
par: Gallego, Victor
Publié: (2024)

Linguistic and Argument Diversity in Synthetic Data for Function-Calling Agents
par: Greenstein, Dan, et autres
Publié: (2026)

Repurposing Synthetic Data for Fine-grained Search Agent Supervision
par: Zhao, Yida, et autres
Publié: (2025)

LatteCLIP: Unsupervised CLIP Fine-Tuning via LMM-Synthetic Texts
par: Cao, Anh-Quan, et autres
Publié: (2024)

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
par: Li, Haoran, et autres
Publié: (2024)

Embedding-Driven Diversity Sampling to Improve Few-Shot Synthetic Data Generation
par: Lopez, Ivan, et autres
Publié: (2025)

SyntheT2C: Generating Synthetic Data for Fine-Tuning Large Language Models on the Text2Cypher Task
par: Zhong, Ziije, et autres
Publié: (2024)

Few-shot LLM Synthetic Data with Distribution Matching
par: Ren, Jiyuan, et autres
Publié: (2025)

CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoning
par: Zhu, Xinyu, et autres
Publié: (2026)

When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering
par: Wong, Hugh Mee, et autres
Publié: (2026)

From Image Captioning to Visual Storytelling
par: Passadakis, Admitos, et autres
Publié: (2025)

Grounded Misunderstandings in Asymmetric Dialogue: A Perspectivist Annotation Scheme for MapTask
par: Li, Nan, et autres
Publié: (2025)

Contrast Is All You Need
par: Kilic, Burak, et autres
Publié: (2023)

How and where does CLIP process negation?
par: Quantmeyer, Vincent, et autres
Publié: (2024)

Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Tracking
par: Finch, James D., et autres
Publié: (2024)

Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data
par: Zhao, Shuaijiang, et autres
Publié: (2024)

LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens
par: Zebaze, Armel, et autres
Publié: (2025)

Understanding the Anchoring Effect of LLM with Synthetic Data: Existence, Mechanism, and Potential Mitigations
par: Huang, Yiming, et autres
Publié: (2025)