Copertina

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Hao, Waheed, Abdul, Li, Xiang, Wang, Yidong, Wang, Jindong, Raj, Bhiksha, Abdin, Marah I.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes
di: Waheed, Abdul, et al.
Pubblicazione: (2024)

On Fairness of Unified Multimodal Large Language Model for Image Generation
di: Liu, Ming, et al.
Pubblicazione: (2025)

On the Robust Approximation of ASR Metrics
di: Waheed, Abdul, et al.
Pubblicazione: (2025)

What Do Speech Foundation Models Not Learn About Speech?
di: Waheed, Abdul, et al.
Pubblicazione: (2024)

Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models
di: Atwany, Hanin, et al.
Pubblicazione: (2025)

Less is More Tokens: Efficient Math Reasoning via Difficulty-Aware Chain-of-Thought Distillation
di: Waheed, Abdul, et al.
Pubblicazione: (2025)

VideoJudge: Bootstrapping Enables Scalable Supervision of MLLM-as-a-Judge for Video Understanding
di: Waheed, Abdul, et al.
Pubblicazione: (2025)

Impact of Noisy Supervision in Foundation Model Learning
di: Chen, Hao, et al.
Pubblicazione: (2024)

On Catastrophic Inheritance of Large Foundation Models
di: Chen, Hao, et al.
Pubblicazione: (2024)

DELULU: Discriminative Embedding Learning Using Latent Units for Speaker-Aware Self-Trained Speech Foundational Model
di: Baali, Massa, et al.
Pubblicazione: (2025)

LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
di: Wu, Minghao, et al.
Pubblicazione: (2023)

CAARMA: Class Augmentation with Adversarial Mixup Regularization
di: Baali, Massa, et al.
Pubblicazione: (2025)

Learning from "Silly" Questions Improves Large Language Models, But Only Slightly
di: Zhu, Tingyuan, et al.
Pubblicazione: (2024)

StringLLM: Understanding the String Processing Capability of Large Language Models
di: Wang, Xilong, et al.
Pubblicazione: (2024)

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data
di: Li, Haolong, et al.
Pubblicazione: (2024)

PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
di: Zhu, Kaijie, et al.
Pubblicazione: (2023)

What and When to Learn: CURriculum Ranking Loss for Large-Scale Speaker Verification
di: Baali, Massa, et al.
Pubblicazione: (2026)

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models
di: Yu, Zhuohao, et al.
Pubblicazione: (2024)

A Survey on Evaluation of Large Language Models
di: Chang, Yupeng, et al.
Pubblicazione: (2023)

Evaluating and Improving Continual Learning in Spoken Language Understanding
di: Yang, Muqiao, et al.
Pubblicazione: (2024)

The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Text
di: Guo, Yanzhu, et al.
Pubblicazione: (2023)

Masked Autoencoders Are Effective Tokenizers for Diffusion Models
di: Chen, Hao, et al.
Pubblicazione: (2025)

Supervised Knowledge Makes Large Language Models Better In-context Learners
di: Yang, Linyi, et al.
Pubblicazione: (2023)

PromptBench: A Unified Library for Evaluation of Large Language Models
di: Zhu, Kaijie, et al.
Pubblicazione: (2023)

NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimuli
di: Wang, Xu, et al.
Pubblicazione: (2024)

Token Prediction as Implicit Classification to Identify LLM-Generated Text
di: Chen, Yutian, et al.
Pubblicazione: (2023)

SVeritas: Benchmark for Robust Speaker Verification under Diverse Conditions
di: Baali, Massa, et al.
Pubblicazione: (2025)

Generating Diverse Training Samples for Relation Extraction with Large Language Models
di: Li, Zexuan, et al.
Pubblicazione: (2025)

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
di: Yu, Zhuohao, et al.
Pubblicazione: (2024)

Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models
di: Chen, Jie, et al.
Pubblicazione: (2024)

Evaluating Language Models as Synthetic Data Generators
di: Kim, Seungone, et al.
Pubblicazione: (2024)

Controllable and Diverse Data Augmentation with Large Language Model for Low-Resource Open-Domain Dialogue Generation
di: Liu, Zhenhua, et al.
Pubblicazione: (2024)

LLM4SFC: Sequential Function Chart Generation via Large Language Models
di: Glick, Ofek, et al.
Pubblicazione: (2025)

Revisiting Acoustic Features for Robust ASR
di: Shah, Muhammad A., et al.
Pubblicazione: (2024)

CultureLLM: Incorporating Cultural Differences into Large Language Models
di: Li, Cheng, et al.
Pubblicazione: (2024)

Synthetic Eggs in Many Baskets: The Impact of Synthetic Data Diversity on LLM Fine-Tuning
di: Schaffelder, Max, et al.
Pubblicazione: (2025)

WhisperRT -- Turning Whisper into a Causal Streaming Model
di: Krichli, Tomer, et al.
Pubblicazione: (2025)

Cross-model Control: Improving Multiple Large Language Models in One-time Training
di: Wu, Jiayi, et al.
Pubblicazione: (2024)

AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition
di: Chen, Zhaorun, et al.
Pubblicazione: (2024)

CoLMbo: Speaker Language Model for Descriptive Profiling
di: Baali, Massa, et al.
Pubblicazione: (2025)