Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2512.12072 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915961690390528 |
|---|---|
| author | Amballa, Avinash Saidutta, Yashas Malur Lin, Chi-Heng Kulkarni, Vivek Chappidi, Srinivas |
| author_facet | Amballa, Avinash Saidutta, Yashas Malur Lin, Chi-Heng Kulkarni, Vivek Chappidi, Srinivas |
| contents | Large language models (LLMs) are increasingly being used to generate synthetic datasets for the evaluation and training of downstream models. However, prior work has noted that such generated data lacks diversity. In this paper, we propose Voyager, a novel principled approach to generate diverse datasets. Our approach is iterative and directly optimizes a mathematical quantity that optimizes the diversity of the dataset using the machinery of determinantal point processes. Furthermore, our approach is training-free, applicable to closed-source models, and scalable. In addition to providing theoretical justification for the working of our method, we also demonstrate through comprehensive experiments that Voyager significantly outperforms popular baseline approaches by providing a 1.5-3 times improvement in diversity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_12072 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VOYAGER: A Training Free Approach for Generating Diverse Datasets using LLMs Amballa, Avinash Saidutta, Yashas Malur Lin, Chi-Heng Kulkarni, Vivek Chappidi, Srinivas Computation and Language Machine Learning Large language models (LLMs) are increasingly being used to generate synthetic datasets for the evaluation and training of downstream models. However, prior work has noted that such generated data lacks diversity. In this paper, we propose Voyager, a novel principled approach to generate diverse datasets. Our approach is iterative and directly optimizes a mathematical quantity that optimizes the diversity of the dataset using the machinery of determinantal point processes. Furthermore, our approach is training-free, applicable to closed-source models, and scalable. In addition to providing theoretical justification for the working of our method, we also demonstrate through comprehensive experiments that Voyager significantly outperforms popular baseline approaches by providing a 1.5-3 times improvement in diversity. |
| title | VOYAGER: A Training Free Approach for Generating Diverse Datasets using LLMs |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2512.12072 |