Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2602.05106 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911422372380672 |
|---|---|
| author | Browder, Michael Duh, Kevin Harris, J. David Lyzinski, Vince McNamee, Paul Park, Youngser Priebe, Carey E. Viechnicki, Peter |
| author_facet | Browder, Michael Duh, Kevin Harris, J. David Lyzinski, Vince McNamee, Paul Park, Youngser Priebe, Carey E. Viechnicki, Peter |
| contents | Scarcity of labeled training data remains the long pole in the tent for building performant language technology and generative AI models. Transformer models -- particularly LLMs -- are increasingly being used to mitigate the data scarcity problem via synthetic data generation. However, because the models are black boxes, the properties of the synthetic data are difficult to predict. In practice it is common for language technology engineers to 'fiddle' with the LLM temperature setting and hope that what comes out the other end improves the downstream model. Faced with this uncertainty, here we propose Data Kernel Perspective Space (DKPS) to provide the foundation for mathematical analysis yielding concrete statistical guarantees for the quality of the outputs of transformer models. We first show the mathematical derivation of DKPS and how it provides performance guarantees. Next we show how DKPS performance guarantees can elucidate performance of a downstream task, such as neural machine translation models or LLMs trained using Contrastive Preference Optimization (CPO). Limitations of the current work and future research are also discussed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_05106 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Data Kernel Perspective Space Performance Guarantees for Synthetic Data from Transformer Models Browder, Michael Duh, Kevin Harris, J. David Lyzinski, Vince McNamee, Paul Park, Youngser Priebe, Carey E. Viechnicki, Peter Computation and Language Machine Learning Scarcity of labeled training data remains the long pole in the tent for building performant language technology and generative AI models. Transformer models -- particularly LLMs -- are increasingly being used to mitigate the data scarcity problem via synthetic data generation. However, because the models are black boxes, the properties of the synthetic data are difficult to predict. In practice it is common for language technology engineers to 'fiddle' with the LLM temperature setting and hope that what comes out the other end improves the downstream model. Faced with this uncertainty, here we propose Data Kernel Perspective Space (DKPS) to provide the foundation for mathematical analysis yielding concrete statistical guarantees for the quality of the outputs of transformer models. We first show the mathematical derivation of DKPS and how it provides performance guarantees. Next we show how DKPS performance guarantees can elucidate performance of a downstream task, such as neural machine translation models or LLMs trained using Contrastive Preference Optimization (CPO). Limitations of the current work and future research are also discussed. |
| title | Data Kernel Perspective Space Performance Guarantees for Synthetic Data from Transformer Models |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2602.05106 |