Concentration bounds on response-based vector embeddings of black-box generative models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Acharyya, Aranyak, Agterberg, Joshua, Park, Youngser, Priebe, Carey E.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908644537270272
author Acharyya, Aranyak
Agterberg, Joshua
Park, Youngser
Priebe, Carey E.
author_facet Acharyya, Aranyak
Agterberg, Joshua
Park, Youngser
Priebe, Carey E.
contents Generative models, such as large language models or text-to-image diffusion models, can generate relevant responses to user-given queries. Response-based vector embeddings of generative models facilitate statistical analysis and inference on a given collection of black-box generative models. The Data Kernel Perspective Space embedding is one particular method of obtaining response-based vector embeddings for a given set of generative models, already discussed in the literature. In this paper, under appropriate regularity conditions, we establish high probability concentration bounds on the sample vector embeddings for a given set of generative models, obtained through the method of Data Kernel Perspective Space embedding. Our results tell us the required number of sample responses needed in order to approximate the population-level vector embeddings with a desired level of accuracy. The algebraic tools used to establish our results can be used further for establishing concentration bounds on Classical Multidimensional Scaling embeddings in general, when the dissimilarities are observed with noise.
format Preprint
id arxiv_https___arxiv_org_abs_2511_08307
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Concentration bounds on response-based vector embeddings of black-box generative models
Acharyya, Aranyak
Agterberg, Joshua
Park, Youngser
Priebe, Carey E.
Machine Learning
Generative models, such as large language models or text-to-image diffusion models, can generate relevant responses to user-given queries. Response-based vector embeddings of generative models facilitate statistical analysis and inference on a given collection of black-box generative models. The Data Kernel Perspective Space embedding is one particular method of obtaining response-based vector embeddings for a given set of generative models, already discussed in the literature. In this paper, under appropriate regularity conditions, we establish high probability concentration bounds on the sample vector embeddings for a given set of generative models, obtained through the method of Data Kernel Perspective Space embedding. Our results tell us the required number of sample responses needed in order to approximate the population-level vector embeddings with a desired level of accuracy. The algebraic tools used to establish our results can be used further for establishing concentration bounds on Classical Multidimensional Scaling embeddings in general, when the dissimilarities are observed with noise.
title Concentration bounds on response-based vector embeddings of black-box generative models
topic Machine Learning
url https://arxiv.org/abs/2511.08307