Tree-Embedded Bayesian Factor Models for Multidimensional Categorical Distributions

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Awaya, Naoki, Sasaki, Keisuke, Kobayashi, Genya, Sugasawa, Shonosuke
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910038962995200
author Awaya, Naoki
Sasaki, Keisuke
Kobayashi, Genya
Sugasawa, Shonosuke
author_facet Awaya, Naoki
Sasaki, Keisuke
Kobayashi, Genya
Sugasawa, Shonosuke
contents Analyzing data collected from multiple sources to estimate common and heterogeneous structures through a hierarchical model is a central task in Bayesian inference, and to this end, Bayesian factor models are one of the most widely used tools for this purpose. In this paper, we propose a new Bayesian latent factor model for distributions, providing a parsimonious model for describing many observed distributions through lower-dimensional structures. Many applications are found in the social science in the form of grouped data, for example, distributions of age composition and income observed across locations. In these contexts, standard mixture models can be inefficient because the distributions do not necessarily exhibit clear clustering structures. To overcome the difficulty, we introduce a tree-based transformation that embeds distributions into a Euclidean space and construct a Bayesian latent factor model in the transformed space. Once transformed into Euclidean vectors, the Bayesian hierarchical model can be extended in a straightforward manner. As an illustration, we incorporate spatial dependence by introducing a prior based on a simultaneous autoregressive (SAR) model. The proposed model is "nonparametric" in the sense that it does not impose parametric assumptions on the form of the observed distributions. Through numerical experiments using real population data, we demonstrate that the proposed model outperforms the standard Dirichlet mixture model as well as models built on parametric assumptions.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02502
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Tree-Embedded Bayesian Factor Models for Multidimensional Categorical Distributions
Awaya, Naoki
Sasaki, Keisuke
Kobayashi, Genya
Sugasawa, Shonosuke
Methodology
Analyzing data collected from multiple sources to estimate common and heterogeneous structures through a hierarchical model is a central task in Bayesian inference, and to this end, Bayesian factor models are one of the most widely used tools for this purpose. In this paper, we propose a new Bayesian latent factor model for distributions, providing a parsimonious model for describing many observed distributions through lower-dimensional structures. Many applications are found in the social science in the form of grouped data, for example, distributions of age composition and income observed across locations. In these contexts, standard mixture models can be inefficient because the distributions do not necessarily exhibit clear clustering structures. To overcome the difficulty, we introduce a tree-based transformation that embeds distributions into a Euclidean space and construct a Bayesian latent factor model in the transformed space. Once transformed into Euclidean vectors, the Bayesian hierarchical model can be extended in a straightforward manner. As an illustration, we incorporate spatial dependence by introducing a prior based on a simultaneous autoregressive (SAR) model. The proposed model is "nonparametric" in the sense that it does not impose parametric assumptions on the form of the observed distributions. Through numerical experiments using real population data, we demonstrate that the proposed model outperforms the standard Dirichlet mixture model as well as models built on parametric assumptions.
title Tree-Embedded Bayesian Factor Models for Multidimensional Categorical Distributions
topic Methodology
url https://arxiv.org/abs/2603.02502