CINDES: Classification induced neural density estimator and simulator

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dai, Dehao, Fan, Jianqing, Gu, Yihong, Mukherjee, Debarghya
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909818161201152
author Dai, Dehao
Fan, Jianqing
Gu, Yihong
Mukherjee, Debarghya
author_facet Dai, Dehao
Fan, Jianqing
Gu, Yihong
Mukherjee, Debarghya
contents Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical successes, implementation can be challenging due to the need to ensure non-negativity and unit-mass constraints, and theoretical understanding remains limited. In particular, it is unclear whether such estimators can adaptively achieve faster convergence rates when the underlying density exhibits a low-dimensional structure. This paper addresses these gaps by proposing a structure-agnostic neural density estimator that is (i) straightforward to implement and (ii) provably adaptive, attaining faster rates when the true density admits a low-dimensional composition structure. Another key contribution of our work is to show that the proposed estimator integrates naturally into generative sampling pipelines, most notably score-based diffusion models, where it achieves provably faster convergence when the underlying density is structured. We validate its performance through extensive simulations and a real-data application.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00367
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CINDES: Classification induced neural density estimator and simulator
Dai, Dehao
Fan, Jianqing
Gu, Yihong
Mukherjee, Debarghya
Machine Learning
Statistics Theory
Methodology
62G08
Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical successes, implementation can be challenging due to the need to ensure non-negativity and unit-mass constraints, and theoretical understanding remains limited. In particular, it is unclear whether such estimators can adaptively achieve faster convergence rates when the underlying density exhibits a low-dimensional structure. This paper addresses these gaps by proposing a structure-agnostic neural density estimator that is (i) straightforward to implement and (ii) provably adaptive, attaining faster rates when the true density admits a low-dimensional composition structure. Another key contribution of our work is to show that the proposed estimator integrates naturally into generative sampling pipelines, most notably score-based diffusion models, where it achieves provably faster convergence when the underlying density is structured. We validate its performance through extensive simulations and a real-data application.
title CINDES: Classification induced neural density estimator and simulator
topic Machine Learning
Statistics Theory
Methodology
62G08
url https://arxiv.org/abs/2510.00367