Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.18530 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914168453464064 |
|---|---|
| author | Reisach, Alexander G. Collier, Olivier Luedtke, Alex Chambaz, Antoine |
| author_facet | Reisach, Alexander G. Collier, Olivier Luedtke, Alex Chambaz, Antoine |
| contents | We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high dimensions, such as neural networks and decision trees. Our main theoretical result characterizes and establishes the convergence of our estimator to the true conditional density in the data limit. We develop condensité, a method that implements this approach. We demonstrate the benefit of the auxiliary samples on synthetic data and showcase that condensité can achieve good out-of-the-box results. We evaluate our method on a large population survey dataset and on a satellite imaging dataset. In both cases, we find that condensité matches or outperforms the state of the art and yields conditional densities in line with established findings in the literature on each dataset. Our contribution opens up new possibilities for regression-based conditional density estimation and the empirical results indicate strong promise for applied research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_18530 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Transforming Conditional Density Estimation Into a Single Nonparametric Regression Task Reisach, Alexander G. Collier, Olivier Luedtke, Alex Chambaz, Antoine Machine Learning We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high dimensions, such as neural networks and decision trees. Our main theoretical result characterizes and establishes the convergence of our estimator to the true conditional density in the data limit. We develop condensité, a method that implements this approach. We demonstrate the benefit of the auxiliary samples on synthetic data and showcase that condensité can achieve good out-of-the-box results. We evaluate our method on a large population survey dataset and on a satellite imaging dataset. In both cases, we find that condensité matches or outperforms the state of the art and yields conditional densities in line with established findings in the literature on each dataset. Our contribution opens up new possibilities for regression-based conditional density estimation and the empirical results indicate strong promise for applied research. |
| title | Transforming Conditional Density Estimation Into a Single Nonparametric Regression Task |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2511.18530 |