Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.18377 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915258862403584 |
|---|---|
| author | Hu, Shenggang Dai, Hongsheng Meng, Fanlin Aslett, Louis Pollock, Murray Roberts, Gareth O. |
| author_facet | Hu, Shenggang Dai, Hongsheng Meng, Fanlin Aslett, Louis Pollock, Murray Roberts, Gareth O. |
| contents | Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting to instead sampling from the joint distribution by means of a Monte Carlo approach is also challenging. For example, a naive rejection sampling does not work when the probability mass of the constraint is zero. A typical example of such constrained problems is to learn energy consumption for a higher resolution level based on data at a lower resolution, e.g., to decompose a daily reading into readings at a finer level. We introduce a novel Monte Carlo sampling algorithm based on Langevin diffusions and rejection sampling to solve the problem of sampling from equality-constrained models. Our method has the advantage of being exact for linear constraints and naturally deals with multimodal distributions on arbitrary constraints. We test our method on statistical disaggregation problems for electricity consumption datasets, and our approach provides better uncertainty estimation and accuracy in data imputation compared with other naive/unconstrained methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_18377 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Statistical Disaggregation -- a Monte Carlo Approach for Imputation under Constraints Hu, Shenggang Dai, Hongsheng Meng, Fanlin Aslett, Louis Pollock, Murray Roberts, Gareth O. Computation 62-08 (Primary) 62D10 (Secondary) Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting to instead sampling from the joint distribution by means of a Monte Carlo approach is also challenging. For example, a naive rejection sampling does not work when the probability mass of the constraint is zero. A typical example of such constrained problems is to learn energy consumption for a higher resolution level based on data at a lower resolution, e.g., to decompose a daily reading into readings at a finer level. We introduce a novel Monte Carlo sampling algorithm based on Langevin diffusions and rejection sampling to solve the problem of sampling from equality-constrained models. Our method has the advantage of being exact for linear constraints and naturally deals with multimodal distributions on arbitrary constraints. We test our method on statistical disaggregation problems for electricity consumption datasets, and our approach provides better uncertainty estimation and accuracy in data imputation compared with other naive/unconstrained methods. |
| title | Statistical Disaggregation -- a Monte Carlo Approach for Imputation under Constraints |
| topic | Computation 62-08 (Primary) 62D10 (Secondary) |
| url | https://arxiv.org/abs/2504.18377 |