Robust and Sparse Estimation of Unbounded Density Ratio under Heavy Contamination

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nagumo, Ryosuke, Fujisawa, Hironori
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912756355039232
author Nagumo, Ryosuke
Fujisawa, Hironori
author_facet Nagumo, Ryosuke
Fujisawa, Hironori
contents We examine the non-asymptotic properties of robust density ratio estimation (DRE) in contaminated settings. Weighted DRE is the most promising among existing methods, exhibiting doubly strong robustness from an asymptotic perspective. This study demonstrates that Weighted DRE achieves sparse consistency even under heavy contamination within a non-asymptotic framework. This method addresses two significant challenges in density ratio estimation and robust estimation. For density ratio estimation, we provide the non-asymptotic properties of estimating unbounded density ratios under the assumption that the weighted density ratio function is bounded. For robust estimation, we introduce a non-asymptotic framework for doubly strong robustness under heavy contamination, assuming that at least one of the following conditions holds: (i) contamination ratios are small, and (ii) outliers have small weighted values. This work provides the first non-asymptotic analysis of strong robustness under heavy contamination.
format Preprint
id arxiv_https___arxiv_org_abs_2512_09266
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust and Sparse Estimation of Unbounded Density Ratio under Heavy Contamination
Nagumo, Ryosuke
Fujisawa, Hironori
Machine Learning
We examine the non-asymptotic properties of robust density ratio estimation (DRE) in contaminated settings. Weighted DRE is the most promising among existing methods, exhibiting doubly strong robustness from an asymptotic perspective. This study demonstrates that Weighted DRE achieves sparse consistency even under heavy contamination within a non-asymptotic framework. This method addresses two significant challenges in density ratio estimation and robust estimation. For density ratio estimation, we provide the non-asymptotic properties of estimating unbounded density ratios under the assumption that the weighted density ratio function is bounded. For robust estimation, we introduce a non-asymptotic framework for doubly strong robustness under heavy contamination, assuming that at least one of the following conditions holds: (i) contamination ratios are small, and (ii) outliers have small weighted values. This work provides the first non-asymptotic analysis of strong robustness under heavy contamination.
title Robust and Sparse Estimation of Unbounded Density Ratio under Heavy Contamination
topic Machine Learning
url https://arxiv.org/abs/2512.09266