Distributionally robust halfspace depth

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ivanovs, Jevgenijs, Mozharovskyi, Pavlo
Format: Preprint
Published: 2021
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916240646209536
author Ivanovs, Jevgenijs
Mozharovskyi, Pavlo
author_facet Ivanovs, Jevgenijs
Mozharovskyi, Pavlo
contents Tukey's halfspace depth can be seen as a stochastic program and as such it is not guarded against optimizer's curse, so that a limited training sample may easily result in a poor out-of-sample performance. We propose a generalized halfspace depth concept relying on the recent advances in distributionally robust optimization, where every halfspace is examined using the respective worst-case distribution in the Wasserstein ball of radius $δ\geq 0$ centered at the empirical law. This new depth can be seen as a smoothed and regularized classical halfspace depth which is retrieved as $δ\downarrow 0$. It inherits most of the main properties of the latter and, additionally, enjoys various new attractive features such as continuity and strict positivity beyond the convex hull of the support. We provide numerical illustrations of the new depth and its advantages, and develop some fundamental theory. In particular, we study the upper level sets and the median region including their breakdown properties.
format Preprint
id arxiv_https___arxiv_org_abs_2101_00726
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Distributionally robust halfspace depth
Ivanovs, Jevgenijs
Mozharovskyi, Pavlo
Optimization and Control
Methodology
Tukey's halfspace depth can be seen as a stochastic program and as such it is not guarded against optimizer's curse, so that a limited training sample may easily result in a poor out-of-sample performance. We propose a generalized halfspace depth concept relying on the recent advances in distributionally robust optimization, where every halfspace is examined using the respective worst-case distribution in the Wasserstein ball of radius $δ\geq 0$ centered at the empirical law. This new depth can be seen as a smoothed and regularized classical halfspace depth which is retrieved as $δ\downarrow 0$. It inherits most of the main properties of the latter and, additionally, enjoys various new attractive features such as continuity and strict positivity beyond the convex hull of the support. We provide numerical illustrations of the new depth and its advantages, and develop some fundamental theory. In particular, we study the upper level sets and the median region including their breakdown properties.
title Distributionally robust halfspace depth
topic Optimization and Control
Methodology
url https://arxiv.org/abs/2101.00726