Robust Kernel Hypothesis Testing under Data Corruption

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schrab, Antonin, Kim, Ilmun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915257476186112
author Schrab, Antonin
Kim, Ilmun
author_facet Schrab, Antonin
Kim, Ilmun
contents We propose a general method for constructing robust permutation tests under data corruption. The proposed tests effectively control the non-asymptotic type I error under data corruption, and we prove their consistency in power under minimal conditions. This contributes to the practical deployment of hypothesis tests for real-world applications with potential adversarial attacks. For the two-sample and independence settings, we show that our kernel robust tests are minimax optimal, in the sense that they are guaranteed to be non-asymptotically powerful against alternatives uniformly separated from the null in the kernel MMD and HSIC metrics at some optimal rate (tight with matching lower bound). We point out that existing differentially private tests can be adapted to be robust to data corruption, and we demonstrate in experiments that our proposed tests achieve much higher power than these private tests. Finally, we provide publicly available implementations and empirically illustrate the practicality of our robust tests.
format Preprint
id arxiv_https___arxiv_org_abs_2405_19912
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Robust Kernel Hypothesis Testing under Data Corruption
Schrab, Antonin
Kim, Ilmun
Machine Learning
We propose a general method for constructing robust permutation tests under data corruption. The proposed tests effectively control the non-asymptotic type I error under data corruption, and we prove their consistency in power under minimal conditions. This contributes to the practical deployment of hypothesis tests for real-world applications with potential adversarial attacks. For the two-sample and independence settings, we show that our kernel robust tests are minimax optimal, in the sense that they are guaranteed to be non-asymptotically powerful against alternatives uniformly separated from the null in the kernel MMD and HSIC metrics at some optimal rate (tight with matching lower bound). We point out that existing differentially private tests can be adapted to be robust to data corruption, and we demonstrate in experiments that our proposed tests achieve much higher power than these private tests. Finally, we provide publicly available implementations and empirically illustrate the practicality of our robust tests.
title Robust Kernel Hypothesis Testing under Data Corruption
topic Machine Learning
url https://arxiv.org/abs/2405.19912