Testing Most Influential Sets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Konrad, Lucas Darius, Kuschnig, Nikolas
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910042011205632
author Konrad, Lucas Darius
Kuschnig, Nikolas
author_facet Konrad, Lucas Darius
Kuschnig, Nikolas
contents Small influential data subsets can dramatically impact model conclusions, with a few data points overturning key findings. While recent work identifies these most influential sets, there is no formal way to tell when maximum influence is excessive rather than expected under natural random sampling variation. We address this gap by developing a principled framework for most influential sets. Focusing on linear least-squares, we derive a convenient exact influence formula and identify the extreme value distributions of maximal influence - the heavy-tailed Fréchet for constant-size sets and heavy-tailed data, and the well-behaved Gumbel for growing sets or light tails. This allows us to conduct rigorous hypothesis tests for excessive influence. We demonstrate through applications across economics, biology, and machine learning benchmarks, resolving contested findings and replacing ad-hoc heuristics with rigorous inference.
format Preprint
id arxiv_https___arxiv_org_abs_2510_20372
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Testing Most Influential Sets
Konrad, Lucas Darius
Kuschnig, Nikolas
Machine Learning
Econometrics
Statistics Theory
Methodology
Small influential data subsets can dramatically impact model conclusions, with a few data points overturning key findings. While recent work identifies these most influential sets, there is no formal way to tell when maximum influence is excessive rather than expected under natural random sampling variation. We address this gap by developing a principled framework for most influential sets. Focusing on linear least-squares, we derive a convenient exact influence formula and identify the extreme value distributions of maximal influence - the heavy-tailed Fréchet for constant-size sets and heavy-tailed data, and the well-behaved Gumbel for growing sets or light tails. This allows us to conduct rigorous hypothesis tests for excessive influence. We demonstrate through applications across economics, biology, and machine learning benchmarks, resolving contested findings and replacing ad-hoc heuristics with rigorous inference.
title Testing Most Influential Sets
topic Machine Learning
Econometrics
Statistics Theory
Methodology
url https://arxiv.org/abs/2510.20372