Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.06121 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915536809492480 |
|---|---|
| author | Bloomston, Adam Burke, Elizabeth Cacace, Megan Diaz, Anne Dougherty, Wren Gonzalez, Matthew Gregg, Remington Güngör, Yeliz Hayes, Bryce Hsu, Eeway Israeli, Oron Kim, Heesoo Kwasnick, Sara Lacsina, Joanne Rodriguez, Demma Rosa Schiller, Adam Schumacher, Whitney Simon, Jessica Tang, Maggie Wharton, Skyler Wilcken, Marilyn |
| author_facet | Bloomston, Adam Burke, Elizabeth Cacace, Megan Diaz, Anne Dougherty, Wren Gonzalez, Matthew Gregg, Remington Güngör, Yeliz Hayes, Bryce Hsu, Eeway Israeli, Oron Kim, Heesoo Kwasnick, Sara Lacsina, Joanne Rodriguez, Demma Rosa Schiller, Adam Schumacher, Whitney Simon, Jessica Tang, Maggie Wharton, Skyler Wilcken, Marilyn |
| contents | In this paper, we first situate the challenges for measuring data quality under Project Lighthouse in the broader academic context. We then discuss in detail the three core data quality metrics we use for measurement--two of which extend prior academic work. Using those data quality metrics as examples, we propose a framework, based on machine learning classification, for empirically justifying the choice of data quality metrics and their associated minimum thresholds. Finally we outline how these methods enable us to rigorously meet the principle of data minimization when analyzing potential experience gaps under Project Lighthouse, which we term quantitative data minimization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_06121 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Measuring Data Quality for Project Lighthouse Bloomston, Adam Burke, Elizabeth Cacace, Megan Diaz, Anne Dougherty, Wren Gonzalez, Matthew Gregg, Remington Güngör, Yeliz Hayes, Bryce Hsu, Eeway Israeli, Oron Kim, Heesoo Kwasnick, Sara Lacsina, Joanne Rodriguez, Demma Rosa Schiller, Adam Schumacher, Whitney Simon, Jessica Tang, Maggie Wharton, Skyler Wilcken, Marilyn Applications In this paper, we first situate the challenges for measuring data quality under Project Lighthouse in the broader academic context. We then discuss in detail the three core data quality metrics we use for measurement--two of which extend prior academic work. Using those data quality metrics as examples, we propose a framework, based on machine learning classification, for empirically justifying the choice of data quality metrics and their associated minimum thresholds. Finally we outline how these methods enable us to rigorously meet the principle of data minimization when analyzing potential experience gaps under Project Lighthouse, which we term quantitative data minimization. |
| title | Measuring Data Quality for Project Lighthouse |
| topic | Applications |
| url | https://arxiv.org/abs/2510.06121 |