Position: Insights from Survey Methodology can Improve Training Data
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917730344501248 |
|---|---|
| author | Eckman, Stephanie Plank, Barbara Kreuter, Frauke |
| author_facet | Eckman, Stephanie Plank, Barbara Kreuter, Frauke |
| contents | Whether future AI models are fair, trustworthy, and aligned with the public's interests rests in part on our ability to collect accurate data about what we want the models to do. However, collecting high-quality data is difficult, and few AI/ML researchers are trained in data collection methods. Recent research in data-centric AI has show that higher quality training data leads to better performing models, making this the right moment to introduce AI/ML researchers to the field of survey methodology, the science of data collection. We summarize insights from the survey methodology literature and discuss how they can improve the quality of training and feedback data. We also suggest collaborative research ideas into how biases in data collection can be mitigated, making models more accurate and human-centric. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_01208 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Position: Insights from Survey Methodology can Improve Training Data Eckman, Stephanie Plank, Barbara Kreuter, Frauke Human-Computer Interaction Methodology E.0 Whether future AI models are fair, trustworthy, and aligned with the public's interests rests in part on our ability to collect accurate data about what we want the models to do. However, collecting high-quality data is difficult, and few AI/ML researchers are trained in data collection methods. Recent research in data-centric AI has show that higher quality training data leads to better performing models, making this the right moment to introduce AI/ML researchers to the field of survey methodology, the science of data collection. We summarize insights from the survey methodology literature and discuss how they can improve the quality of training and feedback data. We also suggest collaborative research ideas into how biases in data collection can be mitigated, making models more accurate and human-centric. |
| title | Position: Insights from Survey Methodology can Improve Training Data |
| topic | Human-Computer Interaction Methodology E.0 |
| url | https://arxiv.org/abs/2403.01208 |