Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Chen Jason, Liu, Yunrui, Zeng, Pengcheng, Wu, Ting, Chen, Lei, Hui, Pan, Hao, Fei
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:https://arxiv.org/abs/2310.16428
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910347120607232
author Zhang, Chen Jason
Liu, Yunrui
Zeng, Pengcheng
Wu, Ting
Chen, Lei
Hui, Pan
Hao, Fei
author_facet Zhang, Chen Jason
Liu, Yunrui
Zeng, Pengcheng
Wu, Ting
Chen, Lei
Hui, Pan
Hao, Fei
contents The recent boom in crowdsourcing has opened up a new avenue for utilizing human intelligence in the realm of data analysis. This innovative approach provides a powerful means for connecting online workers to tasks that cannot effectively be done solely by machines or conducted by professional experts due to cost constraints. Within the field of social science, four elements are required to construct a sound crowd - Diversity of Opinion, Independence, Decentralization and Aggregation. However, while the other three components have already been investigated and implemented in existing crowdsourcing platforms, 'Diversity of Opinion' has not been functionally enabled yet. From a computational point of view, constructing a wise crowd necessitates quantitatively modeling and taking diversity into account. There are usually two paradigms in a crowdsourcing marketplace for worker selection: building a crowd to wait for tasks to come and selecting workers for a given task. We propose similarity-driven and task-driven models for both paradigms. Also, we develop efficient and effective algorithms for recruiting a limited number of workers with optimal diversity in both models. To validate our solutions, we conduct extensive experiments using both synthetic datasets and real data sets.
format Preprint
id arxiv_https___arxiv_org_abs_2310_16428
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Similarity-driven and Task-driven Models for Diversity of Opinion in Crowdsourcing Markets
Zhang, Chen Jason
Liu, Yunrui
Zeng, Pengcheng
Wu, Ting
Chen, Lei
Hui, Pan
Hao, Fei
Applications
The recent boom in crowdsourcing has opened up a new avenue for utilizing human intelligence in the realm of data analysis. This innovative approach provides a powerful means for connecting online workers to tasks that cannot effectively be done solely by machines or conducted by professional experts due to cost constraints. Within the field of social science, four elements are required to construct a sound crowd - Diversity of Opinion, Independence, Decentralization and Aggregation. However, while the other three components have already been investigated and implemented in existing crowdsourcing platforms, 'Diversity of Opinion' has not been functionally enabled yet. From a computational point of view, constructing a wise crowd necessitates quantitatively modeling and taking diversity into account. There are usually two paradigms in a crowdsourcing marketplace for worker selection: building a crowd to wait for tasks to come and selecting workers for a given task. We propose similarity-driven and task-driven models for both paradigms. Also, we develop efficient and effective algorithms for recruiting a limited number of workers with optimal diversity in both models. To validate our solutions, we conduct extensive experiments using both synthetic datasets and real data sets.
title Similarity-driven and Task-driven Models for Diversity of Opinion in Crowdsourcing Markets
topic Applications
url https://arxiv.org/abs/2310.16428