Residential College | false |
Status | 已發表Published |
Crowdsourced top-k queries by pairwise preference judgments with confidence and budget control | |
Yan Li1; Hao Wang2; Ngai Meng Kou3; Leong Hou U1; Zhiguo Gong1 | |
2021-03 | |
Source Publication | VLDB Journal |
ISSN | 1066-8888 |
Volume | 30Pages:189-213 |
Abstract | Crowdsourced query processing is an emerging technique that tackles computationally challenging problems by human intelligence. The basic idea is to decompose a computationally challenging problem into a set of human-friendly microtasks (e.g., pairwise comparisons) that are distributed to and answered by the crowd. The solution of the problem is then computed (e.g., by aggregation) based on the crowdsourced answers to the microtasks. In this work, we attempt to revisit the crowdsourced processing of the top-k queries, aiming at (1) securing the quality of crowdsourced comparisons by a certain confidence level and (2) minimizing the total monetary cost. To secure the quality of each paired comparison, we employ statistical tools to estimate the confidence interval from the collected judgments of the crowd, which is then used to guide the aggregated judgment. We propose novel frameworks, SPR and SPR, to address the crowdsourced top-k queries. Both SPR and SPR are budget-aware, confidence-aware, and effective in producing high-quality top-k results. SPR requires as input a budget for each paired comparison, whereas SPR requires only a total budget for the whole top-k task. Extensive experiments, conducted on four real datasets, demonstrate that our proposed methods outperform the other existing top-k processing techniques by a visible difference. |
Keyword | Budget Control Confidence Crowdsourcing Preference Judgments Top-k Query |
DOI | 10.1007/s00778-020-00631-8 |
URL | View the original |
Indexed By | SCIE ; SSCI |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Hardware & Architecture ; Computer Science, Information Systems |
WOS ID | WOS:000571708100002 |
Publisher | SPRINGER, ONE NEW YORK PLAZA, SUITE 4600 , NEW YORK, NY 10004, UNITED STATES |
Scopus ID | 2-s2.0-85091375210 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Leong Hou U |
Affiliation | 1.State Key Laboratory of Internet of Things for Smart City,Department of Computer and Information Science,University of Macau,Macao,China 2.Inception Institute of Artificial Intelligence,Abu Dhabi,United Arab Emirates 3.Cainiao Smart Logistics Network Limited,Hangzhou,China |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Yan Li,Hao Wang,Ngai Meng Kou,et al. Crowdsourced top-k queries by pairwise preference judgments with confidence and budget control[J]. VLDB Journal, 2021, 30, 189-213. |
APA | Yan Li., Hao Wang., Ngai Meng Kou., Leong Hou U., & Zhiguo Gong (2021). Crowdsourced top-k queries by pairwise preference judgments with confidence and budget control. VLDB Journal, 30, 189-213. |
MLA | Yan Li,et al."Crowdsourced top-k queries by pairwise preference judgments with confidence and budget control".VLDB Journal 30(2021):189-213. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment