Residential Collegefalse
Status已發表Published
Crowdsourced Top-k Queries by Pairwise Preference Judgments with Confidence and Budget Control
Li, Y.1; Wang, H.2; Kou, N. M.3; U, L. H.1; Gong, Z. G.1
2021-03
Source PublicationThe VLDB Journal
ISSN1066-8888
Volume30Pages:189-213
Abstract

Crowdsourced query processing is an emerging technique that tackles computationally challenging problems by human intelligence. The basic idea is to decompose a computationally challenging problem into a set of human-friendly microtasks (e.g., pairwise comparisons) that are distributed to and answered by the crowd. The solution of the problem is then computed (e.g., by aggregation) based on the crowdsourced answers to the microtasks. In this work, we attempt to revisit the crowdsourced processing of the top-k queries, aiming at (1) securing the quality of crowdsourced comparisons by a certain confidence level and (2) minimizing the total monetary cost. To secure the quality of each paired comparison, we employ statistical tools to estimate the confidence interval from the collected judgments of the crowd, which is then used to guide the aggregated judgment. We propose novel frameworks, SPR and SPR+, to address the crowdsourced top-k queries. Both SPR and SPR+ are budget-aware, confidence-aware, and effective in producing high-quality top-k results. SPR requires as input a budget for each paired comparison, whereas SPR+ requires only a total budget for the whole top-k task. Extensive experiments, conducted on four real datasets, demonstrate that our proposed methods outperform the other existing top-k processing techniques by a visible difference.

KeywordCrowdsourcing Top-k Query Preference Judgments Confidence Budget Control
DOI10.1007/s00778-020-00631-8
URLView the original
Indexed BySCIE ; SSCI
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Hardware & Architecture ; Computer Science, Information Systems
WOS IDWOS:000571708100002
PublisherSPRINGER, ONE NEW YORK PLAZA, SUITE 4600 , NEW YORK, NY 10004, UNITED STATES
The Source to ArticlePB_Publication
Scopus ID2-s2.0-85091375210
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorU, L. H.
Affiliation1.State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, Macao, China
2.Inception Institute of Artificial Intelligence, Abu Dhabi, UAE
3.Cainiao Smart Logistics Network Limited, Hangzhou, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Li, Y.,Wang, H.,Kou, N. M.,et al. Crowdsourced Top-k Queries by Pairwise Preference Judgments with Confidence and Budget Control[J]. The VLDB Journal, 2021, 30, 189-213.
APA Li, Y.., Wang, H.., Kou, N. M.., U, L. H.., & Gong, Z. G. (2021). Crowdsourced Top-k Queries by Pairwise Preference Judgments with Confidence and Budget Control. The VLDB Journal, 30, 189-213.
MLA Li, Y.,et al."Crowdsourced Top-k Queries by Pairwise Preference Judgments with Confidence and Budget Control".The VLDB Journal 30(2021):189-213.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Y.]'s Articles
[Wang, H.]'s Articles
[Kou, N. M.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Y.]'s Articles
[Wang, H.]'s Articles
[Kou, N. M.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Y.]'s Articles
[Wang, H.]'s Articles
[Kou, N. M.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.