Residential Collegefalse
Status已發表Published
Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments
Kou, N. M.; Li, Y.; Wang, H.; U, L. H.; Gong, Z. G.
2017-05-01
Conference NameACM Sigmod2017
Source PublicationProceedings of ACM Sigmod2017
Pages1415-1430
Conference Date2017-05-01
Conference PlaceChicago, Illinois
CountryUSA
Abstract

Crowdsourced query processing is an emerging processing technique that tackles computationally challenging problems by human intelligence. The basic idea is to decompose a computationally challenging problem into a set of human friendly microtasks (e.g., pairwise comparisons) that are distributed to and answered by the crowd. The solution of the problem is then computed (e.g., by aggregation) based on the crowdsourced answers to the microtasks. In this work, we attempt to revisit the crowdsourced processing of the top-k queries, aiming at (1) securing the quality of crowdsourced comparisons by a certain confidence level and (2) minimizing the total monetary cost. To secure the quality of each paired comparison, we employ two statistical tools, Student's t-distribution estimation and Stein's estimation, to estimate the confidence interval of the underlying mean value, which is then used to draw a conclusion to the comparison. Based on the pairwise comparison process, we attempt to minimize the monetary cost of the top-k processing within a Select-Partition-Rank framework. Our experiments, conducted on four real datasets, demonstrate that our stochastic method outperforms other existing top-k processing techniques by a visible difference.

KeywordCrowdsourcing Answer Ranking Pairwise Judgments
URLView the original
Language英語English
The Source to ArticlePB_Publication
Document TypeConference paper
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Recommended Citation
GB/T 7714
Kou, N. M.,Li, Y.,Wang, H.,et al. Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments[C], 2017, 1415-1430.
APA Kou, N. M.., Li, Y.., Wang, H.., U, L. H.., & Gong, Z. G. (2017). Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments. Proceedings of ACM Sigmod2017, 1415-1430.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Kou, N. M.]'s Articles
[Li, Y.]'s Articles
[Wang, H.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Kou, N. M.]'s Articles
[Li, Y.]'s Articles
[Wang, H.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Kou, N. M.]'s Articles
[Li, Y.]'s Articles
[Wang, H.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.