Residential College | false |
Status | 已發表Published |
Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments | |
Kou, N. M.; Li, Y.; Wang, H.; U, L. H.; Gong, Z. G. | |
2017-05-01 | |
Conference Name | ACM Sigmod2017 |
Source Publication | Proceedings of ACM Sigmod2017 |
Pages | 1415-1430 |
Conference Date | 2017-05-01 |
Conference Place | Chicago, Illinois |
Country | USA |
Abstract | Crowdsourced query processing is an emerging processing technique that tackles computationally challenging problems by human intelligence. The basic idea is to decompose a computationally challenging problem into a set of human friendly microtasks (e.g., pairwise comparisons) that are distributed to and answered by the crowd. The solution of the problem is then computed (e.g., by aggregation) based on the crowdsourced answers to the microtasks. In this work, we attempt to revisit the crowdsourced processing of the top-k queries, aiming at (1) securing the quality of crowdsourced comparisons by a certain confidence level and (2) minimizing the total monetary cost. To secure the quality of each paired comparison, we employ two statistical tools, Student's t-distribution estimation and Stein's estimation, to estimate the confidence interval of the underlying mean value, which is then used to draw a conclusion to the comparison. Based on the pairwise comparison process, we attempt to minimize the monetary cost of the top-k processing within a Select-Partition-Rank framework. Our experiments, conducted on four real datasets, demonstrate that our stochastic method outperforms other existing top-k processing techniques by a visible difference. |
Keyword | Crowdsourcing Answer Ranking Pairwise Judgments |
URL | View the original |
Language | 英語English |
The Source to Article | PB_Publication |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Recommended Citation GB/T 7714 | Kou, N. M.,Li, Y.,Wang, H.,et al. Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments[C], 2017, 1415-1430. |
APA | Kou, N. M.., Li, Y.., Wang, H.., U, L. H.., & Gong, Z. G. (2017). Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments. Proceedings of ACM Sigmod2017, 1415-1430. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment