UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Toward fast theta-join: A prefiltering and amalgamated partitioning approach
Wu, Jiashu1,2; Wang, Yang1; Fan, Xiaopeng1; Ye, Kejiang1; Xu, Chengzhong3
2022-04-11
Source PublicationConcurrency and Computation: Practice and Experience
ISSN1532-0626
Volume34Issue:17Pages:e6996
Abstract

As one of the most useful online processing techniques, the theta-join operation has been utilized by many applications to fully excavate the relationships between data streams in various scenarios. As such, constant research efforts have been put to optimize its performance in the distributed environment, which is typically characterized by reducing the number of Cartesian products as much as possible. In this article, we design and implement a novel fast theta-join algorithm, called Prefap, by developing two distinct techniques—prefiltering and amalgamated partitioning—based on the state-of-the-art FastThetaJoin algorithm to optimize the efficiency of the theta-join operation. Firstly, we develop a prefiltering strategy before data streams are partitioned to reduce the amount of data to be involved and benefit a more fine-grained partitioning. Secondly, to avoid the data streams being partitioned in a coarse-grained isolated manner and improve the quality of the partition-level filtering, we introduce an amalgamated partitioning mechanism that can amalgamate the partitioning boundaries of two data streams to assist a fine-grained partitioning. With the integration of these two techniques into the existing FastThetaJoin algorithm, we design and implement a new framework to achieve a decreased number of Cartesian products and a higher theta-join efficiency. By comparing with existing algorithms, FastThetaJoin in particular, we evaluate the performance of Prefap on both synthetic and real data streams from two-way to multiway theta-join to demonstrate its superiority.

KeywordAmalgamated Data Stream Partitioning Cartesian Product Reduction Online Data Stream Prefiltering Theta-join (Θ-join)
DOI10.1002/cpe.6996
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering ; Computer Science, Theory & Methods
WOS IDWOS:000779988000001
PublisherWILEY, 111 RIVER ST, HOBOKEN 07030-5774, NJ
Scopus ID2-s2.0-85127802148
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorWang, Yang
Affiliation1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
2.University of Chinese Academy of Sciences, Beijing, China
3.University of Macau, Macao
Recommended Citation
GB/T 7714
Wu, Jiashu,Wang, Yang,Fan, Xiaopeng,et al. Toward fast theta-join: A prefiltering and amalgamated partitioning approach[J]. Concurrency and Computation: Practice and Experience, 2022, 34(17), e6996.
APA Wu, Jiashu., Wang, Yang., Fan, Xiaopeng., Ye, Kejiang., & Xu, Chengzhong (2022). Toward fast theta-join: A prefiltering and amalgamated partitioning approach. Concurrency and Computation: Practice and Experience, 34(17), e6996.
MLA Wu, Jiashu,et al."Toward fast theta-join: A prefiltering and amalgamated partitioning approach".Concurrency and Computation: Practice and Experience 34.17(2022):e6996.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wu, Jiashu]'s Articles
[Wang, Yang]'s Articles
[Fan, Xiaopeng]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wu, Jiashu]'s Articles
[Wang, Yang]'s Articles
[Fan, Xiaopeng]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wu, Jiashu]'s Articles
[Wang, Yang]'s Articles
[Fan, Xiaopeng]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.