UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Toward fast theta‐join: A prefiltering and amalgamated partitioning approach
Jiashu Wu1,2; Yang Wang1; Xiaopeng Fan1; Kejiang Ye1; Chengzhong Xu3
2022-04-11
Source PublicationConcurrency and Computation: Practice and Experience
ISSN1532-0626
Volume34Issue:17Pages:e6996
Abstract

As one of the most useful online processing techniques, the theta-join operation has been utilized by many applications to fully excavate the relationships between data streams in various scenarios. As such, constant research efforts have been put to optimize its performance in the distributed environment, which is typically characterized by reducing the number of Cartesian products as much as possible. In this article, we design and implement a novel fast theta-join algorithm, called Prefap, by developing two distinct techniques—prefiltering and amalgamated partitioning—based on the state-of-the-art FastThetaJoin algorithm to optimize the efficiency of the theta-join operation. Firstly, we develop a prefiltering strategy before data streams are partitioned to reduce the amount of data to be involved and benefit a more fine-grained partitioning. Secondly, to avoid the data streams being partitioned in a coarse-grained isolated manner and improve the quality of the partition-level filtering, we introduce an amalgamated partitioning mechanism that can amalgamate the partitioning boundaries of two data streams to assist a fine-grained partitioning. With the integration of these two techniques into the existing FastThetaJoin algorithm, we design and implement a new framework to achieve a decreased number of Cartesian products and a higher theta-join efficiency. By comparing with existing algorithms, FastThetaJoin in particular, we evaluate the performance of Prefap on both synthetic and real data streams from two-way to multiway theta-join to demonstrate its superiority.

KeywordAmalgamated Data Stream Partitioning Cartesian Product Reduction Online Data Stream Prefiltering Theta-join (Θ-join)
DOI10.1002/cpe.6996
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering ; Computer Science, Theory & Methods
WOS IDWOS:000779988000001
PublisherWILEY, 111 RIVER ST, HOBOKEN 07030-5774, NJ
Scopus ID2-s2.0-85127802148
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorXiaopeng Fan
Affiliation1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
2.University of Chinese Academy of Sciences, Beijing, China
3.University of Macau
Recommended Citation
GB/T 7714
Jiashu Wu,Yang Wang,Xiaopeng Fan,et al. Toward fast theta‐join: A prefiltering and amalgamated partitioning approach[J]. Concurrency and Computation: Practice and Experience, 2022, 34(17), e6996.
APA Jiashu Wu., Yang Wang., Xiaopeng Fan., Kejiang Ye., & Chengzhong Xu (2022). Toward fast theta‐join: A prefiltering and amalgamated partitioning approach. Concurrency and Computation: Practice and Experience, 34(17), e6996.
MLA Jiashu Wu,et al."Toward fast theta‐join: A prefiltering and amalgamated partitioning approach".Concurrency and Computation: Practice and Experience 34.17(2022):e6996.
Files in This Item: Download All
File Name/Size Publications Version Access License
2022_Toward fast the(2200KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jiashu Wu]'s Articles
[Yang Wang]'s Articles
[Xiaopeng Fan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jiashu Wu]'s Articles
[Yang Wang]'s Articles
[Xiaopeng Fan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jiashu Wu]'s Articles
[Yang Wang]'s Articles
[Xiaopeng Fan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 2022_Toward fast theta.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.