Residential Collegefalse
Status已發表Published
LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering
Yang,Geping1; Deng,Sucheng2; Chen,Can3; Yang,Yiyang1; Gong,Zhiguo2; Chen,Xiang4; Hao,Zhifeng5
2023-04-14
Source PublicationIEEE Transactions on Knowledge and Data Engineering
ISSN1041-4347
Volume35Issue:10Pages:10035 – 10047
Abstract

Spectral Clustering (SC) is an effective clustering method for its excellent performance in partitioning non-linearly distributed data. On the other hand, Ensemble Clustering (EC), a different clustering technology, can promote cluster quality by ensembling the results of base clusterings. In this work, we concentrate on an EC framework that utilizes SC as the base method. Nevertheless, SC suffers from scalability due to its high computational complexity in constructing the Laplacian graph and computing the corresponding eigendecomposition. In the past decades, many efforts have been made to it. However, SC suffers from the scalability issue in processing extensive data, especially in web-scale scenarios. Additionally, EC requires multiple clustering results as the ensemble bases, which further aggravates resource consumption. To address this issue, LiteWSEC, a simple yet efficient Lightweight Framework for Web-scale Spectral Ensemble Clustering, is proposed to cluster web-scale data with limited resource requirements. It adopts the Web-scale Spectral Clustering (WSC) as the base method, which has minimal space overhead without computing overall embedding explicitly. LiteWSEC is highly flexible in the memory requirement, which is adaptive to the available resource. It can partition web-scale data (e.g., $n = 8,000~k$) in an resource-limited host (e.g., memory is restricted to 1 GB). Experiments on real-world, large-scale, and web-scale datasets demonstrate both the efficiency and effectiveness of LiteWSEC over state-of-the-art SC and EC methods.

KeywordSpectral Clustering Data Quantization Scalability Ensemble Clustering
DOI10.1109/TKDE.2023.3267167
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Information Systems ; Engineering, Electrical & Electronic
WOS IDWOS:001068964300019
PublisherIEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314
Scopus ID2-s2.0-85153526443
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionTHE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF ACCOUNTING AND INFORMATION MANAGEMENT
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorYang,Yiyang; Gong,Zhiguo
Affiliation1.Faculty of Computer, Guangdong University of Technology, China
2.State Key Laboratory of Internet of Things for Smart City and Department of Computer and Information Science, University of Macau, Taipa, Macau 999078, China
3.Department of Accounting and Information Management, University of Macau, Macau, China
4.School of Electronics and Information Technology, Sun Yat-Sen University, China
5.College of Engineering, Shantou University, China
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Yang,Geping,Deng,Sucheng,Chen,Can,et al. LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering[J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(10), 10035 – 10047.
APA Yang,Geping., Deng,Sucheng., Chen,Can., Yang,Yiyang., Gong,Zhiguo., Chen,Xiang., & Hao,Zhifeng (2023). LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering. IEEE Transactions on Knowledge and Data Engineering, 35(10), 10035 – 10047.
MLA Yang,Geping,et al."LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering".IEEE Transactions on Knowledge and Data Engineering 35.10(2023):10035 – 10047.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang,Geping]'s Articles
[Deng,Sucheng]'s Articles
[Chen,Can]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang,Geping]'s Articles
[Deng,Sucheng]'s Articles
[Chen,Can]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang,Geping]'s Articles
[Deng,Sucheng]'s Articles
[Chen,Can]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.