Residential College | false |
Status | 已發表Published |
LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering | |
Yang,Geping1; Deng,Sucheng2; Chen,Can3; Yang,Yiyang1; Gong,Zhiguo2; Chen,Xiang4; Hao,Zhifeng5 | |
2023-04-14 | |
Source Publication | IEEE Transactions on Knowledge and Data Engineering |
ISSN | 1041-4347 |
Volume | 35Issue:10Pages:10035 – 10047 |
Abstract | Spectral Clustering (SC) is an effective clustering method for its excellent performance in partitioning non-linearly distributed data. On the other hand, Ensemble Clustering (EC), a different clustering technology, can promote cluster quality by ensembling the results of base clusterings. In this work, we concentrate on an EC framework that utilizes SC as the base method. Nevertheless, SC suffers from scalability due to its high computational complexity in constructing the Laplacian graph and computing the corresponding eigendecomposition. In the past decades, many efforts have been made to it. However, SC suffers from the scalability issue in processing extensive data, especially in web-scale scenarios. Additionally, EC requires multiple clustering results as the ensemble bases, which further aggravates resource consumption. To address this issue, LiteWSEC, a simple yet efficient Lightweight Framework for Web-scale Spectral Ensemble Clustering, is proposed to cluster web-scale data with limited resource requirements. It adopts the Web-scale Spectral Clustering (WSC) as the base method, which has minimal space overhead without computing overall embedding explicitly. LiteWSEC is highly flexible in the memory requirement, which is adaptive to the available resource. It can partition web-scale data (e.g., $n = 8,000~k$) in an resource-limited host (e.g., memory is restricted to 1 GB). Experiments on real-world, large-scale, and web-scale datasets demonstrate both the efficiency and effectiveness of LiteWSEC over state-of-the-art SC and EC methods. |
Keyword | Spectral Clustering Data Quantization Scalability Ensemble Clustering |
DOI | 10.1109/TKDE.2023.3267167 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Information Systems ; Engineering, Electrical & Electronic |
WOS ID | WOS:001068964300019 |
Publisher | IEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314 |
Scopus ID | 2-s2.0-85153526443 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF ACCOUNTING AND INFORMATION MANAGEMENT DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Yang,Yiyang; Gong,Zhiguo |
Affiliation | 1.Faculty of Computer, Guangdong University of Technology, China 2.State Key Laboratory of Internet of Things for Smart City and Department of Computer and Information Science, University of Macau, Taipa, Macau 999078, China 3.Department of Accounting and Information Management, University of Macau, Macau, China 4.School of Electronics and Information Technology, Sun Yat-Sen University, China 5.College of Engineering, Shantou University, China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Yang,Geping,Deng,Sucheng,Chen,Can,et al. LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering[J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(10), 10035 – 10047. |
APA | Yang,Geping., Deng,Sucheng., Chen,Can., Yang,Yiyang., Gong,Zhiguo., Chen,Xiang., & Hao,Zhifeng (2023). LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering. IEEE Transactions on Knowledge and Data Engineering, 35(10), 10035 – 10047. |
MLA | Yang,Geping,et al."LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering".IEEE Transactions on Knowledge and Data Engineering 35.10(2023):10035 – 10047. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment