Residential College | false |
Status | 已發表Published |
LiteWSC: A Lightweight Framework for Web-Scale Spectral Clustering | |
Geping Yang1; Sucheng Deng2; Yiyang Yang1; Zhiguo Gong2![]() | |
2022-04-11 | |
Conference Name | DASFAA2022 |
Source Publication | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
![]() |
Volume | 13246 LNCS |
Pages | 556-573 |
Conference Date | 2022-04-11 |
Conference Place | Hyderabad, India |
Abstract | Spectral clustering is an effective clustering method for its excellent performance in partitioning non-linearly distributed data. Nevertheless, it suffers from scalability due to its high computational complexity in constructing the Laplacian graph and computing the corresponding eigendecomposition. In the past decades, many efforts have been made to face this problem. However, the computational bottleneck is still a problem in processing extensive data, especially in web-scale scenarios. We present LiteWSC, a simple yet efficient lightweight spectral clustering framework, to cluster web-scale data with limited resource requirements. Our framework has minimal space overhead and does not require explicit overall embeddings computation. We also analyze the theoretical guarantee and performance boundary of LiteWSC. LiteWSC is highly flexible with O(sp) memory requirement, where s and p are the number of samples and the number of prototypes, which are adaptive to the available resource. Therefore, LiteWSC can partition web-scale data (e.g., n= 8, 000 k ) in an resource-limited host (e.g., memory is restricted to 1 GB). Experiments on real-world, large-scale and web-scale datasets demonstrate both the efficiency and effectiveness of LiteWSC over state-of-the-art methods. |
Keyword | Spectral Clustering Data Quantization Machine Learning Scalability |
DOI | 10.1007/978-3-031-00126-0_40 |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods |
WOS ID | WOS:000873169200040 |
Scopus ID | 2-s2.0-85129848898 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Affiliation | 1.Faculty of Computer, Guangdong University of Technology, Guangzhou, China 2.State Key Laboratory of Internet of Things for Smart City and Department of Computer and Information Science, University of Macau, Macao 3.School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou, China 4.College of Engineering, Shantou University, Shantou, China |
Recommended Citation GB/T 7714 | Geping Yang,Sucheng Deng,Yiyang Yang,et al. LiteWSC: A Lightweight Framework for Web-Scale Spectral Clustering[C], 2022, 556-573. |
APA | Geping Yang., Sucheng Deng., Yiyang Yang., Zhiguo Gong., Xiang Chen., & Zhifeng Hao (2022). LiteWSC: A Lightweight Framework for Web-Scale Spectral Clustering. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13246 LNCS, 556-573. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment