Residential College | false |
Status | 已發表Published |
A Dual-Channel Semi-Supervised Learning Framework on Graphs via Knowledge Transfer and Meta-Learning | |
Ziyue Qiao1; Pengyang Wang2![]() ![]() ![]() | |
2023-01 | |
Source Publication | ACM TRANSACTIONS ON THE WEB
![]() |
ISSN | 1559-1131 |
Volume | 18Issue:2Pages:18 |
Abstract | This article studies the problem of semi-supervised learning on graphs, which aims to incorporate ubiquitous unlabeled knowledge (e.g., graph topology, node attributes) with few-available labeled knowledge (e.g., node class) to alleviate the scarcity issue of supervised information on node classification. While promising results are achieved, existing works for this problem usually suffer from the poor balance of generalization and fitting ability due to the heavy reliance on labels or task-agnostic unsupervised information. To address the challenge, we propose a dual-channel framework for semi-supervised learning on Graphs via Knowledge Transfer between independent supervised and unsupervised embedding spaces, namely, GKT. Specifically, we devise a dual-channel framework including a supervised model for learning the label probability of nodes and an unsupervised model for extracting information from massive unlabeled graph data. A knowledge transfer head is proposed to bridge the gap between the generalization and fitting capability of the two models. We use the unsupervised information to reconstruct batch-graphs to smooth the label probability distribution on the graphs to improve the generalization of prediction. We also adaptively adjust the reconstructed graphs by encouraging the label-related connections to solidify the fitting ability. Since the optimization of the supervised channel with knowledge transfer contains that of the unsupervised channel as a constraint and vice versa, we then propose a meta-learning-based method to solve the bi-level optimization problem, which avoids the negative transfer and further improves the model’s performance. Finally, extensive experiments validate the effectiveness of our proposed framework by comparing state-of-the-art algorithms. |
DOI | 10.1145/3577033 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Information Systems ; Computer Science, Software Engineering |
WOS ID | WOS:001208777200003 |
Publisher | ASSOC COMPUTING MACHINERY, 1601 Broadway, 10th Floor, NEW YORK, NY 10019-7434 |
Scopus ID | 2-s2.0-85190277287 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) |
Corresponding Author | Yuanchun Zhou; Hui Xiong |
Affiliation | 1.Hong Kong University of Science and Technology (Guangzhou) 2.SKL-IOTSC, University of Macau 3.Computer Network Information Center, CAS 4.Department of Computer Science, University of Central Florida 5.Damo Academy, Alibaba Group |
Recommended Citation GB/T 7714 | Ziyue Qiao,Pengyang Wang,Pengfei Wang,et al. A Dual-Channel Semi-Supervised Learning Framework on Graphs via Knowledge Transfer and Meta-Learning[J]. ACM TRANSACTIONS ON THE WEB, 2023, 18(2), 18. |
APA | Ziyue Qiao., Pengyang Wang., Pengfei Wang., Zhiyuan Ning., Yanjie Fu., Yi Du., Yuanchun Zhou., Jianqiang Huang., Xian-Sheng Hua., & Hui Xiong (2023). A Dual-Channel Semi-Supervised Learning Framework on Graphs via Knowledge Transfer and Meta-Learning. ACM TRANSACTIONS ON THE WEB, 18(2), 18. |
MLA | Ziyue Qiao,et al."A Dual-Channel Semi-Supervised Learning Framework on Graphs via Knowledge Transfer and Meta-Learning".ACM TRANSACTIONS ON THE WEB 18.2(2023):18. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment