Residential College | false |
Status | 已發表Published |
A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme | |
Yang, Ning1,2; Pun, Sio Hang2; Vai, Mang I.1,2,3; Yang, Yifan4; Miao, Qingliang4 | |
2022-07-01 | |
Source Publication | Applied Sciences (Switzerland) |
Volume | 12Issue:13Pages:6543 |
Abstract | In the actual knowledge extraction system, different applications have different entity classes and relationship schema, so the generalization and migration ability of knowledge extraction are very important. By training a knowledge extraction model in the source domain and applying the model to an arbitrary target domain directly, open domain knowledge extraction technology becomes crucial to mitigate the generalization and migration ability issues. Traditional knowledge extraction models cannot be directly transferred to new domains and also cannot extract undefined relation types. In order to deal with the above issues, in this paper, we proposed an end-to-end Chinese open-domain knowledge extraction model, TPORE (Extract Open-domain Relations through Token Pair linking), which combined BERT with a handshaking tagging scheme. TPORE can alleviate the nested entities and nested relations issues. Additionally, a new loss function that conducts a pairwise comparison of target category score and non-target category score to automatically balance the weight was adopted, and the experiment results indicate that the loss function can bring speed and performance improvements. The extensive experiments demonstrate that the proposed method can significantly surpass strong baselines. Specifically, our approach can achieve new state-of-the-art Chinese open Relation Extraction (ORE) benchmarks (COER and SAOKE). In the COER dataset, F1 increased from 66.36% to 79.63%, and in the SpanSAOKE dataset, F1 increased from 46.0% to 54.91%. In the medical domain, our method can obtain close performance compared with the SOTA method in the CMeIE and CMeEE datasets. |
Keyword | Bert Fixed-domain Relation Extraction Handshaking Tagging Scheme Knowledge Graph Named Entity Recognition Open-domain Relation Extraction |
DOI | 10.3390/app12136543 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Chemistry ; Engineering ; Materials Science ; Physics |
WOS Subject | Chemistry, Multidisciplinary ; Engineering, Multidisciplinary ; Materials Science, Multidisciplinary ; Physics, Applied |
WOS ID | WOS:000825591100001 |
Publisher | MDPIST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND |
Scopus ID | 2-s2.0-85133520641 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF ANALOG AND MIXED-SIGNAL VLSI (UNIVERSITY OF MACAU) DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING |
Corresponding Author | Pun, Sio Hang |
Affiliation | 1.Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, 999078, China 2.State Key Laboratory of Analog and Mixed-Signal VLSI, University of Maca, Macau, 999078, China 3.Key Laboratory of Medical Instrumentation and Pharmaceutical Technology of Fujian Province, Fuzhou, 350116, China 4.AI Speech Co., Ltd., Tengfei Science and Technology Park, Suzhou, Building 14, No. 388, Xinping Street, Suzhou Industrial Park, 215000, China |
First Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Yang, Ning,Pun, Sio Hang,Vai, Mang I.,et al. A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme[J]. Applied Sciences (Switzerland), 2022, 12(13), 6543. |
APA | Yang, Ning., Pun, Sio Hang., Vai, Mang I.., Yang, Yifan., & Miao, Qingliang (2022). A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme. Applied Sciences (Switzerland), 12(13), 6543. |
MLA | Yang, Ning,et al."A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme".Applied Sciences (Switzerland) 12.13(2022):6543. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment