UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme
Yang, Ning1,2; Pun, Sio Hang2; Vai, Mang I.1,2,3; Yang, Yifan4; Miao, Qingliang4
2022-07-01
Source PublicationApplied Sciences (Switzerland)
Volume12Issue:13Pages:6543
Abstract

In the actual knowledge extraction system, different applications have different entity classes and relationship schema, so the generalization and migration ability of knowledge extraction are very important. By training a knowledge extraction model in the source domain and applying the model to an arbitrary target domain directly, open domain knowledge extraction technology becomes crucial to mitigate the generalization and migration ability issues. Traditional knowledge extraction models cannot be directly transferred to new domains and also cannot extract undefined relation types. In order to deal with the above issues, in this paper, we proposed an end-to-end Chinese open-domain knowledge extraction model, TPORE (Extract Open-domain Relations through Token Pair linking), which combined BERT with a handshaking tagging scheme. TPORE can alleviate the nested entities and nested relations issues. Additionally, a new loss function that conducts a pairwise comparison of target category score and non-target category score to automatically balance the weight was adopted, and the experiment results indicate that the loss function can bring speed and performance improvements. The extensive experiments demonstrate that the proposed method can significantly surpass strong baselines. Specifically, our approach can achieve new state-of-the-art Chinese open Relation Extraction (ORE) benchmarks (COER and SAOKE). In the COER dataset, F1 increased from 66.36% to 79.63%, and in the SpanSAOKE dataset, F1 increased from 46.0% to 54.91%. In the medical domain, our method can obtain close performance compared with the SOTA method in the CMeIE and CMeEE datasets.

KeywordBert Fixed-domain Relation Extraction Handshaking Tagging Scheme Knowledge Graph Named Entity Recognition Open-domain Relation Extraction
DOI10.3390/app12136543
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaChemistry ; Engineering ; Materials Science ; Physics
WOS SubjectChemistry, Multidisciplinary ; Engineering, Multidisciplinary ; Materials Science, Multidisciplinary ; Physics, Applied
WOS IDWOS:000825591100001
PublisherMDPIST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND
Scopus ID2-s2.0-85133520641
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF ANALOG AND MIXED-SIGNAL VLSI (UNIVERSITY OF MACAU)
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Corresponding AuthorPun, Sio Hang
Affiliation1.Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, 999078, China
2.State Key Laboratory of Analog and Mixed-Signal VLSI, University of Maca, Macau, 999078, China
3.Key Laboratory of Medical Instrumentation and Pharmaceutical Technology of Fujian Province, Fuzhou, 350116, China
4.AI Speech Co., Ltd., Tengfei Science and Technology Park, Suzhou, Building 14, No. 388, Xinping Street, Suzhou Industrial Park, 215000, China
First Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Yang, Ning,Pun, Sio Hang,Vai, Mang I.,et al. A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme[J]. Applied Sciences (Switzerland), 2022, 12(13), 6543.
APA Yang, Ning., Pun, Sio Hang., Vai, Mang I.., Yang, Yifan., & Miao, Qingliang (2022). A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme. Applied Sciences (Switzerland), 12(13), 6543.
MLA Yang, Ning,et al."A Unified Knowledge Extraction Method Based on BERT and Handshaking Tagging Scheme".Applied Sciences (Switzerland) 12.13(2022):6543.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang, Ning]'s Articles
[Pun, Sio Hang]'s Articles
[Vai, Mang I.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang, Ning]'s Articles
[Pun, Sio Hang]'s Articles
[Vai, Mang I.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang, Ning]'s Articles
[Pun, Sio Hang]'s Articles
[Vai, Mang I.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.