UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A review on multimodal machine learning in medical diagnostics
Keyue Yan1; Tengyue Li1; João Alexandre Lobo Marques2; Juntao Gao3; Simon James Fong1,4
Source PublicationMathematical Biosciences and Engineering
ISSN1547-1063
2023-03-06
Abstract

Nowadays, the increasing number of medical diagnostic data and clinical data provide more complementary references for doctors to make diagnosis to patients. For example, with medical data, such as electrocardiography (ECG), machine learning algorithms can be used to identify and diagnose heart disease to reduce the workload of doctors. However, ECG data is always exposed to various kinds of noise and interference in reality, and medical diagnostics only based on one-dimensional ECG data is not trustable enough. By extracting new features from other types of medical data, we can implement enhanced recognition methods, called multimodal learning. Multimodal learning helps models to process data from a range of different sources, eliminate the requirement for training each single learning modality, and improve the robustness of models with the diversity of data. Growing number of articles in recent years have been devoted to investigating how to extract data from different sources and build accurate multimodal machine learning models, or deep learning models for medical diagnostics. This paper reviews and summarizes several recent papers that dealing with multimodal machine learning in disease detection, and identify topics for future research.

KeywordDeep Learning Machine Learning Medical Data Multimodal Learning
Language英語English
DOI10.3934/mbe.2023382
URLView the original
Volume20
Issue5
Pages8708-8726
WOS IDWOS:000953160200008
WOS SubjectMathematical & Computational Biology
WOS Research AreaMathematical & Computational Biology
Indexed BySCIE
Scopus ID2-s2.0-85150349670
Fulltext Access
Citation statistics
Document TypeReview article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorKeyue Yan; Simon James Fong
Affiliation1.Department of Computer and Information Science,University of Macau,Macao
2.Laboratory of Applied Neurosciences,University of Saint Joseph,Macao
3.Beijing National Research Center for Information Science and Technology,Tsinghua University,Beijing,100084,China
4.Institute of Artificial Intelligence,Chongqing Technology and Business University,Chongqing,China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Keyue Yan,Tengyue Li,João Alexandre Lobo Marques,et al. A review on multimodal machine learning in medical diagnostics[J]. Mathematical Biosciences and Engineering, 2023, 20(5), 8708-8726.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Keyue Yan]'s Articles
[Tengyue Li]'s Articles
[]'s Articles
Baidu academic
Similar articles in Baidu academic
[Keyue Yan]'s Articles
[Tengyue Li]'s Articles
[João Alexandre ...]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Keyue Yan]'s Articles
[Tengyue Li]'s Articles
[João Alexandre ...]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.