UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection
Wang, Xingrun1; Tian, Jinyu1; Li, Jianqing1; Wang, Binze2; Tang, Yuanyan3
2024-08
Source PublicationIEEE Transactions on Consumer Electronics
ISSN0098-3063
Volume70Issue:3Pages:6000-6010
Abstract

Carefully annotated and processed high-quality datasets are crucial for the training of deep learning models. The commercialization of dataset sales has led to instances of unauthorized dataset disclosure for illicit gains, especially in the medical field, where dataset annotation requires specialized knowledge. Consequently, the verification of dataset copyrights is receiving attention to protect the interests of owners. The multi-modal fusion of text and image is a technology worth studying, in which exclusive information is hidden in the image to achieve the purpose of copyright protection. In the medical field, the fused image needs to meet the requirements of low distortion and text information extraction after being attacked. Slight fusion strength has little damage to the image, but the ability to resist attack is poor and has difficulty in extracting text information from the image. Therefore, an appropriate embedding strength is crucial for multi-modal fusion of text and image to balance imperceptibility and robustness. In this paper, we present an optimization-based approach for obtaining optimal embedding strength. The embedding strength based on the watermark interval is constructed as a differentiable problem, and the loss function is designed to achieve high imperceptibility and strong robustness. In addition, in order to decrease image distortion, an innovative coefficient adjustment scheme based on adjacent blocks is proposed, which distributes the embedding strength into two image blocks. Numerous experimental results indicate the proposed approach offers good imperceptibility and strong robustness when fusing larger text capacities.

KeywordDerivable Function Fusion Strength Multi-modal Fusion Multiple Watermarks Optimization Method
DOI10.1109/TCE.2024.3398660
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering ; Telecommunications
WOS SubjectEngineering, Electrical & Electronic ; Telecommunications
WOS IDWOS:001377297400027
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85193232272
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorTian, Jinyu
Affiliation1.Macau University of Science and Technology, School of Computer Science and Engineering, Macao
2.The Institute of Photogrammetry and Remote Sensing, Chinese Academy of Surveying and Mapping, Beijing, 100036, China
3.University of Macau, Zhuhai UM Science and Technology Research Institute, Zhuhai, 519072, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Wang, Xingrun,Tian, Jinyu,Li, Jianqing,et al. Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection[J]. IEEE Transactions on Consumer Electronics, 2024, 70(3), 6000-6010.
APA Wang, Xingrun., Tian, Jinyu., Li, Jianqing., Wang, Binze., & Tang, Yuanyan (2024). Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection. IEEE Transactions on Consumer Electronics, 70(3), 6000-6010.
MLA Wang, Xingrun,et al."Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection".IEEE Transactions on Consumer Electronics 70.3(2024):6000-6010.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Xingrun]'s Articles
[Tian, Jinyu]'s Articles
[Li, Jianqing]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Xingrun]'s Articles
[Tian, Jinyu]'s Articles
[Li, Jianqing]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Xingrun]'s Articles
[Tian, Jinyu]'s Articles
[Li, Jianqing]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.