Residential College | false |
Status | 已發表Published |
Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection | |
Wang, Xingrun1; Tian, Jinyu1; Li, Jianqing1; Wang, Binze2; Tang, Yuanyan3 | |
2024-08 | |
Source Publication | IEEE Transactions on Consumer Electronics |
ISSN | 0098-3063 |
Volume | 70Issue:3Pages:6000-6010 |
Abstract | Carefully annotated and processed high-quality datasets are crucial for the training of deep learning models. The commercialization of dataset sales has led to instances of unauthorized dataset disclosure for illicit gains, especially in the medical field, where dataset annotation requires specialized knowledge. Consequently, the verification of dataset copyrights is receiving attention to protect the interests of owners. The multi-modal fusion of text and image is a technology worth studying, in which exclusive information is hidden in the image to achieve the purpose of copyright protection. In the medical field, the fused image needs to meet the requirements of low distortion and text information extraction after being attacked. Slight fusion strength has little damage to the image, but the ability to resist attack is poor and has difficulty in extracting text information from the image. Therefore, an appropriate embedding strength is crucial for multi-modal fusion of text and image to balance imperceptibility and robustness. In this paper, we present an optimization-based approach for obtaining optimal embedding strength. The embedding strength based on the watermark interval is constructed as a differentiable problem, and the loss function is designed to achieve high imperceptibility and strong robustness. In addition, in order to decrease image distortion, an innovative coefficient adjustment scheme based on adjacent blocks is proposed, which distributes the embedding strength into two image blocks. Numerous experimental results indicate the proposed approach offers good imperceptibility and strong robustness when fusing larger text capacities. |
Keyword | Derivable Function Fusion Strength Multi-modal Fusion Multiple Watermarks Optimization Method |
DOI | 10.1109/TCE.2024.3398660 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering ; Telecommunications |
WOS Subject | Engineering, Electrical & Electronic ; Telecommunications |
WOS ID | WOS:001377297400027 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85193232272 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Tian, Jinyu |
Affiliation | 1.Macau University of Science and Technology, School of Computer Science and Engineering, Macao 2.The Institute of Photogrammetry and Remote Sensing, Chinese Academy of Surveying and Mapping, Beijing, 100036, China 3.University of Macau, Zhuhai UM Science and Technology Research Institute, Zhuhai, 519072, China |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Wang, Xingrun,Tian, Jinyu,Li, Jianqing,et al. Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection[J]. IEEE Transactions on Consumer Electronics, 2024, 70(3), 6000-6010. |
APA | Wang, Xingrun., Tian, Jinyu., Li, Jianqing., Wang, Binze., & Tang, Yuanyan (2024). Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection. IEEE Transactions on Consumer Electronics, 70(3), 6000-6010. |
MLA | Wang, Xingrun,et al."Multimodal Fusion with Optimized Embedding Strength for Consumptive Medical Image Protection".IEEE Transactions on Consumer Electronics 70.3(2024):6000-6010. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment