Residential College | false |
Status | 已發表Published |
CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment | |
Zhang, Yulan1,2; Zhu, Guopu1,2; Wang, Xing3; Luo, Xiangyang4,5; Zhou, Yicong6; Zhang, Hongli3; Wu, Ligang7 | |
2022-11-07 | |
Source Publication | IEEE Transactions on Circuits and Systems for Video Technology |
ISSN | 1051-8215 |
Volume | 33Issue:5Pages:2019-2032 |
Abstract | Copy-move forgery can be used for hiding certain objects or duplicating meaningful objects in images. Although copy-move forgery detection has been studied extensively in recent years, it is still a challenging task to distinguish between the source and the target regions in copy-move forgery images. In this paper, a convolutional neural network-transformer based generative adversarial network (CNN-T GAN) is proposed to distinguish the source and target regions in a copy-move forged image. A generator is first utilized to generate a mask that is similar to the groundtruth mask. Then, a discriminator is trained to discriminate the true image pairs from the false ones. When the discriminator cannot discriminate the true/false image pairs accurately, the generator can be used to obtain the final localization maps of copy-move forgery. In the generator, convolutional neural network (CNN) and transformer are exploited to extract the local features and global representations in copy-move forgery images, respectively. In addition, feature coupling layers are designed to integrate the features in CNN branch and transformer branch in an interactive way. Finally, a new Pearson correlation layer is introduced to match the similarity features in source and target regions, which can improve the performance of copy-move forgery localization, especially the localization performance on source regions. To the best of our knowledge, this is the first work to utilize transformer for feature extraction in copy-move forgery localization. The proposed method can not only detect the copy-move regions, but also distinguish the source and target regions. Extensive experimental results on several commonly used copy-move datasets have shown that the proposed method outperforms the state-of-the-art methods for copy-move detection. |
Keyword | Image Forensics Copy-move Source/target Distinguishment Convolutional Neural Networks Transformer |
DOI | 10.1109/TCSVT.2022.3220630 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering |
WOS Subject | Engineering, Electrical & Electronic |
WOS ID | WOS:000982426900002 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85141613961 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Zhu, Guopu |
Affiliation | 1.School of Computer Science and Engineering, Huizhou University, Huizhou, China 2.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China 3.School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China 4.State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou, China 5.Key Laboratory of Cyberspace Situation Awareness of Henan Province, Zhengzhou, 450001, China 6.University of Macau, Department of Computer and Information Science, Macau, 999078, Macao 7.Harbin Institute of Technology, Department of Control Science and Engineering, Harbin, 150001, China |
Recommended Citation GB/T 7714 | Zhang, Yulan,Zhu, Guopu,Wang, Xing,et al. CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 33(5), 2019-2032. |
APA | Zhang, Yulan., Zhu, Guopu., Wang, Xing., Luo, Xiangyang., Zhou, Yicong., Zhang, Hongli., & Wu, Ligang (2022). CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment. IEEE Transactions on Circuits and Systems for Video Technology, 33(5), 2019-2032. |
MLA | Zhang, Yulan,et al."CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment".IEEE Transactions on Circuits and Systems for Video Technology 33.5(2022):2019-2032. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment