Residential College | false |
Status | 已發表Published |
An Edge-Aware Transformer Framework for Image Inpainting Detection | |
Hu, Liangpei1; Li, Yuanman1,2; You, Jiaxiang1; Liang, Rongqin1; Li, Xia1 | |
2022 | |
Conference Name | 8th International Conference on Artificial Intelligence and Security (ICAIS) |
Source Publication | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Volume | 13339 LNCS |
Pages | 648-660 |
Conference Date | JUL 15-20, 2022 |
Conference Place | Qinghai |
Country | CHINA |
Abstract | Image inpainting methods based on Generative Adversarial Networks are very powerful in producing visually realistic images. It is widely used in image processing and computer vision, such as recovering damaged photos. However, image inpainting may also be maliciously used to change or delete contents, e.g. removing key objects to report fake news. Such inpainting forged images can bring serious adverse effects to society. Most existing inpainting forgery detection approaches using convolutional neural networks (CNN) have limited receptive fields and do not fully exploit the edge information of the forged regions, making them fail to effectively model the global information of forged regions and well preserve their edges. To fight against inpainting forgeries (not only deep learning (DL) based but also traditional ones), in this work, we propose an edge-aware transformer framework for image inpainting detection. To better perform feature extraction and learn discriminative features, we propose a two-stream Transformer to learn the global body features and fake edge features respectively. Further, a multi-modality cross attention module is employed to propagate their information interactively, thus greatly improving the detection results. Extensive experiments demonstrate the superiority of our scheme over existing ones, and our method exhibits desirable detection generalizability for both DL-based inpainting and traditional inpainting. |
Keyword | Cross Attention Inpainting Forensics Transformer |
DOI | 10.1007/978-3-031-06788-4_53 |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Information Systems ; Computer Science, Interdisciplinary Applications ; Computer Science, Theory & Methods |
WOS ID | WOS:000886410700053 |
Scopus ID | 2-s2.0-85135046648 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Li, Yuanman |
Affiliation | 1.Guangdong Key Laboratory of Intelligent Information Processing College of Electronics and Information Engineering, Shenzhen University, Shenzhen, China 2.Department of Computer and Information Science, University of Macau, Zhuhai, Macao |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Hu, Liangpei,Li, Yuanman,You, Jiaxiang,et al. An Edge-Aware Transformer Framework for Image Inpainting Detection[C], 2022, 648-660. |
APA | Hu, Liangpei., Li, Yuanman., You, Jiaxiang., Liang, Rongqin., & Li, Xia (2022). An Edge-Aware Transformer Framework for Image Inpainting Detection. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13339 LNCS, 648-660. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment