UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
An Edge-Aware Transformer Framework for Image Inpainting Detection
Hu, Liangpei1; Li, Yuanman1,2; You, Jiaxiang1; Liang, Rongqin1; Li, Xia1
2022
Conference Name8th International Conference on Artificial Intelligence and Security (ICAIS)
Source PublicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13339 LNCS
Pages648-660
Conference DateJUL 15-20, 2022
Conference PlaceQinghai
CountryCHINA
Abstract

Image inpainting methods based on Generative Adversarial Networks are very powerful in producing visually realistic images. It is widely used in image processing and computer vision, such as recovering damaged photos. However, image inpainting may also be maliciously used to change or delete contents, e.g. removing key objects to report fake news. Such inpainting forged images can bring serious adverse effects to society. Most existing inpainting forgery detection approaches using convolutional neural networks (CNN) have limited receptive fields and do not fully exploit the edge information of the forged regions, making them fail to effectively model the global information of forged regions and well preserve their edges. To fight against inpainting forgeries (not only deep learning (DL) based but also traditional ones), in this work, we propose an edge-aware transformer framework for image inpainting detection. To better perform feature extraction and learn discriminative features, we propose a two-stream Transformer to learn the global body features and fake edge features respectively. Further, a multi-modality cross attention module is employed to propagate their information interactively, thus greatly improving the detection results. Extensive experiments demonstrate the superiority of our scheme over existing ones, and our method exhibits desirable detection generalizability for both DL-based inpainting and traditional inpainting.

KeywordCross Attention Inpainting Forensics Transformer
DOI10.1007/978-3-031-06788-4_53
URLView the original
Indexed ByCPCI-S
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Information Systems ; Computer Science, Interdisciplinary Applications ; Computer Science, Theory & Methods
WOS IDWOS:000886410700053
Scopus ID2-s2.0-85135046648
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorLi, Yuanman
Affiliation1.Guangdong Key Laboratory of Intelligent Information Processing College of Electronics and Information Engineering, Shenzhen University, Shenzhen, China
2.Department of Computer and Information Science, University of Macau, Zhuhai, Macao
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Hu, Liangpei,Li, Yuanman,You, Jiaxiang,et al. An Edge-Aware Transformer Framework for Image Inpainting Detection[C], 2022, 648-660.
APA Hu, Liangpei., Li, Yuanman., You, Jiaxiang., Liang, Rongqin., & Li, Xia (2022). An Edge-Aware Transformer Framework for Image Inpainting Detection. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13339 LNCS, 648-660.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Hu, Liangpei]'s Articles
[Li, Yuanman]'s Articles
[You, Jiaxiang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Hu, Liangpei]'s Articles
[Li, Yuanman]'s Articles
[You, Jiaxiang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Hu, Liangpei]'s Articles
[Li, Yuanman]'s Articles
[You, Jiaxiang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.