Residential Collegefalse
Status已發表Published
CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment
Zhang, Yulan1,2; Zhu, Guopu1,2; Wang, Xing3; Luo, Xiangyang4,5; Zhou, Yicong6; Zhang, Hongli3; Wu, Ligang7
2022-11-07
Source PublicationIEEE Transactions on Circuits and Systems for Video Technology
ISSN1051-8215
Volume33Issue:5Pages:2019-2032
Abstract

Copy-move forgery can be used for hiding certain objects or duplicating meaningful objects in images. Although copy-move forgery detection has been studied extensively in recent years, it is still a challenging task to distinguish between the source and the target regions in copy-move forgery images. In this paper, a convolutional neural network-transformer based generative adversarial network (CNN-T GAN) is proposed to distinguish the source and target regions in a copy-move forged image. A generator is first utilized to generate a mask that is similar to the groundtruth mask. Then, a discriminator is trained to discriminate the true image pairs from the false ones. When the discriminator cannot discriminate the true/false image pairs accurately, the generator can be used to obtain the final localization maps of copy-move forgery. In the generator, convolutional neural network (CNN) and transformer are exploited to extract the local features and global representations in copy-move forgery images, respectively. In addition, feature coupling layers are designed to integrate the features in CNN branch and transformer branch in an interactive way. Finally, a new Pearson correlation layer is introduced to match the similarity features in source and target regions, which can improve the performance of copy-move forgery localization, especially the localization performance on source regions. To the best of our knowledge, this is the first work to utilize transformer for feature extraction in copy-move forgery localization. The proposed method can not only detect the copy-move regions, but also distinguish the source and target regions. Extensive experimental results on several commonly used copy-move datasets have shown that the proposed method outperforms the state-of-the-art methods for copy-move detection.

KeywordImage Forensics Copy-move Source/target Distinguishment Convolutional Neural Networks Transformer
DOI10.1109/TCSVT.2022.3220630
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:000982426900002
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85141613961
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorZhu, Guopu
Affiliation1.School of Computer Science and Engineering, Huizhou University, Huizhou, China
2.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
3.School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China
4.State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou, China
5.Key Laboratory of Cyberspace Situation Awareness of Henan Province, Zhengzhou, 450001, China
6.University of Macau, Department of Computer and Information Science, Macau, 999078, Macao
7.Harbin Institute of Technology, Department of Control Science and Engineering, Harbin, 150001, China
Recommended Citation
GB/T 7714
Zhang, Yulan,Zhu, Guopu,Wang, Xing,et al. CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 33(5), 2019-2032.
APA Zhang, Yulan., Zhu, Guopu., Wang, Xing., Luo, Xiangyang., Zhou, Yicong., Zhang, Hongli., & Wu, Ligang (2022). CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment. IEEE Transactions on Circuits and Systems for Video Technology, 33(5), 2019-2032.
MLA Zhang, Yulan,et al."CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/Target Distinguishment".IEEE Transactions on Circuits and Systems for Video Technology 33.5(2022):2019-2032.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhang, Yulan]'s Articles
[Zhu, Guopu]'s Articles
[Wang, Xing]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhang, Yulan]'s Articles
[Zhu, Guopu]'s Articles
[Wang, Xing]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhang, Yulan]'s Articles
[Zhu, Guopu]'s Articles
[Wang, Xing]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.