UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A Transformer based Approach for Image Manipulation Chain Detection
You, Jiaxiang1; Li, Yuanman1; Zhou, Jiantao1; Hua, Zhongyun3; Sun, Weiwei2; Li, Xia1
2021-10-17
Conference Namethe 29th ACM International Conference on Multimedia
Source PublicationMM 2021 - Proceedings of the 29th ACM International Conference on Multimedia
Pages3510-3517
Conference Date20 October 2021through 24 October 2021
Conference PlaceVirtual, Online
CountryChina
Abstract

Image manipulation chain detection aims to identify the existence of involved operations and also their orders, playing an important role in multimedia forensics and image analysis. However,all the existing algorithms model the manipulation chain detection as a classification problem, and can only detect chains containing up to two operations. Due to the exponentially increased solution space and the complex interactions among operations, how to reveal a long chain from a processed image remains a long-standing problem in the multimedia forensic community. To address this challenge, in this paper, we propose a new direction for manipulation chain detection. Different from previous works, we treat the manipulation chain detection as a machine translation problem rather than a classification one, where we model the chains as the sentences of a target language, and each word serves as one possible image operation. Specifically, we first transform the manipulated image into a deep feature space, and further model the traces left by the manipulation chain as a sentence of a latent source language. Then, we propose to detect the manipulation chain through learning the mapping from the source language to the target one under a machine translation framework. Our method can detect manipulation chains consisting of up to five operations, and we obtain promising results on both the short-chain detection and the long-chain detection.

KeywordImage Forensics Machine Translation Manipulation Chain Detection Transformer
DOI10.1145/3474085.3475513
URLView the original
Language英語English
Scopus ID2-s2.0-85119345896
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorLi, Yuanman
Affiliation1.Shenzhen University, Shenzhen, China
2.State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, Macau
3.Harbin Institute of Technology, Shenzhen, China
Recommended Citation
GB/T 7714
You, Jiaxiang,Li, Yuanman,Zhou, Jiantao,et al. A Transformer based Approach for Image Manipulation Chain Detection[C], 2021, 3510-3517.
APA You, Jiaxiang., Li, Yuanman., Zhou, Jiantao., Hua, Zhongyun., Sun, Weiwei., & Li, Xia (2021). A Transformer based Approach for Image Manipulation Chain Detection. MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia, 3510-3517.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[You, Jiaxiang]'s Articles
[Li, Yuanman]'s Articles
[Zhou, Jiantao]'s Articles
Baidu academic
Similar articles in Baidu academic
[You, Jiaxiang]'s Articles
[Li, Yuanman]'s Articles
[Zhou, Jiantao]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[You, Jiaxiang]'s Articles
[Li, Yuanman]'s Articles
[Zhou, Jiantao]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.