Residential College | false |
Status | 已發表Published |
A Transformer based Approach for Image Manipulation Chain Detection | |
You, Jiaxiang1; Li, Yuanman1![]() ![]() ![]() | |
2021-10-17 | |
Conference Name | the 29th ACM International Conference on Multimedia |
Source Publication | MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia
![]() |
Pages | 3510-3517 |
Conference Date | 20 October 2021through 24 October 2021 |
Conference Place | Virtual, Online |
Country | China |
Abstract | Image manipulation chain detection aims to identify the existence of involved operations and also their orders, playing an important role in multimedia forensics and image analysis. However,all the existing algorithms model the manipulation chain detection as a classification problem, and can only detect chains containing up to two operations. Due to the exponentially increased solution space and the complex interactions among operations, how to reveal a long chain from a processed image remains a long-standing problem in the multimedia forensic community. To address this challenge, in this paper, we propose a new direction for manipulation chain detection. Different from previous works, we treat the manipulation chain detection as a machine translation problem rather than a classification one, where we model the chains as the sentences of a target language, and each word serves as one possible image operation. Specifically, we first transform the manipulated image into a deep feature space, and further model the traces left by the manipulation chain as a sentence of a latent source language. Then, we propose to detect the manipulation chain through learning the mapping from the source language to the target one under a machine translation framework. Our method can detect manipulation chains consisting of up to five operations, and we obtain promising results on both the short-chain detection and the long-chain detection. |
Keyword | Image Forensics Machine Translation Manipulation Chain Detection Transformer |
DOI | 10.1145/3474085.3475513 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85119345896 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Li, Yuanman |
Affiliation | 1.Shenzhen University, Shenzhen, China 2.State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, Macau 3.Harbin Institute of Technology, Shenzhen, China |
Recommended Citation GB/T 7714 | You, Jiaxiang,Li, Yuanman,Zhou, Jiantao,et al. A Transformer based Approach for Image Manipulation Chain Detection[C], 2021, 3510-3517. |
APA | You, Jiaxiang., Li, Yuanman., Zhou, Jiantao., Hua, Zhongyun., Sun, Weiwei., & Li, Xia (2021). A Transformer based Approach for Image Manipulation Chain Detection. MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia, 3510-3517. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment