Residential Collegefalse
Status已發表Published
Image Operation Chain Detection with Machine Translation Framework
Yuanman Li1; Jiaxiang You1; Jiantao Zhou2; Wei Wang3; Xin Liao4; Xia Li1
2023-12
Source PublicationIEEE TRANSACTIONS ON MULTIMEDIA
ISSN1520-9210
Volume25Pages:6852-6867
Abstract

The aim of operation chain detection for a given manipulated image is to reveal the operations involved and the order in which they were applied, which is significant for image processing and multimedia forensics. Currently, all existing approaches simply treat image operation chain detection as a classification problem and consider only chains of at most two operations. Considering the complex interplay between operations and the exponentially increasing solution space, detecting longer operation chains is extremely challenging. To address this issue, in this work, we devise a new methodology for image operation chain detection. Different from existing approaches based on classification modeling, we strategically conduct operation chain detection within a machine translation framework. Specifically, the chain in our work is modeled as a sentence in a target language, with each possible operation represented by a word in that language. When executing chain detection, we propose first transforming the input image into a sentence in a latent source language from the learned deep features. Then, we propose translating the latent language into the target language within a machine translation framework and finally decoding all operations, arranged in order. Besides, a chain inversion strategy and a bi-directional modeling mechanism are developed to improve the detection performance. We further design a weighted cross-entropy loss to alleviate the problems presented by imbalance among chain lengths and chain categories. Our method can detect operation chains containing up to seven operations and obtains very promising results in various scenarios for the detection of both short and long chains.

KeywordOperation Chain Detection Image Forensics Machine Translation Transformer
DOI10.1109/TMM.2022.3215000
URLView the original
Language英語English
WOS Research AreaComputer Science ; Telecommunications
WOS SubjectComputer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS IDWOS:001102654000011
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85140745625
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionTHE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Faculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorJiantao Zhou
Affiliation1.Guangdong Key Laboratory of Intelligent Information Processing, College of Electronics and Information Engineering, Shenzhen University
2.State Key Laboratory of Internet of Things for Smart City, and also with the Department of Computer and Information Science, Faculty of Science and Technology, University of Macau
3.School of Intelligent Systems Engineering, Sun Yat-Sen University, Shenzhen
4.College of Computer Science and Electronic Engineering, Hunan University, Changsha
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Yuanman Li,Jiaxiang You,Jiantao Zhou,et al. Image Operation Chain Detection with Machine Translation Framework[J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25, 6852-6867.
APA Yuanman Li., Jiaxiang You., Jiantao Zhou., Wei Wang., Xin Liao., & Xia Li (2023). Image Operation Chain Detection with Machine Translation Framework. IEEE TRANSACTIONS ON MULTIMEDIA, 25, 6852-6867.
MLA Yuanman Li,et al."Image Operation Chain Detection with Machine Translation Framework".IEEE TRANSACTIONS ON MULTIMEDIA 25(2023):6852-6867.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yuanman Li]'s Articles
[Jiaxiang You]'s Articles
[Jiantao Zhou]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yuanman Li]'s Articles
[Jiaxiang You]'s Articles
[Jiantao Zhou]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yuanman Li]'s Articles
[Jiaxiang You]'s Articles
[Jiantao Zhou]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.