Residential College | false |
Status | 已發表Published |
Robust Camera Model Identification Over Online Social Network Shared Images via Multi-Scenario Learning | |
Wu, Haiwei1; Zhou, Jiantao1; Zhang, Xinyu1; Tian, Jinyu2; Sun, Weiwei3 | |
2024 | |
Source Publication | IEEE Transactions on Information Forensics and Security |
ISSN | 1556-6013 |
Volume | 19Pages:148-162 |
Abstract | Camera model identification (CMI) can be widely used in image forensics such as authenticity determination, copyright protection, forgery detection, etc. Meanwhile, with the vigorous development of the Internet, online social networks (OSNs) have become the dominant channels for image sharing and transmission. However, the inevitable lossy operations on OSNs, such as compression and post-processing, impose great challenges to the existing CMI schemes, as they severely destroy the camera traces left in the images under investigation. In this work, we propose a novel CMI method that is robust against the lossy operations of various OSN platforms. Specifically, it is observed that a camera trace extractor can be easily trained on a single degradation scenario (e.g., one specific OSN platform); while much more difficult on mixed degradation scenarios (e.g., multiple OSN platforms). Inspired by this observation, we design a new multi-scenario learning (MSL) strategy, enabling us to extract robust camera traces across different OSNs. Furthermore, noticing that image smooth regions incur less distortions by OSN and less interference by image signal itself, we suggest a SmooThness-Aware Trace Extractor (STATE) that can adaptively extract camera traces according to the smoothness of the input image. The superiority of our method is verified by comparative experiments with four state-of-the-art methods, especially under various OSN transmission scenarios. Particularly, for the open-set camera model verification task, we greatly surpass the second-place by 15.30% in AUC on the FODB dataset; while for the close-set camera model classification task, we are significantly ahead of the second-place by 34.51% in F1 on the SIHDR dataset. The code of our proposed method is available at https://github.com/HighwayWu/CameraTraceOSN. |
Keyword | Camera Model Identification Deep Neural Networks Online Social Networks Robustness |
DOI | 10.1109/TIFS.2023.3318968 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS ID | WOS:001123966000016 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85173412123 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Zhou, Jiantao |
Affiliation | 1.University of Macau, Faculty of Science and Technology, State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, Macau, 999078, Macao 2.Macau University of Science and Technology, Faculty of Innovation Engineering, Macau, 999078, Macao 3.Alibaba Group, Hangzhou, 311100, China |
First Author Affilication | Faculty of Science and Technology |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Wu, Haiwei,Zhou, Jiantao,Zhang, Xinyu,et al. Robust Camera Model Identification Over Online Social Network Shared Images via Multi-Scenario Learning[J]. IEEE Transactions on Information Forensics and Security, 2024, 19, 148-162. |
APA | Wu, Haiwei., Zhou, Jiantao., Zhang, Xinyu., Tian, Jinyu., & Sun, Weiwei (2024). Robust Camera Model Identification Over Online Social Network Shared Images via Multi-Scenario Learning. IEEE Transactions on Information Forensics and Security, 19, 148-162. |
MLA | Wu, Haiwei,et al."Robust Camera Model Identification Over Online Social Network Shared Images via Multi-Scenario Learning".IEEE Transactions on Information Forensics and Security 19(2024):148-162. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment