Residential College | false |
Status | 已發表Published |
Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification | |
Shi, Cheng1; Dang, Yenan1; Fang, Li2; Zhao, Minghua1; Lv, Zhiyong1; Miao, Qiguang3; Pun, Chi Man4 | |
2022-09-21 | |
Source Publication | IEEE Transactions on Geoscience and Remote Sensing |
ISSN | 0196-2892 |
Volume | 60Pages:5631815 |
Abstract | Deep neural networks have strong feature learning ability, but their vulnerability cannot be ignored. Current research shows that deep learning models are threatened by adversarial examples in remote sensing (RS) classification tasks, and their robustness drops sharply in the face of adversarial attacks. Therefore, many adversarial attack methods have been studied to predict the risks faced by a network. However, the existing adversarial attack methods mainly focus on single-modal image classification networks, and the rapid growth of RS data makes multimodal RS image classification a research hotspot. Generating multimodal adversarial examples needs to consider a high attack success rate, subtle perturbation, and collaborative attack ability between different modalities. In this article, we investigate the vulnerability of multimodal RS classification networks and propose a multifeature collaborative adversarial network (MFCANet) for generating multimodal adversarial examples. Two modality-specific generators are designed to generate the multimodal collaborative perturbations with strong attack ability, and two modality-specific discriminators make the generated multimodal adversarial examples closer to the real instances. In addition, a modality-specific generative loss and a modality-specific discriminative loss are proposed, and an alternating optimization strategy is designed for training the proposed MFCANet. Extensive experiments are carried out on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen 2D dataset and ISPRS Potsdam 2D dataset. The results show that the attack performance of the proposed method is stronger than that of the fast gradient sign method (FGSM), project gradient descent (PGD), and Carlini and Wagner (C&W) attack methods. |
Keyword | Generative Adversarial Networks (Gans) Multimodal Adversarial Attack Multimodal Remote Sensing (Rs) Image Classification |
DOI | 10.1109/TGRS.2022.3208337 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Geochemistry & Geophysics ; Engineering ; Remote Sensing ; Imaging Science & Photographic Technology |
WOS Subject | Geochemistry & Geophysics ; Engineering, Electrical & Electronic ; Remote Sensing ; Imaging Science & Photographic |
WOS ID | WOS:000874066100010 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85139432193 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Fang, Li |
Affiliation | 1.Xi'an University of Technology, School of Computer Science and Engineering, Xi'an, Shaanxi, 710048, China 2.Quanzhou Institute of Equipment Manufacturing, Haixi Institutes, Chinese Academy of Sciences, Quanzhou, Fujian, 362216, China 3.Xidian University, School of Computer Science and Technology, Xi'an, Shaanxi, 710048, China 4.University of Macau, Department of Computer and Information Science, Macao |
Recommended Citation GB/T 7714 | Shi, Cheng,Dang, Yenan,Fang, Li,et al. Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, 5631815. |
APA | Shi, Cheng., Dang, Yenan., Fang, Li., Zhao, Minghua., Lv, Zhiyong., Miao, Qiguang., & Pun, Chi Man (2022). Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 60, 5631815. |
MLA | Shi, Cheng,et al."Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification".IEEE Transactions on Geoscience and Remote Sensing 60(2022):5631815. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment