Residential Collegefalse
Status已發表Published
Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification
Shi, Cheng1; Dang, Yenan1; Fang, Li2; Zhao, Minghua1; Lv, Zhiyong1; Miao, Qiguang3; Pun, Chi Man4
2022-09-21
Source PublicationIEEE Transactions on Geoscience and Remote Sensing
ISSN0196-2892
Volume60Pages:5631815
Abstract

Deep neural networks have strong feature learning ability, but their vulnerability cannot be ignored. Current research shows that deep learning models are threatened by adversarial examples in remote sensing (RS) classification tasks, and their robustness drops sharply in the face of adversarial attacks. Therefore, many adversarial attack methods have been studied to predict the risks faced by a network. However, the existing adversarial attack methods mainly focus on single-modal image classification networks, and the rapid growth of RS data makes multimodal RS image classification a research hotspot. Generating multimodal adversarial examples needs to consider a high attack success rate, subtle perturbation, and collaborative attack ability between different modalities. In this article, we investigate the vulnerability of multimodal RS classification networks and propose a multifeature collaborative adversarial network (MFCANet) for generating multimodal adversarial examples. Two modality-specific generators are designed to generate the multimodal collaborative perturbations with strong attack ability, and two modality-specific discriminators make the generated multimodal adversarial examples closer to the real instances. In addition, a modality-specific generative loss and a modality-specific discriminative loss are proposed, and an alternating optimization strategy is designed for training the proposed MFCANet. Extensive experiments are carried out on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen 2D dataset and ISPRS Potsdam 2D dataset. The results show that the attack performance of the proposed method is stronger than that of the fast gradient sign method (FGSM), project gradient descent (PGD), and Carlini and Wagner (C&W) attack methods.

KeywordGenerative Adversarial Networks (Gans) Multimodal Adversarial Attack Multimodal Remote Sensing (Rs) Image Classification
DOI10.1109/TGRS.2022.3208337
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaGeochemistry & Geophysics ; Engineering ; Remote Sensing ; Imaging Science & Photographic Technology
WOS SubjectGeochemistry & Geophysics ; Engineering, Electrical & Electronic ; Remote Sensing ; Imaging Science & Photographic
WOS IDWOS:000874066100010
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85139432193
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorFang, Li
Affiliation1.Xi'an University of Technology, School of Computer Science and Engineering, Xi'an, Shaanxi, 710048, China
2.Quanzhou Institute of Equipment Manufacturing, Haixi Institutes, Chinese Academy of Sciences, Quanzhou, Fujian, 362216, China
3.Xidian University, School of Computer Science and Technology, Xi'an, Shaanxi, 710048, China
4.University of Macau, Department of Computer and Information Science, Macao
Recommended Citation
GB/T 7714
Shi, Cheng,Dang, Yenan,Fang, Li,et al. Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, 5631815.
APA Shi, Cheng., Dang, Yenan., Fang, Li., Zhao, Minghua., Lv, Zhiyong., Miao, Qiguang., & Pun, Chi Man (2022). Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 60, 5631815.
MLA Shi, Cheng,et al."Multifeature Collaborative Adversarial Attack in Multimodal Remote Sensing Image Classification".IEEE Transactions on Geoscience and Remote Sensing 60(2022):5631815.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Shi, Cheng]'s Articles
[Dang, Yenan]'s Articles
[Fang, Li]'s Articles
Baidu academic
Similar articles in Baidu academic
[Shi, Cheng]'s Articles
[Dang, Yenan]'s Articles
[Fang, Li]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Shi, Cheng]'s Articles
[Dang, Yenan]'s Articles
[Fang, Li]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.