Residential College | false |
Status | 已發表Published |
TFC: Transformer Fused Convolution for Adversarial Domain Adaptation | |
Wang, Mengzhu1; Chen, Junyang1; Wang, Ye2; Gong, Zhiguo3; Wu, Kaishun1; Leung, Victor C.M.1 | |
2024-02 | |
Source Publication | IEEE Transactions on Computational Social Systems |
ISSN | 2329-924X |
Volume | 11Issue:1Pages:697-706 |
Abstract | In unsupervised domain adaptation (UDA), a classifier is applied to the target domain without or with limited labels, when the target domain has no or few labels. Recently, inspired by their capabilities of long-distance feature dependencies, vision transformer (ViT)-based methods have been used in UDA, however, they ignore the fact that ViT lacks strength in extracting local feature details. To handle the above problems, the purpose of this article is to demonstrate how to take advantage of both convolutional operations and transformer mechanisms for adversarial UDA by using a hybrid network structure called transformer fused convolution (TFC). TFC integrates local features with global features to boost the representation capacity for UDA which can enhance the discrimination between foreground and background. Moreover, to improve the robustness of the TFC, we leverage an uncertainty penalty loss to make incorrect classes have consistently lower scores. Extensive experiments validate the significant performance gains compared to conditional adversarial domain adaptation (CDAN) on all five datasets including DomainNet (↑ 8.5%), VisDA-2017 (↑ 14.9 %), Office-Home (↑ 18.9%), Office-31 (↑ 11.5%), and ImageCLEF-DA (↑ 5.5%). |
Keyword | Convolutional Neural Networks (Cnns) Transfer Fused Convolution Unsupervised Domain Adaptation (Uda) Vision Transform |
DOI | 10.1109/TCSS.2022.3229693 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Cybernetics ; Computer Science, Information Systems |
WOS ID | WOS:000910486400001 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85147215412 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Chen, Junyang |
Affiliation | 1.Shenzhen University, College of Computer Science and Software Engineering, Shenzhen, 518060, China 2.National University of Defense Technology, College of Computer, Changsha, 410073, China 3.University of Macau, State Key Laboratory of Internet of Things for Smart City, Department of Computer Information Science, Macao |
Recommended Citation GB/T 7714 | Wang, Mengzhu,Chen, Junyang,Wang, Ye,et al. TFC: Transformer Fused Convolution for Adversarial Domain Adaptation[J]. IEEE Transactions on Computational Social Systems, 2024, 11(1), 697-706. |
APA | Wang, Mengzhu., Chen, Junyang., Wang, Ye., Gong, Zhiguo., Wu, Kaishun., & Leung, Victor C.M. (2024). TFC: Transformer Fused Convolution for Adversarial Domain Adaptation. IEEE Transactions on Computational Social Systems, 11(1), 697-706. |
MLA | Wang, Mengzhu,et al."TFC: Transformer Fused Convolution for Adversarial Domain Adaptation".IEEE Transactions on Computational Social Systems 11.1(2024):697-706. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment