Residential Collegefalse
Status已發表Published
Person re-identification based on multi-level feature complementarity of cross-attention with part metric learning
Lu,Zeng1; Huang,Guoheng1; Pun,Chi Man2; Cheng,Lianglun1
2020-08-01
Source PublicationMultimedia Tools and Applications
ISSN1380-7501
Volume79Issue:29-30Pages:21409-21439
Abstract

Person re-identification is an image retrieval task, and its task is to perform a person matching in different cameras by a given person target. This research has been noticed and studied by more and more people. However, pose changes and occlusions often occur during a person walking. Especially in the most related methods, local features are not used to simply and effectively solve the problems of occlusion and pose changes. Moreover, the metric loss functions only consider the image-level case, and it cannot adjust the distance between local features well. To tackle the above problems, a novel person re-identification scheme is proposed. Through experiments, we found that we paid more attention to different parts of a person when we look at him from a horizontal or vertical perspective respectively. First, in order to solve the problem of occlusion and pose changes, we propose a Cross Attention Module (CAM). It enables the network to generate a cross attention map and improve the accuracy of person re-identification via the enhancement of the most significant local features of persons. The horizontal and vertical attention vectors of the feature maps are extracted and a cross attention map is generated, and the local key features are enhanced by this attention map. Second, in order to solve the problem of the lack of expression ability of the single-level feature maps, we propose a Multi-Level Feature Complementation Module (MLFCM). In this module, the missing information of high-level features is complemented by low-level features via short skip. Feature selection is also performed among deep features maps. The purpose of this module is to get the feature maps with complete information. Further, this module solves the problem of missing contour features in high-level semantic features. Third, in order to solve the problem that the current metric loss function cannot adjust the distance between local features, we propose Part Triple Loss Function (PTLF). It can reduce both within-class and increase between-class distance of the person parts. Experimental results show that our model achieves high values on Rank-k and mAP on Market-1501, Duke-MTMC and CUHK03-NP.

KeywordCross Attention Joint Training Multi-level Complementation Part Triple Loss Function Person Re-id
DOI10.1007/s11042-020-08972-w
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000531339200005
Scopus ID2-s2.0-85084450883
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorHuang,Guoheng
Affiliation1.Guangdong University of Technology,Guangzhou,China
2.Department of Computer and Information Science,University of Macau,Taipa,Macao
Recommended Citation
GB/T 7714
Lu,Zeng,Huang,Guoheng,Pun,Chi Man,et al. Person re-identification based on multi-level feature complementarity of cross-attention with part metric learning[J]. Multimedia Tools and Applications, 2020, 79(29-30), 21409-21439.
APA Lu,Zeng., Huang,Guoheng., Pun,Chi Man., & Cheng,Lianglun (2020). Person re-identification based on multi-level feature complementarity of cross-attention with part metric learning. Multimedia Tools and Applications, 79(29-30), 21409-21439.
MLA Lu,Zeng,et al."Person re-identification based on multi-level feature complementarity of cross-attention with part metric learning".Multimedia Tools and Applications 79.29-30(2020):21409-21439.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Lu,Zeng]'s Articles
[Huang,Guoheng]'s Articles
[Pun,Chi Man]'s Articles
Baidu academic
Similar articles in Baidu academic
[Lu,Zeng]'s Articles
[Huang,Guoheng]'s Articles
[Pun,Chi Man]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Lu,Zeng]'s Articles
[Huang,Guoheng]'s Articles
[Pun,Chi Man]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.