Multi-type Features Network for Person Re-identification
WANG Peng1, SONG Xiaoning1, WU Xiaojun1, YU Dongjun2
1.School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122; 2.School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094
Abstract The attention mechanism is effective in person re-identification. However, the performance of the combined use of different types of attention mechanisms needs to be improved, such as spatial attention and self-attention. An improved convolutional block attention model(CBAM-PRO) is proposed, and then a multi-type features network(MTFN) is proposed. The features of different interested domains are extracted through the integration of CBAM-Pro and self-attention mechanism, and the local features with different granularities are introduced concurrently to perform person re-identification jointly. The validity and reliability of MTFN are verified by the experiments on the existing general benchmark datasets.
Fund:; National Key Research and Development Program of China(No.2017YFC1601800), National Natural Science Foundation of China(No.61876072), China Postdoctoral Science Foundation(No.2018T110441), Six Talent Peaks Project in Jiangsu Province(No.XYDXX-012)
Corresponding Authors:SONG Xiaoning, Ph.D., professor. His research interests include pattern recognition,image processing, artificial intelligence and computer vision.
About author:: WANG Peng, master student. His research interests include deep learning and computer vision.WU Xiaojun, Ph.D., professor. His research interests include pattern recognition, computer vision, artificial intelligence, fuzzy system and neural network.YU Dongjun, Ph.D., professor. His research interests include machine learning, pattern recognition, neural networks and bioinformatics.
[1] LI W, ZHAO R, XIAO T G, et al. DeepReID: Deep Filter Pairing Neural Network for Person Re-identification // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2014: 152-159. [2] YI D, LEI Z, LIAO S C, et al. Deep Metric Learning for Person Re-identification // Proc of the 22nd International Conference on Pattern Recognition. Washington, USA: IEEE, 2014: 34-39. [3] ZHENG L, YANG Y, HAUPTMANN A G. Person Re-identification: Past, Present and Future[C/OL]. [2020-08-10].https://arxiv.org/pdf/1610.02984.pdf. [4] VARIOR R R, HALOI M, WANG G. Gated Siamese Convolutional Neural Network Architecture for Human Re-identification // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2016: 791-808. [5] SCHROFF F, KALENICHENKO D, PHILBIN J. FaceNet: A Unified Embedding for Face Recognition and Clustering // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2015: 815-823. [6] LIU H, FENG J S, QI M B, et al. End-to-End Comparative Attention Networks for Person Re-identification. IEEE Transactions on Image Processing, 2017, 26(7): 3492-3506. [7] CHENG D, GONG Y H, ZHOU S P, et al. Person Re-identification by Multi-channel Parts-Based CNN with Improved Triplet Loss Function // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2016: 1335-1344. [8] CHEN W H, CHEN X T, ZHANG J G, et al. Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2017: 1320-1329. [9] HERMANS A, BEYER L, LEIBE B. In Defense of the Triplet Loss for Person Re-identification[C/OL]. [2020-08-10].https://arxiv.org/pdf/1703.07737v2.pdf. [10] ZHONG Z, ZHENG L, CAO D L, et al. Re-ranking Person Re-identification with k-Reciprocal Encoding // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2017: 3652-3661. [11] SUN Y F, ZHENG L, YANG Y, et al. Beyond Part Models: Person Retrieval with Refined Part Pooling(and a Strong Convolutional Baseline) // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2018: 501-518. [12] WANG G S, YUAN Y F, CHEN X, et al. Learning Discriminative Features with Multiple Granularities for Person Re-identification // Proc of the 26th ACM International Conference on Multimedia. New York, USA: ACM, 2018: 274-282. [13] ZHANG X, LUO H, FAN X, et al. AlignedReID: Surpassing Human-Level Performance in Person Re-identification[C/OL].[2020-08-10]. https://arxiv.org/pdf/1711.08184.pdf. [14] HUANG H J, YANG W J, CHEN X T, et al. EANet: Enhancing Alignment for Cross-Domain Person Re-identification[C/OL].[2020-08-10]. https://arxiv.org/pdf/1812.11369.pdf. [15] HU J, SHEN L, ALBANIE S, et al. Squeeze-and-Excitation Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(8): 2011-2023. [16] WOO S, PARK J, LEE J Y, et al. CBAM: Convolutional Block Attention Module // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2018: 3-19. [17] WANG Q L, WU B G, ZHU P F, et al. ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2020: 11534-11542. [18] SI J L, ZHANG H G, LI C G, et al. Dual Attention Matching Network for Context-Aware Feature Sequence Based Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 5363-5372. [19] LI W, ZHU X T, GONG S G. Harmonious Attention Network for Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 2285-2294. [20] WANG X L, GIRSHICK R, GUPTA A, et al. Non-local Neural Networks // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 7794-7803. [21] ZHENG L, SHEN L Y, TIAN L, et al. Scalable Person Re-identification: A Benchmark // Proc of the IEEE International Confe-rence on Computer Vision. Washington, USA: IEEE, 2015: 1116-1124. [22] RISTANI E, SOLERA F, ZOU R, et al. Performance Measures and a Data Set for Multi-target, Multi-camera Tracking // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2016: 17-35. [23] ZHENG Z D, ZHENG L, YANG Y. Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2017: 3774-3782. [24] DENG J, DONG W, SOCHER R, et al. ImageNet: A Large-Scale Hierarchical Image Database // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2009: 248-255. [25] SONG C F, HUANG Y, OUYANG W L, et al. Mask-Guided Contrastive Attention Model for Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 1179-1188. [26] WANG C, ZHANG Q, HUANG C, et al. Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-identification // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2018: 384-400. [27] QUAN R J, DONG X Y, WU Y, et al. Auto-ReID: Searching for a Part-Aware ConvNet for Person Re-identification // Proc of the IEEE/CVF International Conference on Computer Vision. Washington, USA: IEEE, 2019: 3749-3758. [28] ZHENG M, KARANAM S, WU Z Y, et al. Re-identification with Consistent Attentive Siamese Networks // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2019: 5735-5744. [29] SHEN Y T, LI H S, YI S, et al. Person Re-identification with Deep Similarity-Guided Graph Neural Network // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2018: 508-526. [30] KALAYEH M M, BASARAN E, GÖKMEN M, et al. Human Semantic Parsing for Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 1062-1071. [31] HOU R B, MA B P, CHANG H, et al. Interaction-and-Aggregation Network for Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2019: 9317-9326. [32] YANG W J, HUANG H J, ZHANG Z, et al. Towards Rich Feature Discovery with Class Activation Maps Augmentation for Person Re-identification // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2019: 1389-1398. [33] DAI Z Z, CHEN M Q, GU X D, et al. Batch DropBlock Network for Person Re-identification and Beyond // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2019: 3691-3701. [34] SELVARAJU R R, COGSWELL M, DAS A, et al. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Loca-lization // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2017: 618-626.
2020, Vol. 33 
