Multi-feature pedestrian recognition based on cross-attention mechanism
DOI:
CSTR:
Author:
Affiliation:

Nanjing University of Information Science and Technology

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    In view of the fact that the existing person re-identification methods are difficult to avoid inaccurate feature extraction caused by environmental noise and are easily mistaken for person features, a person multi-feature fusion branch network based on dynamic convolution and attention mechanism is proposed. Firstly, due to the uncertain factors such as illumination change, human posture, object occlusion, etc., dynamic convolution is proposed to replace static convolution in ResNet50 to obtain a more robust Dy-ResNet50 model. Secondly, considering that there are great differences in the perspective of taking pictures of people and people are blocked by objects, it is proposed to embed the self-attention mechanism and the cross-attention mechanism into the backbone network. Finally, the cross entropy loss function and the difficult sample ternary loss function are used as the loss function together.Experiments are carried out on DukeMTMC-ReID、 Market-1501 and MSMT17 public datasets and compared with mainstream network models. The results show that the Rank-1 and mAP of the proposed model is 0.9 and 1.6 percentage points higher than that of the current mainstream model on the data set DukeMTMC-ReID.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:November 13,2023
  • Revised:December 28,2023
  • Adopted:January 12,2024
  • Online:
  • Published:
Article QR Code

Address:No. 219, Ningliu Road, Nanjing, Jiangsu Province

Postcode:210044

Phone:025-58731025