0 引????????????? 言1 相关工作2 Dy-ResNet50与注意力机制算法3 实验分析4 结束语
DOI:
作者:
作者单位:

南京信息工程大学

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(51875293);国家重点研发计划 (2018YFC1405703)


Multi-feature pedestrian recognition based on cross-attention mechanism
Author:
Affiliation:

Nanjing University of Information Science and Technology

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对现有的行人重识别方法难以避免环境噪声导致的特征提取不精确,易被误认为行人特征等问题,提出一种基于动态卷积与注意力机制的行人多特征融合分支网络。首先,由于拍摄时存在光照变化、人体姿势调整以及物体遮挡等不确定因素,提出使用动态卷积替换ResNet50中的静态卷积得到具有更强鲁棒性的Dy-ResNet50模型;其次,考虑到拍摄行人图片的视角有较大差异且存在行人被物体遮挡的情况,提出将自注意力机制与交叉注意力机制嵌入骨干网络;最后,将交叉熵损失函数和难样本三元损失函数共同作为模型损失函数。在DukeMTMC-ReID、Market-1501和MSMT17公开数据集上进行实验,并与主流网络模型进行比较。结果表明:在数据集DukeMTMC-ReID上本文所提模型的Rank-1与mAP相比当前主流模型分别提升了0.9和1.6个百分点。

    Abstract:

    In view of the fact that the existing person re-identification methods are difficult to avoid inaccurate feature extraction caused by environmental noise and are easily mistaken for person features, a person multi-feature fusion branch network based on dynamic convolution and attention mechanism is proposed. Firstly, due to the uncertain factors such as illumination change, human posture, object occlusion, etc., dynamic convolution is proposed to replace static convolution in ResNet50 to obtain a more robust Dy-ResNet50 model. Secondly, considering that there are great differences in the perspective of taking pictures of people and people are blocked by objects, it is proposed to embed the self-attention mechanism and the cross-attention mechanism into the backbone network. Finally, the cross entropy loss function and the difficult sample ternary loss function are used as the loss function together.Experiments are carried out on DukeMTMC-ReID、 Market-1501 and MSMT17 public datasets and compared with mainstream network models. The results show that the Rank-1 and mAP of the proposed model is 0.9 and 1.6 percentage points higher than that of the current mainstream model on the data set DukeMTMC-ReID.

    参考文献
    相似文献
    引证文献
引用本文

邬心怡,邓志良,刘云平,董娟,李嘉琦.0 引????????????? 言1 相关工作2 Dy-ResNet50与注意力机制算法3 实验分析4 结束语[J].南京信息工程大学学报,,():

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-11-13
  • 最后修改日期:2023-12-28
  • 录用日期:2024-01-12
  • 在线发布日期:
  • 出版日期:

地址:江苏省南京市宁六路219号    邮编:210044

联系电话:025-58731025    E-mail:nxdxb@nuist.edu.cn

南京信息工程大学学报 ® 2024 版权所有  技术支持:北京勤云科技发展有限公司