• Home
  • Search
  • MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification
  • Open Access IconOpen Access
  • Cite Icon72
  • https://doi.org/10.1145/3474085.3475643Copy DOI Icon

MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification

  • Oct 17, 2021
  • Yajun Gao +6 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The RGB-infrared cross-modality person re-identification (ReID) task aims to recognize the images of the same identity between the visible modality and the infrared modality. Existing methods mainly use a two-stream architecture to eliminate the discrepancy between the two modalities in the final common feature space, which ignore the single space of each modality in the shallow layers. To solve it, in this paper, we present a novel multi-feature space joint optimization (MSO) network, which can learn modality-sharable features in both the single-modality space and the common space. Firstly, based on the observation that edge information is modality-invariant, we propose an edge features enhancement module to enhance the modality-sharable features in each single-modality space. Specifically, we design a perceptual edge features (PEF) loss after the edge fusion strategy analysis. According to our knowledge, this is the first work that proposes explicit optimization in the single-modality feature space on cross-modality ReID task. Moreover, to increase the difference between cross-modality distance and class distance, we introduce a novel cross-modality contrastive-center (CMCC) loss into the modality-joint constraints in the common feature space. The PEF loss and CMCC loss jointly optimize the model in an end-to-end manner, which markedly improves the network's performance. Extensive experiments demonstrate that the proposed model significantly outperforms state-of-the-art methods on both the SYSU-MM01 and RegDB datasets.

Similar Papers
  • Research Article
  • Citations7

Improving visible-thermal ReID with structural common space embedding and part models

  • Dec 16, 2020
  • Pattern Recognition Letters
  • Lingyan Ran +4
  • Conference Article
  • Citations78

Cross-View Action Recognition over Heterogeneous Feature Spaces

  • Dec 01, 2013
  • Xinxiao Wu +3
  • Research Article
  • Citations14

Semi-Coupled Dictionary Learning With Relaxation Label Space Transformation for Video-Based Person Re-Identification

  • Jan 01, 2018
  • IEEE Access
  • Lingchuan Sun +4
  • Research Article
  • Citations7

Two-phase self-supervised pretraining for object re-identification

  • Dec 22, 2022
  • Knowledge-Based Systems
  • Haoyan Ma +3
  • Research Article
  • Citations5

Person re-identification based on frequency channel attention networks under the surveillance scenario

  • Jul 01, 2021
  • Journal of Physics: Conference Series
  • Shengbo Chen +1
  • Research Article
  • Citations64

Learning to disentangle scenes for person re-identification

  • Oct 23, 2021
  • Image and Vision Computing
  • Xianghao Zang +3
  • Conference Article
  • Citations1

Coupled analysis-synthesis dictionary learning for person re-identification

  • Sep 01, 2017
  • Lingchuan Sun +3
  • Research Article
  • Citations25

Cross-View Action Recognition Over Heterogeneous Feature Spaces.

  • Jun 12, 2015
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Xinxiao Wu +3
  • Book Chapter
  • Citations29

CoCa-GAN: Common-Feature-Learning-Based Context-Aware Generative Adversarial Network for Glioma Grading

  • Jan 01, 2019
  • Pu Huang +7
  • Conference Article
  • Citations36

Learning Discriminative and Generalizable Representations by Spatial-Channel Partition for Person Re-Identification

  • Nov 21, 2019
  • Hao Chen +2
  • Research Article
  • Citations21

An Adaptive Multi-Projection Metric Learning for Person Re-Identification Across Non-Overlapping Cameras

  • Sep 01, 2019
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Hai-Miao Hu +3
  • Research Article
  • Citations30

Multi-Prompts Learning with Cross-Modal Alignment for Attribute-Based Person Re-identification

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Yajing Zhai +5
  • PDF
  • Research Article
  • Citations2

MULTIMODAL PERSON RE-IDENTIFICATION IN AERIAL IMAGERY BASED ON CONDITIONAL ADVERSARIAL NETWORKS

  • May 12, 2023
  • ˜The œinternational archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences
  • V V Kniaz +2
  • Conference Article
  • Citations1

Graph Regularized and Label-matched Dictionary Learning for Video-based Person Re-identification

  • Dec 01, 2018
  • Lingchuan Sun +4
  • Research Article
  • Citations4

Consistency and label constrained transfer low-rank representation for cross-light finger vein recognition

  • Nov 23, 2024
  • Pattern Recognition
  • Zhen Zhang +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.