Spatial-Temporal Omni-Scale Feature Learning for Person Re-Identification

Person re-identification (Re-ID) aims to retrieve a person of interest across multiple nonoverlapping cameras. In the last few years, the construction of aerial person Re-ID datasets has been appealing because visual surveillance through unmanned aerial vehicle (UAV) platforms has become very valuable in real-world scenarios. However, great differences are exhibited between the pedestrian images captured by ground cameras and those captured by UAVs. Person Re-ID methods based on ground person images have difficulty when performing Re-ID based on aerial person images. In this paper, we first propose a novel meta-transfer learning method for person Re-ID in aerial imagery; this approach trains a generalisable Re-ID model to learn discriminative feature representations for aerial person images. Specifically, a meta-learning strategy is introduced to study a feature extractor, and a transfer learning strategy is introduced to utilise and further improve the acquired meta-knowledge. To overcome the convergence speed and recognition accuracy reductions caused by the presence of difficult categories in the given dataset, we propose a learning strategy based on curriculum sampling that is harmonised with our meta-transfer learning framework. In addition, a new metric formulation of sample similarity is introduced based on Mahalanobis distance to improve the optimisation of the model. Extensive comparative evaluation experiments are conducted on the large-scale aerial Re-ID dataset, and the results obtained show that our method achieves a Rank-1 accuracy of 63.63 $$\%$$ and a mean average precision (mAP) of 38.02 $$\%$$ , demonstrating its potential for completing person Re-ID in aerial images. Ablation studies also validate that each component contributes to improving the performance of the model.

Person re-identification (Re-ID) using infrared surveillance cameras has attracted increasing attention due to its robustness under low-light conditions. However, infrared images generally suffer from a low spatial resolution, which degrades Re-ID performance. To address this issue, this study proposes a part attention and contrastive loss-based super-resolution reconstruction network (PCSR-Net) and a unified infrared-only Re-ID framework. The proposed PCSR-Net consists of a correlation-based super-resolution reconstruction network (CoSR-Net), a feature extractor for Re-ID, and a part attention mechanism that estimates the importance of different body regions. In addition, contrastive loss and part-aware reconstruction loss are incorporated to guide the super-resolution process toward identity-discriminative representations. Experimental results on DBPerson-Recog-DB1 and SYSU-MM01 demonstrate that the proposed method outperforms state-of-the-art approaches in terms of the equal error rate (EER), mean average precision (mAP), and rank-1 accuracy, validating its effectiveness for infrared-based person Re-ID.

Person re-identification is widely regarded as an image retrieval problem. Given a pedestrian-of-interest (query) image in one camera, the person re-identification system aims to identify the pictures of the same person from an image pool (gallery). Due to the differences in camera pixels, pose, illumination, occlusion, and intra-class variations across different cameras, the task of person re-identification remained challenging to the community of computer vision scientists. In this paper, we propose a multi-task network, based on a uniform partition network, which computes the identification loss and verification loss of two input images simultaneously. Given a pair of images as input, the system predicts the identities of the two input images and outputs a similarity score at the same time, to indicate whether they belong to the same identity or not. To get more fine-grained part-level features, we adopted the part-based convolutional baseline network for feature extraction of each input image and output a convolutional descriptor consisting of six local features. Our model achieved 81.19% mAP and 93.34% rank-1 accuracy on Market-1501 datasets. It also achieved 72.12% mAP and 85.59% rank-1 accuracy on DukeMTMC-reID. Comparing them with those of state-of-the-art, our model outperformed the state-of-the-art by a margin of 3.79% mAP, 1.03% rank-1, and 6.02% mAP, 3.79% rank-1 on Market-1501 and DukeMTMC-reID, respectively.

In recent years, with the development of feature extraction and metric learning of deep neural network, the performance of person re-identification (Re-ID) based on deep learning has been greatly improved. However, the vulnerability of deep neural network is also affecting the security of person Re-ID model, and the adversarial examples become a common way to attack the deep models. In this paper, we propose a targeted adversarial attack method against person Re-ID by adding imperceptible noise on the query examples for the generation of adversarial examples, so that the retrieval results of query examples returned from the model are consistently biased towards the specific pedestrian. To test the effectiveness of the proposed method, several experiments are conducted on the Market-1501 dataset, and the results show that the targeted adversarial attack method can effectively attack the retrieval results of person Re-ID model.

Person re-identification has become a very popular research topic in the computer vision community owing to its numerous applications and growing importance in visual surveillance. Person re-identification remains challenging due to occlusion, illumination and significant intra-class variations across different cameras. In this paper, we propose a multi-task network base on an improved Res2Net model that simultaneously computes the identification loss and verification loss of two pedestrian images. Given a pair of pedestrian images, the system predicts the identities of the two input images and whether they belong to the same identity. In order to obtain deeper feature information of pedestrians, we propose to use the latest Res2Net model for feature extraction of each input image. Experiments on several large-scale person re-identification benchmark datasets demonstrate the accuracy of our approach. For example, rank-1 accuracies are 83.18% (+1.38) and 93.14% (+0.84) for the DukeMTMC and Market-1501 datasets, respectively. The proposed method shows encouraging improvements compared with state-of-the-art methods.

Two-phase self-supervised pretraining for object re-identification

Current training objectives of existing person Re-IDentification (ReID) models only ensure that the loss of the model decreases on selected training batch, with no regards to the performance on samples outside the batch. It will inevitably cause the model to over-fit the data in the dominant position (e.g., head data in imbalanced class, easy samples or noisy samples). The latest resampling methods address the issue by designing specific criterion to select specific samples that trains the model generalize more on certain type of data (e.g., hard samples, tail data), which is not adaptive to the inconsistent real world ReID data distributions. Therefore, instead of simply presuming on what samples are generalizable, this paper proposes a one-for-more training objective that directly takes the generalization ability of selected samples as a loss function and learn a sampler to automatically select generalizable samples. More importantly, our proposed one-for-more based sampler can be seamlessly integrated into the ReID training framework which is able to simultaneously train ReID models and the sampler in an end-to-end fashion. The experimental results show that our method can effectively improve the ReID model training and boost the performance of ReID models.

Person re-identification (ReID) is to identify the same person across non-overlapping camera views. After a decade of development, the methods based on deep networks have achieved high performance on benchmarks and become mainstream. In applications, the features of gallery images extracted by deep learning-based methods are stored to speed up the query process and protect the sensitive information contained in the images. Unfortunately, it is demonstrated that turning the images into features cannot properly protect privacy, as these features could be reversed to the corresponding images, revealing the sensitive information they contain. Therefore, for preventing privacy leakage, recent methods learn their features against some feature reversal methods, and most conventional reversal methods focus on minimizing the difference between a reconstruction and its original image. However, there could be many reasonable reconstruction results from a single feature, and the conventional reversal methods will inevitably generate reconstruction results that lie in a different distribution from one of the original images, which cannot properly assess the private information for learning to protect and thus hamper the privacy-protected feature learning. To mitigate this problem, we enforce the reconstructions to follow the same distribution as the original images by the generative adversarial network (GAN). We operate this GAN-based feature reversal module accompanied by the conventional ReID feature extraction module and form a novel GAN-based feature privacy-protected person ReID model, which is expected to protect feature privacy so as against reversal attack and maintain ReID utility. We demonstrate that optimizing ReID model to accommodate privacy protection faces a double adversarial objective and is thus challenging. As a remedy, we design a novel two-step training and lazy update strategy that alternatively optimizes the feature extraction module and stabilizes the update process of the GAN-based feature reversal module. To evaluate the efficiency of the model in balancing its ReID utility and feature privacy protection, we introduce a novel metric called utility-reversibility ratio (URR). Compared with existing privacy-protected feature extraction models, the proposed method achieves a better balance between privacy protection and person ReID performance. Extensive experiments validate that our model can effectively protect feature privacy at a tiny accuracy cost, and validate the effectiveness of our model with the emerging diffusion model.

Person re-identification (Re-ID) has advanced significantly through the integration of deep learning techniques, with face recognition serving as a foundational component. This study presents a comprehensive analysis of state-of-the-art approaches spanning face detection, alignment, recognition, and cross-camera person Re-ID. Deep Convolutional Neural Networks (CNNs), attention mechanisms, and generative models (GANs) drive progress in robust feature extraction, occlusion handling, and domain adaptation. Landmark techniques such as DeepFace, DeepID2+, and center loss have achieved near-human face verification accuracy, while cascaded CNNs and Kalman-filter-based tracking enhance detection and temporal consistency in video surveillance. Emerging trends include transformer-based models, multi-modal biometric fusion, and edge-cloud optimization for scalable deployment. However, challenges remain in cross-domain generalization, fairness, and full-body Re-ID integration. This synthesis identifies critical research gaps and underscores the need for holistic, real-time, and ethically sound Re-ID systems capable of operating under diverse real-world conditions.

Channel-exchanged feature representations for person re-identification

Person reidentification (Re-ID) matches images of the same person captured in disjoint camera views and at different times. To obtain a reliable similarity measurement between images, manually annotating a large amount of pairwise cross-camera-view person images is deemed necessary. However, this kind of annotation is both costly and impractical for efficiently deploying a Re-ID system to a completely new scenario, a new setting of nonoverlapping camera views between which person images are to be matched. To solve this problem, we consider utilizing other existing person images captured in other scenarios to help the Re-ID system in a target (new) scenario, provided that a few samples are captured under the new scenario. More specifically, we tackle this problem by jointly learning the similarity measurements for Re-ID in different scenarios in an asymmetric way. To model the joint learning, we consider that the Re-ID models share certain component across tasks. A distinct consideration in our multitask modeling is to extract the discriminant shared component that reduces the cross-task data overlap in the shared latent space during the joint learning, so as to enhance the target inter-class separation in the shared latent space. For this purpose, we propose to maximize the cross-task data discrepancy on the shared component during asymmetric multitask learning (MTL), along with maximizing the local inter-class variation and minimizing local intra-class variation on all tasks. We call our proposed method the constrained asymmetric multitask discriminant component analysis (cAMT-DCA). We show that cAMT-DCA can be solved by a simple eigen decomposition with a closed form, getting rid of any iterative learning used in most conventional MTL analyses. The experimental results show that the proposed transfer model gains a clear improvement against the related nontransfer and general multitask person Re-ID models.

Person reidentification (Re-ID) benefits greatly from the accurate annotations of existing data sets (e.g., CUHK03 and Market-1501), which are quite expensive because each image in these data sets has to be assigned with a proper label. In this work, we ease the annotation of Re-ID by replacing the accurate annotation with inaccurate annotation, i.e., we group the images into bags in terms of time and assign a bag-level label for each bag. This greatly reduces the annotation effort and leads to the creation of a large-scale Re-ID benchmark called SYSU- 30k . The new benchmark contains 30k individuals, which is about 20 times larger than CUHK03 (1.3k individuals) and Market-1501 (1.5k individuals), and 30 times larger than ImageNet (1k categories). It sums up to 29606918 images. Learning a Re-ID model with bag-level annotation is called the weakly supervised Re-ID problem. To solve this problem, we introduce a differentiable graphical model to capture the dependencies from all images in a bag and generate a reliable pseudolabel for each person's image. The pseudolabel is further used to supervise the learning of the Re-ID model. Compared with the fully supervised Re-ID models, our method achieves state-of-the-art performance on SYSU- 30k and other data sets. The code, data set, and pretrained model will be available at https://github.com/wanggrun/SYSU-30k.

Person re-identification (Re-ID) is a critical task in video surveillance and security systems, aiming to match individuals across non-overlapping camera views. However, significant challenges arise due to variations in illumination, pose, and viewpoint. In this work, we propose a distance fusion-based approach to improve person Re-ID accuracy by effectively combining multiple feature-based distance metrics. We extract discriminative features using Local Maximal Occurrence (LOMO), Gaussian of Gaussian (GOG), and Convolutional Neural Networks (CNN). The extracted features are projected into a lower-dimensional space using Cross-view Quadratic Discriminant Analysis (XQDA), and their distances are computed and normalized using Min-Max scaling. To enhance performance, we implement two fusion strategies: Distance Fusion by Simple Sum (DFSS), an unsupervised method that aggregates normalized distances, and Distance Fusion by Logistic Regression (DFLR), a supervised approach that learns an optimal combination of distances. The proposed techniques are evaluated on four benchmark datasets: VIPeR, PRID450S, GRID, and CUHK01. Experimental results demonstrate that our fusion-based methods significantly outperform individual feature-based approaches, achieving state-of-the-art accuracy. Specifically, the fusion of CNN, LOMO, and GOG in the DFLR framework achieves the best performance across all datasets, with improvements in Rank-1 and Rank-20 accuracy. These findings highlight the effectiveness of distance fusion in improving person Re-ID performance, making it a promising approach for real-world applications.

Person re-identification is indeed a challenging visual recognition task due to the critical issues of human pose variation, human body occlusion, camera view variation, etc. To address this, most of the state-of-the-art approaches are proposed based on deep convolutional neural network (CNN), being leveraged by its strong feature learning power and classification boundary fitting capacity. Although the vital role towards person re-identification, how to build effective CNN baseline model has not been well studied yet. To answer this open question, we propose 3 good practices in this paper from the perspectives of adjusting CNN architecture and training procedure. In particular, they are adding batch normalization after the global pooling layer, executing identity categorization directly using only one fully-connected layer, and using Adam as optimizer. The extensive experiments on 3 widely-used benchmark datasets demonstrate that, our propositions essentially facilitate the CNN baseline model to achieve the state-of-the-art performance without any other high-level domain knowledge or low-level technical trick.

This study explores a simple but strong baseline for person re-identification (ReID). Person ReID with deep neural networks has progressed and achieved high performance in recent years. However, many state-of-the-art methods design complex network structures and concatenate multi-branch features. In the literature, some effective training tricks briefly appear in several papers or source codes. The present study collects and evaluates these effective training tricks in person ReID. By combining these tricks, the model achieves 94.5% rank-1 and 85.9% mean average precision on Market1501 with only using the global features of ResNet50. The performance surpasses all existing global- and part-based baselines in person ReID. We propose a novel neck structure named as batch normalization neck (BNNeck). BNNeck adds a batch normalization layer after global pooling layer to separate metric and classification losses into two different feature spaces because we observe they are inconsistent in one embedding space. Extended experiments show that BNNeck can boost the baseline, and our baseline can improve the performance of existing state-of-the-art methods. Our codes and models are available at: https://github.com/michuanhaohao/reid-strong-baseline.