Person Re-Identification With Reinforced Attribute Attention Selection.

Two-phase self-supervised pretraining for object re-identification

Abstract. Person Re-Identification (Re-ID) is the task of matching the same person in multiple images captured by different cameras. Recently deep learning-based Re-ID algorithms demonstrated an exciting progress for terrestrial-based cameras, still, person Re-ID in aerial images poses multiple challenges including occlusion of human feature parts, image distortion, and dynamic camera location. In this paper, we propose a new Person Aerial Re-ID framework Robust to Occlusion and Thermal imagery (ParrotGAN). Our model is focused on cross-modality person Re-ID in aerial images. Furthermore, we collected a new large-scale synthetic multimodal AerialReID dataset with 30k images and 137 person ID. Our ParrotGAN model leverages two strategies to achieve robust performance in the task of person Re-ID in thermal and visible range. Firstly, we use a latent space of StyleGAN2 model to estimate the distance between two images of a person. Specifically, we project each real image into the latent space with a correspondent latent vector z. We use the distance between latent vectors to provide a Re-ID similarity metric. Secondly, we use a generative-adversarial network to translate a color image to a synthetic thermal image. We use synthetic image for a cross-modality Re-ID. We evaluate our ParrotGAN model and basleines on our AerialReID and PRAI-1581 datasets. The results of the evaluation are encouraging and demonstrate that our ParrotGAN model competes with baselines in visible range aerial person Re-ID and outperforms them in the cross-modality setting. We made our code and dataset publicly available.

Prevalent nighttime person re-identification (ReID) methods typically combine image relighting and ReID networks in a sequential manner. However, their performance (recognition accuracy) is limited by the quality of relighting images and insufficient collaboration between image relighting and ReID tasks. To handle these problems, we propose a novel Collaborative Enhancement Network called CENet, which performs the multilevel feature interactions in a parallel framework, for nighttime person ReID. In particular, the designed parallel structure of CENet can not only avoid the impact of the quality of relighting images on ReID performance, but also allow us to mine the collaborative relations between image relighting and person ReID tasks. To this end, we integrate the multilevel feature interactions in CENet, where we first share the Transformer encoder to build the low-level feature interaction, and then perform the feature distillation that transfers the high-level features from image relighting to ReID, thereby alleviating the severe image degradation issue caused by the nighttime scenario while avoiding the impact of relighting images. In addition, the sizes of existing real-world nighttime person ReID datasets are limited, and large-scale synthetic ones exhibit substantial domain gaps with real-world data. To leverage both small-scale real-world and large-scale synthetic training data, we develop a multi-domain learning algorithm, which alternately utilizes both kinds of data to reduce the inter-domain difference in training procedure. Extensive experiments on two real nighttime datasets, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Night600</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">RGBNT201_rgb</i> , and a synthetic nighttime ReID dataset are conducted to validate the effectiveness of CENet. We release the code and synthetic dataset at: https://github.com/Alexadlu/CENet.

While person Re-identification (Re-ID) has progressed rapidly due to its wide real-world applications, it also causes severe risks of leaking personal information from training data. Thus, this paper focuses on quantifying this risk by membership inference (MI) attack. Most of the existing MI attack algorithms focus on classification models, while Re-ID follows a totally different training and inference paradigm. Re-ID is a fine-grained recognition task with complex feature embedding, and model outputs commonly used by existing MI like logits and losses are not accessible during inference. Since Re-ID focuses on modelling the relative relationship between image pairs instead of individual semantics, we conduct a formal and empirical analysis which validates that the distribution shift of the inter-sample similarity between training and test set is a critical criterion for Re-ID membership inference. As a result, we propose a novel membership inference attack method based on the inter-sample similarity distribution. Specifically, a set of anchor images are sampled to represent the similarity distribution conditioned on a target image, and a neural network with a novel anchor selection module is proposed to predict the membership of the target image. Our experiments validate the effectiveness of the proposed approach on both the Re-ID task and conventional classification task.

PA-Net: Learning local features using by pose attention for short-term person re-identification

Fully-automated person re-identification in multi-camera surveillance system with a robust kernel descriptor and effective shadow removal method

A review on video person re-identification based on deep learning

The fine-grained attribute descriptions can significantly supplement the valuable semantic information for person image, which is vital to the success of person re-identification (ReID) task. However, current ReID algorithms typically failed to effectively leverage the rich contextual information available, primarily due to their reliance on simplistic and coarse utilization of image attributes. Recent advances in artificial intelligence generated content have made it possible to automatically generate plentiful fine-grained attribute descriptions and make full use of them. Thereby, this paper explores the potential of using the generated multiple person attributes as prompts in ReID tasks with off-the-shelf (large) models for more accurate retrieval results. To this end, we present a new framework called Multi-Prompts ReID (MP-ReID), based on prompt learning and language models, to fully dip fine attributes to assist ReID task. Specifically, MP-ReID first learns to hallucinate diverse, informative, and promptable sentences for describing the query images. This procedure includes (i) explicit prompts of which attributes a person has and furthermore (ii) implicit learnable prompts for adjusting/conditioning the criteria used towards this person identity matching. Explicit prompts are obtained by ensembling generation models, such as ChatGPT and VQA models. Moreover, an alignment module is designed to fuse multi-prompts (i.e., explicit and implicit ones) progressively and mitigate the cross-modal gap. Extensive experiments on the existing attribute-involved ReID datasets, namely, Market1501 and DukeMTMC-reID, demonstrate the effectiveness and rationality of the proposed MP-ReID solution.

Person re-identification (ReID) is a critical work in the field of intelligent image processing and deep learning, which has attracted the attention of industry application. Person ReID focuses on matching person images obtained from non-overlapping camera views and finding the person-of-interest. An important unresolved problem is to obtain efficient metric for measuring the similarity among pedestrian images. Lately, deep learning with metric learning has become a general method for person ReID. Yet, previous methods mainly used a variety of distance to measure the similarity among samples. The way of distance measure is more sensitive when the scale changes. In this paper, we propose angular loss with hard sample mining (ALHSM) to learn better similarity metric for the person ReID. Our work uses the angular relationship in triangles as a measure of similarity, minimizing the angle at the negative point of the triangle. ALHSM combines with hard negative mining strategies, which learn better similarity metric and achieve advanced performance on several benchmark datasets. The experimental results show that our work is competitive compared to the state-of-the-art.

Person re-identification (Re-ID) has advanced significantly through the integration of deep learning techniques, with face recognition serving as a foundational component. This study presents a comprehensive analysis of state-of-the-art approaches spanning face detection, alignment, recognition, and cross-camera person Re-ID. Deep Convolutional Neural Networks (CNNs), attention mechanisms, and generative models (GANs) drive progress in robust feature extraction, occlusion handling, and domain adaptation. Landmark techniques such as DeepFace, DeepID2+, and center loss have achieved near-human face verification accuracy, while cascaded CNNs and Kalman-filter-based tracking enhance detection and temporal consistency in video surveillance. Emerging trends include transformer-based models, multi-modal biometric fusion, and edge-cloud optimization for scalable deployment. However, challenges remain in cross-domain generalization, fairness, and full-body Re-ID integration. This synthesis identifies critical research gaps and underscores the need for holistic, real-time, and ethically sound Re-ID systems capable of operating under diverse real-world conditions.

Compact feature representation of person image is important for person re-identification (Re-ID) task. Recently, part-based representation models have been widely studied for extracting the more compact and robust feature representation for person image to improve person Re-ID results. However, existing part-based representation models mostly extract the features of different parts independently which ignore the spatial relationship information among different parts. To address this issue, in this paper we propose a novel deep learning framework, named Part-based Hierarchical Graph Convolutional Network (PH-GCN) for person Re-ID problem. Given a person image, PH-GCN first constructs a hierarchical graph to represent the spatial relationships among different parts. Then, both local and global feature learning is achieved by the feature information passing in PH-GCN, which takes the information of other parts into account for part feature representation. Finally, a perceptron layer is adopted for the final person part label prediction and re-identification. The proposed framework provides a general solution that integrates <i>local</i>, <i>global</i> and <i>structural</i> feature learning simultaneously in a unified end-to-end network representation and learning. Extensive experiments on several widely used benchmark datasets demonstrate the effectiveness and benefits of the proposed PH-GCN approach for person Re-ID task.

Triplet interactive attention network for cross-modality person re-identification

Person re-identification (Re-ID) aims to retrieve a person of interest across multiple nonoverlapping cameras. In the last few years, the construction of aerial person Re-ID datasets has been appealing because visual surveillance through unmanned aerial vehicle (UAV) platforms has become very valuable in real-world scenarios. However, great differences are exhibited between the pedestrian images captured by ground cameras and those captured by UAVs. Person Re-ID methods based on ground person images have difficulty when performing Re-ID based on aerial person images. In this paper, we first propose a novel meta-transfer learning method for person Re-ID in aerial imagery; this approach trains a generalisable Re-ID model to learn discriminative feature representations for aerial person images. Specifically, a meta-learning strategy is introduced to study a feature extractor, and a transfer learning strategy is introduced to utilise and further improve the acquired meta-knowledge. To overcome the convergence speed and recognition accuracy reductions caused by the presence of difficult categories in the given dataset, we propose a learning strategy based on curriculum sampling that is harmonised with our meta-transfer learning framework. In addition, a new metric formulation of sample similarity is introduced based on Mahalanobis distance to improve the optimisation of the model. Extensive comparative evaluation experiments are conducted on the large-scale aerial Re-ID dataset, and the results obtained show that our method achieves a Rank-1 accuracy of 63.63 $$\%$$ and a mean average precision (mAP) of 38.02 $$\%$$ , demonstrating its potential for completing person Re-ID in aerial images. Ablation studies also validate that each component contributes to improving the performance of the model.

Person re-identification (Re-ID) aims to match pedestrian images cross multiple cameras. Most Re-ID studies focus on visible pedestrian images, without considering the images obtained by infrared cameras in the dark. To solve the cross-modality person Re-ID problem, current methods usually exploit global feature descriptors to obtain discriminative representations. However, they ignore the fine-grained information of heterogeneous images. In this paper, we propose an adaptive body partition (ABP) model to automatically detect and distinguish effective part representations. Instead of utilizing a two-stream convolutional neural network (CNN) to extract modality-specific information, we directly design an end-to-end one-stream CNN to simultaneously learn multi-modality sharable features and map them on a common space. Global loss, part losses and threefold triplet loss are integrated to enhance the feature discriminability and minimize the cross-modality gap. Extensive experimental results on two cross-modality Re-ID datasets exhibit the superiority of the proposed method compared with the state-of-the-art solutions.

Person re-identification (Re-ID) is a critical task in video surveillance and security systems, aiming to match individuals across non-overlapping camera views. However, significant challenges arise due to variations in illumination, pose, and viewpoint. In this work, we propose a distance fusion-based approach to improve person Re-ID accuracy by effectively combining multiple feature-based distance metrics. We extract discriminative features using Local Maximal Occurrence (LOMO), Gaussian of Gaussian (GOG), and Convolutional Neural Networks (CNN). The extracted features are projected into a lower-dimensional space using Cross-view Quadratic Discriminant Analysis (XQDA), and their distances are computed and normalized using Min-Max scaling. To enhance performance, we implement two fusion strategies: Distance Fusion by Simple Sum (DFSS), an unsupervised method that aggregates normalized distances, and Distance Fusion by Logistic Regression (DFLR), a supervised approach that learns an optimal combination of distances. The proposed techniques are evaluated on four benchmark datasets: VIPeR, PRID450S, GRID, and CUHK01. Experimental results demonstrate that our fusion-based methods significantly outperform individual feature-based approaches, achieving state-of-the-art accuracy. Specifically, the fusion of CNN, LOMO, and GOG in the DFLR framework achieves the best performance across all datasets, with improvements in Rank-1 and Rank-20 accuracy. These findings highlight the effectiveness of distance fusion in improving person Re-ID performance, making it a promising approach for real-world applications.