Part-guided graph convolution networks for person re-identification

• Published in: Pattern recognition Vol. 120; p. 108155
• Main Authors: Zhang, Zhong, Zhang, Haijia, Liu, Shuang, Xie, Yuan, Durrani, Tariq S.
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01-12-2021
• Subjects: Graph convolution network; Person re-identification; Person re-identification; Graph convolution network
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2021.108155

•We propose a novel deep graph model to learn the inter-local relationship of the corresponding parts among pedestrian images and the intra-local relationship between adjacent parts to obtain discriminative features for person Re-ID.•We propose the fractional dynamic mechanism to optimize the adjacency matrix of intra-local graph for accurately describing the correlation between adjacent parts.•Extensive experiments verify that the proposed PGCN exceeds the state-of-the-art methods.
Recently, part-based deep models have achieved promising performance in person re-identification (Re-ID), yet these models ignore the inter-local relationship of the corresponding parts among pedestrian images and the intra-local relationship between adjacent parts in one pedestrian image. As a result, the feature representations are hard to learn the information from the same parts of other pedestrian images and are lack of the contextual information of pedestrian. In this paper, we propose a novel deep graph model named Part-Guided Graph Convolution Network (PGCN) for person Re-ID, which could simultaneously learn the inter-local relationship and the intra-local relationship for feature representations. Specifically, we construct the inter-local graph using the local features extracted from the same parts of pedestrian images and build the adjacency matrix using the similarity so as to mine the inter-local relationship. Meanwhile, we construct the intra-local graph using the local features extracted from different body parts in one pedestrian image, and propose the fractional dynamic mechanism (FDM) to accurately describe the correlations between adjacent parts in the optimization process. Finally, after the graph convolutional operation, the inter-local relationship and the intra-local relationship are injected into the feature representations of pedestrian images. Extensive experiments are conducted on Market-1501, CUHK03, DukeMTMC-reID and MSMT17, and the experimental results show the proposed PGCN exceeds state-of-the-art methods by an overwhelming margin.