Hierarchical Gaussian Descriptors with Application to Person Re-Identification

Tetsu Matsukawa, Takahiro Okabe, Einoshin Suzuki, Yoichi Sato

Research output: Contribution to journalArticlepeer-review

Abstract

Describing the color and textural information of a person image is one of the most crucial aspects of person re-identification (re-id). Although a covariance descriptor has been successfully applied to person re-id, it loses the local structure of a region and mean information of pixel features, both of which tend to be the major discriminative information for person re-id. In this paper, we present novel meta-descriptors based on a hierarchical Gaussian distribution of pixel features, in which both mean and covariance information are included in patch and region level descriptions. More specifically, the region is modeled as a set of multiple Gaussian distributions, each of which represents the appearance of a local patch. The characteristics of the set of Gaussian distributions are again described by another Gaussian distribution. Because the space of Gaussian distribution is not a linear space, we embed the parameters of the distribution into a point of Symmetric Positive Definite (SPD) matrix manifold in both steps. We show, for the first time, that normalizing the scale of the SPD matrix enhances the hierarchical feature representation on this manifold. Additionally, we develop feature norm normalization methods with the ability to alleviate the biased trends that exist on the SPD matrix descriptors. The experimental results conducted on five public datasets indicate the effectiveness of the proposed descriptors and the two types of normalizations.

Original languageEnglish
Article number8705270
Pages (from-to)2179-2194
Number of pages16
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume42
Issue number9
DOIs
Publication statusPublished - Sep 1 2020

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Hierarchical Gaussian Descriptors with Application to Person Re-Identification'. Together they form a unique fingerprint.

Cite this