Flow guided mutual attention for person re-identification

Flow guided mutual attention for person re-identification

Madhu Kiran, Amran Bhuiyan, Louis-Antoine Blais-Morin, Ismail Ben Ayed, Eric Granger

Image and Vision Computing 2021/9

Abstract : Person Re-Identification (ReID) is a challenging problem in many video analytics and surveillance applications, where a person’s identity must be associated across a distributed non-overlapping network of cameras. Video-based person ReID has recently gained much interest given the potential for capturing discriminant spatio-temporal information from video clips that is unavailable for image-based ReID. Despite recent advances, deep learning (DL) models for video ReID often fail to leverage this information to improve the robustness of feature representations. In this paper, the motion pattern of a person is explored as an additional cue for ReID. In particular, a flow-guided Mutual Attention network is proposed for fusion of bounding box and optical flow sequences over tracklets using any 2D-CNN backbone, allowing to encode temporal information along with spatial appearance information. Our Mutual Attention …