Robust video face recognition from a single still using a synthetic plus variational model
Robust video face recognition from a single still using a synthetic plus variational model
Mokhayeri, Fania and Granger, Eric
Proceedings – 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 2019
Abstract : Sparse representation-based classification (SRC) techniques have been shown to achieve a high level of performance in video-based face recognition (FR). However, matching faces captured in uncontrolled video conditions against a gallery with a single reference facial still per individual typically yields low accuracy. To improve robustness to intra-class variations, SRC techniques for FR have recently been extended to incorporate variational information from an external generic set into an auxiliary variational dictionary. Despite their success in handling linear variations, probe facial images with non-linear variations due to e.g., changes in pose and expressions, cannot be accurately reconstructed with a linear combination of images from gallery and auxiliary dictionaries because they do not share the same type of variations. In this paper, a new synthetic plus variational model is proposed to account for the non-linearities, particularly with pose variations. It reconstructs a probe image using (1) an auxiliary variational dictionary and (2) an augmented gallery dictionary enriched with a set of synthetic images generated from the reference faces with a wide diversity of pose angles. By solving a newly formulated simultaneous sparsity-based optimization problem, the augmented gallery dictionary is encouraged to share the same sparsity pattern with the variational dictionary for the same pose angles. In this way, each synthetic face in the augmented dictionary is combined with similar facial viewpoint in the variational dictionary. Experimental results obtained on Chokepoint and COX-S2V datasets, using different face representations, indicate that the proposed approach can outperform state-of-the-art SRC-based methods for still-to-video FR with a SSPP.
