Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition

Arkshay Asthana, Micahel J. Jones, Tim K. Marks, Roland Goecke, Kinh H. Tieu

Research output: A Conference proceeding or a Chapter in BookConference contribution

25 Citations (Scopus)

Abstract

We present a novel approach to pose-invariant face recognition that handles continuous pose variations, is not database-specific, and achieves high accuracy without any manual intervention. Our method uses multidimensional Gaussian process regression to learn a nonlinear mapping function from the 2D shapes of faces at any non-frontal pose to the corresponding 2D frontal face shapes. We use this mapping to take an input image of a new face at an arbitrary pose and pose-normalize it, generating a synthetic frontal image of the face that is then used for recognition. Our fully automatic system for face recognition includes automatic methods for extracting 2D facial feature points and accurately estimating 3D head pose, and this information is used as input to the 2D pose-normalization algorithm. The current system can handle pose variation up to 45 degrees to the left or right (yaw angle) and up to 30 degrees up or down (pitch angle). The system demonstrates high accuracy in recognition experiments on the CMU-PIE, USF 3D, and Multi-PIE databases, showing excellent generalization across databases and convincingly outperforming other automatic methods.
Original languageEnglish
Title of host publicationProceedings of the British Machine Vision Conference (BMVC 2011)
EditorsJesse Hoey, Stephen McKenna, Emanuele Trucco
Place of PublicationDundee, United Kingdom
PublisherBMVA Press
Pages1-11
Number of pages11
ISBN (Print)978190172543X
DOIs
Publication statusPublished - 2011
Event22nd British Machine Vision Conference BMVC 2011 - Dundee, Dundee, United Kingdom
Duration: 29 Aug 20112 Sep 2011

Conference

Conference22nd British Machine Vision Conference BMVC 2011
CountryUnited Kingdom
CityDundee
Period29/08/112/09/11

Fingerprint Dive into the research topics of 'Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition'. Together they form a unique fingerprint.

  • Cite this

    Asthana, A., Jones, M. J., Marks, T. K., Goecke, R., & Tieu, K. H. (2011). Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition. In J. Hoey, S. McKenna, & E. Trucco (Eds.), Proceedings of the British Machine Vision Conference (BMVC 2011) (pp. 1-11). BMVA Press. https://doi.org/10.5244/C.25.127