Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition

Arkshay Asthana, Micahel J. Jones, Tim K. Marks, Roland Goecke, Kinh H. Tieu

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

26 Citations (Scopus)


We present a novel approach to pose-invariant face recognition that handles continuous pose variations, is not database-specific, and achieves high accuracy without any manual intervention. Our method uses multidimensional Gaussian process regression to learn a nonlinear mapping function from the 2D shapes of faces at any non-frontal pose to the corresponding 2D frontal face shapes. We use this mapping to take an input image of a new face at an arbitrary pose and pose-normalize it, generating a synthetic frontal image of the face that is then used for recognition. Our fully automatic system for face recognition includes automatic methods for extracting 2D facial feature points and accurately estimating 3D head pose, and this information is used as input to the 2D pose-normalization algorithm. The current system can handle pose variation up to 45 degrees to the left or right (yaw angle) and up to 30 degrees up or down (pitch angle). The system demonstrates high accuracy in recognition experiments on the CMU-PIE, USF 3D, and Multi-PIE databases, showing excellent generalization across databases and convincingly outperforming other automatic methods.
Original languageEnglish
Title of host publicationProceedings of the British Machine Vision Conference (BMVC 2011)
EditorsJesse Hoey, Stephen McKenna, Emanuele Trucco
Place of PublicationDundee, United Kingdom
PublisherBMVA Press
Number of pages11
ISBN (Print)978190172543X
Publication statusPublished - 2011
Event22nd British Machine Vision Conference BMVC 2011 - Dundee, Dundee, United Kingdom
Duration: 29 Aug 20112 Sept 2011


Conference22nd British Machine Vision Conference BMVC 2011
Country/TerritoryUnited Kingdom


Dive into the research topics of 'Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition'. Together they form a unique fingerprint.

Cite this