Clustering of video-patches on Grassmannian manifold for facial expression recognition from 3D videos

Munawar Hayat, Mohammed Bennamoun, Amar El-Sallam

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

12 Citations (Scopus)
1 Downloads (Pure)


This paper presents a fully automatic system which exploits the dynamics of 3D videos and is capable of recognizing six basic facial expressions. Local video-patches of variable lengths are extracted from different locations of the training videos and represented as points on the Grass-mannian manifold. An efficient spectral clustering based algorithm is used to separately cluster points for each of the six expression classes. The resulting cluster centers are matched with the points of a test video and a voting based strategy is used to decide about the expression class of the test video. The proposed system is tested on the largest publicly available 3D video database, BU4DFE. The experimental results show that the system achieves a very high classification accuracy and outperforms the current state of the art algorithms for facial expression recognition from 3D videos
Original languageEnglish
Title of host publicationApplications of Computer Vision, 2013 IEEE Workshop on
EditorsSudeep Sarkar, Michael Brown
Place of PublicationUSA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781467350549
ISBN (Print)9781467350532
Publication statusPublished - 2013
Externally publishedYes
EventApplications on Computer Vision (WACV) 2013 IEEE Workshop on - Tampa, Tampa, United States
Duration: 15 Jan 201317 Jan 2013


ConferenceApplications on Computer Vision (WACV) 2013 IEEE Workshop on
Country/TerritoryUnited States

Cite this