On the relationship between head pose, social attention and personality prediction for unstructured and dynamic group interactions

Ramanathan Subramanian, Yan Yan, Jacopo Staiano, Oswald Lanz, Nicu Sebe

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

48 Citations (Scopus)

Abstract

Correlates between social attention and personality traits have been widely acknowledged in social psychology studies. Head pose has commonly been employed as a proxy for determining the social attention direction in small group interactions. However, the impact of head pose estimation errors on personality estimates has not been studied to our knowledge. In this work, we consider the unstructured and dynamic cocktail party scenario where the scene is captured by multiple, large field-of-view cameras. Head pose estimation is a challenging task under these conditions owing to the uninhibited motion of persons (due to which facial appearance varies owing to perspective and scale changes), and the low resolution of captured faces. Based on proxemic and social attention features computed from position and head pose annotations, we first demonstrate that social attention features are excellent predictors of the Extraversion and Neuroticism personality traits. We then repeat classification experiments with behavioral features computed from automated estimates - obtained experimental results show that while prediction performance for both traits is affected by head pose estimation errors, the impact is more adverse for Extraversion.

Original languageEnglish
Title of host publicationICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction
EditorsJulien Epps, Fang Cheng, Sharon Oviatt, Kenji Mase, Andrew Sears, Kristiina Jokinen, Bjorn Schuller
Place of PublicationUnited States
PublisherAssociation for Computing Machinery (ACM)
Pages3-10
Number of pages8
ISBN (Print)9781450321297
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013 - Sydney, NSW, Australia
Duration: 9 Dec 201313 Dec 2013

Publication series

NameICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction

Conference

Conference2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013
Country/TerritoryAustralia
CitySydney, NSW
Period9/12/1313/12/13

Fingerprint

Dive into the research topics of 'On the relationship between head pose, social attention and personality prediction for unstructured and dynamic group interactions'. Together they form a unique fingerprint.

Cite this