Ascertain: Emotion and personality recognition using commercial sensors

Ramanathan Subramanian, Julia Wache, Mojtaba Khomami Abadi, Radu L. Vieriu, Stefan Winkler, Nicu Sebe

Research output: Contribution to journalArticlepeer-review

114 Citations (Scopus)

Abstract

We present ASCERTAIN-a multimodal databaASe for impliCit pERsonali Ty and Affect recognitIoN using commercial physiological sensors. To our knowledge, ASCERTAIN is the first database to connect personality traits and emotional states via physiological responses. ASCERTAIN contains big-five personality scales and emotional self-ratings of 58 users along with their Electroencephalogram (EEG), Electrocardiogram (ECG), Galvanic Skin Response (GSR) and facial activity data, recorded using off-The-shelf sensors while viewing affective movie clips. We first examine relationships between users' affective ratings and personality scales in the context of prior observations, and then study linear and non-linear physiological correlates of emotion and personality. Our analysis suggests that the emotion-personality relationship is better captured by non-linear rather than linear statistics. We finally attempt binary emotion and personality trait recognition using physiological features. Experimental results cumulatively confirm that personality differences are better revealed while comparing user responses to emotionally homogeneous videos, and above-chance recognition is achieved for both affective and personality dimensions.

Original languageEnglish
Pages (from-to)147-160
Number of pages14
JournalIEEE Transactions on Affective Computing
Volume9
Issue number2
DOIs
Publication statusPublished - Apr 2018
Externally publishedYes

Fingerprint

Dive into the research topics of 'Ascertain: Emotion and personality recognition using commercial sensors'. Together they form a unique fingerprint.

Cite this