Exploring eye activity as an indication of emotional states using an eye-tracking sensor

Sharifa Alghowinem, Majdah Alshehri, Roland GOECKE, Michael WAGNER

Research output: A Conference proceeding or a Chapter in BookConference contribution

17 Citations (Scopus)

Abstract

The automatic detection of human emotional states has been of great interest lately for its applications not only in the Human-Computer Interaction field, but also for its applications in psychological studies. Using an emotion elicitation paradigm, we investigate whether eye activity holds discriminative power for detecting affective states. Our emotion elicitation paradigm includes induced emotions by watching emotional movie clips and spontaneous emotions elicited by interviewing participants about emotional events in their life. To reduce gender variability, the selected participants were 60 female native Arabic speakers (30 young adults, and 30 mature adults). In general, the automatic classification results using eye activity were reasonable, giving 66% correct recognition rate on average. Statistical measures show statistically significant differences in eye activity patterns between positive and negative emotions. We conclude that eye activity, including eye movement, pupil dilation and pupil invisibility could be used as a complementary cues for the automatic recognition of human emotional states.
Original languageEnglish
Title of host publicationIntelligent Systems for Science and Information
Subtitle of host publicationExtended and Selected Results from the Science and Information Conference 2013
EditorsLiming Chen, Supriya Kapoor, Rahul Bhatia
Place of PublicationGermany
PublisherSpringer
Pages261-276
Number of pages16
Volume542
ISBN (Print)9783319047010
DOIs
Publication statusPublished - 2014
EventIntelligent Systems for Science and Information 2014 - London, London, United Kingdom
Duration: 27 Aug 201429 Aug 2014

Publication series

NameStudies in Computational Intelligence
Volume542
ISSN (Print)1860-949X

Conference

ConferenceIntelligent Systems for Science and Information 2014
CountryUnited Kingdom
CityLondon
Period27/08/1429/08/14

Fingerprint

Emotions
Pupil
Motion Pictures
Eye Movements
Surgical Instruments
Cues
Dilatation
Young Adult
Psychology
Recognition (Psychology)

Cite this

Alghowinem, S., Alshehri, M., GOECKE, R., & WAGNER, M. (2014). Exploring eye activity as an indication of emotional states using an eye-tracking sensor. In L. Chen, S. Kapoor, & R. Bhatia (Eds.), Intelligent Systems for Science and Information: Extended and Selected Results from the Science and Information Conference 2013 (Vol. 542, pp. 261-276). (Studies in Computational Intelligence; Vol. 542). Germany: Springer. https://doi.org/10.1007/978-3-319-04702-7_15
Alghowinem, Sharifa ; Alshehri, Majdah ; GOECKE, Roland ; WAGNER, Michael. / Exploring eye activity as an indication of emotional states using an eye-tracking sensor. Intelligent Systems for Science and Information: Extended and Selected Results from the Science and Information Conference 2013. editor / Liming Chen ; Supriya Kapoor ; Rahul Bhatia. Vol. 542 Germany : Springer, 2014. pp. 261-276 (Studies in Computational Intelligence).
@inproceedings{8d37aaa6d6834678ad26881960ba5593,
title = "Exploring eye activity as an indication of emotional states using an eye-tracking sensor",
abstract = "The automatic detection of human emotional states has been of great interest lately for its applications not only in the Human-Computer Interaction field, but also for its applications in psychological studies. Using an emotion elicitation paradigm, we investigate whether eye activity holds discriminative power for detecting affective states. Our emotion elicitation paradigm includes induced emotions by watching emotional movie clips and spontaneous emotions elicited by interviewing participants about emotional events in their life. To reduce gender variability, the selected participants were 60 female native Arabic speakers (30 young adults, and 30 mature adults). In general, the automatic classification results using eye activity were reasonable, giving 66{\%} correct recognition rate on average. Statistical measures show statistically significant differences in eye activity patterns between positive and negative emotions. We conclude that eye activity, including eye movement, pupil dilation and pupil invisibility could be used as a complementary cues for the automatic recognition of human emotional states.",
keywords = "Emotion Recognition, Eye Tracking",
author = "Sharifa Alghowinem and Majdah Alshehri and Roland GOECKE and Michael WAGNER",
year = "2014",
doi = "10.1007/978-3-319-04702-7_15",
language = "English",
isbn = "9783319047010",
volume = "542",
series = "Studies in Computational Intelligence",
publisher = "Springer",
pages = "261--276",
editor = "Liming Chen and Supriya Kapoor and Rahul Bhatia",
booktitle = "Intelligent Systems for Science and Information",
address = "Netherlands",

}

Alghowinem, S, Alshehri, M, GOECKE, R & WAGNER, M 2014, Exploring eye activity as an indication of emotional states using an eye-tracking sensor. in L Chen, S Kapoor & R Bhatia (eds), Intelligent Systems for Science and Information: Extended and Selected Results from the Science and Information Conference 2013. vol. 542, Studies in Computational Intelligence, vol. 542, Springer, Germany, pp. 261-276, Intelligent Systems for Science and Information 2014, London, United Kingdom, 27/08/14. https://doi.org/10.1007/978-3-319-04702-7_15

Exploring eye activity as an indication of emotional states using an eye-tracking sensor. / Alghowinem, Sharifa; Alshehri, Majdah; GOECKE, Roland; WAGNER, Michael.

Intelligent Systems for Science and Information: Extended and Selected Results from the Science and Information Conference 2013. ed. / Liming Chen; Supriya Kapoor; Rahul Bhatia. Vol. 542 Germany : Springer, 2014. p. 261-276 (Studies in Computational Intelligence; Vol. 542).

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Exploring eye activity as an indication of emotional states using an eye-tracking sensor

AU - Alghowinem, Sharifa

AU - Alshehri, Majdah

AU - GOECKE, Roland

AU - WAGNER, Michael

PY - 2014

Y1 - 2014

N2 - The automatic detection of human emotional states has been of great interest lately for its applications not only in the Human-Computer Interaction field, but also for its applications in psychological studies. Using an emotion elicitation paradigm, we investigate whether eye activity holds discriminative power for detecting affective states. Our emotion elicitation paradigm includes induced emotions by watching emotional movie clips and spontaneous emotions elicited by interviewing participants about emotional events in their life. To reduce gender variability, the selected participants were 60 female native Arabic speakers (30 young adults, and 30 mature adults). In general, the automatic classification results using eye activity were reasonable, giving 66% correct recognition rate on average. Statistical measures show statistically significant differences in eye activity patterns between positive and negative emotions. We conclude that eye activity, including eye movement, pupil dilation and pupil invisibility could be used as a complementary cues for the automatic recognition of human emotional states.

AB - The automatic detection of human emotional states has been of great interest lately for its applications not only in the Human-Computer Interaction field, but also for its applications in psychological studies. Using an emotion elicitation paradigm, we investigate whether eye activity holds discriminative power for detecting affective states. Our emotion elicitation paradigm includes induced emotions by watching emotional movie clips and spontaneous emotions elicited by interviewing participants about emotional events in their life. To reduce gender variability, the selected participants were 60 female native Arabic speakers (30 young adults, and 30 mature adults). In general, the automatic classification results using eye activity were reasonable, giving 66% correct recognition rate on average. Statistical measures show statistically significant differences in eye activity patterns between positive and negative emotions. We conclude that eye activity, including eye movement, pupil dilation and pupil invisibility could be used as a complementary cues for the automatic recognition of human emotional states.

KW - Emotion Recognition

KW - Eye Tracking

UR - http://www.scopus.com/inward/record.url?scp=84958553761&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-04702-7_15

DO - 10.1007/978-3-319-04702-7_15

M3 - Conference contribution

SN - 9783319047010

VL - 542

T3 - Studies in Computational Intelligence

SP - 261

EP - 276

BT - Intelligent Systems for Science and Information

A2 - Chen, Liming

A2 - Kapoor, Supriya

A2 - Bhatia, Rahul

PB - Springer

CY - Germany

ER -

Alghowinem S, Alshehri M, GOECKE R, WAGNER M. Exploring eye activity as an indication of emotional states using an eye-tracking sensor. In Chen L, Kapoor S, Bhatia R, editors, Intelligent Systems for Science and Information: Extended and Selected Results from the Science and Information Conference 2013. Vol. 542. Germany: Springer. 2014. p. 261-276. (Studies in Computational Intelligence). https://doi.org/10.1007/978-3-319-04702-7_15