Cross cultural detection of depression from nonverbal behaviour

Sharifa Alghowinem, Roland GOECKE, Jeffrey Cohn, Michael WAGNER, Gordon Parker, Michael Breakspear

Research output: A Conference proceeding or a Chapter in BookConference contribution

12 Citations (Scopus)
3 Downloads (Pure)

Abstract

Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.
Original languageEnglish
Title of host publication11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015
EditorsKevin Bowyer, Ales Leonardis, Jeff Cohn
Place of PublicationSlovenia
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-8
Number of pages8
Volume1
ISBN (Electronic)9781479960262
DOIs
Publication statusPublished - 2015
Event11th IEEE International conference and workshop on Automatic face and gesture recognition 2015 - Ljubljana, Ljubljana, Slovenia
Duration: 4 May 20158 May 2015
http://www.fg2015.org/ (Conference website)

Publication series

Name2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Conference

Conference11th IEEE International conference and workshop on Automatic face and gesture recognition 2015
CountrySlovenia
CityLjubljana
Period4/05/158/05/15
OtherThe IEEE conference series on Automatic Face and Gesture Recognition is the premier international forum for research in image and video-based face, gesture, and body movement recognition. Its broad scope includes: advances in fundamental computer vision, pattern recognition and computer graphics; machine learning techniques relevant to face, gesture, and body motion; new algorithms and applications. The conference presents research that advances the state-of-the-art in these and related areas, leading to new capabilities in various application domains
Internet address

Fingerprint

Interviews
Germany
Healthy Volunteers
Head
Datasets

Cite this

Alghowinem, S., GOECKE, R., Cohn, J., WAGNER, M., Parker, G., & Breakspear, M. (2015). Cross cultural detection of depression from nonverbal behaviour. In K. Bowyer, A. Leonardis, & J. Cohn (Eds.), 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015 (Vol. 1, pp. 1-8). [7163113] (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). Slovenia: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2015.7163113
Alghowinem, Sharifa ; GOECKE, Roland ; Cohn, Jeffrey ; WAGNER, Michael ; Parker, Gordon ; Breakspear, Michael. / Cross cultural detection of depression from nonverbal behaviour. 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. editor / Kevin Bowyer ; Ales Leonardis ; Jeff Cohn. Vol. 1 Slovenia : IEEE, Institute of Electrical and Electronics Engineers, 2015. pp. 1-8 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).
@inproceedings{bafb21de58844bda82f2821dfd1a47ef,
title = "Cross cultural detection of depression from nonverbal behaviour",
abstract = "Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.",
keywords = "Depression analysis, Non-verbal behavior",
author = "Sharifa Alghowinem and Roland GOECKE and Jeffrey Cohn and Michael WAGNER and Gordon Parker and Michael Breakspear",
year = "2015",
doi = "10.1109/FG.2015.7163113",
language = "English",
volume = "1",
series = "2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
pages = "1--8",
editor = "Kevin Bowyer and Ales Leonardis and Jeff Cohn",
booktitle = "11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015",
address = "United States",

}

Alghowinem, S, GOECKE, R, Cohn, J, WAGNER, M, Parker, G & Breakspear, M 2015, Cross cultural detection of depression from nonverbal behaviour. in K Bowyer, A Leonardis & J Cohn (eds), 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. vol. 1, 7163113, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015, IEEE, Institute of Electrical and Electronics Engineers, Slovenia, pp. 1-8, 11th IEEE International conference and workshop on Automatic face and gesture recognition 2015, Ljubljana, Slovenia, 4/05/15. https://doi.org/10.1109/FG.2015.7163113

Cross cultural detection of depression from nonverbal behaviour. / Alghowinem, Sharifa; GOECKE, Roland; Cohn, Jeffrey; WAGNER, Michael; Parker, Gordon; Breakspear, Michael.

11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. ed. / Kevin Bowyer; Ales Leonardis; Jeff Cohn. Vol. 1 Slovenia : IEEE, Institute of Electrical and Electronics Engineers, 2015. p. 1-8 7163113 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Cross cultural detection of depression from nonverbal behaviour

AU - Alghowinem, Sharifa

AU - GOECKE, Roland

AU - Cohn, Jeffrey

AU - WAGNER, Michael

AU - Parker, Gordon

AU - Breakspear, Michael

PY - 2015

Y1 - 2015

N2 - Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.

AB - Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.

KW - Depression analysis

KW - Non-verbal behavior

UR - http://purl.org/au-research/grants/arc/DP130101094

U2 - 10.1109/FG.2015.7163113

DO - 10.1109/FG.2015.7163113

M3 - Conference contribution

VL - 1

T3 - 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

SP - 1

EP - 8

BT - 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015

A2 - Bowyer, Kevin

A2 - Leonardis, Ales

A2 - Cohn, Jeff

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Slovenia

ER -

Alghowinem S, GOECKE R, Cohn J, WAGNER M, Parker G, Breakspear M. Cross cultural detection of depression from nonverbal behaviour. In Bowyer K, Leonardis A, Cohn J, editors, 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. Vol. 1. Slovenia: IEEE, Institute of Electrical and Electronics Engineers. 2015. p. 1-8. 7163113. (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). https://doi.org/10.1109/FG.2015.7163113