Cross cultural detection of depression from nonverbal behaviour

Sharifa Alghowinem; Roland GOECKE; Jeffrey Cohn; Michael WAGNER; Gordon Parker; Michael Breakspear

doi:10.1109/FG.2015.7163113

Cross cultural detection of depression from nonverbal behaviour

Sharifa Alghowinem, Roland GOECKE, Jeffrey Cohn, Michael WAGNER, Gordon Parker, Michael Breakspear

Information Systems

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

55 Citations (Scopus)

754 Downloads (Pure)

Abstract

Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.

Original language	English
Title of host publication	11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015
Editors	Kevin Bowyer, Ales Leonardis, Jeff Cohn
Place of Publication	Slovenia
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	1-8
Number of pages	8
Volume	1
ISBN (Electronic)	9781479960262
DOIs	https://doi.org/10.1109/FG.2015.7163113
Publication status	Published - 2015
Event	11th IEEE International conference and workshop on Automatic face and gesture recognition 2015 - Ljubljana, Ljubljana, Slovenia Duration: 4 May 2015 → 8 May 2015 http://www.fg2015.org/ (Conference website)

Publication series

Name	2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Conference

Conference	11th IEEE International conference and workshop on Automatic face and gesture recognition 2015
Country/Territory	Slovenia
City	Ljubljana
Period	4/05/15 → 8/05/15
Other	The IEEE conference series on Automatic Face and Gesture Recognition is the premier international forum for research in image and video-based face, gesture, and body movement recognition. Its broad scope includes: advances in fundamental computer vision, pattern recognition and computer graphics; machine learning techniques relevant to face, gesture, and body motion; new algorithms and applications. The conference presents research that advances the state-of-the-art in these and related areas, leading to new capabilities in various application domains
Internet address	http://www.fg2015.org/ (Conference website)

Access to Document

10.1109/FG.2015.7163113Licence: Unspecified

PaperAccepted author manuscript, 508 KB

Cite this

Alghowinem, S., GOECKE, R., Cohn, J., WAGNER, M., Parker, G., & Breakspear, M. (2015). Cross cultural detection of depression from nonverbal behaviour. In K. Bowyer, A. Leonardis, & J. Cohn (Eds.), 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015 (Vol. 1, pp. 1-8). [7163113] (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2015.7163113

Alghowinem, Sharifa ; GOECKE, Roland ; Cohn, Jeffrey et al. / Cross cultural detection of depression from nonverbal behaviour. 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. editor / Kevin Bowyer ; Ales Leonardis ; Jeff Cohn. Vol. 1 Slovenia : IEEE, Institute of Electrical and Electronics Engineers, 2015. pp. 1-8 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).

@inproceedings{bafb21de58844bda82f2821dfd1a47ef,

title = "Cross cultural detection of depression from nonverbal behaviour",

abstract = "Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.",

keywords = "Depression analysis, Non-verbal behavior",

author = "Sharifa Alghowinem and Roland GOECKE and Jeffrey Cohn and Michael WAGNER and Gordon Parker and Michael Breakspear",

year = "2015",

doi = "10.1109/FG.2015.7163113",

language = "English",

volume = "1",

series = "2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

pages = "1--8",

editor = "Kevin Bowyer and Ales Leonardis and Jeff Cohn",

booktitle = "11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015",

address = "United States",

note = "11th IEEE International conference and workshop on Automatic face and gesture recognition 2015 ; Conference date: 04-05-2015 Through 08-05-2015",

url = "http://www.fg2015.org/",

}

Alghowinem, S, GOECKE, R, Cohn, J, WAGNER, M, Parker, G & Breakspear, M 2015, Cross cultural detection of depression from nonverbal behaviour. in K Bowyer, A Leonardis & J Cohn (eds), 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. vol. 1, 7163113, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015, IEEE, Institute of Electrical and Electronics Engineers, Slovenia, pp. 1-8, 11th IEEE International conference and workshop on Automatic face and gesture recognition 2015, Ljubljana, Slovenia, 4/05/15. https://doi.org/10.1109/FG.2015.7163113

Cross cultural detection of depression from nonverbal behaviour. / Alghowinem, Sharifa; GOECKE, Roland; Cohn, Jeffrey et al.
11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. ed. / Kevin Bowyer; Ales Leonardis; Jeff Cohn. Vol. 1 Slovenia: IEEE, Institute of Electrical and Electronics Engineers, 2015. p. 1-8 7163113 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

TY - GEN

T1 - Cross cultural detection of depression from nonverbal behaviour

AU - Alghowinem, Sharifa

AU - GOECKE, Roland

AU - Cohn, Jeffrey

AU - WAGNER, Michael

AU - Parker, Gordon

AU - Breakspear, Michael

PY - 2015

Y1 - 2015

N2 - Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.

AB - Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.

KW - Depression analysis

KW - Non-verbal behavior

UR - http://purl.org/au-research/grants/arc/DP130101094

U2 - 10.1109/FG.2015.7163113

DO - 10.1109/FG.2015.7163113

M3 - Conference contribution

VL - 1

T3 - 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

SP - 1

EP - 8

BT - 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015

A2 - Bowyer, Kevin

A2 - Leonardis, Ales

A2 - Cohn, Jeff

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Slovenia

T2 - 11th IEEE International conference and workshop on Automatic face and gesture recognition 2015

Y2 - 4 May 2015 through 8 May 2015

ER -

Alghowinem S, GOECKE R, Cohn J, WAGNER M, Parker G, Breakspear M. Cross cultural detection of depression from nonverbal behaviour. In Bowyer K, Leonardis A, Cohn J, editors, 11th IEEE International conference and workshop on Automatic Face and Gesture Recognition 2015. Vol. 1. Slovenia: IEEE, Institute of Electrical and Electronics Engineers. 2015. p. 1-8. 7163113. (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). doi: 10.1109/FG.2015.7163113

Cross cultural detection of depression from nonverbal behaviour

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this