Can Body Expressions Contribute to Automatic Depression Analysis?

Jyoti Joshi, Roland GOECKE, Gordon Parker, Michael Breakspear

Research output: A Conference proceeding or a Chapter in BookConference contribution

38 Citations (Scopus)
5 Downloads (Pure)

Abstract

Depression is one of the most common mental health disorders with strong adverse effects on personal and social functioning. The absence of any objective diagnostic aid for depression leads to a range of subjective biases in initial diagnosis and ongoing monitoring. Psychologists use various visual cues in their assessment to quantify depression such as facial expressions, eye contact and head movements. This paper studies the contribution of (upper) body expressions and gestures for automatic depression analysis. A framework based on space-time interest points and bag of words is proposed for the analysis of upper body and facial movements. Salient interest points are selected using clustering. The major contribution of this paper lies in the creation of a bag of body expressions and a bag of facial dynamics for assessing the contribution of different body parts for depression analysis. Head movement analysis is performed by selecting rigid facial fiducial points and a new histogram of head movements is proposed. The experiments are performed on real-world clinical data where video clips of patients and healthy controls are recorded during interactive interview sessions. The results show the effectiveness of the proposed system to evaluate the contribution of various body parts in depression analysis.
Original languageEnglish
Title of host publicationIEEE International Conference on Automated Face and Gesture Recognition FG2013
EditorsRama Chellappa, Xilin Chen, Qiang Ji
Place of PublicationShanghai, China
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-7
Number of pages7
Volume1
ISBN (Print)9781467355452
DOIs
Publication statusPublished - 2013
EventIEEE International Conference on Automated Face and Gesture Recognition FG2013 - Shanghai, Shanghai, China
Duration: 22 Apr 201326 Apr 2013

Conference

ConferenceIEEE International Conference on Automated Face and Gesture Recognition FG2013
CountryChina
CityShanghai
Period22/04/1326/04/13

    Fingerprint

Cite this

Joshi, J., GOECKE, R., Parker, G., & Breakspear, M. (2013). Can Body Expressions Contribute to Automatic Depression Analysis? In R. Chellappa, X. Chen, & Q. Ji (Eds.), IEEE International Conference on Automated Face and Gesture Recognition FG2013 (Vol. 1, pp. 1-7). Shanghai, China: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2013.6553796