Can Body Expressions Contribute to Automatic Depression Analysis?

Jyoti Joshi, Roland GOECKE, Gordon Parker, Michael Breakspear

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

78 Citations (Scopus)
5 Downloads (Pure)


Depression is one of the most common mental health disorders with strong adverse effects on personal and social functioning. The absence of any objective diagnostic aid for depression leads to a range of subjective biases in initial diagnosis and ongoing monitoring. Psychologists use various visual cues in their assessment to quantify depression such as facial expressions, eye contact and head movements. This paper studies the contribution of (upper) body expressions and gestures for automatic depression analysis. A framework based on space-time interest points and bag of words is proposed for the analysis of upper body and facial movements. Salient interest points are selected using clustering. The major contribution of this paper lies in the creation of a bag of body expressions and a bag of facial dynamics for assessing the contribution of different body parts for depression analysis. Head movement analysis is performed by selecting rigid facial fiducial points and a new histogram of head movements is proposed. The experiments are performed on real-world clinical data where video clips of patients and healthy controls are recorded during interactive interview sessions. The results show the effectiveness of the proposed system to evaluate the contribution of various body parts in depression analysis.
Original languageEnglish
Title of host publicationIEEE International Conference on Automated Face and Gesture Recognition FG2013
EditorsRama Chellappa, Xilin Chen, Qiang Ji
Place of PublicationShanghai, China
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages7
ISBN (Print)9781467355452
Publication statusPublished - 2013
EventIEEE International Conference on Automated Face and Gesture Recognition FG2013 - Shanghai, Shanghai, China
Duration: 22 Apr 201326 Apr 2013


ConferenceIEEE International Conference on Automated Face and Gesture Recognition FG2013


Dive into the research topics of 'Can Body Expressions Contribute to Automatic Depression Analysis?'. Together they form a unique fingerprint.

Cite this