Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews

Shalini BHATIA, Roland GOECKE, Zakia Hammal, Jeffrey F Cohn

Research output: A Conference proceeding or a Chapter in BookConference contribution

Abstract

With few exceptions, most research in automated assessment of depression has considered only the patient’s behavior to the exclusion of the therapist’s behavior. We investigated the interpersonal coordination (synchrony) of head
movement during patient-therapist clinical interviews. Our sample consisted of patients diagnosed with major depressive disorder. They were recorded in clinical interviews (Hamilton Rating Scale for Depression, HRSD) at 7-week intervals over a period of 21 weeks. For each session, patient and therapist 3D head movement was tracked from 2D videos. Head angles in the horizontal (pitch) and vertical (yaw) axes were used to measure head movement. Interpersonal coordination of head movement between patients and therapists was measured using windowed cross-correlation. Patterns of coordination in head movement were investigated using the peak picking algorithm. Changes in head movement coordination over the course of treatment were measured using a hierarchical linear model (HLM). The results indicated a strong effect for patient-therapist head movement synchrony. Within-dyad variability in head movement coordination was found to be higher than between-dyad variability, meaning that differences over time in a dyad were higher as compared to the differences between dyads. Head movement synchrony did not change over the course of treatment with change in depression severity. To the best of our knowledge, this study is the first attempt to analyze the mutual influence of patient-therapist head movement in relation to depression severity.
Original languageEnglish
Title of host publicationProceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019)
Place of PublicationDanvers, United States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages169-176
Number of pages8
ISBN (Electronic)9781728100906
ISBN (Print)9781728100890
DOIs
Publication statusPublished - 14 May 2019
Event14th IEEE International Conference on Automatic Face and Gesture Recognition - Lille, France
Duration: 14 May 201918 May 2019
http://fg2019.org/

Conference

Conference14th IEEE International Conference on Automatic Face and Gesture Recognition
Abbreviated titleFG 2019
CountryFrance
CityLille
Period14/05/1918/05/19
Internet address

Fingerprint

Head Movements
Interviews
Depression
Yaws
Major Depressive Disorder
Linear Models
Head

Cite this

BHATIA, S., GOECKE, R., Hammal, Z., & Cohn, J. F. (2019). Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews. In Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019) (pp. 169-176). Danvers, United States: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2019.8756509
BHATIA, Shalini ; GOECKE, Roland ; Hammal, Zakia ; Cohn, Jeffrey F. / Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews. Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019). Danvers, United States : IEEE, Institute of Electrical and Electronics Engineers, 2019. pp. 169-176
@inproceedings{22719a0b918b4321a3eba30a32db809c,
title = "Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews",
abstract = "With few exceptions, most research in automated assessment of depression has considered only the patient’s behavior to the exclusion of the therapist’s behavior. We investigated the interpersonal coordination (synchrony) of headmovement during patient-therapist clinical interviews. Our sample consisted of patients diagnosed with major depressive disorder. They were recorded in clinical interviews (Hamilton Rating Scale for Depression, HRSD) at 7-week intervals over a period of 21 weeks. For each session, patient and therapist 3D head movement was tracked from 2D videos. Head angles in the horizontal (pitch) and vertical (yaw) axes were used to measure head movement. Interpersonal coordination of head movement between patients and therapists was measured using windowed cross-correlation. Patterns of coordination in head movement were investigated using the peak picking algorithm. Changes in head movement coordination over the course of treatment were measured using a hierarchical linear model (HLM). The results indicated a strong effect for patient-therapist head movement synchrony. Within-dyad variability in head movement coordination was found to be higher than between-dyad variability, meaning that differences over time in a dyad were higher as compared to the differences between dyads. Head movement synchrony did not change over the course of treatment with change in depression severity. To the best of our knowledge, this study is the first attempt to analyze the mutual influence of patient-therapist head movement in relation to depression severity.",
keywords = "Depression analysis, Head movement, Dyadic interviews",
author = "Shalini BHATIA and Roland GOECKE and Zakia Hammal and Cohn, {Jeffrey F}",
year = "2019",
month = "5",
day = "14",
doi = "10.1109/FG.2019.8756509",
language = "English",
isbn = "9781728100890",
pages = "169--176",
booktitle = "Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019)",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
address = "United States",

}

BHATIA, S, GOECKE, R, Hammal, Z & Cohn, JF 2019, Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews. in Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019). IEEE, Institute of Electrical and Electronics Engineers, Danvers, United States, pp. 169-176, 14th IEEE International Conference on Automatic Face and Gesture Recognition, Lille, France, 14/05/19. https://doi.org/10.1109/FG.2019.8756509

Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews. / BHATIA, Shalini; GOECKE, Roland; Hammal, Zakia; Cohn, Jeffrey F.

Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019). Danvers, United States : IEEE, Institute of Electrical and Electronics Engineers, 2019. p. 169-176.

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews

AU - BHATIA, Shalini

AU - GOECKE, Roland

AU - Hammal, Zakia

AU - Cohn, Jeffrey F

PY - 2019/5/14

Y1 - 2019/5/14

N2 - With few exceptions, most research in automated assessment of depression has considered only the patient’s behavior to the exclusion of the therapist’s behavior. We investigated the interpersonal coordination (synchrony) of headmovement during patient-therapist clinical interviews. Our sample consisted of patients diagnosed with major depressive disorder. They were recorded in clinical interviews (Hamilton Rating Scale for Depression, HRSD) at 7-week intervals over a period of 21 weeks. For each session, patient and therapist 3D head movement was tracked from 2D videos. Head angles in the horizontal (pitch) and vertical (yaw) axes were used to measure head movement. Interpersonal coordination of head movement between patients and therapists was measured using windowed cross-correlation. Patterns of coordination in head movement were investigated using the peak picking algorithm. Changes in head movement coordination over the course of treatment were measured using a hierarchical linear model (HLM). The results indicated a strong effect for patient-therapist head movement synchrony. Within-dyad variability in head movement coordination was found to be higher than between-dyad variability, meaning that differences over time in a dyad were higher as compared to the differences between dyads. Head movement synchrony did not change over the course of treatment with change in depression severity. To the best of our knowledge, this study is the first attempt to analyze the mutual influence of patient-therapist head movement in relation to depression severity.

AB - With few exceptions, most research in automated assessment of depression has considered only the patient’s behavior to the exclusion of the therapist’s behavior. We investigated the interpersonal coordination (synchrony) of headmovement during patient-therapist clinical interviews. Our sample consisted of patients diagnosed with major depressive disorder. They were recorded in clinical interviews (Hamilton Rating Scale for Depression, HRSD) at 7-week intervals over a period of 21 weeks. For each session, patient and therapist 3D head movement was tracked from 2D videos. Head angles in the horizontal (pitch) and vertical (yaw) axes were used to measure head movement. Interpersonal coordination of head movement between patients and therapists was measured using windowed cross-correlation. Patterns of coordination in head movement were investigated using the peak picking algorithm. Changes in head movement coordination over the course of treatment were measured using a hierarchical linear model (HLM). The results indicated a strong effect for patient-therapist head movement synchrony. Within-dyad variability in head movement coordination was found to be higher than between-dyad variability, meaning that differences over time in a dyad were higher as compared to the differences between dyads. Head movement synchrony did not change over the course of treatment with change in depression severity. To the best of our knowledge, this study is the first attempt to analyze the mutual influence of patient-therapist head movement in relation to depression severity.

KW - Depression analysis

KW - Head movement

KW - Dyadic interviews

U2 - 10.1109/FG.2019.8756509

DO - 10.1109/FG.2019.8756509

M3 - Conference contribution

SN - 9781728100890

SP - 169

EP - 176

BT - Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019)

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Danvers, United States

ER -

BHATIA S, GOECKE R, Hammal Z, Cohn JF. Automated Measurement of Head Movement Synchrony during Dyadic Depression Severity Interviews. In Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019). Danvers, United States: IEEE, Institute of Electrical and Electronics Engineers. 2019. p. 169-176 https://doi.org/10.1109/FG.2019.8756509