CNN Depression Severity Level Estimation from Upper Body vs. Face-Only Images

Dua’a Ahmad, Roland Goecke, James Ireland

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

Abstract

Upper body gestures have proven to provide more information about a person’s depressive state when added to facial expressions. While several studies on automatic depression analysis have looked into this impact, little is known in regard to how a convolutional neural network (CNN) uses such information for predicting depression severity levels. This study investigates the performance in various CNN models when looking at facial images alone versus including the upper body when estimating depression severity levels on a regressive scale. To assess generalisability of CNN model performance, two vastly different datasets were used, one collected by the Black Dog Institute and the other being the 2013 Audio/Visual Emotion Challenge (AVEC). Results show that the differences in model performance between face versus upper body are slight, as model performance across multiple architectures is very similar but varies when different datasets are introduced.

Original languageEnglish
Title of host publicationPattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings
EditorsAlberto Del Bimbo, Rita Cucchiara, Stan Sclaroff, Giovanni Maria Farinella, Tao Mei, Marco Bertini, Hugo Jair Escalante, Roberto Vezzani
Place of PublicationNetherlands
PublisherSpringer
Pages744-758
Number of pages15
ISBN (Electronic)9783030687809
ISBN (Print)9783030687793
DOIs
Publication statusPublished - 25 Feb 2021
Event25th International Conference on Pattern Recognition Workshops, ICPR 2020 - Virtual, Online
Duration: 10 Jan 202115 Jan 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12666 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference25th International Conference on Pattern Recognition Workshops, ICPR 2020
CityVirtual, Online
Period10/01/2115/01/21

Fingerprint Dive into the research topics of 'CNN Depression Severity Level Estimation from Upper Body vs. Face-Only Images'. Together they form a unique fingerprint.

Cite this