EmotiW 2016: Video and Group-Level Emotion Recognition Challenges

Abhinav Dhall, Roland GOECKE, Jyoti Joshi, Jesse Hoey, Tamas Gedeon

Research output: A Conference proceeding or a Chapter in BookConference contribution

71 Citations (Scopus)
3 Downloads (Pure)

Abstract

This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition `in the wild', the EmotiW challenge 2016 consists of two sub-challenges: an audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based sub-challenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.
Original languageEnglish
Title of host publicationICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction
EditorsYukiko I. Nakano, Elisabeth André, Toyoaki Nishida, Louis-Philippe Morency, Carlos Busso, Catherine Pelachaud
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages427-432
Number of pages6
Volume1
ISBN (Print)9781420345569
DOIs
Publication statusPublished - 2016
Event18th ACM International Conference on Multimodal Interaction - Tokyo, Tokyo, Japan
Duration: 12 Nov 201616 Nov 2016
https://icmi.acm.org/2016/ (Conference details)

Publication series

NameICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

Conference

Conference18th ACM International Conference on Multimodal Interaction
CountryJapan
CityTokyo
Period12/11/1616/11/16
OtherThe preparations have started for the organization of the next International Conference on Multimodal Interaction, ICMI 2016. ICMI is the premier international forum for multidisciplinary research on multimodal human-human and human-computer interaction, interfaces, and system development. The conference focuses on theoretical and empirical foundations, component technologies, and combined multimodal processing techniques that define the field of multimodal interaction analysis, interface design, and system development.ICMI 2016 will feature a single-track main conference which includes: keynote speakers, technical full and short papers (including oral and poster presentations), special sessions, demonstrations, exhibits and doctoral spotlight papers. The conference will also feature workshops and grand challenges
Internet address

Cite this

Dhall, A., GOECKE, R., Joshi, J., Hoey, J., & Gedeon, T. (2016). EmotiW 2016: Video and Group-Level Emotion Recognition Challenges. In Y. I. Nakano, E. André, T. Nishida, L-P. Morency, C. Busso, & C. Pelachaud (Eds.), ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction (Vol. 1, pp. 427-432). (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction). New York: Association for Computing Machinery (ACM). https://doi.org/10.1145/2993148.2997638
Dhall, Abhinav ; GOECKE, Roland ; Joshi, Jyoti ; Hoey, Jesse ; Gedeon, Tamas. / EmotiW 2016: Video and Group-Level Emotion Recognition Challenges. ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. editor / Yukiko I. Nakano ; Elisabeth André ; Toyoaki Nishida ; Louis-Philippe Morency ; Carlos Busso ; Catherine Pelachaud. Vol. 1 New York : Association for Computing Machinery (ACM), 2016. pp. 427-432 (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction).
@inproceedings{648fb83193294e21b8354b4bd2d07420,
title = "EmotiW 2016: Video and Group-Level Emotion Recognition Challenges",
abstract = "This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition `in the wild', the EmotiW challenge 2016 consists of two sub-challenges: an audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based sub-challenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.",
keywords = "audio-video-data-corpus, emotion-recognition, group-level-emotion-recognition, facial-expression-challenge, affect-analysis-in-the-wild",
author = "Abhinav Dhall and Roland GOECKE and Jyoti Joshi and Jesse Hoey and Tamas Gedeon",
year = "2016",
doi = "10.1145/2993148.2997638",
language = "English",
isbn = "9781420345569",
volume = "1",
series = "ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction",
publisher = "Association for Computing Machinery (ACM)",
pages = "427--432",
editor = "Nakano, {Yukiko I.} and Elisabeth Andr{\'e} and Toyoaki Nishida and Louis-Philippe Morency and Carlos Busso and Catherine Pelachaud",
booktitle = "ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction",
address = "United States",

}

Dhall, A, GOECKE, R, Joshi, J, Hoey, J & Gedeon, T 2016, EmotiW 2016: Video and Group-Level Emotion Recognition Challenges. in YI Nakano, E André, T Nishida, L-P Morency, C Busso & C Pelachaud (eds), ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. vol. 1, ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction, Association for Computing Machinery (ACM), New York, pp. 427-432, 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan, 12/11/16. https://doi.org/10.1145/2993148.2997638

EmotiW 2016: Video and Group-Level Emotion Recognition Challenges. / Dhall, Abhinav; GOECKE, Roland; Joshi, Jyoti; Hoey, Jesse; Gedeon, Tamas.

ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. ed. / Yukiko I. Nakano; Elisabeth André; Toyoaki Nishida; Louis-Philippe Morency; Carlos Busso; Catherine Pelachaud. Vol. 1 New York : Association for Computing Machinery (ACM), 2016. p. 427-432 (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction).

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - EmotiW 2016: Video and Group-Level Emotion Recognition Challenges

AU - Dhall, Abhinav

AU - GOECKE, Roland

AU - Joshi, Jyoti

AU - Hoey, Jesse

AU - Gedeon, Tamas

PY - 2016

Y1 - 2016

N2 - This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition `in the wild', the EmotiW challenge 2016 consists of two sub-challenges: an audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based sub-challenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

AB - This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition `in the wild', the EmotiW challenge 2016 consists of two sub-challenges: an audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based sub-challenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

KW - audio-video-data-corpus

KW - emotion-recognition

KW - group-level-emotion-recognition

KW - facial-expression-challenge

KW - affect-analysis-in-the-wild

UR - http://www.scopus.com/inward/record.url?scp=85016619930&partnerID=8YFLogxK

U2 - 10.1145/2993148.2997638

DO - 10.1145/2993148.2997638

M3 - Conference contribution

SN - 9781420345569

VL - 1

T3 - ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

SP - 427

EP - 432

BT - ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

A2 - Nakano, Yukiko I.

A2 - André, Elisabeth

A2 - Nishida, Toyoaki

A2 - Morency, Louis-Philippe

A2 - Busso, Carlos

A2 - Pelachaud, Catherine

PB - Association for Computing Machinery (ACM)

CY - New York

ER -

Dhall A, GOECKE R, Joshi J, Hoey J, Gedeon T. EmotiW 2016: Video and Group-Level Emotion Recognition Challenges. In Nakano YI, André E, Nishida T, Morency L-P, Busso C, Pelachaud C, editors, ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. Vol. 1. New York: Association for Computing Machinery (ACM). 2016. p. 427-432. (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction). https://doi.org/10.1145/2993148.2997638