The more the merrier: Analysing the affect of a group of people in images

Abhinav DHALL; Jyoti Joshi; Karan Sikka; Roland GOECKE; Nicu Sebe

doi:10.1109/FG.2015.7163151

The more the merrier: Analysing the affect of a group of people in images

Abhinav DHALL, Jyoti Joshi, Karan Sikka, Roland GOECKE, Nicu Sebe

Information Systems

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

75 Citations (Scopus)

Abstract

The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.

Original language	English
Title of host publication	11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015)
Editors	Kevin Bowyer, Ales Leonardis, Jeff Cohn
Place of Publication	Slovenia
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	1-8
Number of pages	8
Volume	1
ISBN (Electronic)	9781479960262
ISBN (Print)	9781479960262
DOIs	https://doi.org/10.1109/FG.2015.7163151
Publication status	Published - 4 May 2015
Event	11th IEEE International conference and workshop on Automatic face and gesture recognition 2015 - Ljubljana, Ljubljana, Slovenia Duration: 4 May 2015 → 8 May 2015 http://www.fg2015.org/ (Conference website)

Publication series

Name	2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Conference

Conference	11th IEEE International conference and workshop on Automatic face and gesture recognition 2015
Country/Territory	Slovenia
City	Ljubljana
Period	4/05/15 → 8/05/15
Other	The IEEE conference series on Automatic Face and Gesture Recognition is the premier international forum for research in image and video-based face, gesture, and body movement recognition. Its broad scope includes: advances in fundamental computer vision, pattern recognition and computer graphics; machine learning techniques relevant to face, gesture, and body motion; new algorithms and applications. The conference presents research that advances the state-of-the-art in these and related areas, leading to new capabilities in various application domains
Internet address	http://www.fg2015.org/ (Conference website)

Access to Document

10.1109/FG.2015.7163151

Cite this

DHALL, A., Joshi, J., Sikka, K., GOECKE, R., & Sebe, N. (2015). The more the merrier: Analysing the affect of a group of people in images. In K. Bowyer, A. Leonardis, & J. Cohn (Eds.), 11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015) (Vol. 1, pp. 1-8). [7163151] (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2015.7163151

DHALL, Abhinav ; Joshi, Jyoti ; Sikka, Karan et al. / The more the merrier: Analysing the affect of a group of people in images. 11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015). editor / Kevin Bowyer ; Ales Leonardis ; Jeff Cohn. Vol. 1 Slovenia : IEEE, Institute of Electrical and Electronics Engineers, 2015. pp. 1-8 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).

@inproceedings{3701eda455c047b8801aa1ff1257a035,

title = "The more the merrier: Analysing the affect of a group of people in images",

abstract = "The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.",

keywords = "group affect, Affective computing, face analysis",

author = "Abhinav DHALL and Jyoti Joshi and Karan Sikka and Roland GOECKE and Nicu Sebe",

year = "2015",

month = may,

day = "4",

doi = "10.1109/FG.2015.7163151",

language = "English",

isbn = "9781479960262",

volume = "1",

series = "2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

pages = "1--8",

editor = "Kevin Bowyer and Ales Leonardis and Jeff Cohn",

booktitle = "11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015)",

address = "United States",

note = "11th IEEE International conference and workshop on Automatic face and gesture recognition 2015 ; Conference date: 04-05-2015 Through 08-05-2015",

url = "http://www.fg2015.org/",

}

DHALL, A, Joshi, J, Sikka, K, GOECKE, R & Sebe, N 2015, The more the merrier: Analysing the affect of a group of people in images. in K Bowyer, A Leonardis & J Cohn (eds), 11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015). vol. 1, 7163151, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015, IEEE, Institute of Electrical and Electronics Engineers, Slovenia, pp. 1-8, 11th IEEE International conference and workshop on Automatic face and gesture recognition 2015, Ljubljana, Slovenia, 4/05/15. https://doi.org/10.1109/FG.2015.7163151

The more the merrier: Analysing the affect of a group of people in images. / DHALL, Abhinav; Joshi, Jyoti; Sikka, Karan et al.
11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015). ed. / Kevin Bowyer; Ales Leonardis; Jeff Cohn. Vol. 1 Slovenia: IEEE, Institute of Electrical and Electronics Engineers, 2015. p. 1-8 7163151 (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015).

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

TY - GEN

T1 - The more the merrier: Analysing the affect of a group of people in images

AU - DHALL, Abhinav

AU - Joshi, Jyoti

AU - Sikka, Karan

AU - GOECKE, Roland

AU - Sebe, Nicu

PY - 2015/5/4

Y1 - 2015/5/4

N2 - The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.

AB - The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.

KW - group affect

KW - Affective computing

KW - face analysis

UR - http://ieeexplore.ieee.org/document/7163151/

UR - http://www.scopus.com/inward/record.url?scp=84944936854&partnerID=8YFLogxK

U2 - 10.1109/FG.2015.7163151

DO - 10.1109/FG.2015.7163151

M3 - Conference contribution

SN - 9781479960262

VL - 1

T3 - 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

SP - 1

EP - 8

BT - 11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015)

A2 - Bowyer, Kevin

A2 - Leonardis, Ales

A2 - Cohn, Jeff

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Slovenia

T2 - 11th IEEE International conference and workshop on Automatic face and gesture recognition 2015

Y2 - 4 May 2015 through 8 May 2015

ER -

DHALL A, Joshi J, Sikka K, GOECKE R, Sebe N. The more the merrier: Analysing the affect of a group of people in images. In Bowyer K, Leonardis A, Cohn J, editors, 11th IEE International conference and workshop on Automatic face and gesture recognition (FG 2015). Vol. 1. Slovenia: IEEE, Institute of Electrical and Electronics Engineers. 2015. p. 1-8. 7163151. (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). doi: 10.1109/FG.2015.7163151

The more the merrier: Analysing the affect of a group of people in images

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this