Automatic group happiness intensity analysis

Abhinav Dhall, Roland GOECKE, Tom Gedeon

    Research output: Contribution to journalArticle

    40 Citations (Scopus)
    4 Downloads (Pure)

    Abstract

    The recent advancement of social media has given users a platform to socially engage and interact with a larger population. Millions of images and videos are being uploaded everyday by users on the web from different events and social gatherings. There is an increasing interest in designing systems capable of understanding human manifestations of emotional attributes and affective displays. As images and videos from social events generally contain multiple subjects, it is an essential step to study these groups of people. In this paper, we study the problem of happiness intensity analysis of a group of people in an image using facial expression analysis. A user perception study is conducted to understand various attributes, which affect a person's perception of the happiness intensity of a group. We identify the challenges in developing an automatic mood analysis system and propose three models based on the attributes in the study. An 'in the wild' image-based database is collected. To validate the methods, both quantitative and qualitative experiments are performed and applied to the problem of shot selection, event summarisation and album creation. The experiments show that the global and local attributes defined in the paper provide useful information for theme expression analysis, with results close to human perception results.
    Original languageEnglish
    Pages (from-to)13-26
    Number of pages14
    JournalIEEE Transactions on Affective Computing
    Volume6
    Issue number1
    DOIs
    Publication statusPublished - 2015

    Fingerprint

    Experiments
    Display devices

    Cite this

    Dhall, Abhinav ; GOECKE, Roland ; Gedeon, Tom. / Automatic group happiness intensity analysis. In: IEEE Transactions on Affective Computing. 2015 ; Vol. 6, No. 1. pp. 13-26.
    @article{d7cfb6ffe433468cae45b2fa73d4c0f4,
    title = "Automatic group happiness intensity analysis",
    abstract = "The recent advancement of social media has given users a platform to socially engage and interact with a larger population. Millions of images and videos are being uploaded everyday by users on the web from different events and social gatherings. There is an increasing interest in designing systems capable of understanding human manifestations of emotional attributes and affective displays. As images and videos from social events generally contain multiple subjects, it is an essential step to study these groups of people. In this paper, we study the problem of happiness intensity analysis of a group of people in an image using facial expression analysis. A user perception study is conducted to understand various attributes, which affect a person's perception of the happiness intensity of a group. We identify the challenges in developing an automatic mood analysis system and propose three models based on the attributes in the study. An 'in the wild' image-based database is collected. To validate the methods, both quantitative and qualitative experiments are performed and applied to the problem of shot selection, event summarisation and album creation. The experiments show that the global and local attributes defined in the paper provide useful information for theme expression analysis, with results close to human perception results.",
    keywords = "facial-expression-recognition, group-mood, unconstrained-conditions",
    author = "Abhinav Dhall and Roland GOECKE and Tom Gedeon",
    year = "2015",
    doi = "10.1109/TAFFC.2015.2397456",
    language = "English",
    volume = "6",
    pages = "13--26",
    journal = "IEEE Transactions on Affective Computing",
    issn = "1949-3045",
    publisher = "IEEE, Institute of Electrical and Electronics Engineers",
    number = "1",

    }

    Automatic group happiness intensity analysis. / Dhall, Abhinav; GOECKE, Roland; Gedeon, Tom.

    In: IEEE Transactions on Affective Computing, Vol. 6, No. 1, 2015, p. 13-26.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Automatic group happiness intensity analysis

    AU - Dhall, Abhinav

    AU - GOECKE, Roland

    AU - Gedeon, Tom

    PY - 2015

    Y1 - 2015

    N2 - The recent advancement of social media has given users a platform to socially engage and interact with a larger population. Millions of images and videos are being uploaded everyday by users on the web from different events and social gatherings. There is an increasing interest in designing systems capable of understanding human manifestations of emotional attributes and affective displays. As images and videos from social events generally contain multiple subjects, it is an essential step to study these groups of people. In this paper, we study the problem of happiness intensity analysis of a group of people in an image using facial expression analysis. A user perception study is conducted to understand various attributes, which affect a person's perception of the happiness intensity of a group. We identify the challenges in developing an automatic mood analysis system and propose three models based on the attributes in the study. An 'in the wild' image-based database is collected. To validate the methods, both quantitative and qualitative experiments are performed and applied to the problem of shot selection, event summarisation and album creation. The experiments show that the global and local attributes defined in the paper provide useful information for theme expression analysis, with results close to human perception results.

    AB - The recent advancement of social media has given users a platform to socially engage and interact with a larger population. Millions of images and videos are being uploaded everyday by users on the web from different events and social gatherings. There is an increasing interest in designing systems capable of understanding human manifestations of emotional attributes and affective displays. As images and videos from social events generally contain multiple subjects, it is an essential step to study these groups of people. In this paper, we study the problem of happiness intensity analysis of a group of people in an image using facial expression analysis. A user perception study is conducted to understand various attributes, which affect a person's perception of the happiness intensity of a group. We identify the challenges in developing an automatic mood analysis system and propose three models based on the attributes in the study. An 'in the wild' image-based database is collected. To validate the methods, both quantitative and qualitative experiments are performed and applied to the problem of shot selection, event summarisation and album creation. The experiments show that the global and local attributes defined in the paper provide useful information for theme expression analysis, with results close to human perception results.

    KW - facial-expression-recognition

    KW - group-mood

    KW - unconstrained-conditions

    U2 - 10.1109/TAFFC.2015.2397456

    DO - 10.1109/TAFFC.2015.2397456

    M3 - Article

    VL - 6

    SP - 13

    EP - 26

    JO - IEEE Transactions on Affective Computing

    JF - IEEE Transactions on Affective Computing

    SN - 1949-3045

    IS - 1

    ER -