Uncovering interactions and interactors: Joint estimation of head, body orientation and f-formations from surveillance videos

Elisa Ricci, Jagannadan Varadarajan, Ramanathan Subramanian, Samuel Rota Bulo, Narendra Ahuja, Oswald Lanz

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

29 Citations (Scopus)

Abstract

We present a novel approach for jointly estimating targets' head, body orientations and conversational groups called F-formations from a distant social scene (e.g., a cocktail party captured by surveillance cameras). Differing from related works that have (i) coupled head and body pose learning by exploiting the limited range of orientations that the two can jointly take, or (ii) determined F-formations based on the mutual head (but not body) orientations of interactors, we present a unified framework to jointly infer both (i) and (ii). Apart from exploiting spatial and orientation relationships, we also integrate cues pertaining to temporal consistency and occlusions, which are beneficial while handling low-resolution data under surveillance settings. Efficacy of the joint inference framework reflects via increased head, body pose and F-formation estimation accuracy over the state-of-the-art, as confirmed by extensive experiments on two social datasets.

Original languageEnglish
Title of host publication2015 International Conference on Computer Vision, ICCV 2015
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages4660-4668
Number of pages9
ISBN (Electronic)9781467383912
DOIs
Publication statusPublished - 17 Feb 2015
Externally publishedYes
Event15th IEEE International Conference on Computer Vision, ICCV 2015 - Santiago, Chile
Duration: 11 Dec 201518 Dec 2015

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
Volume2015 International Conference on Computer Vision, ICCV 2015
ISSN (Print)1550-5499

Conference

Conference15th IEEE International Conference on Computer Vision, ICCV 2015
CountryChile
CitySantiago
Period11/12/1518/12/15

Fingerprint Dive into the research topics of 'Uncovering interactions and interactors: Joint estimation of head, body orientation and f-formations from surveillance videos'. Together they form a unique fingerprint.

Cite this