GAZEDA- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings

K. L.Bhanu Moorthy, Moneish Kumar, Ramanathan Subramanian, Vineet Gandhi

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review

2 Citations (Scopus)

Abstract

We present GAZEDA- eye GAZe-guided EDiting for videos captured by a solitary, static, wide-angle and high-resolution camera. Eye-gaze has been effectively employed in computational applications as a cue to capture interesting scene content; we employ gaze as a proxy to select shots for inclusion in the edited video. Given the original video, scene content and user eye-gaze tracks are combined to generate an edited video comprising cinematically valid actor shots and shot transitions to generate an aesthetic and vivid representation of the original narrative. We model cinematic video editing as an energy minimization problem over shot selection, whose constraints capture cinematographic editing conventions. Gazed scene locations primarily determine the shots constituting the edited video. Effectiveness of GAZED against multiple competing methods is demonstrated via a psychophysical study involving 12 users and twelve performance videos.

Original languageEnglish
Title of host publicationCHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
EditorsRegina Bernhaupt, Florian Mueller, David Verweij, Josh Andres, Joanna McGrenere
Place of PublicationUnited States
PublisherAssociation for Computing Machinery (ACM)
Pages1-11
Number of pages11
ISBN (Electronic)9781450367080
DOIs
Publication statusPublished - 21 Apr 2020
Externally publishedYes
Event2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 - Honolulu, United States
Duration: 25 Apr 202030 Apr 2020

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020
CountryUnited States
CityHonolulu
Period25/04/2030/04/20

Fingerprint

Dive into the research topics of 'GAZEDA- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings'. Together they form a unique fingerprint.

Cite this