Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification

Girija Chetty, Michael Wagner

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review


In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.

Original languageEnglish
Title of host publicationMMUI '05: Proceedings of the 2005 NICTA
Subtitle of host publicationHCSNet Multimodal User Interaction Workshop - Volume 57
EditorsFang Chen, Julien Epps
Place of PublicationAustralia
PublisherAustralian Computer Society
Number of pages8
ISBN (Print)1920682392
Publication statusPublished - 1 Apr 2006
EventMMUI2005 - Sydney, Australia
Duration: 13 Sept 200514 Sept 2005




Dive into the research topics of 'Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification'. Together they form a unique fingerprint.

Cite this