Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification

Girija Chetty, Michael Wagner

Research output: A Conference proceeding or a Chapter in BookConference contribution

Abstract

In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.

Original languageEnglish
Title of host publicationMMUI '05: Proceedings of the 2005 NICTA
Subtitle of host publicationHCSNet Multimodal User Interaction Workshop - Volume 57
EditorsFang Chen, Julien Epps
Place of PublicationAustralia
PublisherAustralian Computer Society
Pages17-24
Number of pages8
Volume57
ISBN (Print)1920682392
Publication statusPublished - 1 Apr 2006
EventMMUI2005 - Sydney, Australia
Duration: 13 Sep 200514 Sep 2005

Conference

ConferenceMMUI2005
CountryAustralia
CitySydney
Period13/09/0514/09/05

Fingerprint

Biometrics
Authentication
Fusion reactions
Textures
Lighting

Cite this

Chetty, G., & Wagner, M. (2006). Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification. In F. Chen, & J. Epps (Eds.), MMUI '05: Proceedings of the 2005 NICTA: HCSNet Multimodal User Interaction Workshop - Volume 57 (Vol. 57, pp. 17-24). Australia: Australian Computer Society.
Chetty, Girija ; Wagner, Michael. / Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification. MMUI '05: Proceedings of the 2005 NICTA: HCSNet Multimodal User Interaction Workshop - Volume 57. editor / Fang Chen ; Julien Epps. Vol. 57 Australia : Australian Computer Society, 2006. pp. 17-24
@inproceedings{3d852538a2974ed5875f56801e3d875e,
title = "Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification",
abstract = "In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.",
author = "Girija Chetty and Michael Wagner",
year = "2006",
month = "4",
day = "1",
language = "English",
isbn = "1920682392",
volume = "57",
pages = "17--24",
editor = "Fang Chen and Julien Epps",
booktitle = "MMUI '05: Proceedings of the 2005 NICTA",
publisher = "Australian Computer Society",
address = "Australia",

}

Chetty, G & Wagner, M 2006, Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification. in F Chen & J Epps (eds), MMUI '05: Proceedings of the 2005 NICTA: HCSNet Multimodal User Interaction Workshop - Volume 57. vol. 57, Australian Computer Society, Australia, pp. 17-24, MMUI2005, Sydney, Australia, 13/09/05.

Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification. / Chetty, Girija; Wagner, Michael.

MMUI '05: Proceedings of the 2005 NICTA: HCSNet Multimodal User Interaction Workshop - Volume 57. ed. / Fang Chen; Julien Epps. Vol. 57 Australia : Australian Computer Society, 2006. p. 17-24.

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification

AU - Chetty, Girija

AU - Wagner, Michael

PY - 2006/4/1

Y1 - 2006/4/1

N2 - In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.

AB - In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.

M3 - Conference contribution

SN - 1920682392

VL - 57

SP - 17

EP - 24

BT - MMUI '05: Proceedings of the 2005 NICTA

A2 - Chen, Fang

A2 - Epps, Julien

PB - Australian Computer Society

CY - Australia

ER -

Chetty G, Wagner M. Audio-Visual Multimodal Fusion for Biometric Person Authentication and Liveness Verification. In Chen F, Epps J, editors, MMUI '05: Proceedings of the 2005 NICTA: HCSNet Multimodal User Interaction Workshop - Volume 57. Vol. 57. Australia: Australian Computer Society. 2006. p. 17-24