Audiovisual Speaker Identity Verification Based on Lip Motion Features

Girija Chetty; Michael Wagner

Audiovisual Speaker Identity Verification Based on Lip Motion Features

Girija Chetty, Michael Wagner

Information Systems

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

47 Downloads (Pure)

Abstract

In this paper, we propose the fusion of audio and explicit lip motion features for speaker identity verification applications. Experimental results using GMM-based speaker models indicate that audiovisual fusion with explicit lip motion information provides significant performance improvement for verifying both the speaker identity and the liveness, due to tracking of the closely coupled acoustic labial dynamics. Experiments performed on different gender specific subsets of data from the VidTIMIT and UCBN databases under clean and noisy conditions show that the best performance of 7%– 11% EER is achieved for the speaker verification task and 4%–8% EER for the liveness verification scenario.

Original language	English
Title of host publication	Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007)
Editors	Ronald Bock, Francesca Bonin, Nick Campbell, Ronald Poppe
Place of Publication	Germany
Publisher	International Speech Communication Association
Pages	2045-2048
Number of pages	4
ISBN (Print)	9781605603162
Publication status	Published - 2007
Event	Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association - Antwerp, Belgium Duration: 27 Aug 2007 → 31 Aug 2007

Conference

Conference	Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association
Country/Territory	Belgium
City	Antwerp
Period	27/08/07 → 31/08/07

Access to Document

PaperFinal published version, 234 KB

Cite this

Chetty, Girija ; Wagner, Michael. / Audiovisual Speaker Identity Verification Based on Lip Motion Features. Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007). editor / Ronald Bock ; Francesca Bonin ; Nick Campbell ; Ronald Poppe. Germany : International Speech Communication Association, 2007. pp. 2045-2048

@inproceedings{ae2ca21143ba4a3798095e80dda0125e,

title = "Audiovisual Speaker Identity Verification Based on Lip Motion Features",

abstract = "In this paper, we propose the fusion of audio and explicit lip motion features for speaker identity verification applications. Experimental results using GMM-based speaker models indicate that audiovisual fusion with explicit lip motion information provides significant performance improvement for verifying both the speaker identity and the liveness, due to tracking of the closely coupled acoustic labial dynamics. Experiments performed on different gender specific subsets of data from the VidTIMIT and UCBN databases under clean and noisy conditions show that the best performance of 7%– 11% EER is achieved for the speaker verification task and 4%–8% EER for the liveness verification scenario.",

author = "Girija Chetty and Michael Wagner",

year = "2007",

language = "English",

isbn = "9781605603162",

pages = "2045--2048",

editor = "Ronald Bock and Francesca Bonin and Nick Campbell and Ronald Poppe",

booktitle = "Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007)",

publisher = "International Speech Communication Association",

note = "Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association ; Conference date: 27-08-2007 Through 31-08-2007",

}

Chetty, G & Wagner, M 2007, Audiovisual Speaker Identity Verification Based on Lip Motion Features. in R Bock, F Bonin, N Campbell & R Poppe (eds), Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007). International Speech Communication Association, Germany, pp. 2045-2048, Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association, Antwerp, Belgium, 27/08/07.

Audiovisual Speaker Identity Verification Based on Lip Motion Features. / Chetty, Girija; Wagner, Michael.
Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007). ed. / Ronald Bock; Francesca Bonin; Nick Campbell; Ronald Poppe. Germany: International Speech Communication Association, 2007. p. 2045-2048.

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

TY - GEN

T1 - Audiovisual Speaker Identity Verification Based on Lip Motion Features

AU - Chetty, Girija

AU - Wagner, Michael

PY - 2007

Y1 - 2007

N2 - In this paper, we propose the fusion of audio and explicit lip motion features for speaker identity verification applications. Experimental results using GMM-based speaker models indicate that audiovisual fusion with explicit lip motion information provides significant performance improvement for verifying both the speaker identity and the liveness, due to tracking of the closely coupled acoustic labial dynamics. Experiments performed on different gender specific subsets of data from the VidTIMIT and UCBN databases under clean and noisy conditions show that the best performance of 7%– 11% EER is achieved for the speaker verification task and 4%–8% EER for the liveness verification scenario.

AB - In this paper, we propose the fusion of audio and explicit lip motion features for speaker identity verification applications. Experimental results using GMM-based speaker models indicate that audiovisual fusion with explicit lip motion information provides significant performance improvement for verifying both the speaker identity and the liveness, due to tracking of the closely coupled acoustic labial dynamics. Experiments performed on different gender specific subsets of data from the VidTIMIT and UCBN databases under clean and noisy conditions show that the best performance of 7%– 11% EER is achieved for the speaker verification task and 4%–8% EER for the liveness verification scenario.

M3 - Conference contribution

SN - 9781605603162

SP - 2045

EP - 2048

BT - Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007)

A2 - Bock, Ronald

A2 - Bonin, Francesca

A2 - Campbell, Nick

A2 - Poppe, Ronald

PB - International Speech Communication Association

CY - Germany

T2 - Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association

Y2 - 27 August 2007 through 31 August 2007

ER -

Audiovisual Speaker Identity Verification Based on Lip Motion Features

Abstract

Conference

Access to Document

Fingerprint

Cite this