Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication

Girija Chetty, Michael Wagner

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    9 Citations (Scopus)

    Abstract

    In this paper we propose a feature level fusion approach for checking liveness in face-voice person authentication. Liveness verification experiments conducted on two audiovisual databases, VidTIMIT and UCBN, show that feature-level fusion is indeed a powerful technique for checking liveness in systems that are vulnerable to replay attacks, as it preserves synchronisation between closely coupled modalities, such as voice and face, through various stages of authentication. An improvement in error rate of the order of 25-40% is achieved for replay attack experiments by using feature level fusion of acoustic and visual feature vectors from lip region as compared to classical late fusion approach.
    Original languageEnglish
    Title of host publicationProceedings of the Eighth International Symposium on Signal Processing and Applications
    Place of PublicationPiscataway, New Jersey, USA
    PublisherIEEE, Institute of Electrical and Electronics Engineers
    Pages66-69
    Number of pages4
    ISBN (Print)0-7803-9244-2
    DOIs
    Publication statusPublished - 2005
    EventISSPA-2005 - Sydney, Australia
    Duration: 28 Aug 200531 Aug 2005

    Conference

    ConferenceISSPA-2005
    CountryAustralia
    CitySydney
    Period28/08/0531/08/05

    Fingerprint

    Authentication
    Fusion reactions
    Synchronization
    Acoustics
    Experiments

    Cite this

    Chetty, G., & Wagner, M. (2005). Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication. In Proceedings of the Eighth International Symposium on Signal Processing and Applications (pp. 66-69). Piscataway, New Jersey, USA: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ISSPA.2005.1580197
    Chetty, Girija ; Wagner, Michael. / Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication. Proceedings of the Eighth International Symposium on Signal Processing and Applications. Piscataway, New Jersey, USA : IEEE, Institute of Electrical and Electronics Engineers, 2005. pp. 66-69
    @inproceedings{8336f93ced604b388f80ae94da03a5c2,
    title = "Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication",
    abstract = "In this paper we propose a feature level fusion approach for checking liveness in face-voice person authentication. Liveness verification experiments conducted on two audiovisual databases, VidTIMIT and UCBN, show that feature-level fusion is indeed a powerful technique for checking liveness in systems that are vulnerable to replay attacks, as it preserves synchronisation between closely coupled modalities, such as voice and face, through various stages of authentication. An improvement in error rate of the order of 25-40{\%} is achieved for replay attack experiments by using feature level fusion of acoustic and visual feature vectors from lip region as compared to classical late fusion approach.",
    author = "Girija Chetty and Michael Wagner",
    year = "2005",
    doi = "10.1109/ISSPA.2005.1580197",
    language = "English",
    isbn = "0-7803-9244-2",
    pages = "66--69",
    booktitle = "Proceedings of the Eighth International Symposium on Signal Processing and Applications",
    publisher = "IEEE, Institute of Electrical and Electronics Engineers",
    address = "United States",

    }

    Chetty, G & Wagner, M 2005, Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication. in Proceedings of the Eighth International Symposium on Signal Processing and Applications. IEEE, Institute of Electrical and Electronics Engineers, Piscataway, New Jersey, USA, pp. 66-69, ISSPA-2005, Sydney, Australia, 28/08/05. https://doi.org/10.1109/ISSPA.2005.1580197

    Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication. / Chetty, Girija; Wagner, Michael.

    Proceedings of the Eighth International Symposium on Signal Processing and Applications. Piscataway, New Jersey, USA : IEEE, Institute of Electrical and Electronics Engineers, 2005. p. 66-69.

    Research output: A Conference proceeding or a Chapter in BookConference contribution

    TY - GEN

    T1 - Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication

    AU - Chetty, Girija

    AU - Wagner, Michael

    PY - 2005

    Y1 - 2005

    N2 - In this paper we propose a feature level fusion approach for checking liveness in face-voice person authentication. Liveness verification experiments conducted on two audiovisual databases, VidTIMIT and UCBN, show that feature-level fusion is indeed a powerful technique for checking liveness in systems that are vulnerable to replay attacks, as it preserves synchronisation between closely coupled modalities, such as voice and face, through various stages of authentication. An improvement in error rate of the order of 25-40% is achieved for replay attack experiments by using feature level fusion of acoustic and visual feature vectors from lip region as compared to classical late fusion approach.

    AB - In this paper we propose a feature level fusion approach for checking liveness in face-voice person authentication. Liveness verification experiments conducted on two audiovisual databases, VidTIMIT and UCBN, show that feature-level fusion is indeed a powerful technique for checking liveness in systems that are vulnerable to replay attacks, as it preserves synchronisation between closely coupled modalities, such as voice and face, through various stages of authentication. An improvement in error rate of the order of 25-40% is achieved for replay attack experiments by using feature level fusion of acoustic and visual feature vectors from lip region as compared to classical late fusion approach.

    U2 - 10.1109/ISSPA.2005.1580197

    DO - 10.1109/ISSPA.2005.1580197

    M3 - Conference contribution

    SN - 0-7803-9244-2

    SP - 66

    EP - 69

    BT - Proceedings of the Eighth International Symposium on Signal Processing and Applications

    PB - IEEE, Institute of Electrical and Electronics Engineers

    CY - Piscataway, New Jersey, USA

    ER -

    Chetty G, Wagner M. Investigating Feature Level Fusion for Checking Liveness in Face-Voice Authentication. In Proceedings of the Eighth International Symposium on Signal Processing and Applications. Piscataway, New Jersey, USA: IEEE, Institute of Electrical and Electronics Engineers. 2005. p. 66-69 https://doi.org/10.1109/ISSPA.2005.1580197