Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators

Girija CHETTY, Matthew White

Research output: A Conference proceeding or a Chapter in BookConference contribution

Abstract

Embodied Conversational Agents (ECA) and Interactive Virtual Humans (IVH) based on 3D Virtual and Augmented reality technologies can be immensely beneficial for human to human communications and interpersonal skills training for a range of skills including sales pitching, negotiation, leadership, interviewing, and communicating with empathy and cultural sensitivities. They provide an opportunity to practice the skills needed for communicating with humans in difficult environments, with virtual simulated scenarios. And these complex environments can include health care contexts, sales, retail and customer service contexts, or communication with people with different cultural and ethnic backgrounds. At HCT research Centre at University of Canberra, we have been investigating several new technology frameworks and algorithmic techniques for building ECAs and IVHs based on integrating Artificial Intelligence (AI), deep machine learning, cloud computing, 3D virtual and augmented reality
technologies, as training simulators for different application contexts. In this paper, we present the details in terms of the research, technology and implementation for modelling different persona for ECAs and IVHs. A multilevel
architecture with adaptable functional modules based on the customized persona for different virtual environments, their implementation using an integrated cloud based software platform and its evaluation is discussed.
Original languageEnglish
Title of host publicationProceedings of 2019 Audio Visual Speech Processing Conference (AVSP)
Place of PublicationMelbourne, Australia
PublisherInternational Speech Communication Association
Pages1-5
Number of pages5
Publication statusPublished - 2019
EventAVSP 2019 - International Conference on Auditory-Visual Speech Processing - Melbourne, Melourne, Australia
Duration: 10 Aug 201911 Aug 2019
https://avsp2019.loria.fr/

Conference

ConferenceAVSP 2019 - International Conference on Auditory-Visual Speech Processing
Abbreviated titleAVSP 2019
CountryAustralia
CityMelourne
Period10/08/1911/08/19
Internet address

Fingerprint

Simulators
Virtual reality
Sales
Augmented reality
Communication
Cloud computing
Health care
Artificial intelligence
Learning systems

Cite this

CHETTY, G., & White, M. (2019). Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators. In Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP) (pp. 1-5). Melbourne, Australia: International Speech Communication Association.
CHETTY, Girija ; White, Matthew. / Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators. Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP). Melbourne, Australia : International Speech Communication Association, 2019. pp. 1-5
@inproceedings{62eedc6d2d074e699bb7cd586c1d8f15,
title = "Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators",
abstract = "Embodied Conversational Agents (ECA) and Interactive Virtual Humans (IVH) based on 3D Virtual and Augmented reality technologies can be immensely beneficial for human to human communications and interpersonal skills training for a range of skills including sales pitching, negotiation, leadership, interviewing, and communicating with empathy and cultural sensitivities. They provide an opportunity to practice the skills needed for communicating with humans in difficult environments, with virtual simulated scenarios. And these complex environments can include health care contexts, sales, retail and customer service contexts, or communication with people with different cultural and ethnic backgrounds. At HCT research Centre at University of Canberra, we have been investigating several new technology frameworks and algorithmic techniques for building ECAs and IVHs based on integrating Artificial Intelligence (AI), deep machine learning, cloud computing, 3D virtual and augmented realitytechnologies, as training simulators for different application contexts. In this paper, we present the details in terms of the research, technology and implementation for modelling different persona for ECAs and IVHs. A multilevelarchitecture with adaptable functional modules based on the customized persona for different virtual environments, their implementation using an integrated cloud based software platform and its evaluation is discussed.",
keywords = "Embodied interaction, Virtual simulation, Multimodal Technologies",
author = "Girija CHETTY and Matthew White",
year = "2019",
language = "English",
pages = "1--5",
booktitle = "Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP)",
publisher = "International Speech Communication Association",

}

CHETTY, G & White, M 2019, Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators. in Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP). International Speech Communication Association, Melbourne, Australia, pp. 1-5, AVSP 2019 - International Conference on Auditory-Visual Speech Processing , Melourne, Australia, 10/08/19.

Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators. / CHETTY, Girija; White, Matthew.

Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP). Melbourne, Australia : International Speech Communication Association, 2019. p. 1-5.

Research output: A Conference proceeding or a Chapter in BookConference contribution

TY - GEN

T1 - Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators

AU - CHETTY, Girija

AU - White, Matthew

PY - 2019

Y1 - 2019

N2 - Embodied Conversational Agents (ECA) and Interactive Virtual Humans (IVH) based on 3D Virtual and Augmented reality technologies can be immensely beneficial for human to human communications and interpersonal skills training for a range of skills including sales pitching, negotiation, leadership, interviewing, and communicating with empathy and cultural sensitivities. They provide an opportunity to practice the skills needed for communicating with humans in difficult environments, with virtual simulated scenarios. And these complex environments can include health care contexts, sales, retail and customer service contexts, or communication with people with different cultural and ethnic backgrounds. At HCT research Centre at University of Canberra, we have been investigating several new technology frameworks and algorithmic techniques for building ECAs and IVHs based on integrating Artificial Intelligence (AI), deep machine learning, cloud computing, 3D virtual and augmented realitytechnologies, as training simulators for different application contexts. In this paper, we present the details in terms of the research, technology and implementation for modelling different persona for ECAs and IVHs. A multilevelarchitecture with adaptable functional modules based on the customized persona for different virtual environments, their implementation using an integrated cloud based software platform and its evaluation is discussed.

AB - Embodied Conversational Agents (ECA) and Interactive Virtual Humans (IVH) based on 3D Virtual and Augmented reality technologies can be immensely beneficial for human to human communications and interpersonal skills training for a range of skills including sales pitching, negotiation, leadership, interviewing, and communicating with empathy and cultural sensitivities. They provide an opportunity to practice the skills needed for communicating with humans in difficult environments, with virtual simulated scenarios. And these complex environments can include health care contexts, sales, retail and customer service contexts, or communication with people with different cultural and ethnic backgrounds. At HCT research Centre at University of Canberra, we have been investigating several new technology frameworks and algorithmic techniques for building ECAs and IVHs based on integrating Artificial Intelligence (AI), deep machine learning, cloud computing, 3D virtual and augmented realitytechnologies, as training simulators for different application contexts. In this paper, we present the details in terms of the research, technology and implementation for modelling different persona for ECAs and IVHs. A multilevelarchitecture with adaptable functional modules based on the customized persona for different virtual environments, their implementation using an integrated cloud based software platform and its evaluation is discussed.

KW - Embodied interaction

KW - Virtual simulation

KW - Multimodal Technologies

UR - https://avsp2019.loria.fr/home/program/

UR - https://avsp2019.loria.fr/

M3 - Conference contribution

SP - 1

EP - 5

BT - Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP)

PB - International Speech Communication Association

CY - Melbourne, Australia

ER -

CHETTY G, White M. Embodied Conversational Agents and Interactive Virtual Humans for Training Simulators. In Proceedings of 2019 Audio Visual Speech Processing Conference (AVSP). Melbourne, Australia: International Speech Communication Association. 2019. p. 1-5