Development of a remote therapy tool for childhood apraxia of speech

Avinash Parnandi, Virendra Karappa, Tian Lan, Mostafa Shahin, Jacqueline McKechnie, Kirrie Ballard, Beena Ahmed, Ricardo Gutierrez-Osuna

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

Original languageEnglish
Article number2776895
Pages (from-to)1-23
Number of pages23
JournalACM Transactions on Accessible Computing
Volume7
Issue number3
DOIs
Publication statusPublished - 1 Nov 2015
Externally publishedYes

Fingerprint

Speech analysis
Servers
Middleware
Application programs
Mobile devices
Computer systems
Engines
Feedback

Cite this

Parnandi, A., Karappa, V., Lan, T., Shahin, M., McKechnie, J., Ballard, K., ... Gutierrez-Osuna, R. (2015). Development of a remote therapy tool for childhood apraxia of speech. ACM Transactions on Accessible Computing, 7(3), 1-23. [2776895]. https://doi.org/10.1145/2776895
Parnandi, Avinash ; Karappa, Virendra ; Lan, Tian ; Shahin, Mostafa ; McKechnie, Jacqueline ; Ballard, Kirrie ; Ahmed, Beena ; Gutierrez-Osuna, Ricardo. / Development of a remote therapy tool for childhood apraxia of speech. In: ACM Transactions on Accessible Computing. 2015 ; Vol. 7, No. 3. pp. 1-23.
@article{67b3b7000dea4f58ae0eb2f4cc56a903,
title = "Development of a remote therapy tool for childhood apraxia of speech",
abstract = "We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.",
keywords = "Automated speech analysis, Childhood apraxia of speech, Speech therapy",
author = "Avinash Parnandi and Virendra Karappa and Tian Lan and Mostafa Shahin and Jacqueline McKechnie and Kirrie Ballard and Beena Ahmed and Ricardo Gutierrez-Osuna",
year = "2015",
month = "11",
day = "1",
doi = "10.1145/2776895",
language = "English",
volume = "7",
pages = "1--23",
journal = "ACM Transactions on Accessible Computing",
issn = "1936-7228",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

Parnandi, A, Karappa, V, Lan, T, Shahin, M, McKechnie, J, Ballard, K, Ahmed, B & Gutierrez-Osuna, R 2015, 'Development of a remote therapy tool for childhood apraxia of speech', ACM Transactions on Accessible Computing, vol. 7, no. 3, 2776895, pp. 1-23. https://doi.org/10.1145/2776895

Development of a remote therapy tool for childhood apraxia of speech. / Parnandi, Avinash; Karappa, Virendra; Lan, Tian; Shahin, Mostafa; McKechnie, Jacqueline; Ballard, Kirrie; Ahmed, Beena; Gutierrez-Osuna, Ricardo.

In: ACM Transactions on Accessible Computing, Vol. 7, No. 3, 2776895, 01.11.2015, p. 1-23.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Development of a remote therapy tool for childhood apraxia of speech

AU - Parnandi, Avinash

AU - Karappa, Virendra

AU - Lan, Tian

AU - Shahin, Mostafa

AU - McKechnie, Jacqueline

AU - Ballard, Kirrie

AU - Ahmed, Beena

AU - Gutierrez-Osuna, Ricardo

PY - 2015/11/1

Y1 - 2015/11/1

N2 - We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

AB - We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

KW - Automated speech analysis

KW - Childhood apraxia of speech

KW - Speech therapy

UR - http://www.scopus.com/inward/record.url?scp=84954190775&partnerID=8YFLogxK

U2 - 10.1145/2776895

DO - 10.1145/2776895

M3 - Article

VL - 7

SP - 1

EP - 23

JO - ACM Transactions on Accessible Computing

JF - ACM Transactions on Accessible Computing

SN - 1936-7228

IS - 3

M1 - 2776895

ER -