Development of a remote therapy tool for childhood apraxia of speech

Avinash Parnandi, Virendra Karappa, Tian Lan, Mostafa Shahin, Jacqueline McKechnie, Kirrie Ballard, Beena Ahmed, Ricardo Gutierrez-Osuna

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

Original languageEnglish
Article number2776895
JournalACM Transactions on Accessible Computing
Volume7
Issue number3
DOIs
Publication statusPublished - 1 Nov 2015
Externally publishedYes

Fingerprint

Speech analysis
Servers
Middleware
Application programs
Mobile devices
Computer systems
Engines
Feedback

Keywords

  • Automated speech analysis
  • Childhood apraxia of speech
  • Speech therapy

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Science Applications

Cite this

Parnandi, A., Karappa, V., Lan, T., Shahin, M., McKechnie, J., Ballard, K., ... Gutierrez-Osuna, R. (2015). Development of a remote therapy tool for childhood apraxia of speech. ACM Transactions on Accessible Computing, 7(3), [2776895]. https://doi.org/10.1145/2776895

Development of a remote therapy tool for childhood apraxia of speech. / Parnandi, Avinash; Karappa, Virendra; Lan, Tian; Shahin, Mostafa; McKechnie, Jacqueline; Ballard, Kirrie; Ahmed, Beena; Gutierrez-Osuna, Ricardo.

In: ACM Transactions on Accessible Computing, Vol. 7, No. 3, 2776895, 01.11.2015.

Research output: Contribution to journalArticle

Parnandi, A, Karappa, V, Lan, T, Shahin, M, McKechnie, J, Ballard, K, Ahmed, B & Gutierrez-Osuna, R 2015, 'Development of a remote therapy tool for childhood apraxia of speech', ACM Transactions on Accessible Computing, vol. 7, no. 3, 2776895. https://doi.org/10.1145/2776895
Parnandi A, Karappa V, Lan T, Shahin M, McKechnie J, Ballard K et al. Development of a remote therapy tool for childhood apraxia of speech. ACM Transactions on Accessible Computing. 2015 Nov 1;7(3). 2776895. https://doi.org/10.1145/2776895
Parnandi, Avinash ; Karappa, Virendra ; Lan, Tian ; Shahin, Mostafa ; McKechnie, Jacqueline ; Ballard, Kirrie ; Ahmed, Beena ; Gutierrez-Osuna, Ricardo. / Development of a remote therapy tool for childhood apraxia of speech. In: ACM Transactions on Accessible Computing. 2015 ; Vol. 7, No. 3.
@article{0bdaaf31d7d04962901d0198f33b172a,
title = "Development of a remote therapy tool for childhood apraxia of speech",
abstract = "We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.",
keywords = "Automated speech analysis, Childhood apraxia of speech, Speech therapy",
author = "Avinash Parnandi and Virendra Karappa and Tian Lan and Mostafa Shahin and Jacqueline McKechnie and Kirrie Ballard and Beena Ahmed and Ricardo Gutierrez-Osuna",
year = "2015",
month = "11",
day = "1",
doi = "10.1145/2776895",
language = "English",
volume = "7",
journal = "ACM Transactions on Accessible Computing",
issn = "1936-7228",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

TY - JOUR

T1 - Development of a remote therapy tool for childhood apraxia of speech

AU - Parnandi, Avinash

AU - Karappa, Virendra

AU - Lan, Tian

AU - Shahin, Mostafa

AU - McKechnie, Jacqueline

AU - Ballard, Kirrie

AU - Ahmed, Beena

AU - Gutierrez-Osuna, Ricardo

PY - 2015/11/1

Y1 - 2015/11/1

N2 - We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

AB - We present a multitier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. The system allows a speech language pathologist (SLP) to remotely assign speech production exercises to each child through a web interface and the child to practice these exercises in the form of a game on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The SLP can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We have validated the system through a pilot study with children diagnosed with apraxia of speech, their parents, and SLPs. Here, we describe the overall client-server architecture, middleware tools used to build the system, speech-analysis tools for automatic scoring of utterances, and present results from a clinical study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

KW - Automated speech analysis

KW - Childhood apraxia of speech

KW - Speech therapy

UR - http://www.scopus.com/inward/record.url?scp=84954190775&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954190775&partnerID=8YFLogxK

U2 - 10.1145/2776895

DO - 10.1145/2776895

M3 - Article

VL - 7

JO - ACM Transactions on Accessible Computing

JF - ACM Transactions on Accessible Computing

SN - 1936-7228

IS - 3

M1 - 2776895

ER -