Architecture of an automated therapy tool for childhood apraxia of speech

Avinash Parnandi, Virendra Karappa, Youngpyo Son, Mostafa Shahin, Jacqueline McKechnie, Kirrie Ballard, Beena Ahmed, Ricardo Gutierrez-Osuna

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

We present a multi-tier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. Namely, the system allows a speech therapist to remotely assign speech production exercises to each child through a web interface, and the child to practice these exercises on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The therapist can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We validated the system through a pilot study with children diagnosed with apraxia of speech, and their parents and speech therapists. Here we describe the overall client-server architecture, middleware tools used to build the system, the speech-analysis tools for automatic scoring of recorded utterances, and results from the pilot study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

Original languageEnglish
Title of host publicationProceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013
DOIs
Publication statusPublished - 2013
Event15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013 - Bellevue, WA, United States
Duration: 21 Oct 201323 Oct 2013

Other

Other15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013
CountryUnited States
CityBellevue, WA
Period21/10/1323/10/13

Fingerprint

Speech analysis
Servers
Middleware
Application programs
Mobile devices
Computer systems
Engines
Feedback

Keywords

  • Automated speech analysis
  • Childhood apraxia of speech
  • Speech therapy

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Parnandi, A., Karappa, V., Son, Y., Shahin, M., McKechnie, J., Ballard, K., ... Gutierrez-Osuna, R. (2013). Architecture of an automated therapy tool for childhood apraxia of speech. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013 [5] https://doi.org/10.1145/2513383.2513450

Architecture of an automated therapy tool for childhood apraxia of speech. / Parnandi, Avinash; Karappa, Virendra; Son, Youngpyo; Shahin, Mostafa; McKechnie, Jacqueline; Ballard, Kirrie; Ahmed, Beena; Gutierrez-Osuna, Ricardo.

Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013. 2013. 5.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Parnandi, A, Karappa, V, Son, Y, Shahin, M, McKechnie, J, Ballard, K, Ahmed, B & Gutierrez-Osuna, R 2013, Architecture of an automated therapy tool for childhood apraxia of speech. in Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013., 5, 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013, Bellevue, WA, United States, 21/10/13. https://doi.org/10.1145/2513383.2513450
Parnandi A, Karappa V, Son Y, Shahin M, McKechnie J, Ballard K et al. Architecture of an automated therapy tool for childhood apraxia of speech. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013. 2013. 5 https://doi.org/10.1145/2513383.2513450
Parnandi, Avinash ; Karappa, Virendra ; Son, Youngpyo ; Shahin, Mostafa ; McKechnie, Jacqueline ; Ballard, Kirrie ; Ahmed, Beena ; Gutierrez-Osuna, Ricardo. / Architecture of an automated therapy tool for childhood apraxia of speech. Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013. 2013.
@inproceedings{deca2a457f39483697bbbf2b6ab9d1da,
title = "Architecture of an automated therapy tool for childhood apraxia of speech",
abstract = "We present a multi-tier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. Namely, the system allows a speech therapist to remotely assign speech production exercises to each child through a web interface, and the child to practice these exercises on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The therapist can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We validated the system through a pilot study with children diagnosed with apraxia of speech, and their parents and speech therapists. Here we describe the overall client-server architecture, middleware tools used to build the system, the speech-analysis tools for automatic scoring of recorded utterances, and results from the pilot study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.",
keywords = "Automated speech analysis, Childhood apraxia of speech, Speech therapy",
author = "Avinash Parnandi and Virendra Karappa and Youngpyo Son and Mostafa Shahin and Jacqueline McKechnie and Kirrie Ballard and Beena Ahmed and Ricardo Gutierrez-Osuna",
year = "2013",
doi = "10.1145/2513383.2513450",
language = "English",
isbn = "9781450324052",
booktitle = "Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013",

}

TY - GEN

T1 - Architecture of an automated therapy tool for childhood apraxia of speech

AU - Parnandi, Avinash

AU - Karappa, Virendra

AU - Son, Youngpyo

AU - Shahin, Mostafa

AU - McKechnie, Jacqueline

AU - Ballard, Kirrie

AU - Ahmed, Beena

AU - Gutierrez-Osuna, Ricardo

PY - 2013

Y1 - 2013

N2 - We present a multi-tier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. Namely, the system allows a speech therapist to remotely assign speech production exercises to each child through a web interface, and the child to practice these exercises on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The therapist can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We validated the system through a pilot study with children diagnosed with apraxia of speech, and their parents and speech therapists. Here we describe the overall client-server architecture, middleware tools used to build the system, the speech-analysis tools for automatic scoring of recorded utterances, and results from the pilot study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

AB - We present a multi-tier system for the remote administration of speech therapy to children with apraxia of speech. The system uses a client-server architecture model and facilitates task-oriented remote therapeutic training in both in-home and clinical settings. Namely, the system allows a speech therapist to remotely assign speech production exercises to each child through a web interface, and the child to practice these exercises on a mobile device. The mobile app records the child's utterances and streams them to a back-end server for automated scoring by a speech-analysis engine. The therapist can then review the individual recordings and the automated scores through a web interface, provide feedback to the child, and adapt the training program as needed. We validated the system through a pilot study with children diagnosed with apraxia of speech, and their parents and speech therapists. Here we describe the overall client-server architecture, middleware tools used to build the system, the speech-analysis tools for automatic scoring of recorded utterances, and results from the pilot study. Our results support the feasibility of the system as a complement to traditional face-to-face therapy through the use of mobile tools and automated speech analysis algorithms.

KW - Automated speech analysis

KW - Childhood apraxia of speech

KW - Speech therapy

UR - http://www.scopus.com/inward/record.url?scp=84887478979&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887478979&partnerID=8YFLogxK

U2 - 10.1145/2513383.2513450

DO - 10.1145/2513383.2513450

M3 - Conference contribution

SN - 9781450324052

BT - Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2013

ER -