Speech-driven mobile games for speech therapy

User experiences and feasibility

Beena Ahmed, Penelope Monroe, Adam Hair, Chek Tien Tan, Ricardo Gutierrez-Osuna, Kirrie J. Ballard

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Purpose: To assist in remote treatment, speech-language pathologists (SLPs) rely on mobile games, which though entertaining, lack feedback mechanisms. Games integrated with automatic speech recognition (ASR) offer a solution where speech productions control gameplay. We therefore performed a feasibility study to assess children’s and SLPs’ experiences towards speech-controlled games, game feature preferences and ASR accuracy. Method: Ten children with childhood apraxia of speech (CAS), six typically developing (TD) children and seven SLPs trialled five games and answered questionnaires. Researchers also compared the results of ASR to perceptual judgment. Result: Children and SLPs found speech-controlled games interesting and fun, despite ASR–human disagreements. They preferred games with rewards, challenge and multiple difficulty levels. Automatic speech recognition–human agreement was higher for SLPs than children, similar between TD and CAS and unaffected by CAS severity (77% TD, 75% CAS–incorrect; 51% TD, 47% CAS, 71% SLP–correct). Manual stop recording yielded higher agreement than automatic. Word length did not influence agreement. Conclusion: Children’s and SLPs’ positive responses towards speech-controlled games suggest that they can engage children in higher intensity practice. Our findings can guide future improvements to the ASR, recording methods and game features to improve the user experience and therapy adherence.

Original languageEnglish
JournalInternational Journal of Speech-Language Pathology
DOIs
Publication statusAccepted/In press - 1 Jan 2018

Fingerprint

Speech Therapy
Apraxias
Language
User Experience
Child Language
Speech-language Pathologists

Keywords

  • ASR applications
  • ASR in games
  • childhood apraxia of speech
  • mobile therapy apps
  • speech-controlled games

ASJC Scopus subject areas

  • Research and Theory
  • Otorhinolaryngology
  • Language and Linguistics
  • LPN and LVN
  • Speech and Hearing

Cite this

Speech-driven mobile games for speech therapy : User experiences and feasibility. / Ahmed, Beena; Monroe, Penelope; Hair, Adam; Tan, Chek Tien; Gutierrez-Osuna, Ricardo; Ballard, Kirrie J.

In: International Journal of Speech-Language Pathology, 01.01.2018.

Research output: Contribution to journalArticle

Ahmed, Beena ; Monroe, Penelope ; Hair, Adam ; Tan, Chek Tien ; Gutierrez-Osuna, Ricardo ; Ballard, Kirrie J. / Speech-driven mobile games for speech therapy : User experiences and feasibility. In: International Journal of Speech-Language Pathology. 2018.
@article{2476aac1a2ba4ea79526bc05da8dab0d,
title = "Speech-driven mobile games for speech therapy: User experiences and feasibility",
abstract = "Purpose: To assist in remote treatment, speech-language pathologists (SLPs) rely on mobile games, which though entertaining, lack feedback mechanisms. Games integrated with automatic speech recognition (ASR) offer a solution where speech productions control gameplay. We therefore performed a feasibility study to assess children’s and SLPs’ experiences towards speech-controlled games, game feature preferences and ASR accuracy. Method: Ten children with childhood apraxia of speech (CAS), six typically developing (TD) children and seven SLPs trialled five games and answered questionnaires. Researchers also compared the results of ASR to perceptual judgment. Result: Children and SLPs found speech-controlled games interesting and fun, despite ASR–human disagreements. They preferred games with rewards, challenge and multiple difficulty levels. Automatic speech recognition–human agreement was higher for SLPs than children, similar between TD and CAS and unaffected by CAS severity (77{\%} TD, 75{\%} CAS–incorrect; 51{\%} TD, 47{\%} CAS, 71{\%} SLP–correct). Manual stop recording yielded higher agreement than automatic. Word length did not influence agreement. Conclusion: Children’s and SLPs’ positive responses towards speech-controlled games suggest that they can engage children in higher intensity practice. Our findings can guide future improvements to the ASR, recording methods and game features to improve the user experience and therapy adherence.",
keywords = "ASR applications, ASR in games, childhood apraxia of speech, mobile therapy apps, speech-controlled games",
author = "Beena Ahmed and Penelope Monroe and Adam Hair and Tan, {Chek Tien} and Ricardo Gutierrez-Osuna and Ballard, {Kirrie J.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1080/17549507.2018.1513562",
language = "English",
journal = "International Journal of Speech-Language Pathology",
issn = "1754-9507",
publisher = "Informa Healthcare",

}

TY - JOUR

T1 - Speech-driven mobile games for speech therapy

T2 - User experiences and feasibility

AU - Ahmed, Beena

AU - Monroe, Penelope

AU - Hair, Adam

AU - Tan, Chek Tien

AU - Gutierrez-Osuna, Ricardo

AU - Ballard, Kirrie J.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Purpose: To assist in remote treatment, speech-language pathologists (SLPs) rely on mobile games, which though entertaining, lack feedback mechanisms. Games integrated with automatic speech recognition (ASR) offer a solution where speech productions control gameplay. We therefore performed a feasibility study to assess children’s and SLPs’ experiences towards speech-controlled games, game feature preferences and ASR accuracy. Method: Ten children with childhood apraxia of speech (CAS), six typically developing (TD) children and seven SLPs trialled five games and answered questionnaires. Researchers also compared the results of ASR to perceptual judgment. Result: Children and SLPs found speech-controlled games interesting and fun, despite ASR–human disagreements. They preferred games with rewards, challenge and multiple difficulty levels. Automatic speech recognition–human agreement was higher for SLPs than children, similar between TD and CAS and unaffected by CAS severity (77% TD, 75% CAS–incorrect; 51% TD, 47% CAS, 71% SLP–correct). Manual stop recording yielded higher agreement than automatic. Word length did not influence agreement. Conclusion: Children’s and SLPs’ positive responses towards speech-controlled games suggest that they can engage children in higher intensity practice. Our findings can guide future improvements to the ASR, recording methods and game features to improve the user experience and therapy adherence.

AB - Purpose: To assist in remote treatment, speech-language pathologists (SLPs) rely on mobile games, which though entertaining, lack feedback mechanisms. Games integrated with automatic speech recognition (ASR) offer a solution where speech productions control gameplay. We therefore performed a feasibility study to assess children’s and SLPs’ experiences towards speech-controlled games, game feature preferences and ASR accuracy. Method: Ten children with childhood apraxia of speech (CAS), six typically developing (TD) children and seven SLPs trialled five games and answered questionnaires. Researchers also compared the results of ASR to perceptual judgment. Result: Children and SLPs found speech-controlled games interesting and fun, despite ASR–human disagreements. They preferred games with rewards, challenge and multiple difficulty levels. Automatic speech recognition–human agreement was higher for SLPs than children, similar between TD and CAS and unaffected by CAS severity (77% TD, 75% CAS–incorrect; 51% TD, 47% CAS, 71% SLP–correct). Manual stop recording yielded higher agreement than automatic. Word length did not influence agreement. Conclusion: Children’s and SLPs’ positive responses towards speech-controlled games suggest that they can engage children in higher intensity practice. Our findings can guide future improvements to the ASR, recording methods and game features to improve the user experience and therapy adherence.

KW - ASR applications

KW - ASR in games

KW - childhood apraxia of speech

KW - mobile therapy apps

KW - speech-controlled games

UR - http://www.scopus.com/inward/record.url?scp=85054733438&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054733438&partnerID=8YFLogxK

U2 - 10.1080/17549507.2018.1513562

DO - 10.1080/17549507.2018.1513562

M3 - Article

JO - International Journal of Speech-Language Pathology

JF - International Journal of Speech-Language Pathology

SN - 1754-9507

ER -