Evaluating the readability of text simplification output for readers with cognitive disabilities

Victoria Yaneva, Irina Temnikova, Ruslan Mitkov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper presents an approach for automatic evaluation of the readability of text simplification output for readers with cognitive disabilities. First, we present our work towards the development of the EasyRead corpus, which contains easy-to-read documents created especially for people with cognitive disabilities. We then compare the EasyRead corpus to the simplified output contained in the LocalNews corpus (Feng, 2009), the accessibility of which has been evaluated through reading comprehension experiments including 20 adults with mild intellectual disability. This comparison is made on the basis of 13 disability-specific linguistic features. The comparison reveals that there are no major differences between the two corpora, which shows that the EasyRead corpus is to a similar reading level as the user-evaluated texts. We also discuss the role of Simple Wikipedia (Zhu et al., 2010) as a widely-used accessibility benchmark, in light of our finding that it is significantly more complex than both the EasyRead and the LocalNews corpora.

Original languageEnglish
Title of host publicationProceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016
PublisherEuropean Language Resources Association (ELRA)
Pages293-299
Number of pages7
ISBN (Electronic)9782951740891
Publication statusPublished - 1 Jan 2016
Event10th International Conference on Language Resources and Evaluation, LREC 2016 - Portoroz, Slovenia
Duration: 23 May 201628 May 2016

Other

Other10th International Conference on Language Resources and Evaluation, LREC 2016
CountrySlovenia
CityPortoroz
Period23/5/1628/5/16

Fingerprint

disability
Wikipedia
comprehension
linguistics
Cognitive Disabilities
Readability
Simplification
Reader
experiment
evaluation
Accessibility

Keywords

  • Autism
  • Cognitive disabilities
  • Easy-to-read
  • Readability
  • Text simplification

ASJC Scopus subject areas

  • Linguistics and Language
  • Library and Information Sciences
  • Language and Linguistics
  • Education

Cite this

Yaneva, V., Temnikova, I., & Mitkov, R. (2016). Evaluating the readability of text simplification output for readers with cognitive disabilities. In Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016 (pp. 293-299). European Language Resources Association (ELRA).

Evaluating the readability of text simplification output for readers with cognitive disabilities. / Yaneva, Victoria; Temnikova, Irina; Mitkov, Ruslan.

Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. European Language Resources Association (ELRA), 2016. p. 293-299.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yaneva, V, Temnikova, I & Mitkov, R 2016, Evaluating the readability of text simplification output for readers with cognitive disabilities. in Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. European Language Resources Association (ELRA), pp. 293-299, 10th International Conference on Language Resources and Evaluation, LREC 2016, Portoroz, Slovenia, 23/5/16.
Yaneva V, Temnikova I, Mitkov R. Evaluating the readability of text simplification output for readers with cognitive disabilities. In Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. European Language Resources Association (ELRA). 2016. p. 293-299
Yaneva, Victoria ; Temnikova, Irina ; Mitkov, Ruslan. / Evaluating the readability of text simplification output for readers with cognitive disabilities. Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. European Language Resources Association (ELRA), 2016. pp. 293-299
@inproceedings{6db7240f2962433f9c7a4cf3f4977878,
title = "Evaluating the readability of text simplification output for readers with cognitive disabilities",
abstract = "This paper presents an approach for automatic evaluation of the readability of text simplification output for readers with cognitive disabilities. First, we present our work towards the development of the EasyRead corpus, which contains easy-to-read documents created especially for people with cognitive disabilities. We then compare the EasyRead corpus to the simplified output contained in the LocalNews corpus (Feng, 2009), the accessibility of which has been evaluated through reading comprehension experiments including 20 adults with mild intellectual disability. This comparison is made on the basis of 13 disability-specific linguistic features. The comparison reveals that there are no major differences between the two corpora, which shows that the EasyRead corpus is to a similar reading level as the user-evaluated texts. We also discuss the role of Simple Wikipedia (Zhu et al., 2010) as a widely-used accessibility benchmark, in light of our finding that it is significantly more complex than both the EasyRead and the LocalNews corpora.",
keywords = "Autism, Cognitive disabilities, Easy-to-read, Readability, Text simplification",
author = "Victoria Yaneva and Irina Temnikova and Ruslan Mitkov",
year = "2016",
month = "1",
day = "1",
language = "English",
pages = "293--299",
booktitle = "Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016",
publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - Evaluating the readability of text simplification output for readers with cognitive disabilities

AU - Yaneva, Victoria

AU - Temnikova, Irina

AU - Mitkov, Ruslan

PY - 2016/1/1

Y1 - 2016/1/1

N2 - This paper presents an approach for automatic evaluation of the readability of text simplification output for readers with cognitive disabilities. First, we present our work towards the development of the EasyRead corpus, which contains easy-to-read documents created especially for people with cognitive disabilities. We then compare the EasyRead corpus to the simplified output contained in the LocalNews corpus (Feng, 2009), the accessibility of which has been evaluated through reading comprehension experiments including 20 adults with mild intellectual disability. This comparison is made on the basis of 13 disability-specific linguistic features. The comparison reveals that there are no major differences between the two corpora, which shows that the EasyRead corpus is to a similar reading level as the user-evaluated texts. We also discuss the role of Simple Wikipedia (Zhu et al., 2010) as a widely-used accessibility benchmark, in light of our finding that it is significantly more complex than both the EasyRead and the LocalNews corpora.

AB - This paper presents an approach for automatic evaluation of the readability of text simplification output for readers with cognitive disabilities. First, we present our work towards the development of the EasyRead corpus, which contains easy-to-read documents created especially for people with cognitive disabilities. We then compare the EasyRead corpus to the simplified output contained in the LocalNews corpus (Feng, 2009), the accessibility of which has been evaluated through reading comprehension experiments including 20 adults with mild intellectual disability. This comparison is made on the basis of 13 disability-specific linguistic features. The comparison reveals that there are no major differences between the two corpora, which shows that the EasyRead corpus is to a similar reading level as the user-evaluated texts. We also discuss the role of Simple Wikipedia (Zhu et al., 2010) as a widely-used accessibility benchmark, in light of our finding that it is significantly more complex than both the EasyRead and the LocalNews corpora.

KW - Autism

KW - Cognitive disabilities

KW - Easy-to-read

KW - Readability

KW - Text simplification

UR - http://www.scopus.com/inward/record.url?scp=85037079234&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85037079234&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85037079234

SP - 293

EP - 299

BT - Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016

PB - European Language Resources Association (ELRA)

ER -