Web-based assessment of communication-related parameters in dysarthria: development and implementation of the KommPaS web app

References

• Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H. R., Bertino, E., & Dustdar, S. (2013). Quality control in crowdsourcing systems: Issues and directions. IEEE Internet Computing, 17(2), 76–81. https://doi.org/10.1109/MIC.2013.20
   Web of Science ®Google Scholar
• Anand, S., & Stepp, C. E. (2015). Listener perception of monopitch, naturalness, and intelligibility for speakers with Parkinson’s disease. Journal of Speech, Language, and Hearing Research, 58(4), 1134–1144. https://doi.org/10.1044/2015_JSLHR-S-14-0243
   PubMed Web of Science ®Google Scholar
• Atkinson-Clement, C., Letanneux, A., Baille, G., Cuartero, M. C., Véron-Delor, L., Robieux, C., Berthelot, M., Robert, D., Azulay, J. P., Defebvre, L., Ferreira, J., Eusebio, A., Moreau, C., & Pinto, S. (2019). Psychosocial impact of dysarthria: The patient-reported outcome as part of the clinical management. Neurodegenerative Diseases, 19(1), 12–21. https://doi.org/10.1159/000499627
   PubMed Web of Science ®Google Scholar
• Barreto, S. S., & Ortiz, K. Z. (2020). Speech intelligibility in dysarthrias: Influence of utterance length. Folia Phoniatrica Et Logopaedica, 72, 202-210. https://doi.org/10.1159/000497178
   Google Scholar
• Beverly, D., Cannito, M. P., Chorna, L., Wolf, T., Suiter, D. M., & Bene, E. R. (2010). Influence of stimulus sentence characteristics on speech intelligibility scores in hypokinetic dysarthria. Journal of Medical Speech - Language Pathology, 18(4), 9+.
   Google Scholar
• Bloch, S., & Barnes, S. (2020, November). Dysarthria and other-initiated repair in everyday conversation. Clinical Linguistics & Phonetics, 34(10–11), 977–997. https://doi.org/10.1080/02699206.2019.1705915
   PubMed Web of Science ®Google Scholar
• Borrie, S. A., Lansford, K. L., & Barrett, T. S. (2017). Generalized adaptation to dysarthric speech. Journal of Speech, Language & Hearing Research, 60(11), 3110–3117. https://doi.org/10.1044/2017_JSLHR-S-17-0127
   PubMed Web of Science ®Google Scholar
• Chiu, Y. F., & Forrest, K. (2018). The impact of lexical characteristics and noise on intelligibility of Parkinsonian speech. Journal of Speech, Language, and Hearing Research, 61(4), 837–846. https://doi.org/10.1044/2017_jslhr-s-17-0205
   PubMed Web of Science ®Google Scholar
• Clickworker. (2021). Retrieved 21 February 2021, from https://www.clickworker.com/clickworker-crowd/
   Google Scholar
• Dagenais, P. A., Brown, G. R., & Moore, R. E. (2006). Speech rate effects upon intelligibility and acceptability of dysarthric speech. Clinical Linguistics & Phonetics, 20(2–3), 141–148. https://doi.org/10.1080/02699200400026843
   Google Scholar
• Dagenais, P. A., Watts, C. R., Turnage, L. M., & Kennedy, S. (1999). Intelligibility and acceptability of moderately dysarthric speech by three types of listeners. Journal of Medical Speech-Language Pathology, 7(2), 91–95.
   Google Scholar
• DePaul, R., & Kent, R. D. (2000). A longitudinal case study of ALS: Effects of listener familiarity and proficiency on intelligibility judgments. American Journal of Speech-Language Pathology, 9(3), 230–240. https://doi.org/10.1044/1058-0360.0903.230
   Web of Science ®Google Scholar
• Draxler, C., & Jänsch, K. (2004). SpeechRecorder – A universal platform independent multi-channel audio recording software. LREC.
   Google Scholar
• Duffy, J. R. (2020). Examination of motor speech disorders. In J. R. Duffy (Ed.), Motor speech disorders. Subtrates, differential diagnosis, and management (4th ed., pp. 57–89). Elsevier.
   Google Scholar
• Enderby, P. M., & Palmer, R. (2008). FDA-2: Frenchay dysarthria assessment. Pro–Ed.
   Google Scholar
• Eskenazi, M., Levow, G.-A., Meng, H., Parent, G., & Suendermann, D. (2013). Crowdsourcing for speech processing: Applications to data collection, transcription and assessment. John Wiley & Sons.
   Google Scholar
• FairCrowdWork. (2021). Retrieved 21 February 2021, from http://faircrowd.work/platform/amazon-mechanical-turk/
   Google Scholar
• Fletcher, A. R., McAuliffe, M. J., Lansford, K. L., Sinex, D. G., & Liss, J. M. (2017). Predicting intelligibility gains in individuals with dysarthria from baseline speech features [Article]. Journal of Speech, Language & Hearing Research, 60(11), 3043–3057. https://doi.org/10.1044/2016_JSLHR-S-16-0218
   PubMed Web of Science ®Google Scholar
• Funke, F. (2016). A web experiment showing negative effects of slider scales compared to visual analogue scales and radio button scales. Social Science Computer Review, 34(2), 244–254. https://doi.org/10.1177/0894439315575477
   Web of Science ®Google Scholar
• Funke, F., & Reips, U.-D. (2012). Why semantic differentials in web-based research should be made from visual analogue scales and not from 5-point scales. Field Methods, 24(3), 310–327. https://doi.org/10.1177/1525822X12444061
   Web of Science ®Google Scholar
• Hustad, K. C. (2006a). A closer look at transcription intelligibility for speakers with dysarthria: Evaluation of scoring paradigms and linguistic errors made by listeners. American Journal of Speech-Language Pathology, 15(3), 268–277. https://doi.org/10.1044/1058-0360(2006/025)
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2006b). Estimating the intelligibility of speakers with dysarthria. Folia Phoniatrica Et Logopaedica, 58(3), 217–228. https://doi.org/10.1159/000091735
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2008). The relationship between listener comprehension and intelligibility scores for speakers with dysarthria. Journal of Speech, Language & Hearing Research, 51(3), 562–573. https://doi.org/10.1044/1092-4388(2008/040)
   PubMed Web of Science ®Google Scholar
• Hustad, K. C., Dardis, C. M., & McCourt, K. A. (2007). Effects of visual information on intelligibility of open and closed class words in predictable sentences produced by speakers with dysarthria. Clinical Linguistics & Phonetics, 21(5), 353–367. https://doi.org/10.1080/02699200701259150
   PubMed Web of Science ®Google Scholar
• Klasner, E. R., & Yorkston, K. M. (2005). Speech intelligibility in ALS and HD dysarthria: The everyday listener’s perspective. Journal of Medical Speech-Language Pathology, 13 (2), 127–139
   Web of Science ®Google Scholar
• Klopfenstein, M. (2015). Relationship between acoustic measures and speech naturalness ratings in Parkinson’s disease: A within-speaker approach. Clinical Linguistics & Phonetics, 29(12), 938–954. https://doi.org/10.3109/02699206.2015.1081293
   PubMed Web of Science ®Google Scholar
• Klopfenstein, M. (2016). Speech naturalness ratings and perceptual correlates of highly natural and unnatural speech in hypokinetic dysarthria secondary to Parkinson’s disease. Journal of Interactional Research in Communication Disorders, 7(1), 123. https://doi.org/10.1558/jircd.v7i1.27932
   Web of Science ®Google Scholar
• Klopfenstein, M., Bernard, K., & Heyman, C. (2020). The study of speech naturalness in communication disorders: A systematic review of the literature. Clinical Linguistics & Phonetics, 34(4), 327–338. https://doi.org/10.1080/02699206.2019.1652692
   PubMed Web of Science ®Google Scholar
• Laganaro, M., Fougeron, C., Pernon, M., Levêque, N., Borel, S., Fournet, M., Catalano Chiuvé, S., Lopez, U., Trouville, R., Ménard, L., Burkhard, P. R., Assal, F., & Delvaux, V. (2021). Sensitivity and specificity of an acoustic- and perceptual-based tool for assessing motor speech disorders in French: The MonPaGe-screening protocol. Clinical Linguistics & Phonetics, 1–16. https://doi.org/10.1080/02699206.2020.1865460
   Web of Science ®Google Scholar
• Landa, S., Pennington, L., Miller, N., Robson, S., Thompson, V., & Steen, N. (2014). Association between objective measurement of the speech intelligibility of young people with dysarthria and listener ratings of ease of understanding. International Journal of Speech-Language Pathology, 16(4), 408–416. https://doi.org/10.3109/17549507.2014.927922
   PubMed Web of Science ®Google Scholar
• Lansford, K. L., Borrie, S. A., & Bystricky, L. (2016). Use of Crowdsourcing to Assess the Ecological Validity of Perceptual-Training Paradigms in Dysarthria. American Journal of Speech-Language Pathology, 25(2), 233–239. https://doi.org/10.1044/2015_AJSLP-15-0059
   PubMed Web of Science ®Google Scholar
• Lehner, K., & Ziegler, W., & KommPaS Study Group. (in press -b). Indicators of communication limitation in dysarthria and their relation to auditory-perceptual speech symptoms: Construct validity of the KommPaS Webapp. Journal of Speech, Language & Hearing Research
   Google Scholar
• Lehner, K., & Ziegler, W., & KommPaS Study Group. (in press - a). Clinical measures of communication limitations in dysarthria assessed through crowdsourcing: Specificity, sensitivity, and retest-reliability. Clinical Linguistics & Phonetics
   Google Scholar
• Lehner, K., & Ziegler, W. (2021). The Impact of Lexical and Articulatory Factors in the Automatic Selection of Test Materials for a Web-Based Assessment of Intelligibility in Dysarthria. Journal of Speech, Language, and Hearing Research, 64(6S), 2196–2212. https://doi.org/10.1044/2020_JSLHR-20-00267
   PubMed Web of Science ®Google Scholar
• McAllister Byun, T., Halpin, P. F., & Szeredi, D. (2015). Online crowdsourcing for efficient rating of speech: A validation study. Journal of Communication Disorders, 53, 70–83. https://doi.org/10.1016/j.jcomdis.2014.11.003
   PubMed Web of Science ®Google Scholar
• McAuliffe, M. J., Fletcher, A. R., Kerr, S. E., O’Beirne, G. A., & Anderson, T. (2017). Effect of dysarthria type, speaking condition, and listener age on speech intelligibility. American Journal of Speech-Language Pathology, 26(1), 113–123. https://doi.org/10.1044/2016_AJSLP-15-0182
   PubMed Web of Science ®Google Scholar
• McAuliffe, M. J., Gibson, E. M. R., Kerr, S. E., Anderson, T., & LaShell, P. J. (2013). Vocabulary influences older and younger listeners’ processing of dysarthric speech. The Journal of the Acoustical Society of America, 134(2), 1358–1368. https://doi.org/10.1121/1.4812764
   PubMed Web of Science ®Google Scholar
• Miller, N. (2013). Measuring up to speech intelligibility. International Journal of Language & Communication Disorders, 48(6), 601–612. https://doi.org/10.1111/1460-6984.12061
   PubMed Web of Science ®Google Scholar
• Nightingale, C., Swartz, M., Ramig, L. O., & McAllister, T. (2020). Using crowdsourced listeners’ ratings to measure speech changes in hypokinetic dysarthria: A proof-of-concept study. American Journal of Speech-Language Pathology, 29(2), 873–882. https://doi.org/10.1044/2019_AJSLP-19-00162
   PubMed Web of Science ®Google Scholar
• Olmstead, A. J., Lee, J., & Viswanathan, N. (2020). The role of the speaker, the listener, and their joint contributions during communicative interactions: A tripartite view of intelligibility in individuals with dysarthria. Journal of Speech, Language, and Hearing Research, 63(4), 1106–1114. https://doi.org/10.1044/2020_JSLHR-19-00233
   PubMed Web of Science ®Google Scholar
• Schölderle, T., Staiger, A., Lampe, R., Strecker, K., & Ziegler, W. (2016). Dysarthria in Adults With Cerebral Palsy: Clinical Presentation and Impacts on Communication. Journal of Speech, Language & Hearing Research, 59(2), 216–229. https://doi.org/10.1044/2015_JSLHR-S-15-0086
   PubMed Web of Science ®Google Scholar
• Schölderle, T., Staiger, A., Schumacher, B., & Ziegler, W. (2019). The Impact of Dysarthria on Laypersons’ Attitudes towards Adults with Cerebral Palsy. Folia Phoniatrica Et Logopaedica, 71(5–6), 309–320. https://doi.org/10.1159/000493916
   PubMed Web of Science ®Google Scholar
• Smith, C. H., Patel, S., Woolley, R. L., Brady, M. C., Rick, C. E., Halfpenny, R., Rontiris, A., Knox-Smith, L., Dowling, F., Clarke, C. E., Au, P., Ives, N., Wheatley, K., & Sackley, C. M. (2019). Rating the intelligibility of dysarthic speech amongst people with Parkinson’s Disease: A comparison of trained and untrained listeners. Clinical Linguistics & Phonetics, 33 (10–11), 1063–1070. https://doi.org/10.1080/02699206.2019
   Google Scholar
• Tamati, T. N., Gilbert, J. L., & Pisoni, D. B. (2013). Some factors underlying individual differences in speech recognition on PRESTO: A first report. Journal of the American Academy of Audiology, 24(7), 616–634. https://doi.org/10.3766/jaaa.24.7.10
   PubMed Web of Science ®Google Scholar
• Tjaden, K., & Wilding, G. (2011). Effects of speaking task on intelligibility in Parkinson’s disease. Clinical Linguistics & Phonetics, 25(2), 155–168. https://doi.org/10.3109/02699206.2010.520185
   PubMed Web of Science ®Google Scholar
• Utianski, R. L., Lansford, K. L., Liss, J. M., & Azuma, T. (2011). The effects of topic knowledge on intelligibility and lexical segmentation in hypokinetic and ataxic dysarthria. Journal of Medical Speech-Language Pathology, 19(4), 25–36. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3738182/
   PubMedGoogle Scholar
• Vuurens, J., De Vries, A., & Eickhoff, C. (2011). How much spam can you take? an analysis of crowdsourcing results to increase accuracy. Proceedings of the ACM SIGIR Workshop on Crowdsourcing for Information Retrieval (CIR’11), 21–26.
   Google Scholar
• Whitehill, T., & Wong, C. (2006). Contributing factors to listener effort for dysarthric speech. Journal of Medical Speech-Language Pathology, 14, 335–342.
   Web of Science ®Google Scholar
• Yorkston, K., Beukelman, D., & Tice, R. (1996). Sentence intelligibility test (SIT). Communication disorders software. Tice Technology Services, Inc.
   Google Scholar
• Yorkston, K. M. (2010). Management of motor speech disorders in children and adults (3rd ed.). Pro-Ed. https://books.google.de/books?id=SuNIPwAACAAJ
   Google Scholar
• Yorkston, K. M., & Beukelman, D. R. (1978). A comparison of techniques for measuring intelligibility of dysarthric speech. Journal of Communication Disorders, 11(6), 499–512. https://doi.org/10.1016/0021-9924(78)90024-2
   PubMed Web of Science ®Google Scholar
• Yorkston, K. M., & Beukelman, D. R. (1981). Communication efficiency of dysarthric speakers as measured by sentence intelligibility and speaking rate. Journal of Speech and Hearing Disorders, 46(3), 296–301. https://doi.org/10.1044/jshd.4603.296
   PubMedGoogle Scholar
• Yorkston, K. M., & Beukelmann, D. R. (1984). Assessment of intelligibility of dysarthric speech. C.C. Publications.
   Google Scholar
• Ziegler, W., & Lehner, K., & KommPaS Study Group. (2021). Crowdsourcing as a tool in the clinical assessment of intelligibility in dysarthria: How to deal with excessive variation. Journal of Communication Disorders, 93, 106135. https://doi.org/10.1016/j.jcomdis.2021.106135
   PubMed Web of Science ®Google Scholar
• Ziegler, W., Schölderle, T., Staiger, A., & Vogel, M. (2018). Bogenhausener dysarthrieskalen (BoDyS) [Bogenhausen Dysarthria Scales (BoDyS)]. Hogrefe.
   Google Scholar
• Ziegler, W., Staiger, A., Schölderle, T., & Vogel, M. (2017). Gauging the auditory dimensions of dysarthric impairment: Reliability and construct validity of the bogenhausen dysarthria scales (BoDyS). Journal of Speech, Language & Hearing Research, 60(6), 1516–1534. https://doi.org/10.1044/2017_JSLHR-S-16-0336
   PubMed Web of Science ®Google Scholar
• Ziegler, W., & Zierdt, A. (2008). Telediagnostic assessment of intelligibility in dysarthria: A pilot investigation of MVP-online. Journal of Communication Disorders, 41(6), 553–577. https://doi.org/10.1016/j.jcomdis.2008.05.001
   PubMed Web of Science ®Google Scholar