Clinical measures of communication limitations in dysarthria assessed through crowdsourcing: specificity, sensitivity, and retest-reliability

References

• Barreto, S. S., & Ortiz, K. Z. (2020). Speech intelligibility in dysarthrias: Influence of utterance length. Folia Phoniatrica Et Logopaedica, 72, 202-210. https://doi.org/10.1159/000497178
   Google Scholar
• Beukelman, D., Childes, J., Carrell, T., Funk, T., Ball, L. J., & Pattee, G. L. (2011). Perceived attention allocation of listeners who transcribe the speech of speakers with amyotrophic lateral sclerosis. Speech Communication, 53(6), 801–806. https://doi.org/10.1016/j.specom.2010.12.005
   Web of Science ®Google Scholar
• Beukelman, D., Gillespie, L., Fager, S., & Ullman, C. (2014). Perceived attention allocation of listeners who transcribe the speech of dysarthric speakers with traumatic brain injury. Journal of Medical Speech-Language Pathology, 21(3), 261–266.
   Google Scholar
• Beverly, D., Cannito, M. P., Chorna, L., Wolf, T., Suiter, D. M., & Bene, E. R. (2010). Influence of stimulus sentence characteristics on speech intelligibility scores in hypokinetic dysarthria. Journal of Medical Speech - Language Pathology, 18(4), 9+.
   Google Scholar
• Borrie, S. A., Lansford, K. L., & Barrett, T. S. (2017). Generalized adaptation to dysarthric speech. Journal of Speech, Language & Hearing Research, 60(11), 3110–3117. https://doi.org/10.1044/2017_JSLHR-S-17-0127
   PubMed Web of Science ®Google Scholar
• Chiu, Y. F., & Forrest, K. (2018). The impact of lexical characteristics and noise on intelligibility of parkinsonian speech. Journal of Speech, Language, and Hearing Research, 61(4), 837–846. https://doi.org/10.1044/2017_jslhr-s-17-0205
   PubMed Web of Science ®Google Scholar
• Clickworker. (2021). Retrieved February 21, 2021, from https://www.clickworker.com/clickworker-crowd/
   Google Scholar
• Crocker, L. M., & Algina, J. (2008). Introduction to classical and modern test theory. Cengage Learning.
   Google Scholar
• Dagenais, P. A., Brown, G. R., & Moore, R. E. (2006). Speech rate effects upon intelligibility and acceptability of dysarthric speech. Clinical Linguistics & Phonetics, 20(2–3), 141–148. https://doi.org/10.1080/02699200400026843
   PubMed Web of Science ®Google Scholar
• Dagenais, P. A., Watts, C. R., Turnage, L. M., & Kennedy, S. (1999). Intelligibility and acceptability of moderately dysarthric speech by three types of listeners. Journal of Medical Speech-Language Pathology, 7(2), 91–95.
   Google Scholar
• DePaul, R., & Kent, R. D. (2000). A longitudinal case study of ALS: Effects of listener familiarity and proficiency on intelligibility judgments. American Journal of Speech-Language Pathology, 9(3), 230–240. https://doi.org/10.1044/1058-0360.0903.230
   Web of Science ®Google Scholar
• Duffy, J. R. (2020). Examination of motor speech disorders. In J. R. Duffy (Ed.), Motor speech disorders. Subtrates, differential diagnosis, and management (4th ed., pp. 57–89). Elsevier.
   Google Scholar
• Dykstra, A. D., Hakel, M. E., & Adams, S. G. (2007). Application of the ICF in reduced speech intelligibility in dysarthria. Seminars in Speech and Language, 28(4), 301–311. https://doi.org/10.1055/s-2007-986527
   PubMedGoogle Scholar
• Enderby, P. (2011). The Frenchay Dysarthria Assessment. International Journal of Language & Communication Disorders, 15, 165-173. https://doi.org/10.3109/13682828009112541
   Google Scholar
• Feenaughty, L., Tjaden, K., & Sussman, J. (2014). Relationship between acoustic measures and judgments of intelligibility in Parkinson’s disease: A within-speaker approach. Clinical Linguistics & Phonetics, 28(11), 857–878. https://doi.org/10.3109/02699206.2014.921839
   PubMed Web of Science ®Google Scholar
• Gurevich, N., & Scamihorn, S. L. (2017). Speech-language pathologists’ use of intelligibility measures in adults with dysarthria. American Journal of Speech-Language Pathology, 26(3), 873–892. https://doi.org/10.1044/2017_AJSLP-16-0112
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2008). The relationship between listener comprehension and intelligibility scores for speakers with dysarthria. Journal of Speech, Language & Hearing Research, 51(3), 562–573. https://doi.org/10.1044/1092-4388(2008/040)
   PubMed Web of Science ®Google Scholar
• Janbakhshi, P., Kodrasi, I., & Bourlard, H. (2019). Spectral subspace analysis for automatic assessment of pathological speech intelligibility. In Proc. Interspeech 2019 (pp. 3038–3042). https://doi.org/10.21437/Interspeech.2019-2791
   Google Scholar
• Kent, R. D. (2009). Perceptual sensorimotor speech examination for motor speech disorders. In M. R. McNeil (Ed.), Clinical management of sensorimotor speech disorders (2nd ed., pp. 19–29). Thieme.
   Google Scholar
• Kent, R. D., & Kim, Y. (2010). The assessment of intelligibility in motor speech disorders. In A. Lowit & R. D. Kent (Eds.), Assessment of motor speech disorders (pp. 21–38). Plural Publishing.
   Google Scholar
• Kent, R. D., Kent, J. F., Weismer, G., Martin, R. E., Sufit, R. L., Brooks, B. R., & Rosenbek, J. C. (1989). Relationships between speech intelligibility and the slope of second-formant transitions in dysarthric subjects. Clinical Linguistics & Phonetics, 3(4), 347–358. https://doi.org/10.3109/02699208908985295
   Web of Science ®Google Scholar
• Klopfenstein, M., Bernard, K., & Heyman, C. (2020). The study of speech naturalness in communication disorders: A systematic review of the literature. Clinical Linguistics & Phonetics, 34(4), 327–338. https://doi.org/10.1080/02699206.2019.1652692
   PubMed Web of Science ®Google Scholar
• Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
   PubMed Web of Science ®Google Scholar
• Laganaro, M., Fougeron, C., Pernon, M., Levêque, N., Borel, S., Fournet, M., Catalano Chiuvé, S., Lopez, U., Trouville, R., Ménard, L., Burkhard, P. R., Assal, F., & Delvaux, V. (2021). Sensitivity and specificity of an acoustic- and perceptual-based tool for assessing motor speech disorders in French: The MonPaGe-screening protocol. Clinical Linguistics & Phonetics, 1–16. https://doi.org/10.1080/02699206.2020.1865460
   Web of Science ®Google Scholar
• Lansford, K. L., & Liss, J. M. (2014a). Vowel acoustics in dysarthria: Mapping to perception. Journal of Speech, Language, and Hearing Research, 57(1), 68–80. https://doi.org/10.1044/1092-4388(2013/12-0263)
   PubMed Web of Science ®Google Scholar
• Lansford, K. L., & Liss, J. M. (2014b). Vowel acoustics in dysarthria: Speech disorder diagnosis and classification. Journal of Speech, Language, and Hearing Research, 57(1), 57–67. https://doi.org/10.1044/1092-4388(2013/12-0262)
   PubMed Web of Science ®Google Scholar
• Lehner, K., Pfab, J., & Ziegler, W. (in press). Web-based assessment of communication-related parameters in dysarthria: Development and implementation of the KommPaS web app. Clinical Linguistics & Phonetics
   Google Scholar
• Lehner, K., & Ziegler, W. (2021). The impact of lexical and articulatory factors in the automatic selection of test materials for a web-based assessment of intelligibility in dysarthria. Journal of Speech, Language, and Hearing Research, 64(6S), 2196–2212. https://doi.org/10.1044/2020_JSLHR-20-00267
   PubMed Web of Science ®Google Scholar
• MacDonald, M. C., & Hsiao, Y. (2018). Sentence comprehension. In S.-A. Rueschemeyer & M. G. Gaske (Eds.), The Oxford handbook of psycholinguistics (pp. 171–197). Oxford University Press.
   Google Scholar
• McAllister Byun, T., Halpin, P. F., & Szeredi, D. (2015). Online crowdsourcing for efficient rating of speech: A validation study. Journal of Communication Disorders, 53, 70–83. https://doi.org/10.1016/j.jcomdis.2014.11.003
   PubMed Web of Science ®Google Scholar
• McAuliffe, M. J., Fletcher, A. R., Kerr, S. E., O’Beirne, G. A., & Anderson, T. (2017). Effect of dysarthria type, speaking condition, and Listener Age On Speech Intelligibility. American Journal of Speech-Language Pathology, 26(1), 113–123. https://doi.org/10.1044/2016_AJSLP-15-0182
   PubMed Web of Science ®Google Scholar
• McAuliffe, M. J., Gibson, E. M. R., Kerr, S. E., Anderson, T., & LaShell, P. J. (2013). Vocabulary influences older and younger listeners’ processing of dysarthric speech. The Journal of the Acoustical Society of America, 134(2), 1358–1368. https://doi.org/10.1121/1.4812764
   PubMed Web of Science ®Google Scholar
• Miller, N. (2013). Measuring up to speech intelligibility. International Journal of Language & Communication Disorders, 48(6), 601–612. https://doi.org/10.1111/1460-6984.12061
   PubMed Web of Science ®Google Scholar
• Nightingale, C., Swartz, M., Ramig, L. O., & McAllister, T. (2020). Using crowdsourced listeners’ ratings to measure speech changes in hypokinetic dysarthria: A proof-of-concept study. American Journal of Speech-Language Pathology, 29(2), 873–882. https://doi.org/10.1044/2019_AJSLP-19-00162
   PubMed Web of Science ®Google Scholar
• RCoreTeam. (2020). R: A Language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org
   Google Scholar
• Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12(1), 77. https://doi.org/10.1186/1471-2105-12-77
   PubMed Web of Science ®Google Scholar
• Scherer, K. R. (1972). Judging personality from voice: A cross-cultural approach to an old issue in interpersonal perception. Journal of Personality, 40(2), 191–210. https://doi.org/10.1111/j.1467-6494.1972.tb00998.x
   PubMed Web of Science ®Google Scholar
• Schölderle, T., Staiger, A., Lampe, R., Strecker, K., & Ziegler, W. (2016). Dysarthria in adults with cerebral palsy: Clinical presentation and impacts on communication. Journal of Speech, Language & Hearing Research, 59(2), 216–229. https://doi.org/10.1044/2015_JSLHR-S-15-0086
   PubMed Web of Science ®Google Scholar
• Schölderle, T., Staiger, A., Schumacher, B., & Ziegler, W. (2019). The impact of dysarthria on laypersons’ attitudes towards adults with cerebral palsy. Folia Phoniatrica Et Logopaedica, 71(5–6), 309–320. https://doi.org/10.1159/000493916
   PubMed Web of Science ®Google Scholar
• Selouani, S. A., Dahmani, H., Amami, R., & Hamam, H. (2012). Using speech rhythm knowledge to improve dysarthric speech recognition. International Journal of Speech Technology, 15(1), 57–64. https://doi.org/10.1007/s10772-011-9104-6
   Google Scholar
• Smith, C. H., Patel, S., Woolley, R. L., Brady, M. C., Rick, C. E., Halfpenny, R., Rontiris, A., Knox-Smith, L., Dowling, F., Clarke, C. E., Au, P., Ives, N., Wheatley, K., & Sackley, C. M. (2019). Rating the intelligibility of dysarthic speech amongst people with Parkinson’s Disease: A comparison of trained and untrained listeners. Clinical Linguistics & Phonetics, 33 (10–11), 1063–1070. https://doi.org/10.1080/02699206.2019
   Google Scholar
• Stipancic, K. L., Tjaden, K., & Wilding, G. (2016). Comparison of intelligibility measures for adults with Parkinson’s disease, adults with multiple sclerosis, and healthy controls. Journal of Speech, Language, and Hearing Research: JSLHR, 59(2), 230–238. https://doi.org/10.1044/2015_JSLHR-S-15-0271
   PubMed Web of Science ®Google Scholar
• Tjaden, K., & Wilding, G. (2011). Effects of speaking task on intelligibility in Parkinson’s disease. Clinical Linguistics & Phonetics, 25(2), 155–168. https://doi.org/10.3109/02699206.2010.520185
   PubMed Web of Science ®Google Scholar
• Tsanas, A., Little, M. A., McSharry, P. E., Spielman, J., & Ramig, L. O. (2012). Novel speech signal processing algorithms for high-accuracy classification of parkinson’s disease. IEEE Transactions on Biomedical Engineering, 59(5), 1264–1271. https://doi.org/10.1109/TBME.2012.2183367
   PubMed Web of Science ®Google Scholar
• Utianski, R. L., Lansford, K. L., Liss, J. M., & Azuma, T. (2011). The effects of topic knowledge on intelligibility and lexical segmentation in hypokinetic and ataxic dysarthria. Journal of Medical Speech-Language Pathology, 19(4), 25–36. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3738182/
   PubMedGoogle Scholar
• Vojtech, J. M., Noordzij, J. P., Cler, G. J., & Stepp, C. E. (2019). The effects of modulating fundamental frequency and speech rate on the intelligibility, communication efficiency, and perceived naturalness of synthetic speech. American Journal of Speech-Language Pathology, 28(2S), 875–886. https://doi.org/10.1044/2019_AJSLP-MSC18-18-0052
   PubMed Web of Science ®Google Scholar
• Walshe, M., & Miller, N. (2011). Living with acquired dysarthria: The speaker’s perspective. Disability and Rehabilitation, 33(3), 195–203. https://doi.org/10.3109/09638288.2010.511685
   PubMed Web of Science ®Google Scholar
• Walshe, M., Peach, R. K., & Miller, N. (2009). Dysarthria impact profile: Development of a scale to measure psychosocial effects. International Journal of Language & Communication Disorders, 44(5), 693–715. https://doi.org/10.1080/13682820802317536
   PubMed Web of Science ®Google Scholar
• Whitehill, T., & Wong, C. (2006). Contributing factors to listener effort for dysarthric speech. Journal of Medical Speech-Language Pathology, 14, 335–342.
   Web of Science ®Google Scholar
• Yorkston, K., Beukelman, D., & Tice, R. (1996). Sentence Intelligibility Test (SIT). Communication Disorders Software. In Tice Technology Services, Inc.
   Google Scholar
• Yorkston, K. M. (2010). Management of Motor Speech Disorders in Children and Adults (3rd ed.). Pro-Ed. https://books.google.de/books?id=SuNIPwAACAAJ
   Google Scholar
• Yorkston, K. M., & Beukelman, D. R. (1981). Communication Efficiency of Dysarthric Speakers as Measured by Sentence Intelligibility and Speaking Rate. Journal of Speech and Hearing Disorders, 46(3), 296–301. https://doi.org/10.1044/jshd.4603.296
   PubMedGoogle Scholar
• Ziegler, W., & Lehner, K., & KommPaS Study Group. (2021). Crowdsourcing as a tool in the clinical assessment of intelligibility in dysarthria: How to deal with excessive variation. Journal of Communication Disorders, 93, 106135. https://doi.org/10.1016/j.jcomdis.2021.106135
   PubMed Web of Science ®Google Scholar
• Ziegler, W., Schölderle, T., Staiger, A., & Vogel, M. (2018). Bogenhausener Dysarthrieskalen (BoDyS) [Bogenhausen Dysarthria Scales (BoDyS)]. Hogrefe.
   Google Scholar
• Ziegler, W., Staiger, A., Schölderle, T., & Vogel, M. (2017). Gauging the Auditory Dimensions of Dysarthric Impairment: Reliability and Construct Validity of the Bogenhausen Dysarthria Scales (BoDyS). Journal of Speech, Language & Hearing Research, 60(6), 1516–1534. https://doi.org/10.1044/2017_JSLHR-S-16-0336
   PubMed Web of Science ®Google Scholar