Assessing speech intelligibility of pathological speech: test types, ratings and transcription measures

References

• Abur, D., Enos, N. M., & Stepp, C. E. (2019). Visual analog scale ratings and orthographic transcription measures of sentence intelligibility in Parkinson’s disease with variable listener exposure. American Journal of Speech-Language Pathology, 28(3), 1222–1232. https://doi.org/10.1044/2019_AJSLP-18-0275
   PubMed Web of Science ®Google Scholar
• Adank, P., Van Hout, R., & Van de Velde, H. (2007). An acoustic description of the vowels of Northern and Southern Standard Dutch II: Regional varieties. Journal of the Acoustical Society of America, 121(2), 1130–1141. https://doi.org/10.1121/1.2409492
   PubMed Web of Science ®Google Scholar
• Beijer, L. J., Clapham, R. P., & Rietveld, A. C. M. (2012). Evaluating the suitability of orthographic transcription and intelligibility scale rating of semantically unpredictable sentences (SUS) for speech training efficacy research in dysarthric speakers with Parkinson’s disease. Journal of Medical Speech-Language Pathology, 20(2), 17–35. https://doi.org/10.1089/tmj.2009.0183
   PubMedGoogle Scholar
• Brennan, R. L. (2001). Generalizability theory. Springer.
   Google Scholar
• Briesch, A. M., Swaminathan, H., Welsh, M., & Chafouleas, S. M. (2014). Generalizability theory: A practical guide to study design, implementation, and interpretation. Journal of School Psychology, 52(1), 13–35. https://doi.org/10.1016/j.jsp.2013.11.008
   PubMed Web of Science ®Google Scholar
• Bunton, K., Kent, R. D., Kent, J. F., & Duffy, J. R. (2001). The effects of flattening fundamental frequency contours on sentence intelligibility in speakers with dysarthria. Clinical Linguistics & Phonetics, 15(3), 181–193. https://doi.org/10.1080/02699200010003378
   Web of Science ®Google Scholar
• Cannito, M. P., Suiter, D. M., Beverly, D., Chorna, L., Wolf, T., & Pfeiffer, R. M. (2012). Sentence intelligibility before and after voice treatment in speakers with idiopathic Parkinson’s disease. Journal of Voice, 26(2), 214–219. https://doi.org/10.1016/j.jvoice.2011.08.014
   PubMed Web of Science ®Google Scholar
• Carvalho, J., Cardoso, R., Guimarães, I., & Ferreira, J. J. (2021). Speech intelligibility of Parkinson’s disease patients evaluated by different groups of healthcare professionals and naïve listeners. Logopedics Phoniatrics Vocology, 46(3), 1–7. https://doi.org/10.1080/14015439.2020.1785546
   PubMed Web of Science ®Google Scholar
• De Bodt, M., Guns, C., & Van Nuffelen, G. (2006). NSVO: Nederlandstalig Spraakverstaanbaarheidsonderzoek. Vlaamse Vereniging voor Logopedisten.
   Google Scholar
• Dongilli, P. (1994). Semantic context and speech intelligibility. In J. Till, K. Yorkston, & D. Beukelman (Eds.), Motor speech disorders: Advances in assessment and treatment (pp. 175–191). Paul H. Brookes.
   Google Scholar
• Dos Barreto, S., & Ortiz, K. (2008). Intelligibility measurements in speech disorders: A critical review of the literature. Pró-Fono Revista de Atualização Científica, 20(3), 201–206. https://doi.org/10.1590/s0104-56872008000300011
   PubMedGoogle Scholar
• Dos Barreto, S., & Ortiz, K. (2016). Protocol for the evaluation of speech intelligibility in dysarthrias: Evidence of reliability and validity. Folia Phoniatrica Et Logopaedica, 67(4), 212–218. https://doi.org/10.1159/000441929
   Web of Science ®Google Scholar
• Ellis, L. W., & Fucci, D. J. (1991). Magnitude-estimation scaling of speech intelligibility: Effects of listeners’ experience and semantic-syntactic context. Perceptual and Motor Skills, 73(1), 295–305. https://doi.org/10.2466/pms.1991.73.1.295
   PubMed Web of Science ®Google Scholar
• Evans, J. D. (1996). Straightforward statistics for the behavioral sciences. Brooks/Cole Publishing.
   Google Scholar
• Fisher, R. A. (1992). Statistical methods for research workers. In S. Kotz & N. L. Johnson (Eds.), Breakthroughs in statistics (pp. 66–70). Springer.
   Google Scholar
• Ford, A. L., & Johnson, L. D. (2021). The use of generalizability theory to inform sampling of educator language used with preschoolers with Autism Spectrum Disorder. Journal of Speech, Language, and Hearing Research, 64(5), 1748–1757. https://doi.org/10.1044/2021_JSLHR-20-00586
   PubMed Web of Science ®Google Scholar
• Ganzeboom, M., Bakker, M., Cucchiarini, C., & Strik, H. (2016). Intelligibility of disordered speech: Global and detailed scores. In Proceedings of Interspeech 2016 (pp. 2503–2507). San Francisco, USA.
   Google Scholar
• Hodge, M. M., & Gotzke, C. L. (2014). Construct-related validity of the TOCS measures: Comparison of intelligibility and speaking rate scores in children with and without speech disorders. Journal of Communication Disorders, 51, 51–63. https://doi.org/10.1016/j.jcomdis.2014.06.007
   PubMed Web of Science ®Google Scholar
• Hollo, A., Staubitz, J. L., & Chow, J. C. (2020). Applying generalizability theory to optimize analysis of spontaneous teacher talk in elementary classrooms. Journal of Speech, Language, and Hearing Research, 63(6), 1947–1957. https://doi.org/10.1044/2020_JSLHR-19-00118
   PubMed Web of Science ®Google Scholar
• Hubers, F., Cucchiarini, C., Strik, H., & Dijkstra, T. (2019). Normative data of Dutch idiomatic expressions: Subjective judgments you can bank on. Frontiers in Psychology, 10, 1075. https://doi.org/10.3389/fpsyg.2019.01075
   PubMed Web of Science ®Google Scholar
• Hustad, K. C., & Cahill, M. A. (2003). Effects of presentation mode and repeated familiarization on intelligibility of dysarthric speech. American Journal of Speech-Language Pathology, 12(2), 198–208. https://doi.org/10.1044/1058-0360(2003/066)
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2006). Estimating the intelligibility of speakers with dysarthria. Folia Phoniatrica Et Logopaedica, 58(3), 217–228. https://doi.org/10.1159/000091735
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2007). Effects of speech stimuli and dysarthria severity on intelligibility scores and listener confidence ratings for speakers with Cerebral Palsy. Folia Phoniatrica Et Logopaedica, 59(6), 306–317. https://doi.org/10.1159/000108337
   PubMed Web of Science ®Google Scholar
• Hustad, K. C. (2008). The relationship between listener comprehension and intelligibility scores for speakers with dysarthria. Journal of Speech Language and Hearing Research, 51(3), 562. https://doi.org/10.1044/1092-4388(2008/040)
   PubMed Web of Science ®Google Scholar
• Ishikawa, K., de Alarcon, A., Khosla, S., Kelchner, L., Silbert, N., & Boyce, S. (2018). Predicting intelligibility deficit in dysphonic speech with cepstral peak prominence. Annals of Otology, Rhinology & Laryngology, 127(2), 69–78. https://doi.org/10.1177/0003489417743518
   PubMed Web of Science ®Google Scholar
• Ishikawa, K., Webster, J., & Ketring, C. (2021). Agreement between transcription- and rating-based intelligibility measurements for evaluation of dysphonic speech in noise. Clinical Linguistics & Phonetics, 35(10) , 1–13. https://doi.org/10.1080/02699206.2020.1852602
   PubMed Web of Science ®Google Scholar
• Kent, R. D., & Kim, Y. (2011). The assessment of intelligibility in motor speech disorders. In A. Lowit & R. D. Kent (Eds.), Assessment of motor speech disorders (pp. 21–37). Plural.
   Google Scholar
• Kent, R. D., Weismer, G., Kent, J. F., & Rosenbek, J. C. (1989). Toward phonetic intelligibility testing in dysarthria. Journal of Speech and Hearing Disorders, 54(4), 482. https://doi.org/10.1044/jshd.5404.482
   PubMedGoogle Scholar
• Levy, E. S., Moya-Galé, G., Chang, Y. H. M., Freeman, K., Forrest, K., Brin, M. F., & Ramig, L. A. (2020). The effects of intensive speech treatment on intelligibility in Parkinson’s disease: A randomised controlled trial. EClinicalMedicine, 24, Article 100429. https://doi.org/10.1016/j.eclinm.2020.100429
   PubMedGoogle Scholar
• Li, M., Shavelson, R. J., Yin, Y., Wiley, E., Li, M., & Shavelson, R. J. (2015). Generalizability theory. In R. L. Cautin, S. O. Lilienfeld, et al. (Eds.), The encyclopedia of clinical psychology (pp. 1–19). John Wiley & Sons. Inc.
   Google Scholar
• Liss, J. M., Spitzer, S. M., Caviness, J. N., & Adler, C. (2002). The effects of familiarization on intelligibility and lexical segmentation in hypokinetic and ataxic dysarthria. Journal of Acoustical Society of America, 112(6), 10. https://doi.org/10.1121/1.1515793
   Web of Science ®Google Scholar
• Maruthy, S., & Raj, N. (2014). Relationship between speech intelligibility and listener effort in Malayalam-speaking individuals with hypokinetic dysarthria. Speech, Language and Hearing, 17(4), 237–245. https://doi.org/10.1179/2050571X14Z.00000000057
   Google Scholar
• Mencke, E. O., Ochsner, G. J., & Testut, E. W. (1983). Listener judges and the speech intelligibility of deaf children. Journal of Communication Disorders, 16(3), 175–180. https://doi.org/10.1016/0021-9924(83)90031-X
   PubMed Web of Science ®Google Scholar
• Middag, C., Martens, J. P., Van Nuffelen, G., & De Bodt, M. (2009b). DIA: A tool for objective intelligibility assessment of pathological speech. In 6th International workshop on Models and Analysis of Vocal Emissions for Biomedical Applications (pp. 165–167).
   Google Scholar
• Middag, C., Martens, J., Van Nuffelen, G., & De Bodt, M. (2009a). Automated intelligibility assessment of pathological speech using phonological features. EURASIP Journal on Advances in Signal Processing 2009, 2009, Article 629030. https://doi.org/10.1155/2009/629030
   Web of Science ®Google Scholar
• Middag, C. (2012). Automatic analysis of pathological speech. Ghent University, Department of Electronics and information systems.
   Google Scholar
• Miller, N. (2013). Measuring up to speech intelligibility. International Journal of Language & Communication Disorders, 48(6), 601–612. https://doi.org/10.1111/1460-6984.12061
   PubMed Web of Science ®Google Scholar
• Monsen R. B. (1983). The Oral Speech Intelligibility of Hearing-Impaired Talkers. Journal of Speech & Hearing Disorders, 48(3), 286–296. https://doi.org/10.1044/jshd.4803.286
   PubMedGoogle Scholar
• Moore, C. T. (2016). gtheory: Apply generalizability theory with R. [Computer software]. Retrieved from https://CRAN.R-project.org/package=gtheory
   Google Scholar
• Nakayama, K., Yamamoto, T., Oda, C., Sato, M., Murakami, T., & Horiguchi, S. (2020). Effectiveness of Lee Silverman Voice Treatment® LOUD on Japanese-speaking patients with Parkinson’s disease. Rehabilitation research and practice, 2020, Article 6585264. https://doi.org/10.1155/2020/6585264
   Web of Science ®Google Scholar
• O’Brian, S., Packman, A., Onslow, M., & O’Brian, N. (2003). Generalizability Theory II: Application to perceptual scaling of speech naturalness in adults who stutter. Journal of Speech, Language & Hearing Research, 46(3), 718–723. https://doi.org/10.1044/1092-4388(2003/057)
   PubMed Web of Science ®Google Scholar
• R Core Team. (2014). R: A language and environment for statistical computing [Computer software]. http://www.R-project.org/
   Google Scholar
• Revelle, W. (2019) psych: Procedures for psychological, psychometric, and personality research [Computer software]. Northwestern University. https://CRAN.R-project.org/package=psych
   Google Scholar
• Rietveld, T. (2020). Human measurement techniques in speech and language pathology: Methods for research and clinical practice. Routledge.
   Google Scholar
• RStudio Team. (2020). RStudio: Integrated development for R [Computer software]. http://www.rstudio.com/
   Google Scholar
• Schiavetti, N. (1992). Scaling procedures for the measurement of speech intelligibility. In R. D. Kent (Ed.), Intelligibility in speech disorders: Theory, measurement and management (pp. 11–34). John Benjamins.
   Google Scholar
• Shavelson, R. J., & Webb, N. M. (2006). Generalizability theory. In J. L. Green, G. Camilli, & P. B. Elmore (Eds.), Handbook of complementary methods in education research (pp. 309–322). Lawrence Erlbaum Associates.
   Google Scholar
• Signorell, A., et al. (2021). DescTools: Tools for descriptive statistics (R package version 0.99.44) [Computer software]. https://cran.r-project.org/package=DescTools
   Google Scholar
• Stipancic, K. L., Tjaden, K., & Wilding, G. (2016). Comparison of intelligibility measures for adults with Parkinson’s disease, adults with multiple sclerosis, and healthy controls. Journal of Speech Language and Hearing Research, 59(2), 230. https://doi.org/10.1044/2015_JSLHR-S-15-0271
   PubMed Web of Science ®Google Scholar
• Sussman, J. E., & Tjaden, K. (2012). Perceptual measures of speech from individuals with Parkinson’s disease and multiple sclerosis: Intelligibility and beyond. Journal of Speech, Language, and Hearing Research, 55(4), 1208–1219. https://doi.org/10.1044/1092-4388(2011/11-0048)
   PubMed Web of Science ®Google Scholar
• Tjaden, K. K., & Liss, J. M. (1995a). The role of listener familiarity in the perception of dysarthric speech. Clinical Linguistics & Phonetics, 9(2), 139–154. https://doi.org/10.3109/02699209508985329
   Web of Science ®Google Scholar
• Tjaden, K., Kain, A., & Lam, J. (2014). Hybridizing conversational and clear speech to investigate the source of increased intelligibility in speakers with Parkinson’s disease. Journal of Speech, Language, and Hearing Research, 57(4), 1191–1205. https://doi.org/10.1044/2014_JSLHR-S-13-0086
   PubMed Web of Science ®Google Scholar
• Tjaden, K., & Liss, J. M. (1995b). The influence of familiarity on judgments of treated speech. American Journal of Speech-Language Pathology, 4(1), 39–48. https://doi.org/10.1044/1058-0360.0401.39
   Google Scholar
• Tjaden, K., & Wilding, G. (2010). Effects of speaking task on intelligibility in Parkinson’s disease. Clinical Linguistics & Phonetics, 25(2), 155–168. https://doi.org/10.3109/02699206.2010.520185
   PubMed Web of Science ®Google Scholar
• Van de Weijer, J., & Slis, I. (1991). Nasaliteitsmeting met de Nasometer Logopedie en Foniatrie, 63, 97–101.
   Google Scholar
• Van Nuffelen, G., De Bodt, M., Guns, C., Wuyts, F., & Van de Heyning, P. (2008). Reliability and clinical relevance of segmental analysis based on intelligibility assessment. Folia Phoniatrica et Logopaedica, 60(5), 264–268. https://doi.org/10.1159/000153433
   PubMed Web of Science ®Google Scholar
• Van Nuffelen, G., De Bodt, M., Vanderwegen, J., Van de Heyning, P., & Wuyts, F. (2010). Effect of rate control on speech production and intelligibility in dysarthria. Folia Phoniatrica Et Logopaedica, 62(3), 110–119. https://doi.org/10.1159/000287209
   PubMed Web of Science ®Google Scholar
• Van Nuffelen, G., Middag, C., De Bodt, M., & Martens, J. P. (2009). Speech technology-based assessment of phoneme intelligibility in dysarthria. International Journal of Language & Communication Disorders, 44(5), 716–730. https://doi.org/10.1080/13682820802342062
   PubMed Web of Science ®Google Scholar
• Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S (4th ed.). Springer. https://www.stats.ox.ac.uk/pub/MASS4/
   Google Scholar
• Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006). Reliability coefficients and generalizability theory. Handbook of Statistics, 26, 81–124. https://doi.org/10.1016/S0169-7161(06)26004-8
   Google Scholar
• Wells, C. S., & Wollack, J. A. (2003). An instructor’s guide to understanding test reliability. Testing & Evaluation Services, University of Wisconsin.
   Google Scholar
• Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. New York: Springer-Verlag. https://ggplot2.tidyverse.org
   Google Scholar
• Xue, W., Ramos, V. M., Harmsen, W., Cucchiarini, C., van Hout, R. W. N. M., & Strik, H. (2020). Towards a comprehensive assessment of speech intelligibility for pathological speech. In Proceedings of interspeech 2020 (pp. 3146–3150). Shanghai, China.
   Google Scholar
• Xue, W., van Hout, R., Boogmans, F., Ganzeboom, M., Cucchiarini, C., & Strik, H. (2021). Speech intelligibility of dysarthric speech: Human scores and acoustic-phonetic features. In Proceedings of interspeech 2021 (pp. 2911–2915). Brno, Czech Republic.
   Google Scholar
• Yilmaz, E., Ganzeboom, M. S., Cucchiarini, C., & Strik, H. (2016). Combining non-pathological data of different language varieties to improve DNN-HMM performance on pathological speech. In Proceedings of interspeech 2016 (pp. 218–222). San Francisco, USA.
   Google Scholar
• Yorkston, K. M., & Beukelman, D. R. (1978). A comparison of techniques for measuring intelligibility of dysarthric speech. Journal of Communication Disorders, 11(6), 499–512. https://doi.org/10.1016/0021-9924(78)90024-2
   PubMed Web of Science ®Google Scholar
• Yorkston, K. M., & Beukelman, D. R. (1981). Communication efficiency of dysarthric speakers as measured by sentence intelligibility and speaking rate. Journal of Speech and Hearing Disorders, 46(3), 296–301. https://doi.org/10.1044/jshd.4603.296
   PubMedGoogle Scholar
• Yorkston, K., Beukelman, D., & Tice, R. (1996). Sentence intelligibility test [Computer software]. Tice Technologies.
   Google Scholar
• Yuan, F., Guo, X., Wei, X., Xie, F., Zheng, J., Huang, Y., Huang, Z., Chang, Z., Li, H., Guo, Y., Chen, J., Guo, J., Tang, B., Deng, B., & Wang, Q. (2020). Lee Silverman Voice Treatment for dysarthria in patients with Parkinson’s disease: A systematic review and meta-analysis. European Journal of Neurology, 27(10), 1957–1970. https://doi.org/10.1111/ene.14399
   PubMed Web of Science ®Google Scholar