Sensitivity, reliability and convergent validity of sequential dual-task measures of listening effort

References

• Alhanbali, S., P. Dawes, R. E. Millman, and K. J. Munro. 2019. “Measures of Listening Effort Are Multidimensional.” Ear and Hearing 40 (5):1084–1097. doi:10.1097/AUD.0000000000000697.
   PubMed Web of Science ®Google Scholar
• Alhanbali, S., K. J. Munro, P. Dawes, P. J. Carolan, and R. E. Millman. 2021. “Dimensions of Self-reported Listening Effort and Fatigue on a Digits-in-Noise Task, and Association with Baseline Pupil Size and Performance Accuracy.” International Journal of Audiology, 60: 1–11. doi: 10.1080/14992027.2020.1853262
   Google Scholar
• Anwyl-Irvine, A., E. S. Dalmaijer, N. Hodges, and J. K. Evershed. 2021. “Realistic Precision and Accuracy of Online Experiment Platforms, Web Browsers, and Devices.” Behavior Research Methods 53 (4): 1407–1425. doi:10.3758/s13428-020-01501-5.
   PubMed Web of Science ®Google Scholar
• Baayen, R. H., D. J. Davidson, and D. M. Bates. 2008. “Mixed-effects Modeling with Crossed Random Effects for Subjects and Items.” Journal of Memory and Language 59 (4): 390–412. doi:10.1016/j.jml.2007.12.005.
   Web of Science ®Google Scholar
• Baddeley, A. 2012. “Working Memory: Theories, Models, and Controversies.” Annual Review of Psychology 63: 1–29. doi:10.1146/annurev-psych-120710-100422.
   PubMed Web of Science ®Google Scholar
• Baddeley, A. D., and G. Hitch. 1974. “Working Memory.” In Psychology of Learning and Motivation, edited by G. A. Bower, Vol. 8, 47–89. Elsevier.
   Google Scholar
• Bakdash, J. Z., and L. R. Marusich. 2017. “Repeated Measures Correlation.” Frontiers in Psychology 8: 456. doi:10.3389/fpsyg.2017.00456.
   PubMed Web of Science ®Google Scholar
• Barr, D. J., R. Levy, C. Scheepers, and H. J. Tily. 2013. “Random Effects Structure for Confirmatory Hypothesis Testing: Keep It Maximal.” Journal of Memory and Language 68 (3):255–278. doi:10.1016/j.jml.2012.11.001.
   Web of Science ®Google Scholar
• Bates, D., M. Mächler, B. Bolker, and S. Walker. 2014. “Fitting Linear Mixed-Effects Models Using lme4.” ArXiv Preprint ArXiv:1406.5823.
   Google Scholar
• Bates, D., R. Kliegl, S. Vasishth, and H. Baayen. 2015. “Parsimonious Mixed Models.” ArXiv Preprint ArXiv:1506.04967.
   Google Scholar
• Benjamini, Y., and Y. Hochberg. 1995. “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.” Journal of the Royal Statistical Society: Series B (Methodological) 57 (1): 289–300. doi:10.1111/j.2517-6161.1995.tb02031.x.
   Web of Science ®Google Scholar
• Bogacz, R., E.-J. Wagenmakers, B. U. Forstmann, and S. Nieuwenhuis. 2010. “The Neural Basis of the Speed–Accuracy Tradeoff.” Trends in Neurosciences 33 (1): 10–16. doi:10.1016/j.tins.2009.09.002.
   PubMed Web of Science ®Google Scholar
• Bridges, D., A. Pitiot, M. R. MacAskill, and J. W. Peirce. 2020. “The Timing Mega-study: Comparing a Range of Experiment Generators, Both Lab-based and Online.” PeerJ. 8: e9414. doi:10.7717/peerj.9414.
   PubMed Web of Science ®Google Scholar
• Cicchetti, D. V. 1994. “Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology.” Psychological Assessment 6 (4): 284–290. doi:10.1037/1040-3590.6.4.284.
   Google Scholar
• Cousineau, D. 2005. “Confidence Intervals in Within-subject Designs: A Simpler Solution to Loftus and Masson’s Method.” Tutorials in Quantitative Methods for Psychology 1 (1): 42–45. doi:10.20982/tqmp.01.1.p042.
   Google Scholar
• Doherty, J. M., C. Belletier, S. Rhodes, A. Jaroslawska, P. Barrouillet, V. Camos, N. Cowan, M. Naveh-Benjamin, and R. H. Logie. 2019. “Dual-task Costs in Working Memory: An Adversarial Collaboration.” Journal of Experimental Psychology. Learning, Memory, and Cognition 45 (9): 1529–1551. doi:10.1037/xlm0000668.
   PubMed Web of Science ®Google Scholar
• Etymotic, R. I. 2005. Bamfor-Kowal-Bench Speech-in-Noise Test (Version 1.3) Manual [Audio CD]. Elk Grove Village, IL.
   Google Scholar
• Fletcher, T. D. 2014. Psychometric: Applied Psychometric Theory (R Package Version 2.2)[Computer software]. https://CRAN.R-project.org/package=psychometric.
   Google Scholar
• Francis, A. L., and H. C. Nusbaum. 2009. “Effects of Intelligibility on Working Memory Demand for Speech Perception.” Attention, Perception, & Psychophysics 71 (6): 1360–1374. doi:10.3758/APP.71.6.1360.
   PubMed Web of Science ®Google Scholar
• Gagne, J.-P., J. Besser, and U. Lemke. 2017. “Behavioral Assessment of Listening Effort Using a Dual-task Paradigm: A Review.” Trends in Hearing 21: 2331216516687287. doi:10.1177/2331216516687287.
   Web of Science ®Google Scholar
• Giuliani, N. P., C. J. Brown, and Y.-H. Wu. 2021. “Comparisons of the Sensitivity and Reliability of Multiple Measures of Listening Effort.” Ear and Hearing 42 (2): 465–474. doi:10.1097/AUD.0000000000000950.
   PubMed Web of Science ®Google Scholar
• Houben, R., M. van Doorn-Bierman, and W. A. Dreschler. 2013. “Using Response Time to Speech as a Measure for Listening Effort.” International Journal of Audiology 52 (11): 753–761. doi:10.3109/14992027.2013.832415.
   PubMed Web of Science ®Google Scholar
• Hunter, C. R. 2021. “Dual-task Accuracy and Response Time Index Effects of Spoken Sentence Predictability and Cognitive Load on Listening Effort.” Trends in Hearing 25: 23312165211018092. doi:10.1177/23312165211018092.
   Web of Science ®Google Scholar
• Hunter, C. R., and L. E. Humes. 2022. “Predictive Sentence Context Reduces Listening Effort in Older Adults with and without Hearing Loss and with High and Low Working Memory Capacity.” Ear and Hearing 43 (4): 1164–1177. doi:10.1097/AUD.0000000000001192.
   Google Scholar
• Hunter, C. R., and D. B. Pisoni. 2018. “Extrinsic Cognitive Load Impairs Spoken Word Recognition in High- and Low-predictability Sentences.” Ear and Hearing 39 (2): 378–389. doi:10.1097/AUD.0000000000000493.
   PubMed Web of Science ®Google Scholar
• Kahneman, D. 1973. Attention and Effort. Englewood Cliffs, NJ: Prentice-Hall, Inc.
   Google Scholar
• Keidser, G., G. Naylor, D. S. Brungart, A. Caduff, J. Campos, S. Carlile, M. G. Carpenter, G. Grimm, V. Hohmann, I. Holube, et al. 2020. “The Quest for Ecological Validity in Hearing Science: What It Is, Why It Matters, and How to Advance It.” Ear & Hearing 41 (Supplement 1): 5S–19S. doi:10.1097/AUD.0000000000000944.
   PubMedGoogle Scholar
• Kidd, G., C. R. Mason, V. M. Richards, F. J. Gallun, and N. I. Durlach. 2008. “Informational masking.” In Auditory Perception of Sound Sources, edited by W. A. Yost and R. R Fay, 143–189. Berlin, Germany: Springer.
   Google Scholar
• Kuznetsova, A., P. B. Brockhoff, and R. H. Christensen. 2017. “lmerTest Package: Tests in Linear Mixed Effects Models.” Journal of Statistical Software 82 (13): 1–26. doi: 10.18637/jss.v082.i13.
   Google Scholar
• Luce, P. A., T. C. Feustel, and D. B. Pisoni. 1983. “Capacity Demands in Short-term Memory for Synthetic and Natural Speech.” Human Factors 25 (1): 17–32. doi:10.1177/001872088302500102.
   PubMed Web of Science ®Google Scholar
• McGarrigle, R., K. J. Munro, P. Dawes, A. J. Stewart, D. R. Moore, J. G. Barry, and S. Amitay. 2014. “Listening Effort and Fatigue: What Exactly Are We Measuring? A British Society of Audiology Cognition in Hearing Special Interest Group ‘White Paper’.” International Journal of Audiology 53 (7): 433–445. doi:10.3109/14992027.2014.890296.
   PubMed Web of Science ®Google Scholar
• McGraw, K. O., and S. P. Wong. 1996. “Forming Inferences about Some Intraclass Correlation Coefficients.” Psychological Methods 1 (1): 30–46. doi:10.1037/1082-989X.1.1.30.
   Web of Science ®Google Scholar
• Morey, C. C., and N. Cowan. 2004. “When Visual and Verbal Memories Compete: Evidence of Cross-domain Limits in Working Memory.” Psychonomic Bulletin & Review 11 (2): 296–301. doi:10.3758/bf03196573.
   PubMed Web of Science ®Google Scholar
• Ohlenforst, B., A. A. Zekveld, E. P. Jansma, Y. Wang, G. Naylor, A. Lorens, T. Lunner, and S. E. Kramer. 2017. “Effects of Hearing Impairment and Hearing Aid Amplification on Listening Effort: A Systematic Review.” Ear and Hearing 38 (3): 267–281. doi:10.1097/AUD.0000000000000396.
   PubMed Web of Science ®Google Scholar
• Petersen, E. B., M. Wöstmann, J. Obleser, S. Stenfelt, and T. Lunner. 2015. “Hearing Loss Impacts Neural Alpha Oscillations under Adverse Listening Conditions.” Frontiers in Psychology 6: 177. doi:10.3389/fpsyg.2015.00177.
   Web of Science ®Google Scholar
• Pichora-Fuller, M. K., S. E. Kramer, M. A. Eckert, B. Edwards, B. W. Hornsby, L. E. Humes, U. Lemke, T. Lunner, M. Matthen, C. L. Mackersie, et al. 2016. “Hearing Impairment and Cognitive Energy: The Framework for Understanding Effortful Listening (FUEL).” Ear & Hearing 37 (1): . S–27S. doi:10.1097/AUD.0000000000000312.
   Google Scholar
• R Development Core Team. 2013. R: A language and environment for statistical computing; http://www.R-project.org/.
   Google Scholar
• Rakerd, B., P. Seitz, and M. Whearty. 1996. “Assessing the Cognitive Demands of Speech Listening for People with Hearing Losses.” Ear and Hearing 17 (2): 97–106. doi:10.1097/00003446-199604000-00002.
   PubMed Web of Science ®Google Scholar
• Ratcliff, R. 1993. “Methods for Dealing with Reaction Time Outliers.” Psychological Bulletin 114 (3): 510–532. doi:10.1037/0033-2909.114.3.510.
   PubMed Web of Science ®Google Scholar
• Rönnberg, J., T. Lunner, A. Zekveld, P. Sörqvist, H. Danielsson, B. Lyxell, O. Dahlström, C. Signoret, S. Stenfelt, M. K. Pichora-Fuller, et al. 2013. “The Ease of Language Understanding (ELU) Model: Theoretical, Empirical, and Clinical Advances.” Frontiers in Systems Neuroscience 7: 31. doi:10.3389/fnsys.2013.00031.
   PubMedGoogle Scholar
• Sarampalis, A., S. Kalluri, B. Edwards, and E. Hafter. 2009. “Objective Measures of Listening Effort: Effects of Background Noise and Noise Reduction.” Journal of Speech, Language, and Hearing Research: JSLHR 52 (5): 1230–1240. doi:10.1044/1092-4388(2009/08-0111).
   PubMed Web of Science ®Google Scholar
• Strand, J. F., V. A. Brown, M. B. Merchant, H. E. Brown, and J. Smith. 2018. “Measuring Listening Effort: Convergent Validity, Sensitivity, and Links With Cognitive and Personality Measures.” Journal of Speech, Language, and Hearing Research 61 (6):1463–1486. doi:10.1044/2018_JSLHR-H-17-0257.
   PubMed Web of Science ®Google Scholar
• Strand, J. F., L. Ray, N. H. Dillman-Hasso, J. Villanueva, and V. A. Brown. 2020. “Understanding Speech Amid the Jingle and Jangle: Recommendations for Improving Measurement Practices in Listening Effort Research.” Auditory Perception & Cognition 3 (4): 169–188. doi:10.1080/25742442.2021.1903293.
   PubMedGoogle Scholar
• Tun, P. A., S. McCoy, and A. Wingfield. 2009. “Aging, Hearing Acuity, and the Attentional Costs of Effortful Listening.” Psychology and Aging 24 (3): 761–766. doi:10.1037/a0014802.
   PubMed Web of Science ®Google Scholar
• Wagenmakers, E.-J., H. L. Van Der Maas, and R. P. Grasman. 2007. “An EZ-diffusion Model for Response Time and Accuracy.” Psychonomic Bulletin & Review 14 (1): 3–22. doi:10.3758/BF03194023.
   PubMed Web of Science ®Google Scholar
• Watson, C. S. 2005. “Some Comments on Informational Masking.” Acta Acustica United with Acustica 91 (3): 502–512.
   Web of Science ®Google Scholar
• Wendt, D., R. K. Hietkamp, and T. Lunner. 2017. “Impact of Noise and Noise Reduction on Processing Effort: A Pupillometry Study.” Ear and Hearing 38 (6): 690–700. doi:10.1097/AUD.0000000000000454.
   PubMed Web of Science ®Google Scholar
• Wickelgren, W. A. 1977. “Speed-accuracy Tradeoff and Information Processing Dynamics.” Acta Psychologica 41 (1): 67–85. doi:10.1016/0001-6918(77)90012-9.
   Web of Science ®Google Scholar
• Wilson, R. H., and R. McArdle. 2007. “Intra-and Inter-session Test, Retest Reliability of the Words-in-Noise (WIN) Test.” Journal of the American Academy of Audiology 18 (10): 813–825.
   PubMed Web of Science ®Google Scholar
• Winn, M. B., and K. H. Teece. 2021. “Slower Speaking Rate Reduces Listening Effort among Listeners with Cochlear Implants.” Ear and Hearing 42 (3): 584–595. doi:10.1097/AUD.0000000000000958.
   PubMed Web of Science ®Google Scholar
• Woods, K. J., M. H. Siegel, J. Traer, and J. H. McDermott. 2017. “Headphone Screening to Facilitate Web-based Auditory Experiments.” Attention, Perception, & Psychophysics 79 (7): 2064–2072. doi:10.3758/s13414-017-1361-2.
   PubMed Web of Science ®Google Scholar
• Wu, Y.-H., E. Stangl, X. Zhang, J. Perkins, and E. Eilers. 2016. “Psychometric Functions of Dual-task Paradigms for Measuring Listening Effort.” Ear and Hearing 37 (6): 660–670. doi:10.1097/AUD.0000000000000335.
   PubMed Web of Science ®Google Scholar
• Zekveld, A. A., and S. E. Kramer. 2014. “Cognitive Processing Load across a Wide Range of Listening Conditions: Insights from Pupillometry.” Psychophysiology 51 (3): 277–284.
   PubMed Web of Science ®Google Scholar