Predicting confrontation naming item difficulty

References

• Ash, R., Crook, J., Dannenberg, R., Drung, B., Johnson, V., Lucius, L., & Shaw, M. (1999). Audacity (Version 2.06) [Computer software]. Retrieved from https://www.audacityteam.org/
   Google Scholar
• Babbitt, E. M., Heinemann, A. W., Semik, P., & Cherney, L. R. (2011). Psychometric properties of the Communication Confidence Rating Scale for Aphasia (CCRSA): Phase 2. Aphasiology, 25, 727–735.
   Web of Science ®Google Scholar
• Barry, C., Hirsh, K. W., Johnston, R. A., & Williams, C. L. (2001). Age of acquisition, word frequency, and the locus of repetition priming of picture naming. Journal of Memory and Language, 44, 350–375.
   Web of Science ®Google Scholar
• Bates, E., D’amico, S., Jacobsen, T., Székely, A., Andonova, E., Devescovi, A., … Tzeng, O. (2003). Timed picture naming in seven languages. Psychonomic Bulletin & Review, 10, 344–380.
   PubMed Web of Science ®Google Scholar
• Belke, E., Brysbaert, M., Meyer, A. S., & Ghyselinck, M. (2005). Age of acquisition effects in picture naming: Evidence for a lexical-semantic competition hypothesis. Cognition, 96, B45–B54.
   PubMed Web of Science ®Google Scholar
• Beltyukova, S. A., Stone, G. M., & Ellis, L. W. (2008). Rasch analysis of word identification and magnitude estimation scaling responses in measuring naïve listeners’ judgments of speech intelligibility of children with severe-to-profound hearing impairments. Journal of Speech Language and Hearing Research, 51, 1124.
   PubMed Web of Science ®Google Scholar
• Bonin, P., & Fayol, M. (2002). Frequency effects in the written and spoken production of homophonic picture names. European Journal of Cognitive Psychology, 14, 289–313.
   Web of Science ®Google Scholar
• Bormann, T. (2011). The role of lexical-semantic neighborhood in object naming: Implications for models of lexical access. Frontiers in Psychology, 2, 127.
   PubMed Web of Science ®Google Scholar
• Britt, A. E., Ferrara, C., & Mirman, D. (2016). Distinct effects of lexical and semantic competition during picture naming in younger adults, older adults, and people with aphasia. Frontiers in Psychology, 7, 813.
   PubMed Web of Science ®Google Scholar
• Brysbaert, M., & Ghyselinck, M. (2006). The effect of age of acquisition: Partly frequency related, partly frequency independent. Visual Cognition, 13, 992–1011.
   Web of Science ®Google Scholar
• Brysbaert, M., & New, B. (2009). Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41, 977–990.
   PubMed Web of Science ®Google Scholar
• Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5.
   PubMed Web of Science ®Google Scholar
• Cai, Q., & Brysbaert, M. (2010). SUBTLEX-CH: Chinese word and character frequencies based on film subtitles. PLOS ONE, 5, e10729. https://doi.org/10.1371/journal.pone.0010729
   PubMed Web of Science ®Google Scholar
• Caramazza, A., Costa, A., Miozzo, M., & Bi, Y. (2001). The specific-word frequency effect: Implications for the representation of homophones in speech production. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 1430–1450.
   PubMed Web of Science ®Google Scholar
• Casler, K., Bickel, L., & Hackett, E. (2013). Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29, 2156–2160.
   Web of Science ®Google Scholar
• Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., … Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63, 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011
   PubMed Web of Science ®Google Scholar
• Cuetos, F., Glez-Nosti, M., Barbon, A., & Brysbaert, M. (2011). SUBTLEX-ESP: Spanish word frequencies based on film subtitles. Psicologica: International Journal of Methodology and Experimental Psychology, 32, 133–143.
   Google Scholar
• De Ayala, R. J. (2009). Theory and practice of item response theory. New York, New York: Guilford Publications.
   Google Scholar
• Dell, G. S. (1990). Effects of frequency and vocabulary type on phonological speech errors. Language and Cognitive Processes, 5, 313–349.
   Web of Science ®Google Scholar
• Dell, G. S., Schwartz, M. F., Martin, N., Saffran, E. M., & Gagnon, D. A. (1997). Lexical access in aphasic and nonaphasic speakers. Psychological Review, 104, 801–838.
   PubMed Web of Science ®Google Scholar
• Dent, K., Johnston, R. A., & Humphreys, G. W. (2008). Age of acquisition and word frequency effects in picture naming: A dual-task investigation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 282–301.
   PubMed Web of Science ®Google Scholar
• Donovan, N. J., Velozo, C. A., & Rosenbek, J. C. (2007). The Communicative Effectiveness Survey: Investigating its item-level psychometric properties. Journal of Medical Speech - Language Pathology, 15, 433–447.
   Web of Science ®Google Scholar
• Eadie, T. L., Yorkston, K. M., Klasner, E. R., Dudgeon, B. J., Deitz, J. C., Baylor, C. R., … Amtmann, D. (2006). Measuring communicative participation: A review of self-report instruments in speech-language pathology. American Journal of Speech-Language Pathology, 15, 307. https://doi.org/10.1044/1058-0360(2006/030)
   PubMed Web of Science ®Google Scholar
• Edmonds, L. A., & Donovan, N. J. (2012). Item-level psychometrics and predictors of performance for Spanish/English bilingual speakers on an object and action naming battery. Journal of Speech, Language, and Hearing Research, 55, 359–381.
   PubMed Web of Science ®Google Scholar
• Ellis, A. W., & Lambon Ralph, M. A. (2000). Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: Insights from connectionist networks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 1103–1123. DOI:10.1037/0278-7393.26.5.1103
   PubMed Web of Science ®Google Scholar
• Embretson, S. E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380–396. http://dx.doi.org/10.1037/1082-989X.3.3.380
   Web of Science ®Google Scholar
• Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, N.J.: L. Erlbaum Associates.
   Google Scholar
• Enders, C. K. (2010). Applied Missing Data Analysis. New York, NY: Guilford Press.
   Google Scholar
• Enright, M. K., Morley, M., & Sheehan, K. M. (2002). Items by design: The impact of systematic feature variation on item statistical characteristics. Applied Measurement in Education, 15, 49–74.
   Web of Science ®Google Scholar
• Fergadiotis, G., Kellough, S., & Hula, W. D. (2015). Item response theory modeling of the Philadelphia Naming Test. Journal of Speech, Language, and Hearing Research, 58, 865–877.
   PubMed Web of Science ®Google Scholar
• Feyereisen, P., Der Borght, V., & Seron, X. (1988). The operativity effect in naming: A re-analysis. Neuropsychologia, 26, 401–415.
   PubMed Web of Science ®Google Scholar
• Fox, J., & Weisberg, S. (2011). An R Companion to Applied Regression (Second ed.). Thousand Oaks, CA: Sage.
   Google Scholar
• Foygel, D., & Dell, G. S. (2000). Models of impaired lexical access in speech production. Journal of Memory and Language, 43, 182–216.
   Web of Science ®Google Scholar
• Francis, W., & Kucera, H. (1982). Frequency Analysis of English Usage. Boston, MA: Houghton Mifflin Company.
   Google Scholar
• Freund, P. A., Hofer, S., & Holling, H. (2008). Explaining and controlling for the psychometric properties of computer-generated figural matrix items. Applied Psychological Measurement, 32, 195–210.
   Web of Science ®Google Scholar
• Gierl, M. J., & Haladyna, T. M. (Eds.). (2012). Automatic Item Generation: Theory and Practice. New York, NY: Routledge.
   Google Scholar
• Gollan, T. H., & Brown, A. S. (2006). From tip-of-the-tongue (TOT) data to theoretical implications in two steps: When more TOTs means better retrieval. Journal of Experimental Psychology: General, 135, 462–483.
   PubMed Web of Science ®Google Scholar
• Goodglass, H., & Wingfield, A. (1997). Anomia: Neuroanatomical and cognitive correlates. San Diego, CA: Academic Press.
   Google Scholar
• Gordon, J. K. (2008). Measuring the lexical semantics of picture description in aphasia. Aphasiology, 22, 839–852.
   PubMed Web of Science ®Google Scholar
• Hameau, S., Nickels, L., & Biedermann, B. (2017). Influential neighbours? The role of semantic neighbours in word production. Frontiers in Human Neuroscience Conference Abstract: Academy of Aphasia 55th Annual Meeting. https://doi.org/10.3389/conf.fnhum.2017.223.00117
   Google Scholar
• Harley, T. A., & Bown, H. E. (1998). What causes a tip-of-the-tongue state? Evidence for lexical neighbourhood effects in speech production. British Journal of Psychology, 89, 151–174.
   Web of Science ®Google Scholar
• Herbert, R., Hickin, J., Howard, D., Osborne, F., & Best, W. (2008). Do picture-naming tests provide a valid assessment of lexical retrieval in conversation in aphasia? Aphasiology, 22, 184–203.
   Web of Science ®Google Scholar
• Humphreys, G. W., Riddoch, M. J., & Quinlan, P. T. (1988). Cascade processes in picture identification. Cognitive Neuropsychology, 5, 67–103.
   Web of Science ®Google Scholar
• James, L. E., & Burke, D. M. (2000). Phonological priming effects on word retrieval and tip-of-the-tongue experiences in young and older adults. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 1378–1391. http://dx.doi.org/10.1037/0278-7393.26.6.1378
   PubMed Web of Science ®Google Scholar
• Jescheniak, J. D., & Levelt, W. J. (1994). Word frequency effects in speech production: Retrieval of syntactic information and of phonological form. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 824–843.
   Web of Science ®Google Scholar
• Johnston, R. A., & Barry, C. (2005). Age of acquisition effects in the semantic processing of pictures. Memory & Cognition, 33, 905–912.
   PubMed Web of Science ®Google Scholar
• Johnston, R. A., & Barry, C. (2006). Age of acquisition and lexical processing. Visual Cognition, 13, 789–845.
   Web of Science ®Google Scholar
• Kaplan, E., Goodlgass, H., & Weintraub, S. (2001). Boston Naming Test (2nd ed.). Philadelphia, PA: Lippincott Williams & Wilkins.
   Google Scholar
• Kertesz, A. (1982). Western Aphasia Battery test manual. New York, NY: Grune & Stratton.
   Google Scholar
• Keuleers, E., Brysbaert, M., & New, B. (2010). SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles. Behavior Research Methods, 42, 643–650.
   PubMed Web of Science ®Google Scholar
• Kittredge, A. K., Dell, G. S., & Schwartz, M. F. (2007). Omissions in aphasic picture naming: Late age-of-acquisition is the culprit, not low semantic density. Brain and Language, 103, 132–133.
   Web of Science ®Google Scholar
• Kittredge, A. K., Dell, G. S., Verkuilen, J., & Schwartz, M. F. (2008). Where is the effect of frequency in word production? Insights from aphasic picture-naming errors. Cognitive Neuropsychology, 25, 463–492.
   PubMed Web of Science ®Google Scholar
• Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed. ed.). New York, NY: Guilford Press.
   Google Scholar
• Knobel, M., Finkbeiner, M., & Caramazza, A. (2008). The many places of frequency: Evidence for a novel locus of the lexical frequency effect in word production. Cognitive Neuropsychology, 25, 256–286.
   PubMed Web of Science ®Google Scholar
• Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection (pp. 1137–1145). Presented at the 14th International Joint Conference on Artificial Intelligence (IJCAI).
   Google Scholar
• Kuhn, M. (2018). R package caret: Classification and regression training (Version 6.0–80). Retrieved from https://CRAN.R-project.org/package=caret
   Google Scholar
• Kuperman, V., Stadthagen-Gonzalez, H., & Brysbaert, M. (2012). Age-of-acquisition ratings for 30,000 English words. Behavior Research Methods, 44, 978–990.
   PubMed Web of Science ®Google Scholar
• La Heij, W., Puerta-Melguizo, M. C., Van Oostrum, M., & Starreveld, P. A. (1999). Picture naming: Identical priming and word frequency interact. Acta Psychologica, 102, 77–95.
   Web of Science ®Google Scholar
• Laganaro, M., & Perret, C. (2011). Comparing electrophysiological correlates of word production in immediate and delayed naming through the analysis of word age of acquisition effects. Brain Topography, 24, 19–29.
   PubMed Web of Science ®Google Scholar
• Levelt, W. J., Roelofs, A., & Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22, 1–38.
   PubMed Web of Science ®Google Scholar
• Lima, S. D., Hale, S., & Myerson, J. (1991). How general is general slowing? Evidence from the lexical domain. Psychology and Aging, 6, 416–425. DOI:10.1037/0882-7974.6.3.416
   PubMed Web of Science ®Google Scholar
• Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Welsley Publishing Company.
   Google Scholar
• Lotery, A. J., Wiggam, M. I., Jackson, A. J., Refson, K., Fullerton, K. J., Gilmore, D. H., & Beringer, T. R. (2000). Correctable visual impairment in stroke rehabilitation patients. Age and Ageing, 29, 221–222. https://doi.org/10.1093/ageing/29.3.221
   PubMed Web of Science ®Google Scholar
• Mandera, P., Keuleers, E., Wodniecka, Z., & Brysbaert, M. (2015). Subtlex-pl: Subtitle-based word frequency estimates for Polish. Behavior Research Methods, 47, 471–483.
   PubMed Web of Science ®Google Scholar
• Matteucci, M., Mignani, S., & Veldkamp, B. P. (2012). Prior distributions for item parameters in IRT models. Communications in Statistics – Theory and Methods, 41, 2944–2958.
   Web of Science ®Google Scholar
• Meyer, A. S., & Bock, K. (1992). The tip-of-the-tongue phenomenon: Blocking or partial activation? Memory & Cognition, 20, 715–726.
   PubMed Web of Science ®Google Scholar
• Mirman, D. (2011). Effects of near and distant semantic neighbors on word production. Cognitive, Affective, & Behavioral Neuroscience, 11, 32–43.
   PubMed Web of Science ®Google Scholar
• Mirman, D., & Magnuson, J. S. (2008). Attractor dynamics and semantic neighborhood density: Processing is slowed by near neighbors and speeded by distant neighbors. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 65–79. http://doi.org/10.1037/0278-7393.34.1.65
   PubMed Web of Science ®Google Scholar
• Mirman, D., Strauss, T. J., Brecher, A., Walker, G. M., Sobel, P., Dell, G. S., & Schwartz, M. F. (2010). A large, searchable, web-based database of aphasic performance on picture naming and other tests of cognitive function. Cognitive Neuropsychology, 27, 495–504.
   PubMed Web of Science ®Google Scholar
• Morgan, G., Gorin, J., Gray, S., & Levy, R. (2011). Nonword item generation: Predicting item difficulty in nonword repetition. ProQuest Dissertations and Theses.
   Google Scholar
• Morrison, C. M., Ellis, A. W., & Quinlan, P. T. (1992). Age of acquisition, not word frequency, affects object naming, not recognition. Memory & Cognition, 20(6), 705–714.
   Google Scholar
• Navarrete, E., Scaltritti, M., Mulatti, C., & Peressotti, F. (2013). Age-of-acquisition effects in delayed picture-naming tasks. Psychonomic Bulletin & Review, 20, 148–153.
   PubMed Web of Science ®Google Scholar
• Nozari, N., Kittredge, A. K., Dell, G. S., & Schwartz, M. F. (2010). Naming and repetition in aphasia: Steps, routes, and frequency effects. Journal of Memory and Language, 63, 541–559.
   PubMed Web of Science ®Google Scholar
• Rapp, B., & Goldrick, M. (2000). Discreteness and interactivity in spoken word production. Psychological Review, 107, 460–499.
   PubMed Web of Science ®Google Scholar
• Reetz, H., & Jongman, A. (2011). Phonetics: Transcription, production, acoustics, and perception. Oxford, UK: Wiley-Blackwell.
   Google Scholar
• Refaeilzadeh, P., Tang, L., & Liu, H. (2016). Cross-Validation. In L. Liu & M. T. Özsu (Eds.), Encyclopedia of Database Systems (pp. 1–7). New York, NY: Springer New York. https://doi.org/10.1007/978-1-4899-7993-3_565-2
   Google Scholar
• Roach, A., Schwartz, M. F., Martin, N., Grewal, R. S., & Brecher, A. (1996). The Philadelphia naming test: Scoring and rationale. Clinical Aphasiology, 24, 121–133. Retrieved from http://eprints-prod-05.library.pitt.edu/215/1/24-09.pdf.
   Google Scholar
• Rubin, D. B. (1976). Inference and missing data. Biometrika, 63, 581–592.
   Web of Science ®Google Scholar
• Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.
   PubMed Web of Science ®Google Scholar
• Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime: User’s guide. Pittsburgh, PA: Psychology Software Incorporated.
   Google Scholar
• Schwartz, M., Dell, G., Martin, N., Gahl, S., & Sobel, P. (2006). A case-series test of the interactive two-step model of lexical access: Evidence from picture naming. Journal of Memory and Language, 54, 228–264.
   Web of Science ®Google Scholar
• Selst, M. V., & Jolicoeur, P. (1994). A solution to the effect of sample size on outlier elimination. The Quarterly Journal of Experimental Psychology Section A, 47, 631–650.
   Google Scholar
• Simon, H. A. (2001). Science seeks parsimony, not simplicity: Searching for pattern in phenomena. In A. Zellner, H. A. Keuzenkamp, and M. McAleer (Eds.), Simplicity, inference and modelling: Keeping it sophisticatedly simple (pp. 32–72). Cambridge: Cambridge University Press.
   Google Scholar
• Snodgrass, J. G., & Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory, 6, 174–215. http://dx.doi.org/10.1037/0278-7393.6.2.174
   PubMed Web of Science ®Google Scholar
• Snodgrass, J. G., & Yuditsky, T. (1996). Naming times for the Snodgrass and Vanderwart pictures. Behavior Research Methods, Instruments & Computers, 28, 516–536.
   Google Scholar
• Swiderski, A., Fergadiotis, G., & Hula, W. D. (2016). Predicting item difficulty of confrontation naming tests within an Item Response Theory framework. Presented at the Clinical Aphasiology Conference, Charlottesville, VA.
   Google Scholar
• Swinburn, K., Porter, G., & Howard, D. (2004). CAT: Comprehensive Aphasia Test. Hove, UK: Psychology Press.
   Google Scholar
• Székely, A., & Bates, E. (2000). Objective visual complexity as a variable in studies of picture naming. In Center for Research in Language Newsletter, 12(2). La Jolla: University of California, San Diego.
   Google Scholar
• Székely, A., D’Amico, S., Devescovi, A., Federmeier, K., Herron, D., Iyer, G., … Bates, E. (2003). Timed picture naming: Extended norms and validation against previous studies. Behavior Research Methods, Instruments, & Computers, 35, 621–633. https://doi.org/10.3758/BF03195542
   PubMedGoogle Scholar
• Szekely, A., Jacobsen, T., D’Amico, S., Devescovi, A., Andonova, E., Herron, D., … Bates, E. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory and Language, 51, 247–250.
   PubMed Web of Science ®Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (6th ed.). Boston: Pearson/Allyn & Bacon.
   Google Scholar
• Van Heuven, W. J. B., Mandera, P., Keuleers, E., & Brysbaert, M. (2014). SUBTLEX-UK: A new and improved word frequency database for British English. Quarterly Journal of Experimental Psychology (2006), 67, 1176–1190. https://doi.org/10.1080/17470218.2013.850521
   PubMed Web of Science ®Google Scholar
• Vitkovitch, M., & Humphreys, G. W. (1991). Perseverant responding in speeded naming of pictures: It’s in the links. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17, 664–680.
   Web of Science ®Google Scholar
• Wheeldon, L. R., & Monsell, S. (1992). The locus of repetition priming of spoken word production. The Quarterly Journal of Experimental Psychology, 44, 723–761.
   Web of Science ®Google Scholar