Measuring “Spoken Collocational Competence” in Communicative Speaking Assessment

References

• Bachman, L. F. (2007). What is the construct? The dialectic of abilities and contexts in defining constructs in language assessment. In J. D. Fox (Ed.), Language testing reconsidered (pp. 41–71). Ottawa: University of Ottawa Press.
   Google Scholar
• Barnbrook, G. (2007). Sinclair on collocation. International Journal of Corpus Linguistics, 12(2), 183–199. doi:10.1075/ijcl.12.2.06bar
   Google Scholar
• Benson, M., Benson, E., & Ilson, R. (1986). Lexicographic description of English. Philadelphia: John Benjamins.
   Google Scholar
• Biber, D., Conrad, S., & Leech, G. (2002). Longman student grammar of spoken and written English. Harlow, Essex: Longman.
   Google Scholar
• Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman grammar of spoken and written English. Harlow, UK: Longman.
   Google Scholar
• Bonk, W. J. (2000). Testing ESL learners’ knowledge of collocations (ERIC Document Reproduction Service No. ED 442 309). Retrieved from http://files.eric.ed.gov/fulltext/ED442309.pdf
   Google Scholar
• Bortfeld, H., & Brennan, S. E. (1997). Use and acquisition of idiomatic expressions in referring by native and non-native speakers. Discourse Processes, 23(2), 119–148. doi:10.1080/01638537709544986
   Web of Science ®Google Scholar
• Brown, A., Iwashita, N., & McNamara, T. (2005). An examination of rater orientations and test-taker performance on English-for-academic-purposes speaking tasks. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Bygate, M. (1987). Speaking. Oxford: Oxford University Press.
   Google Scholar
• Carter, R. (1998). Vocabulary: Applied linguistic perspectives. New York: Routledge.
   Google Scholar
• Chandler, P., & Sweller, J. (1991). Cognitive load theory and the format of instruction. Cognition and Instruction, 8(4), 293–332. doi:10.1207/s1532690xci0804_2
   Web of Science ®Google Scholar
• Chapelle, C. A. (1998). Construct definition and validity inquiry in SLA research. In L. F. Bachman & A. D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 32–70). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Chapelle, C. A., & Chung, Y.-R. (2010). The promise of NLP and speech processing technologies in language assessment. Language Testing, 27(3), 301–315. doi:10.1177/0265532210364405
   Web of Science ®Google Scholar
• Chapelle, C. A., Enright, M. K., & Jamieson, J. M. (2010). Does an argument-based approach to validity make a difference? Educational Measurement: Issues and Practice, 29(1), 3–13. doi:10.1111/j.1745-3992.2009.00165.x
   Google Scholar
• Clauser, B. E., Kane, M. T., & Swanson, D. B. (2002). Validity issues for performance-based tests scored with computer-automated scoring systems. Applied Measurement in Education, 15(4), 413–432. doi:10.1207/S15324818AME1504_05
   Web of Science ®Google Scholar
• Conklin, K., & Schmitt, N. (2012). The processing of formulaic language. Annual Review of Applied Linguistics, 32, 45–61. doi:10.1017/S0267190512000074
   Web of Science ®Google Scholar
• Cowie, A. P. (1978). The place of illustrative material and collocations in the design of a learner’s dictionary. In P. Strevens (Ed.), In honour of A.S. Hornby (pp. 127–139). Oxford: Oxford University Press.
   Google Scholar
• Crutchley, A. (2007). Comprehension of idiomatic verb + particle constructions in 6- to 11-year-old children. First Language, 27(3), 203–226. doi:10.1177/0142723707078317
   Google Scholar
• Davies, M. (2010). The Corpus of Contemporary American English as the first reliable monitor corpus of English. Literary and Linguistic Computing, 25(4), 447–464. doi:10.1093/llc/fqq018
   Google Scholar
• Ellis, N. C. (1996). Sequencing in SLA: Phonological memory, chunking, and points of order. Studies in Second Language Acquisition, 18(1), 91–126. doi:10.1017/S0272263100014698
   Google Scholar
• Ellis, N. C. (2008). Phraseology: The periphery and the heart of language. In F. Meunier & S. Granger (Eds.), Phraseology in foreign language learning and teaching (pp. 1–14). Amsterdam: John Benjamins.
   Google Scholar
• Enright, M. K., & Quinlan, T. (2010). Complementing human judgment of essays written by English language learners with e-rater® scoring. Language Testing, 27(3), 317–334. doi:10.1177/0265532210363144
   Web of Science ®Google Scholar
• Evert, S. (2005). The statistics of word cooccurrences: Word pairs and collocations ( Unpublished doctoral dissertation). University of Stuttgart, Stuttgart, Germany.
   Google Scholar
• Fernando, C. (1996). Idioms and idiomaticity. Oxford: Oxford University Press.
   Google Scholar
• Firth, J. R. (Ed.). (1957). Papers in linguistics 1934-51. Oxford: Oxford University Press.
   Google Scholar
• Fitzpatrick, T. (2006). Habits and rabbits: Word associations and the L2 lexicon. EUROSLA Yearbook, 6(1), 121–146. doi:10.1075/eurosla.6.09fit
   Google Scholar
• Fulcher, G. (2003). Testing second language speaking. New York: Pearson Longman.
   Google Scholar
• Futagi, Y., Deane, P., Chodorow, M., & Tetreault, J. (2008). A computational approach to detecting collocation errors in the writing of non-native speakers of English. Computer Assisted Language Learning, 21(4), 353–367. doi:10.1080/09588220802343561
   Google Scholar
• Glucksberg, S. (1993). Idiom meanings and allusional content. In C. Cacciari & P. Tabossi (Eds.), Idioms: Processing, structure, and interpretation (pp. 3–26). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Halliday, M. A. K., & Hasan, R. (1976). Cohesion in English. London: Longman.
   Google Scholar
• Handl, S. (2008). Essential collocations for learner of English: The role of collocational direction and weight. In F. Meunier & S. Granger (Eds.), Phraseology in foreign language learning and teaching (pp. 43–66). Amsterdam: John Benjamins.
   Google Scholar
• Howarth, P. (1998). The phraseology of learners’ academic writing. In A. Cowie (Ed.), Phraseology: Theory, analysis, and applications (pp. 161–186). Oxford, UK: Oxford University Press.
   Google Scholar
• Jones, N., & Saville, N. (2016). Learning oriented assessment: A systemic approach. Cambridge: Cambridge University Press.
   Google Scholar
• Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. doi:10.1111/jedm.2013.50.issue-1
   Web of Science ®Google Scholar
• Kennedy, G. (2008). Phraseology and language pedagogy: Semantic preference associated with English verbs in the British National Corpus. In F. Meunier & S. Granger (Eds.), Phraseology in foreign language learning and teaching (pp. 21–42).
   Google Scholar
• Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Krashen, S. (1989). We acquire vocabulary and spelling by reading: Additional evidence for the Input Hypothesis. Modern Language Journal, 73(4), 440–464. doi:10.1111/j.1540-4781.1989.tb05325.x
   Web of Science ®Google Scholar
• Laufer, B., Elder, C., Hill, K., & Congdon, P. (2004). Size and strength: Do we need both to measure vocabulary knowledge? Language Testing, 21(2), 202–226. doi:10.1191/0265532204lt277oa
   Google Scholar
• Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT Press.
   Google Scholar
• Levelt, W. J. M. (1999). Producing spoken language: A blueprint of the speaker. In C. M. Brown & P. Hagoort (Eds.), The neurocognition of language (pp. 83–122). Oxford: Oxford University Press.
   Google Scholar
• Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22, 1–75. doi:10.1017/S0140525X99001776
   PubMed Web of Science ®Google Scholar
• Lin, P. M. S. (2010). The phonology of formulaic sequences: A review. In D. Wood (Ed.), Perspectives on formulaic language: Acquisition and communication (pp. 174–193). London: Continuum.
   Google Scholar
• Litman, D., Strik, H., & Lim, G. S. (this issue).
   Google Scholar
• Luoma, S. (2004). Assessing speaking. Cambridge: Cambridge University Press.
   Google Scholar
• McIntosh, C., Francis, B., & Poole, R. (2009). Oxford collocations dictionary: For students of English. Oxford: Oxford University Press.
   Google Scholar
• Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: Macmillan.
   Google Scholar
• Michou, A., & Seretan, V. (2009). A tool for multi-word expression extraction in Modern Greek using syntactic parsing. Proceedings of the Demonstrations Session at EACL 2009 (pp. 45–48), Athens, Greece. Retrieved from http://www.latl.unige.ch/personal/vseretan/publ/Michou_Seretan_2009.pdf
   Google Scholar
• Millar, N. (2011). The processing of malformed formulaic language. Applied Linguistics, 32(2), 129–148. doi:10.1093/applin/amq035
   Web of Science ®Google Scholar
• Moon, R. (2008). Sinclair, phraseology, and lexicography. International Journal of Lexicography, 21(3), 243–254. doi:10.1093/ijl/ecn027
   Web of Science ®Google Scholar
• Myers, J. L., & Chang, S.-F. (2009). A multiple-strategy-based approach to word and collocation acquisition. International Review of Applied Linguistics in Language Teaching, 47, 179–207. doi:10.1515/iral.2009.008
   Google Scholar
• Namei, S. (2004). Bilingual lexical development: A Persian–Swedish word association study. International Journal of Applied Linguistics, 14(3), 363–388. doi:10.1111/ijal.2004.14.issue-3
   Google Scholar
• Nesselhauf, N. (2005). Collocations in a learner corpus. Amsterdam: John Benjamins.
   Google Scholar
• Palmer, H. E. (1933). Second interim report on English collocations. Tokyo: Kaitakusha.
   Google Scholar
• Pap, A. (1953). Reduction-sentences and open concepts. Methodos, 5, 3–30.
   Google Scholar
• Pawley, A., & Syder, F. H. (1983). Two puzzles for linguistic theory: Nativelike selection and nativelike fluency. In J. C. Richards & R. W. Schmidt (Eds.), Language and communication (pp. 191–226). London: Longman.
   Google Scholar
• Piao, S. S., Rayson, P., Archer, D., & McEnery, T. (2005). Comparing and combining a semantic tagger and a statistical tool for MWE extraction. Computer Speech & Language, 19(4), 378–397. doi:10.1016/j.csl.2004.11.002
   Web of Science ®Google Scholar
• Qian, D. D., & Schedl, M. (2004). Evaluation of an in-depth vocabulary knowledge measure for assessing reading performance. Language Testing, 21(1), 28–52. doi:10.1191/0265532204lt273oa
   Google Scholar
• Read, J., & Nation, P. (2004). Measurement of formulaic sequences. In N. Schmitt (Ed.), Formulaic sequences: Acquisition, processing, and use (pp. 23–35). Amsterdam: John Benjamins.
   Google Scholar
• Schmidgall, J. E. (2013). Modeling speaker proficiency, comprehensibility, and perceived competence in a language use domain (Unpublished doctoral dissertation). University of California, Los Angeles.
   Google Scholar
• Schmitt, D., & Schmitt, N. (2005). Focus on vocabulary: Mastering the academic word list. White Plains, NY: Longman.
   Google Scholar
• Schmitt, N. (1998). Measuring collocational knowledge: Key issues and an experimental assessment procedure. I.T.L. Review of Applied Linguistics, 119–120, 27–47.
   Google Scholar
• Schmitt, N. (2010). Researching vocabulary. New York: Palgrave Macmillan.
   Google Scholar
• Schmitt, N., Ng, J. W. C., & Garras, J. (2011). The word associates format: Validation evidence. Language Testing, 28(1), 105–126. doi:10.1177/0265532210373605
   Web of Science ®Google Scholar
• Seretan, V. (2011). Syntax-based collocation extraction. Dordrecht: Springer.
   Google Scholar
• Shutova, E., Sun, L., Gutierrez, D., Lichtenstein, P., & Narayanan, S. (2017). Multilingual metaphor processing: Experiments with semi-supervised and unsupervised learning. Computational Linguistics, 43(1), 71–123. doi:10.1162/COLI_a_00275
   Web of Science ®Google Scholar
• Sinclair, J. (1991). Corpus, concordance, collocation. Oxford: Oxford University Press.
   Google Scholar
• Skehan, P. (1998). A cognitive approach to language learning. Oxford: Oxford University Press.
   Google Scholar
• Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30(4), 510–532. doi:10.1093/applin/amp047
   Web of Science ®Google Scholar
• Skripnikova, I. (2012). The main difficulties when studying Russian verbs of motion in a figurative meaning. Open Journal of Modern Linguistics, 2(4), 147–150. doi:10.4236/ojml.2012.24019
   Google Scholar
• Stefanowitsch, A., & Gries, S. T. (2003). Collostructions: Investigating the interaction of words and constructions. International Journal of Corpus Linguistics, 8(2), 209–243. doi:10.1075/ijcl.8.2
   Google Scholar
• Swain, M., Huang, L.-S., Barkaoui, K., Brooks, L., & Lapkin, S. (2009). The speaking section of the TOEFL iBT™ (SSTiBT): Test-takers’ reported strategic behaviors (ETS Research Rep. No. RR-09-30). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Van Lancker, D., & Canter, G. J. (1981). Idiomatic versus literal interpretations of ditropically ambiguous sentences. Journal of Speech, Language, and Hearing Research, 24(1), 64–69. doi:10.1044/jshr.2401.64
   Web of Science ®Google Scholar
• Van Lancker, D., Canter, G. J., & Terbeek, D. (1981). Disambiguation of ditropic sentences: Acoustic and phonetic cues. Journal of Speech, Language, and Hearing Research, 24(3), 330–335. doi:10.1044/jshr.2403.330
   Web of Science ®Google Scholar
• Voss, E. (2012). A validity argument for score meaning of a computer-based ESL academic collocational ability test based on a corpus-driven approach to test design ( Unpublished doctoral dissertation). Iowa State University, Ames, IA.
   Google Scholar
• Wang, X., Evanini, K., & Zechner, K. (2013). Coherence modelling for the automated assessment of spontaneous spoken responses. Proceedings of NAACL-HLT 2013 (pp. 814–819).
   Google Scholar
• Wehrli, E., Seretan, V., Nerima, L., & Russo, L. (2009). Collocations in a rule-based MT system: A case study evaluation of their translation adequacy. Proceedings of the 13th Annual Meeting of the European Association for Machine Translation (pp. 128–135), Barcelona, Spain. Retrieved from http://www.latl.unige.ch/personal/vseretan/publ/EAMT2009_EW_VS_LN_LR.pdf
   Google Scholar
• Widdowson, H. (2007). J.R. Firth, 1957, Papers in Linguistics 1934–51. International Journal of Applied Linguistics, 17(3), 402–413. doi:10.1111/ijal.2007.17.issue-3
   Google Scholar
• Wolf, M. K., Everson, P., Lopez, A., Hauck, M., Pooler, E., & Wang, J. (2014). Building a framework for a next-generation English language proficiency assessment system. ETS Research Report Series, 2014(2), 1–48. doi:10.1002/ets2.12034
   Google Scholar
• Wolter, B. (2001). Comparing the L1 and L2 mental lexicon. Studies in Second Language Acquisition, 23, 41–69. doi:10.1017/S0272263101001024
   Google Scholar
• Wolter, B. (2006). Lexical network structures and L2 vocabulary acquisition: The role of L1 lexical/conceptual knowledge. Applied Linguistics, 27(4), 741–747. doi:10.1093/applin/aml036
   Web of Science ®Google Scholar
• Wood, D. (2006). Uses and functions of formulaic sequences in second language speech: An exploration of the foundations of fluency. Canadian Modern Language Review, 63(1), 13–33.
   Web of Science ®Google Scholar
• Wood, D. (2009). Effects of focused instruction of formulaic sequences on fluent expression in second language narratives: A case study. Canadian Journal of Applied Linguistics, 12(1), 39–57.
   Google Scholar
• Wray, A. (2002). Formulaic language and the lexicon. Cambridge: Cambridge University Press.
   Google Scholar
• Wray, A. (2004). ‘Here’s one I prepared earlier’: Formulaic language learning on television. In N. Schmitt (Ed.), Formulaic sequences: Acquisition, processing and use (pp. 249–268). Amsterdam: John Benjamins.
   Google Scholar
• Wray, A., & Fitzpatrick, T. (2010). Pushing learners to the extreme: The artificial use of prefabricated material in conversation. Innovation in Language Learning and Teaching, 4(1), 37–52. doi:10.1080/17501220802596413
   Google Scholar
• Wróbel, A. (2011). Formulaicity vs. fluency and accuracy in using English as a foreign language. In M. Pawlak, E. Waniek-Klimczak, & J. Majer (Eds.), Speaking and instructed foreign language acquisition (pp. 55–65). Tonawanda, NY: Multilingual Matters.
   Google Scholar
• Xi, X., Higgins, D., Zechner, K., & Williamson, D. (2012). A comparison of two scoring methods for an automated speech scoring system. Language Testing, 29(3), 371–394. doi:10.1177/0265532211425673
   Web of Science ®Google Scholar
• Xu, J. (2015). Predicting ESL learners’ oral proficiency by measuring the collocations in their spontaneous speech ( Unpublished doctoral dissertation). Iowa State University, Ames, IA.
   Google Scholar
• Xu, J., & Xi, X. (2010). Comparing human and machine judgments of collocations and relating them to speaking proficiency. Paper presented at the 32nd Language Testing Research Colloquium, UK. University of Cambridge.
   Google Scholar
• Yu, D., & Deng, L. (2014). Automatic speech recognition: A deep learning approach. New York: Springer.
   Google Scholar
• Zareva, A. (2007). Structure of the second language mental lexicon: How does it compare to native speakers’ lexical organization? Second Language Research, 23(3), 123–153. doi:10.1177/0267658307076543
   Web of Science ®Google Scholar