Constructing a Scale to Assess L2 Written Speech Act Performance: WDCT and E-mail Tasks

References

• Alderson, C. (2005). Diagnosing foreign language proficiency. The interface between learning and assessment. London, UK: Continuum.
   Google Scholar
• Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, UK: Oxford University Press.
   Google Scholar
• Bardovi-Harlig, K. (1999). Exploring the interlanguage of interlanguage pragmatics: A research agenda for acquisitional pragmatics. Language Learning, 49(4), 677–713. doi:10.1111/lang.1999.49.issue-4
   Web of Science ®Google Scholar
• Bardovi-Harlig, K. (2003). Understanding the role of grammar in the acquisition of L2 pragmatics. In A. Martinez-Flor, E. U. Juan, & A. F. Guerra (Eds.), Pragmatic competence and foreign language teaching (pp. 25–44). Castellón de la Plana, Spain: Universitat Jaume I.
   Google Scholar
• Bardovi-Harlig, K., & Dornyei, Z. (1998). Do language learners recognize pragmatic violations? Pragmatic versus grammatical awareness in instructed L2 learning. TESOL Quarterly, 32(2), 233–262. doi:10.2307/3587583
   Web of Science ®Google Scholar
• Bardovi-Harlig, K., & Griffin, R. (2005). L2 pragmatic awareness: Evidence from the ESL classroom. System, 33(3), 401–415. doi:10.1016/j.system.2005.06.004
   Google Scholar
• Barron, A. (2003). Acquisition in interlanguage pragmatics: Learning how to do things with words in a study abroad context. Amsterdam, Netherlands: John Benjamins.
   Google Scholar
• Beebe, L. M., & Cummings, M. C. (1995). Natural speech act data versus written questionnaire data: How data collection method affects speech act performance. In S. M. Gass & J. Neu (Eds.), Speech acts across cultures (pp. 65–88). Berlin, Germany: Mouton de Gruyter.
   Google Scholar
• Biesenbach-Lucas, S. (2007). Students writing emails to faculty: An examination of e-politeness among native and non-native speakers of english. Language Learning and Technology, 11(2), 59–81.
   Web of Science ®Google Scholar
• Blum-Kulka, S., House, J., & Kasper, G. (1989). Cross-cultural pragmatics: Requests and apologies. Norwood, NJ: Ablex.
   Google Scholar
• Bonk, W. J., & Ockey, G. J. (2003). A many-facet Rasch analysis of the second language group oral discussion task. Language Testing, 20(1), 89–110. doi:10.1191/0265532203lt245oa
   Google Scholar
• Brown, J. D. (2001). Pragmatics tests: Different purposes, different tests. In K. R. Rose & G. Kasper (Eds.), Pragmatics in language teaching (pp. 301–326). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Brown, J. D., & Bailey, K. M. (1984). A categorical instrument for scoring second language writing skills. Language Learning, 34(4), 21–42. doi:10.1111/j.1467-1770.1984.tb00350.x
   Web of Science ®Google Scholar
• Brown, P., & Levinson, S. (1987). Politeness: Some universals in language usage. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Chen, C. F. (2006). The development of e-mail literacy: From writing to peers to writing to authority figures. Language Learning and Technology, 10(2), 35–55.
   Web of Science ®Google Scholar
• Chen, Y. S. (2015). Developing Chinese EFL learners’ email literacy through requests to faculty. Journal of Pragmatics, 75, 131–149. doi:10.1016/j.pragma.2014.05.009
   Web of Science ®Google Scholar
• Chen, Y. S., & Rau, D. H. (2011). Investigating the complimenting behaviors of Chinese speakers of American English. Language and Linguistics, 12(4), 917–950.
   Web of Science ®Google Scholar
• Cohen, A. (2006). Interlanguage pragmatics: A reply to Pilar Garces-Conejos Blitvich. Intercultural Pragmatics, 3(3), 359–364. doi:10.1515/IP.2006.021
   Google Scholar
• Crystal, D. (1997). English as a global language. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Davis, L. (2016). The influence of training and experience on rater performance in scoring spoken language. Language Testing, 33(1), 117–135. doi:10.1177/0265532215582282
   Web of Science ®Google Scholar
• Economidou-Kogetsidis, M. (2011). “Please answer me as soon as possible”: Pragmatic failure in non-native speakers’ e-mail requests to faculty. Journal of Pragmatics, 43(13), 3193–3215. doi:10.1016/j.pragma.2011.06.006
   Web of Science ®Google Scholar
• Elder, C., Knoch, U., Barkhuizen, G., & von Randow, J. (2005). Individual feedback to enhance rater training: Does it work? Language Assessment Quarterly, 2(3), 175–196. doi:10.1207/s15434311laq0203_1
   Google Scholar
• Faerch, C., & Kasper, G. (1984). Pragmatic knowledge: Rules and procedures. Applied Linguistics, 5(3), 214–225. doi:10.1093/applin/5.3.214
   Web of Science ®Google Scholar
• Fulcher, G. (1987). Tests of oral performance: The need for data-based criteria. ELT Journal, 41(4), 287–291. doi:10.1093/elt/41.4.287
   Google Scholar
• Fulcher, G. (2003). Testing second language speaking. London, UK: Pearson Longman.
   Google Scholar
• Fulcher, G., Davidson, F., & Kemp, J. (2011). Effective rating scale development for speaking tests: Performance decision trees. Language Testing, 28(1), 5–29. doi:10.1177/0265532209359514
   Web of Science ®Google Scholar
• Golato, A. (2003). Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90–121. doi:10.1093/applin/24.1.90
   Web of Science ®Google Scholar
• Grabowski, K. C. (2009). Investigating the construct validity of a test designed to measure grammatical and pragmatic knowledge in the context of speaking ( Unpublished PhD dissertation). Columbia University, NY, USA.
   Google Scholar
• Grice, H. P. (1975). Logic and conversation. In P. Cole & J. Morgan (Eds.), Syntax and semantics (Vol. 3, Speech acts pp. 41–58). New York, NY: Academic Press.
   Google Scholar
• Hardford, B. S., & Bardovi-Harlig, K. (1996). “At your earliest convenience”: A study of written student requests to faculty. In L. Bouton (Ed.), Pragmatics and language learning (Vol. 7, pp. 55–69). Urbana-Champaign, IL: Division of English as an International Language. University of Illinois.
   Google Scholar
• Hawkey, R., & Barker, F. (2004). Developing a common scale for the assessment of writing. Assessing Writing, 9(2), 122–159. doi:10.1016/j.asw.2004.06.001
   Google Scholar
• Hudson, T. (2001). Indicators for pragmatic instruction: Some quantitative tools. In K. R. Rose, & G. Kasper (Eds.), Pragmatics in language teaching (pp. 283–300). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Hudson, T., Detmer, E., & Brown, J. D. (1995). Developing prototypic measures of cross-cultural pragmatics: Technical report #7. Honolulu, HI: University of Hawai‘i.
   Google Scholar
• Ishihara, N. (2010). Assessing learners’ pragmatic ability in the classroom. In D. H. Tatsuki & N. R. Houck (Eds.), Pragmatics: Teaching speech acts (pp. 209–228). Alexandra, VA: Teachers of English to Speakers of Other Languages.
   Google Scholar
• Jenkins, J. (2000). The phonology of english as an international language: New models, new norms, new goals. Oxford, UK: Oxford University Press.
   Google Scholar
• Kasper, G. (1997). Can pragmatic competence be taught? (NetWork #6). Retrieved from http://www.nflrc.hawaii.edu/networks/NW06/.
   Google Scholar
• Kasper, G. (2008). Data collection in pragmatics research. In H. Spncer-Oatey (Eds.), Culutrally speaking: Culture, communication and politeness theory (pp. 279–302). New York, NY: Continuum.
   Google Scholar
• Kasper, G., & Roever, C. (2005). Pragmatics in second language learning. In E. Hinkel (Ed.), Handbook of research in second language learning and teaching (pp. 317–334). Mahwah, NJ: Lawrence, Erlbaum Assoicates.
   Google Scholar
• Kasper, G., & Ross, S. J. (2013). Assessing second language pragmatics: An overview and introductions. In S. J. Ross, & G. Kapser (Eds.), Assessing second language pragmatics (pp. 1–40). Houndmills, Basingstoke: Palgrave Macmillan.
   Google Scholar
• Ke, I. C., & Cahyani, H. (2014). Learning to become users of english as a lingua franca (ELF): How ELF online communication affects Taiwanese learners’ beliefs of English. System, 46, 28–38. doi:10.1016/j.system.2014.07.008
   Web of Science ®Google Scholar
• Kim, H. J. (2009). Investigating the effects of context and task type on second language speaking ability ( Unpublished PhD dissertation). Columbia University, NY, USA.
   Google Scholar
• Kirkpatrick, A. (1991). Information sequencing in Mandarin letters of request. Anthropological Linguistics, 33(2), 183–203.
   Google Scholar
• Kirkpatrick, A. (1993). Information sequencing in modern standard Chinese in a genre of extended spoken discourse. Text & Talk, 13(3), 423–453.
   Google Scholar
• Knoch, U. (2009). Diagnostic assessment of writing: A comparison of two rating scales. Language Testing, 26(2), 275–304. doi:10.1177/0265532208101008
   Web of Science ®Google Scholar
• Lee, F. K. (2010). Written requests in emails sent by adult Chinese learners of English. Language, Culture and Curriculum, 17(1), 58–72. doi:10.1080/07908310408666682
   Google Scholar
• Leech, G. (1983). Principles of pragmatics. London, UK: Longman.
   Google Scholar
• Li, W. J., Chen, Y. S., & Rau, D. H. (2011). What constitutes an appropriate email request? In C. Ying-Hsiung (Ed.), Multimedia-based multicultural instruction and research: Innovative 21st-century approaches via literature and language (pp. 151–166). Taipei, Taiwan: Crane.
   Google Scholar
• Linacre, J. M. (1999). Category Disordering (disordered categories) vs. Threshold Disordering (disordered thresholds). Rasch Measurement Transactions, 13(1), 675.
   Google Scholar
• Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85–106.
   PubMedGoogle Scholar
• Linacre, J. M. (2006). FACETS Rasch measurement computer program (Version 3.6). Chicago, IL.
   Google Scholar
• Lumley, T. (2005). Assessing second language writing: The rater’s perspective. Frankfurt, Germany: Peter Lang.
   Google Scholar
• McNamara, T. F. (1996). Measuring second language performance. London, UK: Longman.
   Google Scholar
• Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet Rasch measurement: Part II. Journal of Applied Measurement, 5(2), 189–227.
   PubMedGoogle Scholar
• Niezgoda, K., & Roever, C. (2001). Pragmatic and grammatical awareness: A function of the learning environment? In K. R. Rose & G. Kasper (Eds.), Pragmatics in language teaching (pp. 63–79). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Panayides, P., & Walker, M. (2013). Evaluating the psychometric properties of the foreign language classroom anxiety scale for Cypriot senior high school EFL students: The Rasch measurement approach. Europe’s Journal of Psychology, 9(3), 493–516. doi:10.5964/ejop.v9i3.611
   Google Scholar
• Pollitt, A., & Murray, N. (1996). What raters really pay attention to. In M. Milahovic & N. Saville (Eds.), Performance testing, cognition, and assessment (pp. 74–91). Cambridge, UK: University of Cambridge Local Examinations Syndicate/Cambridge University Press.
   Google Scholar
• Purpura, J. (2004). Assessing grammar. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Roever, C. (2011). Testing of second language pragmatics: Past and future. Language Testing, 28(4), 463–481. doi:10.1177/0265532210394633
   Web of Science ®Google Scholar
• Sasaki, M. (1998). Investigating EFL students’ production of speech acts: A comparison of production questionnaires and role plays. Journal of Pragmatics, 30(4), 457–484. doi:10.1016/S0378-2166(98)00013-7
   Web of Science ®Google Scholar
• Schneider, K. (2008). Small talk in England, Ireland and the U.S.A. In K. Schneider, & A. Barron (Eds.), Variational pragmatics: A focus on regional varieties in pluricentric languages (pp. 97–139). Amsterdam, Netherlands: John Benjamins.
   Google Scholar
• Storch, N. (2005). Collaborative writing: Product, process and students’ reflections. Journal of Second Language Writing, 14(3), 153–173. doi:10.1016/j.jslw.2005.05.002
   Web of Science ®Google Scholar
• The Language Testing and Training Center. (2014). Score data summary for 2013 GEPT. Retrieved August 3, 2014, from http://www.lttc.ntu.edu.tw/academics/GEPT_ScoreR_Doc/Score%20Data%20Summary%20for%202010%20GEPT.pdf.
   Google Scholar
• Thomas, J. (1983). Cross-cultural pragmatic failure. Applied Linguistics, 4(2), 91–112. doi:10.1093/applin/4.2.91
   Web of Science ®Google Scholar
• Timpe Laughlin, V. T., Wain, J., & Schmidgall, J. (2015). Defining and operationalizing the construct of pragmatic competence: Review and recommendations (ETS Research Report No. RR-15-06).
   Google Scholar
• Upshur, J. A., & Turner, C. E. (1995). Constructing rating scales for second language tests. ELT Journal, 49(1), 3–12. doi:10.1093/elt/49.1.3
   Google Scholar
• Upshur, J. A., & Turner, C. E. (1999). Systematic effects in the rating of second- language speaking ability: Test method and learner discourse. Language Testing, 16(1), 82–111.
   Google Scholar
• Walters, F. S. (2007). A conversation-analytic hermeneutic rating protocol to assess L2 oral pragmatic competence. Language Testing, 24(2), 155–183. doi:10.1177/0265532207076362
   Google Scholar
• Weigle, S. C. (1994). Effects of training on raters of ESL compositions. Language Testing, 11(2), 197–223. doi:10.1177/026553229401100206
   Google Scholar
• Weigle, S. C. (1998). Using FACETS to model rater training effects. Language Testing, 15(2), 263–287. doi:10.1177/026553229801500205
   Google Scholar
• Weigle, S. C. (2002). Assessing writing. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Weir, C. J. (1990). Communicative language testing. London, UK: Prentice Hall.
   Google Scholar
• Youn, S. J. (2015). Validity argument for assessing L2 pragmatics in interaction using mixed methods. Language Testing, 32(2), 199–225. doi:10.1177/0265532214557113
   Web of Science ®Google Scholar
• Yuan, Y. (2001). An inquiry into empirical pragmatics data-gathering methods: Written DCTs, oral DCTs, field notes, and natural conversations. Journal of Pragmatics, 33(2), 271–292. doi:10.1016/S0378-2166(00)00031-X
   Web of Science ®Google Scholar