Can subject matter experts rate the English language skills of customer services representatives (CSRs) at work in Indian contact centre?

References

• Alderson, J. C. (2011). The politics of aviation English testing. Language Assessment Quarterly, 8(4), 386–403. doi:10.1080/15434303.2011.622017
   Web of Science ®Google Scholar
• Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2(1), 1–34. doi:10.1207/s15434311laq0201_1
   Google Scholar
• Barkaoui, K. (2010). Do ESL raters’ evaluative criteria change with experience? A mixed methods, cross-sectional study. TESOL Quarterly, 44(1), 31–57.
   Web of Science ®Google Scholar
• Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Brown, A. (1995). The effect of rater variables in the development of an occupation-specific language performance test. Language Testing, 12(1), 1–15.
   Google Scholar
• Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1(1), 1–47.
   Google Scholar
• Davies, A. (2012). Kane, validity and soundness. Language Testing, 29(1), 37–42. doi:10.1177/0265532211417213
   Web of Science ®Google Scholar
• Davis, L. (2016). The influence of training and experience on rater performance in scoring spoken language. Language Testing, 33(1), 117–135. doi:10.1177/0265532215582282
   Web of Science ®Google Scholar
• Douglas, D., & Myers, R. (2000). Assessing communication skills of veterinary students: Whose criteria?. In A. J. Kunnan (Ed.), Fairness and validation in language assessment: selected papers from the 19th Language Testing Research Colloquium, Orlando, Florida. Cambridge, U.K.: Cambridge University Press.
   Google Scholar
• Eckes, T. (2005). Examining rater effects in testDaF writing and speaking performance assessments: A many-facet Rasch analysis. Language Assessment Quarterly, 2(3), 197–221. doi:10.1207/s15434311laq0203_2
   Google Scholar
• Elder, C. (1993). How do subject specialists construe classroom language proficiency? Language Testing, 10(3), 235–254.
   Google Scholar
• Elder, C. (2016). Exploring the limits of authenticity in LSP testing: The case of a specific-purpose language test for health professionals. Language Testing, 33(2), 147–152. doi:10.1177/0265532215607397
   Web of Science ®Google Scholar
• Elder, C., Barber, M., Staples, M., Osborne, R. H., Clerehan, R., & Buchbinder, R. (2012). Assessing health literacy: A new domain for collaboration between language testers and health professionals. Language Assessment Quarterly, 9(3), 205–224. doi:10.1080/15434303.2011.627751
   Web of Science ®Google Scholar
• Elder, C., McNamara, T., Woodward-Kron, R., Manias, E., McColl, G., Webb, G.,… O‘ Hagan, S. (2013). Developing and validating language proficiency standards for non-native English speaking health professionals. Papers in Language Testing and Assessment, 2, 66–70.
   Google Scholar
• Elder, C., Pill, J., Woodward-Kron, R., McNamara, T. I. M., Manias, E., Webb, G., & McColl, G. (2012). Health professionals‘ views of communication: Implications for assessing performance on a health-specific English language test. TESOL Quarterly, 46(2), 409–419.
   Web of Science ®Google Scholar
• Forey, G., & Lam, M. (2013). Applying systemic functional linguistics: Understanding the choices of quality in the workplace. Journal of Applied Linguistics and Professional Practice, 9(1), 61–80.
   Google Scholar
• Forey, G., & Lockwood, J. (2007). “I’d love to put someone in jail for this”: An initial investigation of English in the business processing outsourcing (BPO) industry. English for Specific Purposes, 26(3), 308–326. doi:10.1016/j.esp.2006.09.005
   Web of Science ®Google Scholar
• Friginal, E. (2009). Threats to the sustainability of the outsourced call center industry in the Philippines: implications for language policy. Language Policy, 8(1), 51–68. doi:10.1007/s10993-008-9119-2
   Web of Science ®Google Scholar
• Friginal, E. (2013). Evaluation of oral performance in outsourced call centres: An exploratory case study. English for Specific Purposes, 32(1), 25–35. doi:10.1016/j.esp.2012.06.002
   Web of Science ®Google Scholar
• Fulcher, G. (2003). Testing second language speaking. London: Pearson Longman.
   Google Scholar
• Halliday, M. A. K. (1985). An introduction to functional grammar. London: Edward Arnold.
   Google Scholar
• Hood, S. (2010). Naming and negotiating relationships in call centre talk. In G. Forey & J. Lockwood (Eds.), Globalization, communication and the workplace: talking across the world (pp. 88–106). London, U.K.: Continuum.
   Google Scholar
• Jacoby, S. (1998). Science as performance: Socializing scientific discourse through the conference talk rehearsal. Unpublished Ph.D. dissertation. University of California. Los Angeles.
   Google Scholar
• Jacoby, S., & McNamara, T. (1999). Locating Competence. English for Specific Purposes, 18(3), 213–241. doi:10.1016/S0889-4906(97)00053-7
   Google Scholar
• Kim, H. J. (2015). A Qualitative Analysis of Rater Behavior on an L2 Speaking Assessment. Language Assessment Quarterly, 12(3), 239–261. doi:10.1080/15434303.2015.1049353
   Web of Science ®Google Scholar
• Knoch, U. (2014). Using subject specialists to validate an ESP rating scale: The case of the International Civil Aviation Organization (ICAO) rating scale. English for Specific Purposes, 33, 77–86.
   Web of Science ®Google Scholar
• Linacre, J. M. (1989). Many-facet Rasch measurement. Chicago: MESA Press.
   Google Scholar
• Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328.
   Google Scholar
• Linacre, J. M. (2012). Many-Facet Rasch Measurement: Facets Tutorial 2. Retrieved from https://www.winsteps.com/a/ftutorial2.pdf
   Google Scholar
• Linacre, J. M. (2014). Facets computer program for many-facet Rasch measurement, version 3.71.4. Beaverton, Oregon: Winstep.com.
   Google Scholar
• Lockwood, J. (2010). What causes communication breakdown in the call centres? The discrepancies in BPO workplace training and academic research. In G. Forey & J. Lockwood (Eds.), Globalization, communication and the workplace: talking across the world (pp. 204–218). London, U.K.: Continuum.
   Google Scholar
• Lockwood, J. (2012). Are we getting the right people for the job? A study of English language recruitment assessment practices in the Business Processing Outsourcing (BPO) sector: India and the Philippines. Journal of Business Communication, 49(2), 107–127.
   Google Scholar
• Lumley, T. (1998). Perceptions of language-trained raters and occupational experts in a test of occupational English language profficiency. English for Specific Purposes, 17(4), 347–367. doi:10.1016/S0889-4906(97)00016-1
   Google Scholar
• Lumley, T. (2006). Assessing second language writing: The rater‘s perspective. Franfurt, Germany: Peter Lang.
   Google Scholar
• Lumley, T., & McNamara, T. (1995). Rater characteristics and rater bias: Implications for training. Language Testing, 12(2), 238–257.
   Google Scholar
• Manias, E., & McNamara, T. (2016). Standard setting in specific-purpose language testing: What can a qualitative study add? Language Testing, 33(2), 235–249. doi:10.1177/0265532215608411
   Web of Science ®Google Scholar
• McNamara, T. (1990). Assessing the second langauge proficiency of health professionals. (Doctoral Ph.D. dissertation), University of Melbourne,
   Google Scholar
• McNamara, T. (1996). Measuring second language performance. Harlow, Essex: Pearson Education.
   Google Scholar
• Miles, M. B., & Huberman, M. A. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: SAGE Publications.
   Google Scholar
• Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet Rasch measurement: Part II. Journal of Applied Measurement, 5(2), 189–227.
   PubMedGoogle Scholar
• Nickerson, C. (2005). English as a lingua franca in international business contexts. English for Specific Purposes, 24(4), 367–380. doi:10.1016/j.esp.2005.02.001
   Web of Science ®Google Scholar
• Patton, M. Q. (2002). Qualitative research and evaluation methods. Thousand Oaks, California: Sage Publications.
   Google Scholar
• Pill, J., & McNamara, T. (2016). How much is enough? Involving occupational experts in setting standards on a specific-purpose language test for health professionals. Language Testing, 33(2), 217–234. doi:10.1177/0265532215607402
   Web of Science ®Google Scholar
• Shohamy, E., Gordon, C. M., & Kraemer, R. (1992). The effect of raters‘ background and training on the reliability of direct writing tests. The Modern Language Journal, 76(1), 27–33. doi:10.1111/j.1540-4781.1992.tb02574.x
   Web of Science ®Google Scholar
• Weigle, S. C., Boldt, H., Valsecchi, M., xed, a, I., & xe. (2003). Effects of task and rater background on the evaluation of ESL student writing: A pilot study. TESOL Quarterly, 37(2), 345–354. doi:10.2307/3588510
   Web of Science ®Google Scholar
• Winke, P., Gass, S., & Myford, C. (2013). Raters’ L2 background as a potential source of bias in rating oral performance. Language Testing, 30(2), 231–252. doi:10.1177/0265532212456968
   Web of Science ®Google Scholar
• Wright, B. D. (1996). Reliability and separation. Rasch Measurement Transactions, 9(4), 472. Retrieved from http://www.rasch.org/rmt/rmt94n.htm.
   Google Scholar
• Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370. Retrieved from http://www.rasch.org/rmt/rmt83b.htm.
   Google Scholar
• Wright, B. D., & Masters, G. (1982). Rating scale analysis: Rasch measurement. Chicago: MESA Press.
   Google Scholar