2,037
Views
19
CrossRef citations to date
0
Altmetric
Original Articles

Shifting Sands in Second Language Pronunciation Teaching and Assessment Research and Practice

ORCID Icon

References

  • ACTFL. (2012). ACTFL proficiency guidelines. Alexandra, VA: Author.
  • Anderson-Hsieh, J., Johnson, R., & Koehler, K. (1992). The relationship between native speaker judgments of nonnative pronunciation and deviance in segmentals, prosody, and syllable structure. Language Learning, 42(4), 529–555. doi:10.1111/j.1467-1770.1992.tb01043.x
  • Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, UK: Oxford University Press.
  • Bachman, L. F. (2000). Modern language testing at the turn of the century: Assuring that what we count counts. Language Testing, 17, 1–42. doi:10.1177/026553220001700101
  • Bachman, L. F. (2004). Statistical analyses for language assessment. Cambridge, UK: Cambridge University Press.
  • Bachman, L. F., & Palmer, A. S. (1982). The construct validation of some components of communicative proficiency. TESOL Quarterly, 16, 449–465. doi:10.2307/3586464
  • Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford, UK: Oxford University Press.
  • Baker, A., & Burri, M. (2016). Feedback on second language pronunciation: A case study of EAP teachers’ beliefs and practices. Australian Journal of Teacher Education, 41, 1–19. doi:10.14221/ajte
  • Ballard, L., & Winke, P. (2017). The interplay of accent familiarity, comprehensibility, intelligibility, perceived native-speaker status, and acceptability as a teacher. In T. Isaacs & P. Trofimovich (Eds.), Second language pronunciation assessment: Interdisciplinary perspectives (pp. 121–140). Bristol, UK: Multilingual Matters.
  • Bernstein, J. (1999). PhonePass testing: Structure and construct. Menlo Park, CA: Ordinate Corporation.
  • Bernstein, J., Van Moere, A., & Cheng, J. (2010). Validating automated speaking tests. Language Testing, 27, 355–377. doi:10.1177/0265532210364404
  • Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge, UK: Cambridge University Press.
  • Boveé, A. G. (1925). A suggested score for attainment in pronunciation. The Modern Language Journal, 10, 15–19. doi:10.1111/j.1540-4781.1925.tb03722.x
  • Brown, A. (1988). Functional load and the teaching of pronunciation. TESOL Quarterly, 22, 593–606. doi:10.2307/3587258
  • Buck, G. (1989). Written tests of pronunciation: Do they work? ELT Journal, 43, 50–56. doi:10.1093/elt/43.1.50
  • Cambridge English. (2016). Cambridge English first for schools: Handbook for teachers for exams from 2016. Cambridge, UK: Author.
  • Carey, M. D., Mannell, R. H., & Dunn, P. K. (2011). Does a rater’s familiarity with a candidate’s pronunciation affect the rating in oral proficiency interviews? Language Testing, 28, 201–219. doi:10.1177/0265532210393704
  • Carroll, J. B. (1961). Fundamental considerations in testing English proficiency of foreign students. In (Ed.), Testing the English proficiency of foreign students (pp. 30–40). Washington, DC: Center for Applied Linguistics.
  • Catford, J. C. (1987). Phonetics and the teaching of pronunciation: A systemic description of English phonology. In J. Morley (Ed.), Current perspectives on pronunciation: Practices anchored in theory (pp. 87–100). Washington, DC: TESOL.
  • Celce-Murcia, M., Brinton, D., & Goodwin, J., with Griner, B. (2010). Teaching pronunciation: A course book and reference guide (2nd ed.). Cambridge, UK: Cambridge University Press.
  • Chun, C. W. (2008). Comments on “evaluation of the usefulness of the Versant for English test: A response”: The author responds. Language Assessment Quarterly, 5, 168–172. doi:10.1080/15434300801934751
  • Council of Europe. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge, UK: Cambridge University Press.
  • Crowther, D., Trofimovich, P., Isaacs, T., & Saito, K. (2015). Does a speaking task affect second language comprehensibility? Modern Language Journal, 99(1), 80–95. doi:10.1111/modl.12185
  • Crowther, D., Trofimovich, P., Saito, K., & Isaacs, T. (2015). Second language comprehensibility revisited: Investigating the effects of learner background. TESOL Quarterly, 49(4), 814‒837. doi:10.1002/tesq.203
  • Crowther, D., Trofimovich, P., Saito, K., & Isaacs, T. (2017). Linguistic dimensions of L2 accentedness and comprehensibility vary across speaking tasks. Studies in Second Language Acquisition, 1–15. Advance online publication. doi:10.1017/S027226311700016X
  • Dauer, R. (2005). The Lingua Franca Core: A new model for pronunciation instruction? TESOL Quarterly, 39, 543–550. doi:10.2307/3588494
  • Davies, A. (1984). Validating three tests of English language proficiency. Language Testing, 1, 50–69. doi:10.1177/026553228400100105
  • De Jong, N. H. (this issue). Fluency in second language testing: Insights from different disciplines. Language Assessment Quarterly.
  • De Jong, N. H., Steinel, M. P., Florijn, A. F., Schoonen, R., & Hulstijn, J. H. (2012). Facets of speaking proficiency. Studies in Second Language Acquisition, 34(1), 5–34. doi:10.1017/S0272263111000489
  • De Jong, N. H., & Wempe, T. (2009). Praat script to detect syllable nuclei and measure speech rate automatically. Behavior Research Methods, 41, 385–390. doi:10.3758/BRM.41.2.385
  • Deng, J., Holtby, A., Howden-Weaver, L., Nessim, L., Nicholas, B., Nickle, K., … Sun, S. (2009). English pronunciation research: The neglected orphan of second language acquisition studies? Working Paper WP05-09. Edmonton, AB: Prairie Metropolis Centre.
  • Deng, L., & O’Shaughnessy, D. (2003). Speech processing: A dynamic and optimization-oriented approach. New York, NY: Marcel Dekker.
  • Derwing, T. M., & Munro, M. J. (2015). Pronunciation fundamentals: Evidence-based perspectives for L2 teaching and research. Amsterdam, The Netherlands: John Benjamins.
  • Downey, R., Farhady, H., Present-Thomas, R., Suzuki, M., & Van Moere, A. (2008). Evaluation of the usefulness of the Versant for English test: A response. Language Assessment Quarterly, 5, 160–167. doi:10.1080/15434300801934744
  • Eades, D. (2005). Applied linguistics and language analysis in asylum seeker cases. Applied Linguistics, 26, 503–526. doi:10.1093/applin/ami021
  • ETS. (2010). TOEIC® user guide: Speaking & writing. Princeton, NJ: Educational Testing Service.
  • ETS. (2014). TOEFL iBT® Test: Integrated speaking rubrics. New York, NY: McGraw-Hill.
  • Fayer, J. M., & Krasinski, E. (1987). Native and nonnative judgments of intelligibility and irritation. Language Learning, 37, 313–326. doi:10.1111/lang.1987.37.issue-3
  • Field, J. (2005). Intelligibility and the listener: The role of lexical stress. TESOL Quarterly, 39, 399–423. doi:10.2307/3588487
  • Flege, J. E. (1984). The detection of French accent by American listeners. Journal of the Acoustical Society of America, 76, 692–707. doi:10.1121/1.391256
  • Flege, J. E. (1987). The production and perception of foreign language speech sounds. In H. Winitz (Ed.), Human communication and its disorders (Vol. II, pp. 224–401). Norwood, NJ.: Ablex.
  • Flege, J. E. (1995). Second language speech learning: Theory, findings, and problems. In W. Strange (Ed.), Speech perception and linguistic experience: Issues in cross-language research (pp. 233–277). Timonium, MD: York Press.
  • Flege, J. E., Munro, M. J., & MacKay, I. R. A. (1995). Factors affecting strength of perceived foreign accent in a second language. Journal of the Acoustical Society of America, 97, 3125–3134. doi:10.1121/1.413041
  • Fraser, H. (2009). The role of “educated native speakers” in providing language analysis for the determination of the origin of asylum seekers. International Journal of Speech Language and the Law, 16, 113–138. doi:10.1558/ijsll.v16i1.113
  • Fulcher, G. (2015). Research timeline: Assessing second language speaking. Language Teaching, 48, 198–216. doi:10.1017/S0261444814000391
  • Galaczi, E., Post, B., Li, A., & Graham, C. (2012). Measuring L2 English phonological proficiency: Implications for language assessment. In J. D. M. Angouri & J. Treffers-Daller (Eds.), The impact of applied linguistics: Proceedings of the 44th annual meeting of the British Association for applied linguistics (pp. 67–72). London, UK: BAAL.
  • Galaczi, E., & Taylor, L. (this issue). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly.
  • Greenleaf, J. J. (1929). French pronunciation tests. The Modern Language Journal, 13, 534–537. doi:10.1111/j.1540-4781.1929.tb00003.x
  • Hahn, L. D. (2004). Primary stress and intelligibility: Research to motivate the teaching of suprasegmentals. TESOL Quarterly, 38, 201–233. doi:10.2307/3588378
  • Harding, L. (2012). Accent, listening assessment and the potential for a shared-L1 advantage: A DIF perspective. Language Testing, 29, 163–180. doi:10.1177/0265532211421161
  • Harding, L. (2013). Pronunciation assessment. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. Hoboken, NJ: Wiley-Blackwell.
  • Hecker, M. H. L., Stevens, K. N., & Williams, C. E. (1966). Measurements of reaction time in intelligibility tests. The Journal of the Acoustical Society of America, 39, 1188–1189. doi:10.1121/1.1910013
  • Hu, G., & Lindemann, S. (2009). Stereotypes of Cantonese English, apparent native/non-native status, and their effect on non-native English speakers’ perception. Multilingual and Multicultural Development, 30, 253–269. doi:10.1080/01434630802651677
  • Huang, B., Alegre, A., & Eisenberg, A. (2016). A cross-linguistic investigation of the effect of raters’ accent familiarity on speaking assessment. Language Assessment Quarterly, 13(1), 25–41. doi:10.1080/15434303.2015.1134540
  • IELTS. (n.d.) IELTS Speaking band descriptors (public version). Retrieved January 30, 2017, from https://takeielts.britishcouncil.org/sites/default/files/IELTS_Speaking_band_descriptors.pdf
  • Isaacs, T. (2018). Fully automated speaking assessment: Changes to proficiency testing and the role of pronunciation. In O. Kang, R. I. Thomson, & J. Murphy (Eds.), The Routledge handbook of English pronunciation (pp. 570–584). New York, NY: Routledge.
  • Isaacs, T., & Harding, L. (2017). Research timeline: Pronunciation assessment. Language Teaching, 50, 347–366. doi:10.1017/S0261444817000118
  • Isaacs, T., & Thomson, R. I. (2013). Rater experience, rating scale length, and judgments of L2 pronunciation: Revisiting research conventions. Language Assessment Quarterly, 10, 135–159. doi:10.1080/15434303.2013.769545
  • Isaacs, T., & Trofimovich, P. (2012). Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 34, 475–505. doi:10.1017/S0272263112000150
  • Isaacs, T., & Trofimovich, P. (2017a). Key themes, constructs, and interdisciplinary perspectives in second language pronunciation assessment. In T. Isaacs & P. Trofimovich (Eds.), Second language pronunciation assessment: Interdisciplinary perspectives (pp. 3–11). Bristol, UK: Multilingual Matters.
  • Isaacs, T., & Trofimovich, P. (2017b). Second language pronunciation assessment: Interdisciplinary perspectives. Bristol, UK: Multilingual Matters.
  • Isaacs, T., Trofimovich, P., & Foote, J. A. (2018). Developing a user-oriented second language comprehensibility scale for English-medium universities. Language Testing, 35, 193–216. doi:10.1177/0265532217703433
  • Jaiyote, S. (2016). The relationship between test-takers’ L1, their listening proficiency and their performance in pairs. Unpublished PhD thesis, University of Bedfordshire, Luton, UK.
  • Jenkins, J. (2002). A sociolinguistically based, empirically researched pronunciation syllabus for English as an International Language. Applied Linguistics, 23, 83–103. doi:10.1093/applin/23.1.83
  • Jones, J. (2015). Exploring open consonantal environments for testing vowel perception. Unpublished Master’s thesis, University of Melbourne, Melbourne, Australia.
  • Kang, O. (2012). Impact of rater characteristics and prosodic features of speaker accentedness on ratings of international teaching assistants’ oral performance. Language Assessment Quarterly, 9, 249–269. doi:10.1080/15434303.2011.642631
  • Kang, O., & Ginther, A. (Eds.). (2018). Assessment in second language pronunciation. Abingdon, UK: Routledge.
  • Kang, O., & Moran, M. (2014). Functional loads of pronunciation features in nonnative speakers’ oral assessment. TESOL Quarterly, 48, 176–187. doi:10.1002/tesq.152
  • Kang, O., Rubin, D., & Pickering, L. (2010). Suprasegmental measures of accentedness and judgments of language learner proficiency in oral English. The Modern Language Journal, 94, 554–566. doi:10.1111/modl.2010.94.issue-4
  • Kang, O., & Rubin, D. L. (2009). Reverse linguistic stereotyping: Measuring the effect of listener expectations on speech evaluation. Journal of Language and Social Psychology, 28(4), 441–456. doi:10.1177/0261927X09341950
  • Kaulfers, W. V. (1944). Wartime development in modern-language achievement testing. The Modern Language Journal, 28, 136–150. doi:10.1111/modl.1944.28.issue-2
  • Kelly, L. G. (1969). 25 centuries of language teaching: An inquiry into the science, art, and development of language teaching methodology, 500 B.C.-1969. Rowley, MA: Newbury House.
  • Kennedy, S., Blanchet, J., & Guénette, D. (2017). Teacher-raters’ assessments of French lingua franca pronunciation. In T. Isaacs & P. Trofimovich (Eds.), Second language pronunciation assessment: Interdisciplinary perspectives (pp. 212–236). Bristol, UK: Multilingual Matters.
  • Krashen, S. (1981). Second language acquisition and second language learning. Oxford, UK: Pergamon Press.
  • Lado, R. (1961). Language testing: The construction and use of foreign language tests. London, UK: Longman.
  • Lee, J., Jang, J., & Plonsky, L. (2015). The effectiveness of second language pronunciation instruction: A meta-analysis. Applied Linguistics, 36, 345–366. doi:10.1093/applin/amu040
  • Levis, J. (2015). Pronunciation trends across journals and the Journal of Second Language Pronunciation. Journal of Second Language Pronunciation, 2, 129–134. doi:10.1075/jslp.1.2.001edi
  • Levis, J. M. (2005). Changing contexts and shifting paradigms in pronunciation teaching. TESOL Quarterly, 39, 369–377. doi:10.2307/3588485
  • Levis, J. M. (2006). Pronunciation and the assessment of spoken language. In R. Hughes (Ed.), Spoken English, TESOL and applied linguistics: Challenges for theory and practice (pp. 245–270). New York, NY: Palgrave Macmillan.
  • Lindemann, S. (2003). Koreans, Chinese or Indians? Attitudes and ideologies about non-native English speakers in the United States. Journal of Sociolinguistics, 7, 348–364. doi:10.1111/1467-9481.00228
  • Lindemann, S. (2017). Variation or ‘error’? Perception of pronunciation variation and its implications for assessment. In T. Isaacs & P. Trofimovich (Eds.), Second language pronunciation assessment: Interdisciplinary perspectives (pp. 193–209). Bristol, UK: Multilingual Matters.
  • Litman, D., Strik, H., & Lim, G. S. (this issue). Speech technologies and the assessment of second language speaking: Approaches, challenges, and opportunities. Language Assessment Quarterly.
  • Ludwig, A. (2012). Interlanguage speech intelligibility benefit for non-native listeners of English. Unpublished Master’s thesis. Universitat de Barcelona, Barcelona, Spain.
  • Ludwig, J. (1982). Native-speaker judgments of second-language learners’ efforts at communication: A review. Modern Language Journal, 66, 274–283. doi:10.1111/j.1540-4781.1982.tb06989.x
  • Lundeberg, O. K. (1929). Recent developments in audition-speech tests. The Modern Language Journal, 14, 193–202. doi:10.1111/modl.1929.14.issue-3
  • Luoma, S. (2004). Assessing speaking. Cambridge, UK: Cambridge University Press.
  • Major, R. C. (2007). Identifying a foreign accent in an unfamiliar language. Studies in Second Language Acquisition, 29, 539–556. doi:10.1017/S0272263107070428
  • May, L. (2011). Interactional competence in a paired speaking test: Features salient to raters. Language Assessment Quarterly, 8, 127–145. doi:10.1080/15434303.2011.565845
  • McNamara, T. (2012). Language assessments as shibboleths: A poststructuralist perspective. Applied Linguistics, 33, 564–581. doi:10.1093/applin/ams052
  • Mitchell, C. M., Evanini, K., & Zechner, K. (2014). A trialogue-based spoken dialogue system for assessment of English language learners. Proceedings of the 5th International Workshop on Spoken Dialog Systems, Napa, CA.
  • Mora, J. C., & Darcy, I. (2017). The relationship between cognitive control and pronunciation in a second language. In T. Isaacs & P. Trofimovich (Eds.), Second language pronunciation assessment: Interdisciplinary perspectives (pp. 95–120). Bristol, UK: Multilingual Matters.
  • Moyer, A. (2013). Foreign accent: The phenomenon of non-native speech. Cambridge, UK: Cambridge University Press.
  • Munro, M. J., Derwing, T. M., & Burgess, C. S. (2010). Detection of nonnative speaker status from content-masked speech. Speech Communication, 52, 626–637. doi:10.1016/j.specom.2010.02.013
  • North, B. (2000). The development of a common framework scale of language proficiency. New York, NY: Peter Lang.
  • Nusbaum, H. C., Francis, A. L., & Henly, A. S. (1995). Measuring the naturalness of synthetic speech. International Journal of Speech Technology, 2, 7–19. doi:10.1007/BF02215800
  • Ockey, G., & French, R. (2016). From one to multiple accents on a test of L2 listening comprehension. Applied Linguistics, 37, 693–715. doi:10.1093/applin/amu060
  • Pelton, G. (2013). Intelligent tutoring of pronunciation consonant cluster problems. Cambridge English centenary symposium on speaking assessment (pp. 25–26). Cambridge: Cambridge English Language Assessment.
  • Piske, T. (2013). Flege, James. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. Hoboken, NJ: Wiley-Blackwell.
  • Ramineni, C., Trapani, C. S., Williamson, D. M., Davey, T., & Bridgeman, B. (2012). Evaluation of the e-rater scoring engine for the TOEFL independent and integrated prompts. Research Report 12-06. Princeton, NJ: ETS.
  • Reetz, H., & Jongman, A. (2009). Phonetics: Transcription, production, acoustics, and perception. Malden, MA: Wiley-Blackwell.
  • Richards, J. C., & Rodgers, T. S. (2014). Approaches and methods in language teaching (3rd ed.). Cambridge, UK: Cambridge University Press.
  • Rogerson, P., & Gilbert, J. B. (1990). Speaking clearly. Cambridge, UK: Cambridge University Press.
  • Rogerson-Revell, P. (2011). English phonology and pronunciation teaching. London, UK: Continuum.
  • Saito, K. (2012). Effects of instruction on L2 pronunciation development: A synthesis of 15 quasi-experimental intervention studies. TESOL Quarterly, 46, 842–854. doi:10.1002/tesq.2012.46.issue-4
  • Saito, K., Trofimovich, P., & Isaacs, T. (2017). Using listener judgements to investigate linguistic influences on L2 comprehensibility and accentedness: A validation and generalization study. Applied Linguistics, 38(4), 439–462.
  • Scovel, T. (2000). A critical review of the critical period research. Annual Review of Applied Linguistics, 20, 213–223. doi:10.1017/S0267190500200135
  • Sewell, A. (2013). Language testing and international intelligibility: A Hong Kong case study. Language Assessment Quarterly, 10, 423–443. doi:10.1080/15434303.2013.824974
  • Smith, L. E., & Nelson, C. I. (1985). International intelligibility of English: Directions and resources. World Englishes, 4, 333–342. doi:10.1111/j.1467-971X.1985.tb00423.x
  • Solewicz, Y. A., & Koppel, M. (2006). Automatically correcting bias in speaker recognition systems. Proceedings of the 2006 IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing (pp. 186–191). Maynooth, Ireland: IEEE.
  • Spolsky, B. (1995). Measured words: The development of objective language testing. Oxford, UK: Oxford University Press.
  • Sweet, H. (1899). The practical study of languages: A guide for teachers and learners. Dent: London, UK.
  • Taylor, L. (Ed.). (2011). Examining speaking: Research and practice in assessing second language speaking. Cambridge, UK: UCLES/Cambridge University Press.
  • Tharp, J. B. (1930). The effect of oral-aural ability on scholastic achievement in modern foreign languages. The Modern Language Journal, 15, 10–26. doi:10.1111/modl.1930.15.issue-1
  • Thomson, R. I. (2012). Improving L2 listeners’ perception of English vowels: A computer-mediated approach. Language Learning, 62, 1231‒1258. doi:10.1111/lang.2012.62.issue-4
  • Thomson, R. I. (2013). Accent reduction. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. Hoboken, NJ: Wiley-Blackwell.
  • Turner, C. E., & Purpura, J. E. (2016). Learning-oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 255‒274). Boston, MA: Walter de Gruyter.
  • Van Moere, A., & Suzuki, M. (2018). Using speech processing technology in assessing pronunciation. In O. Kang & A. Ginther (Eds.), Assessment in second language pronunciation (pp. 137‒152). Abingdon, UK: Routledge.
  • van Santen, J. P. H., Prud’hommeaux, E. T., & Black, L. M. (2009). Automated assessment of prosody production. Speech Communication, 51, 1082‒1097. doi:10.1016/j.specom.2009.04.007
  • Walker, R. (2010). Teaching the pronunciation of English as a Lingua Franca. Oxford, UK: Oxford University Press.
  • Watanabe, Y. (2013). The National Center Test for University Admissions. Language Testing, 30, 565–573. doi:10.1177/0265532213483095
  • Weir, C. J., Vidaković, I., & Galaczi, E. (2013). Measured constructs: A history of Cambridge English language examinations 1913-2012. Cambridge, UK: Cambridge University Press.
  • Winke, P., Gass, S., & Myford, C. (2013). Raters’ L2 background as a potential source of bias in rating oral performance. Language Testing, 30, 231–252. doi:10.1177/0265532212456968
  • Xi, X. (2010). Automated scoring and feedback systems: Where are we and where are we heading? Language Testing, 27, 291–300. doi:10.1177/0265532210364643
  • Xi, X., & Mollaun, P. (2011). Using raters from India to score a large‐scale speaking test. Language Learning, 61, 1222–1255. doi:10.1111/lang.2011.61.issue-4

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.