Standard Setting to an International Reference Framework: Implications for Theory and Practice

REFERENCES

• Alderson , J. C. , Figueras , N. , Kuijper , H. , Nold , G. , Takala , S. and Tardieu , C. 2006 . Analysing tests of reading and listening in relation to the common European framework of reference: The experience of the Dutch CEFR construct project . Language Assessment Quarterly , 3 ( 1 ) : 3 – 30 .
   Google Scholar
• Angoff , W. H. 1971 . “ Scales, norms, and equivalent scores ” . In Educational measurement (2nd ed. , Edited by: Thorndike , R. L. 508 – 560 . Washington , DC : American Council on Education .
   Google Scholar
• Camilli , G. , Cizek , G. J. and Lugg , C. A. 2001 . “ Psychometric theory and the validation of performance standards: History and future perspectives ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. 445 – 475 . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Cizek , G. J. 1993 . Reconsidering standards and criteria . Journal of Educational Measurement , 30 ( 2 ) : 93 – 106 .
   Web of Science ®Google Scholar
• Cizek , G. J. 2001 . “ Preface. ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. ix – xiii . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Cizek , G. J. and Bunch , M. B. 2007 . Standard setting: A guide to establishing and evaluating performance standards on tests , Thousand Oaks, CA : Sage Publications .
   Google Scholar
• Coste , D. Contextualising uses of the common European framework of reference for languages . Paper presented at Council of Europe Policy Forum on use of the CEFR, Strasbourg , Retrieved from http://www.coe.int/T/DG4/Linguistic/Source/SourceForum07/D-Coste_Contextualise_EN.doc
   Google Scholar
• Council of Europe . 2001 . Common European framework of reference for languages: Learning, teaching, assessment , Cambridge , UK : Cambridge University Press .
   Google Scholar
• Council of Europe . 2008 . Explanatory notes to recommendation CM/Rec (2008)7 of the committee of ministers to member states concerning the use of the common European framework of reference for languages (CEFR) and the promotion of plurilingualism Retrieved from https://wcd.coe.int/wcd/ViewDoc.jsp?id=1318855&Site=COE
   Google Scholar
• Council of Europe . 2009 . Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR) , Strasbourg , , France : Council of Europe . Retrieved from http://www.coe.int/t/dg4/linguistic/Source/ManualRevision-proofread-FINAL_en.pdf
   Google Scholar
• Educational Testing Service . 2006 . TOEFL internet-based test score comparison tables , Princeton , NJ : Educational Testing Service . Retrieved from http://www.ets.org/Media/Tests/TOEFL/pdf/TOEFL_iBT_Score_Comparison_Tables.pdf
   Google Scholar
• Educational Testing Service . 2010 . Linking TOEFL iBT scores to IELTS scores—A research report , Princeton , NJ : Educational Testing Service . Retrieved from http://www.ets.org/s/toefl/pdf/linking_toefl_ibt_scores_to_ielts_scores.pdf
   Google Scholar
• Fulcher , G. 2008 . Testing times ahead? . Liaison Magazine , 1 : 20 – 24 .
   Google Scholar
• Galaczi , E. D. , ffrench , A. , Hubbard , C. and Green , A. 2011 . Developing assessment scales for large-scale speaking tests: A multi-method approach . Assessment in Education: Principles, Policy & Practice , 18 ( 3 ) : 217 – 237 .
   Google Scholar
• Green , A. 2012 . Language functions revisited: Theoretical and empirical bases for language construct definition across the ability range. , Cambridge : UK: UCLES/Cambridge University Press .
   Google Scholar
• Hambleton , R. K. 2001 . “ Setting performance standards on educational assessments and criteria for evaluating the process ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. 89 – 116 . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Hanson , B. A. and Chien , Y. 2004 . Equating error computer software , Iowa City , IA : CASMA .
   Google Scholar
• Hawkey , R. 2009 . Examining FCE and CAE: Key issues and recurring themes in developing the First Certificate in English and Certificate in Advanced English exams , Cambridge : UK: UCLES/Cambridge University Press .
   Google Scholar
• Hawkins , J. A. and Filipovic , L. 2012 . Criterial features in L2 English: Specifying the reference levels of the common European framework , Cambridge : UK: UCLES/Cambridge University Press .
   Google Scholar
• Holland , P. W. and Thayer , D. T. 2000 . Univariate and bivariate loglinear models for discrete test score distributions . Journal of Educational and Behavioral Statistics , 25 ( 2 ) : 133 – 183 .
   Web of Science ®Google Scholar
• Impara , J. C. and Plake , B. S. 1997 . An alternative approach to standard setting . Journal of Educational Measurement , 34 ( 4 ) : 355 – 368 .
   Web of Science ®Google Scholar
• Jaeger , R. M. 1989 . “ Certification of student competence ” . In Educational measurement (3rd ed. , Edited by: Linn , R. L. 485 – 514 . Washington , DC : American Council on Education .
   Google Scholar
• Jones , N. 2009 . “ A comparative approach to constructing a multilingual proficiency framework: Constraining the role of standard setting ” . In Linking to the CEFR levels: Research perspectives , Edited by: Figueras , N. and Noijons , J. 35 – 43 . Arnhem , The Netherlands : CITO .
   Google Scholar
• Jones , N. and Saville , N. 2009 . European language policy: Assessment, learning, and the CEFR . Annual Review of Applied Linguistics , 29 : 51 – 63 .
   Web of Science ®Google Scholar
• Kaftandjieva , F. 2004 . Reference supplement to the manual for relating language examinations to the CEFR, Section B: Standard Setting . Retrieved from http://www.coe.int/t/dg4/linguistic/CEF-refSupp-SectionB.pdf
   Google Scholar
• Kane , M. T. 1992 . An argument-based approach to validity . Psychological Bulletin , 112 ( 3 ) : 527 – 535 .
   Web of Science ®Google Scholar
• Kane , M. T. 1998 . Choosing between examinee-centered and test-centered standard setting methods . Educational Assessment , 5 ( 3 ) : 129 – 145 .
   Google Scholar
• Kane , M. T. 2001 . “ So much remains the same: Conception and status of validation in setting standards ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. 53 – 88 . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Kane , M. T. 2006 . “ Validation ” . In Educational Measurement (4th ed. , Edited by: Brennan , R. L. 17 – 64 . Westport , CT : American Council on Education .
   Google Scholar
• Kolen , M. J. and Brennan , R. L. 2004 . “ Test equating, scaling, and linking ” . New York , NY : Springer .
   Google Scholar
• Little , D. 2007 . The common European framework of reference for languages: Perspectives on the making of supranational language education policy . Modern Language Journal , 91 ( 4 ) : 645 – 653 .
   Web of Science ®Google Scholar
• Martinyuk , W. and Noijons , J. 2007 . Executive summary of results of a survey on the use of the CEFR at national level in the Council of Europe member states , Strasbourg , , France : Council of Europe .
   Google Scholar
• North , B. 2000 . The development of a common framework scale of language proficiency , Frankfurt , Germany : Peter Lang .
   Google Scholar
• North , B. 2004, April 15 . Europe's framework promotes language discussion, not directives . Guardian Weekly , Retrieved from http://www.guardian.co.uk/education/2004/apr/15/tefl6
   Google Scholar
• North , B. 2011 . Putting the common European framework of reference to good use . Language Teaching , available on CJO 2011, doi:10.1017/S0261444811000206
   Web of Science ®Google Scholar
• North , B. and Schneider , G. 1998 . Scaling descriptors for language proficiency scales . Language Testing , 15 ( 2 ) : 217 – 263 .
   Google Scholar
• Pearson Test of English . 2009 . Preliminary estimates of concordance between Pearson test of English academic and other measures of English language competencies , London , UK : Edexcel . Retrieved from http://www.pearsonpte.com/SiteCollectionDocuments/PremliminaryEstimatesofConcordanceUS.pdf
   Google Scholar
• Plake , B. S. and Hambleton , R. K. 2000 . A standard-setting method designed for complex performance assessments: Categorical assignments of student work . Educational Assessment , 6 ( 3 ) : 197 – 215 .
   Google Scholar
• Raymond , M. R. and Reid , J. B. 2001 . “ Who made thee a judge? Selecting and training participants for standard setting ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. 119 – 157 . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Reckase , M. D. 2009 . “ Standard setting theory and practice: Issues and difficulties ” . In Linking to the CEFR levels: Research perspectives , Edited by: Figueras , N. and Noijons , J. 13 – 20 . Arnhem , The Netherlands : CITO .
   Google Scholar
• Tannenbaum , R. J. and Wylie , E. C. 2004 . Mapping test scores onto the common European framework: Setting standards of language proficiency on the test of English as a foreign language (TOEFL), the test of spoken English (TSE), the test of written English (TWE), and the test of English for international communication (TOEIC) , Princeton , NJ : Educational Testing Service . Retrieved from http://www.ets.org/Media/Tests/TOEFL/pdf/CEFstudyreport.pdf
   Google Scholar
• Tannenbaum , R. J. and Wylie , E. C. 2008 . Linking English-language test scores onto the common European framework of reference: An application of standard-setting methodology , Princeton , NJ : Educational Testing Service . ETS Research Report 08-34
   Google Scholar
• Taylor , L. and Jones , N. 2006 . Cambridge ESOL exams and the common European framework of reference (CEFR) . Research Notes , 24 : 2 – 5 .
   Google Scholar
• Weir , C. J. 2005 . Limitations of the common European framework for developing comparable examinations and tests . Language Testing , 22 ( 3 ) : 281 – 300 .
   Google Scholar
• WIDA Consortium . 2007 . English language proficiency standards prekindergarten through grade 5 Retrieved from http://www.wida.us/standards/PreK-5%20Standards%20web.pdf
   Google Scholar
• Zeng , L. , Kolen , M. J. , Hanson , B. A. , Cui , Z. and Chien , Y. 2004 . RAGE-RGEQUATE computer software , Iowa City , IA : CASMA .
   Google Scholar
• Zieky , M. J. 2001 . “ So much has changed: How the setting of cutscores has evolved since the 1980s ” . In Setting performance standards: Concepts, methods, and perspectives , Edited by: Cizek , G. J. 19 – 51 . Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar