Constructing benchmarks for monitoring purposes: evidence from South Africa

References

• Anderson , J. 2005 . Accountability in education , Paris, France : UNESCO .
   Google Scholar
• Aziz , A. A. , Mohamed , A. , Arshad , N. , Zakaria , S. , Zaharim , A. , Ghulman , H. A. and Masodi , M. S. 2008 . Application of Rasch model in validating the construct of measurement instrument . International Journal of Education and Information Technologies , 2 : 105 – 112 .
   Google Scholar
• Azwell , T. 1995 . “ Messages about learning ” . In Report card on report cards: Alternatives to consider , Edited by: Azwell , T. and Schumar , E. 3 – 10 . Portsmouth, NH : Heinemann .
   Google Scholar
• Bandaranayake , R. C. 2008 . Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37 . Medical Teacher , 30 : 836 – 845 .
   PubMed Web of Science ®Google Scholar
• Beaton , A. and Johnson , E. G. 1992 . Overview of the scaling methodology used in the national assessment . Journal of Educational Measurement , 29 : 163 – 175 .
   Web of Science ®Google Scholar
• Ben-David , M. F. 2000 . AMEE Guide No. 18: Standard setting in pupil assessment . Medical Teacher , 22 : 120 – 130 .
   Web of Science ®Google Scholar
• Bennett , J. 1999 . Benchmarking in education for general practice: The challenge for quality improvement in the Royal Australia College of General Practitioners Training Program (RNCGP –TP) Retrieved from www.aes.asn.au/conferences/1999/Bennett%20Joanne% 20LS.pdf
   Google Scholar
• Berk , R. A. 1986 . A consumer’s guide to setting performance standards on criterion-referenced tests . Review of Educational Research , 56 : 137 – 172 .
   Web of Science ®Google Scholar
• Black , P. 1999 . Testing: Friend or foe? , London, UK : Falmer Press .
   Google Scholar
• Bond , T. G. and Fox , C. M. 2007 . Applying the Rasch model: Fundamental measurement in the human sciences , London, UK : Lawrence Erlbaum Associates .
   Google Scholar
• Cizek , G. J. and Bunch , M. B. 2007 . Standard setting: A Guide to establish and evaluate performance standards on tests , London, UK : Sage .
   Google Scholar
• Department of Education . 2007 . National policy on assessment and qualifications for schools in the general education and training band , Pretoria, South Africa : Author .
   Google Scholar
• Department of Education . 2009 . Education for All (EFA): Country report for South Africa , Pretoria, South Africa : Author .
   Google Scholar
• Du Toit , G. F. and Du Toit , E. R. 2004 . “ Understanding outcomes-based education (OBE) ” . In Outcomes-based assessment , Edited by: Maree , J. G. and Fraser , W. J. 2 – 27 . Sandown, South Africa : Heinemann Publishers .
   Google Scholar
• Education Handbook . 2011 . Education handbook: Connecting to make a difference , Stellenbosch, South Africa : Sunday Times .
   Google Scholar
• Ellis , R. A. and Moore , R. R. 2006 . Learning through benchmarking: Developing a relational, prospective approach to benchmarking ICT in learning and teaching . Higher Education , 51 : 351 – 371 .
   Web of Science ®Google Scholar
• Foy , P. , Galia , J. and Li , I. 2007 . “ Scaling the PIRLS 2006 assessment data ” . In PIRLS 2006 technical report , Edited by: Martin , M. O. , Mullis , I. V.S. and Kennedy , A. M. 149 – 172 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Foy , P. , Galia , J. and Li , I. 2008 . “ Scaling data from the TIMSS 2007 mathematics and science assessment ” . In TIMSS 2007 technical report , Edited by: Olson , J. F. , Martin , M. O. and Mullis , I. V.S. 225 – 338 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Hambleton , R. K. 1994 . “ Standard setting in criterion referenced testing ” . In The international encyclopaedia of education , Edited by: Husén , T. and Postlethwaite , T. N. 5721 – 5726 . New York, NY : Pergamon Press .
   Google Scholar
• Hambleton , R. K. , Sireci , S. G. and Smith , Z. R. 2009 . How do other countries measure up to the mathematics achievement levels on the National Assessment of Educational Progress? . Applied Measurement in Education , 22 : 376 – 393 .
   Web of Science ®Google Scholar
• Henson , R. K. Understanding the one-parameter Rasch model of item response theory . Paper presented at the Annual Meeting of the Southwest Educational Research Association, San Antonio, TX . January .
   Google Scholar
• Howie , S. J. 2002 . English language proficiency and contextual factors influencing mathematics achievement of secondary school pupils in South Africa , Enschede, The Netherlands : University of Twente .
   Google Scholar
• Howie , S. J. 2003 . “ Renewal of secondary education curricula and assessment in South Africa ” . In The renewal of secondary education in Africa , 305 – 321 . Dakar, Senegal : UNESCO Publishing .
   Google Scholar
• Howie , S. J. August 2011 . “ Keynote address Vice Chancellor’s Expert Lecture series ” . In Quality education for all: South Africa’s quest for the “Holy Grail” , August , University of Pretoria, Pretoria : South Africa .
   Google Scholar
• Howie , S. J. in press . “ The involvement of African countries in the IEA studies over 50 years ” . In Celebrating 50 years of the IEA , Edited by: Papanastastiou , C. , Plomp , T. and Papanastastiou , E. Amsterdam, The Netherlands : IEA .
   Google Scholar
• Kellaghan , T. , Greaney , V. and Murray , T. S. 2009 . Using the results of a national assessment of educational achievement , Washington, DC : The World Bank .
   Google Scholar
• Kennedy , A. M. and Sainbury , M. 2007 . “ Developing the PIRLS 2006 reading assessment and scoring guides ” . In PIRLS 2006 technical report , Edited by: Martin , M. O. , Mullis , I. V.S. and Kenn , A. M. 9 – 22 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Kennedy , A. M. and Trong , K. L. 2007 . “ Reporting student achievement in reading ” . In PIRLS 2006 technical report , Edited by: Martin , M. O. , Mullis , I. V.S. and Kennedy , A. M. 173 – 194 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Kotze , G. S. 2002 . Issues related to adapting assessment practices . South African Journal of Education , 22 : 76 – 80 .
   Google Scholar
• Linacre , J. M. 2005 . A user’s guide to Winsteps Retrieved from http://www.winsteps.com
   Google Scholar
• Livingston , I. D. 1988 . “ Standards, national: Monitoring ” . In The international encyclopaedia of education , Edited by: Husén , T. and Postlethwaite , T. N. 4786 – 4791 . New York, NY : Pergamon Press .
   Google Scholar
• MacCann , R. G. and Stanley , G. 2006 . The use of Rasch modelling to improve standard setting . Practical Assessment, Research & Evaluation , 11 ( 2 ) : 1 – 17 .
   Google Scholar
• Martin , M. O. , Gregory , K. D. , O’Connor , K. M. and Stemler , S. E. 2001 . TIMSS 1999 benchmarking technical report , Chestnut Hill, MA : Boston College .
   Google Scholar
• McCamey , R. A primer for the one-parameter Rasch model . Paper presented at the Annual Meeting of the Southwest Educational Research Association, Austin TX . February .
   Google Scholar
• Muijtjens , A. M.M. , Schuwirth , L. W.T. , Cohen-Schotanus , J. , Thoben , A. J.N.M. and Van der Vleuten , C. P.M. 2008 . Benchmarking by cross-institutional comparison of student achievement in a progress test . Medical Education , 42 : 82 – 88 .
   PubMed Web of Science ®Google Scholar
• Mullis , I. V.S. , Erberber , E. and Preuschoff , C. 2008 . “ The TIMSS 2007 international benchmarks of pupil achievement in mathematics ” . In TIMSS 2007 technical report , Edited by: Olson , J. F. , Martin , M. O. and Mullis , I. V.S. 339 – 347 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Mullis , I. V.S. , Martin , M. O. and Foy , P. 2008 . TIMSS 2007 international mathematics report , Chestnut Hill, MA : Boston College .
   Google Scholar
• Mullis , I. V.S. , Martin , M. O. , Kennedy , A. and Foy , P. 2007 . PIRLS 2006 international report , Chestnut Hill, MA : Boston College .
   Google Scholar
• National Assessment of Educational Progress . 2007 . Technical report on the NAEP mathematics assessment in Puerto Rico Retrieved from http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2007462rev
   Google Scholar
• National Department of Education . 2002 . Revised National Curriculum Statement Grades R-9: Overview , Pretoria, South Africa : Department of Education .
   Google Scholar
• Noell , J. and Ginsburg , A. 2008 . Evaluation of the National Assessment of Educational Progress: Next steps . Applied Measurement in Education , 22 : 409 – 414 .
   Web of Science ®Google Scholar
• Oberholzer , A. 2008 . “ Why shouldn’t quality be enhanced by efforts to evaluate it ” . In How can quality assurance be improved , 12 – 20 . Pretoria, South Africa : Umalusi .
   Google Scholar
• Olson , J. F. , Martin , M. O. , Mullis , I. V.S. , Foy , P. , Erberber , E. and Preuschoff , C. 2008 . “ Reviewing the TIMSS 2007 item statistics ” . In TIMSS 2007 technical report , Edited by: Olson , J. F. , Martin , M. O. and Mullis , I. V.S. 193 – 224 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Parker , B. 2008 . “ How can quality assurance improve quality? ” . In How can quality assurance be improved , 20 – 29 . Pretoria, South Africa : Umalusi .
   Google Scholar
• Reschly , D. J. 1990 . “ Aptitude tests in educational classification and placement ” . In Handbook of psychological assessment , Edited by: Goldstein , G. and Hersen , M. 148 – 172 . New York, NY : Pergamon Press .
   Google Scholar
• Resnick , L. B. , Nolan , K. J. and Resnick , D. P. 1995 . Benchmarking education standards . Educational Evaluation and Policy Analysis , 17 : 438 – 461 .
   Web of Science ®Google Scholar
• Rudduck , G. J. , O’Sullivan , C. Y. , Arora , A. and Erberber , E. 2008 . “ Developing the TIMSS 2007 mathematics and science assessments and scoring guides ” . In TIMSS 2007 technical report , Edited by: Olson , J. F. , Martin , M. O. and Mullis , I. V.S. 13 – 44 . Chestnut Hill, MA : Boston College .
   Google Scholar
• Scherman , V. 2007 . The validity of value-added measures in secondary schools (Unpublished doctoral dissertation) , University of Pretoria : Pretoria .
   Google Scholar
• Schumacker , R. E. 2004 . “ Rasch measurement: The dichotomous model ” . In Introduction to Rasch measurement , Edited by: Smith , E. V. and Smith , R. M. 226 – 257 . Maple Grove, MN : JAM Press .
   Google Scholar
• Sireci , S. G. , Hauger , J. B. , Wells , C. S. , Shea , C. and Zenisky , A. L. 2009 . Evaluation of the standard setting on the 2005 Grade 12 National Assessment of Educational Progress Mathematics Test . Applied Measurement in Education , 22 : 339 – 358 .
   Web of Science ®Google Scholar
• Smith , R. M. 2004 . “ Detecting item bias with the Rasch Model ” . In Introduction to Rasch measurement , Edited by: Smith , E. V. and Smith , R. M. 391 – 417 . Maple Grove, MN : JAM Press .
   Google Scholar
• Sutherland , S. 2004 . Creating a culture of data use for continuous improvement: A case study of an Edison Project School . American Journal of Evaluation , 25 : 277 – 293 .
   Web of Science ®Google Scholar
• Thomas , N. 2000 . Assessing model sensitivity of the imputation methods used in the National Assessment of Educational Progress . Journal of Educational and Behavioral Statistics , 25 : 351 – 371 .
   Web of Science ®Google Scholar
• Thomas , S. and Peng , W. J. 2004 . The use of educational standards and benchmarks in indicator publications . European Educational Research Journal , 3 : 177 – 212 .
   Google Scholar
• United Nations Educational Scientific and Cultural Organization . 2011 . The hidden crisis: Armed conflict and education (EFA Global Monitoring Report 2011). Retrieved from http://unesdoc.unesco.org/images/0019/001907/190743e.pdf
   Google Scholar
• Vaderas , J. M. , Alonso , J. , Prieto , L. , Espallargues , M. and Castells , X. 2004 . “ Content-based interpretation aids for health-related quality of life measures in clinical practice. An example for the visual function index (VF-14) ” . In Quality of Life 35 – 44 .
   Google Scholar
• Wang , N. 2003 . Use of the Rasch IRT model in standard setting: An item-mapping method . Journal of Educational Measurement , 40 : 231 – 253 .
   Web of Science ®Google Scholar
• Wilson , M. 2005 . Constructing measures: An item response modeling approach , New York, NY : Psychology Press .
   Google Scholar
• Wright , B. D. and Grosse , M. 1993 . How to set standards . Rasch Measurement Transactions , 7 : 315
   Google Scholar
• World Bank . 2011 . Learning for All: Investing in people’s knowledge and skills to promote development. World Bank Group Education Strategy 2020 , Washington, DC : World Bank .
   Google Scholar
• Yorke , M. 1999 . Benchmarking academic standards in the UK . Tertiary Education and Management , 5 : 81 – 96 .
   Google Scholar