Summative assessment of portfolios: an examination of different approaches to agreement over outcomes

References

• Adams , St Pierre E . (2000) . Poststructural feminism in education: an overview . Qualitative Studies in Education , 13 : 477 – 515 .
   Google Scholar
• Allen , M . (1995) . Valuing differences: Portnet's first year . Assessing Writing , 2 : 67 – 89 .
   Google Scholar
• Applebee A Langer JA Mullis IVS (1990) The Writing Report Card, 1984–1988: findings from the nation's Report Card (Princeton, NJ, National Assessment of Educational Progress)
   Google Scholar
• Assessment in Education (1998) Editorial 5 301 307
   Google Scholar
• Baume , D and Yorke , M . (2002) . The reliability of assessment by portfolio on a course to develop and accredit teachers in higher education . Studies in Higher Education , 27 : 7 – 25 .
   Web of Science ®Google Scholar
• Becker H Geer B Hughes E (1968) Making the grade: the academic side of college life (New York, John Wiley)
   Google Scholar
• Berlin J (1994) The subversions of the portfolio in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large‐scale scoring (Portsmouth, NH, Boynton/Cook)
   Google Scholar
• Black L Daiker D Sommers J Stygall G (1994) Writing like a woman and being rewarded for it? Gender, assessment and reflective letters from Miami University's student portfolios in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large‐scale scoring (Portsmouth, NH, Boynton/Cook)
   Google Scholar
• Black , P and Wiliam , D . (1998) . Assessment and classroom learning . Assessment in Education , 5 : 7 – 74 .
   Google Scholar
• Bourdieu P (1997) The state nobility (Cambridge, Polity Press)
   Google Scholar
• Britton J Burgess T Martin N Mcleod A Rosen H (1975) The development of writing abilities (London, Macmillan)
   Google Scholar
• Broad B (1994) ‘Portfolio scoring’: a contradiction in terms in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large‐scale scoring (Portsmouth, NH, Boynton/Cook)
   Google Scholar
• Broad , B . (2000) . Pulling your hair out: crises of standardization in communal writing assessment . Research in the Teaching of English , 35 : 213 – 260 .
   Web of Science ®Google Scholar
• Broadfoot PM (1996) Education, assessment and society (Buckingham, Open University Press)
   Google Scholar
• Brown G Bull J Pendlebury M (1997) Assessing student learning in higher education (London, Routledge)
   Google Scholar
• Centra , JA . (1994) . The use of the teaching portfolio and student evaluations for summative evaluation . Journal of Higher Education , 65 : 555 – 570 .
   Web of Science ®Google Scholar
• Challis , M . (1999) . AMEE [Association for Medical Education in Europe] Medical Education Guide No. 11 (revised): portfolio‐based learning and assessment in medical education . Medical Teacher , 21 : 370 – 386 .
   Web of Science ®Google Scholar
• Chilisa , B . (2000) . Towards equity in assessment: crafting gender‐fair assessment . Assessment in Education , 7 : 61 – 81 .
   Google Scholar
• Clifford , VA . (2002) . Does the use of journals as a form of assessment put into practice principles of feminist pedagogy? . Gender and Education , 14 : 109 – 121 .
   Web of Science ®Google Scholar
• Condon W Hamp‐Lyons L (1994) Maintaining a portfolio based writing assessment: research that informs program development in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large‐scale scoring (Portsmouth, NH, Boynton/Cook)
   Google Scholar
• Darling , LF . (2001) . Portfolio as practice: the narratives of emerging teachers . Teaching and Teacher Education , 17 : 107 – 121 .
   Web of Science ®Google Scholar
• Delandshere , G . (2001) . Implicit theories, unexamined assumptions and the status quo of educational assessment . Assessment in Education , 8 : 113 – 133 .
   Google Scholar
• Durst R Roemer M Schultz L (1994) Portfolio negotiation: acts in speech in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large‐scale scoring (Portsmouth, NH, Boynton/Cook)
   Google Scholar
• Edwards, A., & Knight, P. (Eds) (1995) Assessing competence (London, Kogan Page)
   Google Scholar
• Eisner EW (1984) The art of educational evaluation (London, Falmer Press)
   Google Scholar
• Elton , L and Laurillard , D . (1979) . Trends in research on student learning . Studies in Higher Education , 4 : 87 – 102 .
   Web of Science ®Google Scholar
• Fenwick A Assiter A Nixon N (1992) Profiling in higher education (London, Council for National Academic Awards)
   Google Scholar
• Fish S (1980) Is there a text in this class? The authority of interpretive communities (Cambridge, MA, Harvard University Press)
   Google Scholar
• Flynn , E . (1988) . Composing as a woman . College Composition and Communication , 39 : 423 – 435 .
   Web of Science ®Google Scholar
• Fourali , C . (1997) . Using fuzzy logic in educational measurement: the case of portfolio assessment . Evaluation and Research in Education , 11 : 129 – 148 .
   Google Scholar
• Geerzt C (1973) Thick description: towards an interpretive theory of culture in: C. Geertz (Ed.) The interpretation of culture (New York, Basic Books)
   Google Scholar
• Giroux H (1992) Border crossings: cultural workers and the politics of education (New York, Routledge)
   Google Scholar
• Gore JM (1993) The struggle for pedagogies (New York, Routledge)
   Google Scholar
• Guba EG Lincoln V (1989) Fourth generation evaluation (London, Sage)
   Google Scholar
• Hanson FA (1993) Testing, testing: social consequences of the examined life (Berkeley, CA, University of California Press)
   Google Scholar
• Hartog P Rhodes EC (1935) An examination of examinations (London, Macmillan)
   Google Scholar
• Heller , JI , Sheingold , K and Myford , CM . (1998) . Reasoning about evidence in portfolios: cognitive foundational for valid and reliable assessment . Educational Assessment , 5 : 5 – 40 .
   Google Scholar
• Herman , J and Winters , L . (1994) . Portfolio research: a slim collection . Educational Leadership , 52 : 48 – 55 .
   Web of Science ®Google Scholar
• Heywood J (2000) Assessment in higher education: student learning, teaching, programmes and institutions (London, Jessica Kingsley)
   Google Scholar
• Huot , B . (1996) . Towards a new theory of writing assessment . College Composition and Communication , 47 : 549 – 566 .
   Web of Science ®Google Scholar
• Knight , P . (2002) . Summative assessment in higher education: practices in disarray . Studies in Higher Education , 27 : 275 – 286 .
   Web of Science ®Google Scholar
• Kolb DA (1984) Experiential learning (Chicago, IL, Prentice Hall)
   Google Scholar
• Koretz , D . (1993) . New report of the Vermont portfolio project documents challenges . National Council on Measurement in Education Quarterly Newsletter , 1 : 1 – 2 .
   Google Scholar
• Kvale S (1993) Examinations re‐examined: certification of students or certification of knowledge? in S. Chaiklin & J. Lave (Eds) Understanding practice: perspectives on activity and context (New York, Cambridge University Press)
   Google Scholar
• LeMahieu , PG , Gitomer , DH and Eresh , JA . (1995) . Portfolios in large‐scale assessment: difficult but not impossible . Educational Measurement: issues and practice , 14 : 11–16 and 25–28
   Google Scholar
• Marton F Säljö V (1984) Approaches to learning in: F. Marton, D. Hounsell & N. J. Entwistle (Eds) The experience of learning (Edinburgh, Scottish Academic Press)
   Google Scholar
• Miller , MD and Legg , M . (1993) . Alternative assessment in a high‐stakes environment . Educational Measurement: issues and practice , 12 : 9 – 15 .
   Google Scholar
• Moss , P . (1994) . Can there be validity without reliability? . Educational Researcher , 23 : 5 – 12 .
   Google Scholar
• Murphy , S . (1994) . Portfolios and curriculum reform: patterns in practice . Assessing Writing , 1 : 175 – 206 .
   Google Scholar
• Musil CM (1992) Students at the centre: feminist assessment (Washington DC, Association of American Colleges)
   Google Scholar
• Newble , DI , Hoare , J and Sheldrake , PF . (1980) . The selection and training of examiners for clinical examinations . Medical Education , 14 : 345 – 349 .
   PubMed Web of Science ®Google Scholar
• Nystrand , M , Cohen , AS and Dowling , NM . (1993) . Addressing reliability problems in the portfolio assessment of college writing . Educational Assessment , 1 : 53 – 70 .
   Google Scholar
• Payne , RN , Bramhall , MD , Lawson , JS , Robinson , I and Short , C . (1993) . Portfolio assessment in practice in engineering . International Journal of Technology and Design Education , 3 : 37 – 42 .
   Google Scholar
• Pitts , J , Coles , C and Thomas , P . (1999) . Educational portfolios in the assessment of general practice trainers: reliability of assessors . Medical Education , 33 : 515 – 520 .
   PubMed Web of Science ®Google Scholar
• Pitts , J , Coles , C and Thomas , P . (2001) . Enhancing reliability in portfolio assessment: ‘shaping’ the portfolio . Medical Teacher , 23 : 351 – 355 .
   PubMed Web of Science ®Google Scholar
• Reckase , MD . (1995) . Portfolio assessment: a theoretical estimate of score reliability . Educational Measurement: issues and practice , 14 : 12–14, 31
   Google Scholar
• Reynolds , M and Trehan , K . (2000) . Assessment: a critical perspective . Studies in Higher Education , 25 : 267 – 278 .
   Web of Science ®Google Scholar
• Shapiro JP (1992) What is feminist assessment? in: C. M. Musil (Ed.) Students at the centre: feminist assessment (Washington DC, Association of American Colleges)
   Google Scholar
• Simons H (1987) Getting to know schools in a democracy: the politics and process of evaluation (Lewes, Falmer Press)
   Google Scholar
• Sirc , G . (1989) . Gender and ‘writing formations’ in first year narratives . Freshman English News , 18 : 4 – 11 .
   Google Scholar
• Snadden , D and Thomas , M . (1998) . The use of portfolio learning in medical education . Medical Teacher , 20 : 192 – 199 .
   Web of Science ®Google Scholar
• Snyder BR (1970) The hidden curriculum (Cambridge, MA, MIT Press)
   Google Scholar
• Stake RE Kerr D (1994) Rene Magritte, constructivism, and the researcher as interpreter paper presented to the Annual Meeting of the American Educational Research Association New Orleans, April
   Google Scholar
• Supovitz , J , Macgowan , A and Slattery , V . (1997) . Assessing agreement: an examination of the interrater reliability of portfolio assessment in Rochester, New York . Educational Assessment , 4 : pp. 237–259
   Google Scholar
• Vygotsky LS (1962) Thought and Language (Cambridge, MA, Massachusetts Institute of Technology)
   Google Scholar
• Vygotsky LS (1978) Mind in society: the development of higher psychological processes (M. Cole, V. John‐Steiner, S. Scribner & E. Souberman Eds) (Cambridge, MA, Harvard University Press)
   Google Scholar
• White E (1994) Teaching and assessing writing (San Francisco, CA, Jossey Bass)
   Google Scholar