Using an evidential reasoning approach for portfolio assessments in a project-based learning engineering design course

References

• Alha, K. 2004. “Portfolio Assessment on Chemical Reactor Analysis and Process Design Courses.” European Journal of Engineering Education 29 (2): 267–273. 10.1080/03043790320000157178 doi: 10.1080/03043790320000157178
   Google Scholar
• Barton, J., and A. Collins, eds. 1997. Portfolio Assessment: A Handbook for Educators. New York: Addison-Wesley.
   Google Scholar
• Biggs, J. B., and K. F. Collis. 1982. Evaluating the Quality of Learning: The SOLO Taxonomy. New York: Academic Press.
   Google Scholar
• Broad, B. 1994. “‘Portfolio Scoring’: A Contradiction in Terms.” In New Directions in Portfolio Assessment: Reflective Practice, Critical Theory and Large-Scale Scoring, edited by L. Black, D. Daiker, J. Sommers, and G. Stygall, 263–276. Portsmouth, NH: Boynton/Cook.
   Google Scholar
• Crawley, E. F., J. Malmquist, S. Østlund, and D. Bordeur. 2007. Rethinking Engineering Education: The CDIO Approach. New York: Springer.
   Google Scholar
• Engineers Australia. 2011. “The Revised 2011 National Competency Standards.” Engineers Australia. http://www.engineersaustralia.org.au/about-us/program-accreditation#standards
   Google Scholar
• Felder, R. M., and R. Brent. 2003. “Designing and Teaching Courses to Satisfy the ABET Engineering Criteria.” Journal of Engineering Education 92 (1): 7–25. doi: 10.1002/j.2168-9830.2003.tb00734.x
   Google Scholar
• Fernandes, S., M. A. Flores, and R. M. Lima. 2012. “Students’ Views of Assessment in Project-led Engineering Education: Findings from a Case Study in Portugal.” Assessment & Evaluation in Higher Education 37 (2): 163–178. doi: 10.1080/02602938.2010.515015
   Web of Science ®Google Scholar
• Fourali, C. 1997. “Using Fuzzy Logic in Educational Measurement: The Case of Portfolio Assessment.” Evaluation and Research in Education 11 (3): 129–148. doi: 10.1080/09500799708666923
   Google Scholar
• Glen, S., and N. F. Hight. 1992. “Portfolios: An ‘Affective’ Assessment Strategy?” Nurse Education Today 12 (6): 416–423. doi: 10.1016/0260-6917(92)90132-8
   PubMedGoogle Scholar
• Johnston, B. 2004. “Summative Assessment of Portfolios: An Examination of Different Approaches to Agreement Over Outcomes.” Studies in Higher Education 29 (3): 395–412. 10.1080/03075070410001682646 doi: 10.1080/03075070410001682646
   Web of Science ®Google Scholar
• Jonsson, A., and G. Svingby. 2007. “The Use of Scoring Rubrics: Reliability, Validity and Educational Consequences.” Educational Research Review 2 (2): 130–144. doi: 10.1016/j.edurev.2007.05.002
   Google Scholar
• Kennedy, G. J. 2005. “Peer-assessment in Group Projects: Is it Worth It?” In Volume 42, 7th Australasian Computing Education Conference, edited by Alison Young and Denise Tolhurst, 59–65. Newcastle: Australian Computer Society.
   Google Scholar
• Kofoed, L. B., and M. S. Stachowicz. 2012. “Assessment of Students Project: Numbers, Letters, Words.” 18th International Conference on Engineering Education (ICEE), 763–770. Turku, July 30–August 3.
   Google Scholar
• Kuisma, R. 2007. “Portfolio Assessment of an Undergraduate Group Project.” Assessment & Evaluation in Higher Education 32 (5): 557–569. doi: 10.1080/02602930601116904
   Google Scholar
• Laarhoven, P. J. M., and W. Pedrycz. 1983. “A Fuzzy Extension of Saaty's Priority Theory.” Fuzzy Set and System 11 (1): 229–241. doi: 10.1016/S0165-0114(83)80083-9
   Google Scholar
• Lee, Y., H. Kim, and J. Park. 2012. “A Study on the Development of Program Outcomes Assessment Tool Using Reflection Journal.” 18th International Conference on Engineering Education (ICEE), 310–316, Turku, July 30–August 3.
   Google Scholar
• McGourty, J., L. Shuman, M. Besterfield-Sacre, C. Atman, R. Miller, B. Olds, G. Rogers, and H. Wolfe. 2002. “Preparing for ABET EC 2000: Research-Based Assessment Methods and Processes.” International Journal of Engineering Education 18 (2): 157–167.
   Web of Science ®Google Scholar
• McMullan, M., R. Endacott, and M. A. Gray. 2003. “Portfolios and Assessment of Competencies: A Review of the Literature.” Journal of Advanced Nursing 41 (3): 283–294. doi: 10.1046/j.1365-2648.2003.02528.x
   PubMed Web of Science ®Google Scholar
• Moss, P. A. 1994. “Can There Be Validity Without Reliability?” Educational Researcher 23 (2): 5–12. doi: 10.3102/0013189X023002005
   Google Scholar
• Nepal, K. 2012. “A Comparative Evaluation of Analytical Methods to Allocate Individual Marks from a Team Mark.” European Journal of Engineering Education 37 (4): 397–404. doi: 10.1080/03043797.2012.702099
   Google Scholar
• Onwuegbuzie, A. J., and K. M. T. Collins. 2007. “A Typology of Mixed Methods Sampling Designs in Social Science Research.” The Qualitative Report 12 (2): 281–316.
   Google Scholar
• Penttilä, T., A. Jagiello-Rusilowski, and L. Kairisto-Mertanen. 2012. “Validating Social Competencies as Learning Outcomes of Innovation Pedagogy: Experiences in Finland and Poland.” 18th International Conference on Engineering Education (ICEE), 218–224. Turku, July 30–August 3.
   Google Scholar
• Pitts, J., C. Coles, and P. Thomas. 1999. “Educational Portfolios in the Assessment of General Practice Trainers: Reliability of Assessors.” Medical Education 33 (7): 515–520. doi: 10.1046/j.1365-2923.1999.00445.x
   PubMed Web of Science ®Google Scholar
• Reeves, T. C., and J. R. Okey. 1996. “Alternative Assessment for Constructivist Learning Environments.” In Constructivist Learning Environments: Case Studies in Instructional Design, edited by B. G. Wilson, 191–202. Englewood Cliffs: Educational Technology Publications.
   Google Scholar
• Savery, J. R. 2006. “Overview of Problem-based Learning: Definitions and Distinctions.” Interdisciplinary Journal of Problem-based Learning 1 (1): 8–20. doi: 10.7771/1541-5015.1002
   Google Scholar
• Savin-Baden, M. 2007. “Challenging Models and Perspectives of Problem-based Learning.” In Management of Change – Implementation of Problem-based and Project-based Learning in Engineering, edited by Erik de Graaff and Anette Kolmos, 9–29. Rotterdam: Sense Publishers.
   Google Scholar
• Senocak, E. 2009. “Development of an Instrument for Assessing Undergraduate Science Students' Perceptions: The Problem-based Learning Environment Inventory.” Journal of Science Education Technology 18 (6): 560–569. doi: 10.1007/s10956-009-9173-3
   Web of Science ®Google Scholar
• Shafer, G. 1976. A Mathematical Theory of Evidence. Princeton, NJ: Princeton University Press.
   Google Scholar
• Snadden, D. 1999. “Portfolios – Attempting to Measure the Unmeasurable?” (Commentary). Medical Education 33 (7): 478–479. doi: 10.1046/j.1365-2923.1999.00446.x
   PubMed Web of Science ®Google Scholar
• Sömmez, M., J. B. Yang, and G. D. Holt. 2001. “Addressing the Contractor Selection Problem Using an Evidential Reasoning Approach.” Engineering, Construction and Architectural Management 8 (3): 198–210. doi: 10.1108/eb021182
   Google Scholar
• Stojcevski, A., and X. Du. 2008. “Portfolio as an Assessment Method in PBL.” International conference on engineering education, Pécs-Budapest, Hungary, July 27–31, 2008.
   Google Scholar
• Tigelaar, D. E. H., D. H. J. M. Dolmans, I. H. A. P. Wolfhagen, and C. P. M. van der Vleuten. 2005. “Quality Issues in Judging Portfolios: Implications for Organizing Teaching Portfolio Assessment Procedures.” Studies in Higher Education 30 (5): 595–610. doi: 10.1080/03075070500249302
   Web of Science ®Google Scholar
• Tomkinson, B., and J. Freeman. 2007. “Using Portfolios for Assessment: Problems of Reliability or Standardisation?” Enhancing Higher Education, Theory and Scholarship. Proceedings of the 30th HERDSA annual conference, 574–584, Adelaide, July 8–11, 2007.
   Google Scholar
• Venkatesan, S., S. Fragomeni, and K. Zhang. 2008. “An Investigation into the Student Grading System in Problem Based Learning.” The international conference SEFI 8, 1–10. Rotterdam: Sense Publishers.
   Google Scholar
• Wang, Y. M., and T. M. S. Elhag. 2007. “A Comparison of Neural Network: Evidential Reasoning and Multiple Regression Analysis in Modelling Bridge Risks.” Expert Systems with Applications 32 (2): 336–348. doi: 10.1016/j.eswa.2005.11.029
   Web of Science ®Google Scholar
• Webb, C., R. Endacott, M. A. Gray, M. A. Jasper, M. McMullan, and J. Scholes. 2003. “Evaluating Portfolio Assessment Systems: What are the Appropriate Criteria?” Nurse Education Today 23 (8): 600–609. 10.1016/S0260-6917(03)00098-4. doi: 10.1016/S0260-6917(03)00098-4
   PubMed Web of Science ®Google Scholar
• Willey, K., and A. Gardner. 2010. “Investigating the Capacity of Self and Peer Assessment Activities to Engage Students and Promote Learning.” European Journal of Engineering Education 35 (4): 429–443. doi: 10.1080/03043797.2010.490577
   Google Scholar
• Williams, J. M. 2002. “The Engineering Portfolio: Communication, Reflection, and Student Learning Outcomes Assessment.” International Journal of Engineering Education 18 (2): 199–207.
   Web of Science ®Google Scholar
• Williams, N. 2006. “Reflective Journal Writing as an Alternative Assessment.” Journal of Teacher Initiated Research 3: 1–15. http://www.otterbein.edu/Files/pdf/Education/JTIR/VolumeIII/williams.pdf
   Google Scholar
• Winston, W. L. 1994. Operations Research: Applications and Algorithms. Belmont: Duxbury Press.
   Google Scholar
• Xu, D. L., and J. B. Yang. 2005. “Intelligent Decision System Based on the Evidential Reasoning Approach and Its Applications.” Journal of Telecommunication and Information Technology 3: 73–80. http://yadda.icm.edu.pl/baztech/element/bwmeta1.element.baztech-article-BAT3-0027-0009/c/httpwww_itl_waw_plczasopismajtit2005373.pdf.
   Google Scholar
• Yager, R. R., and A. Kelman. 1995. “Decision-making Under Various Types of Uncertainties.” Journal of Intelligent Fuzzy Systems 3 (1): 317–323.
   Google Scholar
• Yang, J. B., and M. G. Singh. 1994. “An Evidential Reasoning Approach for Multiple Attribute Decision Making with Uncertainty.” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 24 (1): 1–18. doi: 10.1109/21.259681
   Web of Science ®Google Scholar
• Yang, J., and D. L. Xu. 2002. “On the Evidential Reasoning Algorithm for Multi-Attribute Decision Analysis Under Uncertainty.” IEEE Transactions of Systems, Man and Cybernetics Part A: Systems and Humans 32 (3): 289–304. doi: 10.1109/TSMCA.2002.802746
   Web of Science ®Google Scholar
• Zhang, Z. J., J. B. Yang, and D. L. Xu. 1990. “A Hierarchical Analysis Model for Multiobjective Decision Making.”In Analysis, Design and Evaluation of Man-Machine Systems: Proceedings 4th IFAC/IFIP/IFORS/IEA Conference on Man-Machine Systems, edited by B. S. Hu, 13–18. Oxford: Pergamon Press.
   Google Scholar
• Zimmermann, H. J. 1990. “Problems and Tools to Model Uncertainty in Expert and Decision Support Systems.” Mathematical and Computer Modelling 13: 8–20. doi: 10.1016/0895-7177(90)90142-A
   Web of Science ®Google Scholar