https://orcid.org/0000-0002-3305-9493
Figures & data
Table 1. Analysing Generative AI Performance for the Online Quiz Assessment Type.
Table 2. Analysing Generative AI Performance for the Numerical (Assignments and Exams) Assessment Type.
Table 3. Analysing Generative AI Performance for the Oral Assessment Type.
Table 4. Analysing Generative AI Performance for the Visual Assessment Type.
Table 5. Analysing Generative AI Performance for the Programming Assessment Type.
Table 6. Analysing Generative AI Performance for the Written (Experimentation-based) Assessment Type.
Table 7. Analysing Generative AI Performance for the Written (Project-based) Assessment Type.
Table 8. Analysing Generative AI Performance for the Written (Reflective & Critical Thinking-based) Assessment Type.
Table 9. Analysing Generative AI Performance for the Written (Research-based) Assessment Type.
Figure 1. An example of Copilot struggling to represent mathematical equations.
Figure 2. Example of circuit diagrams examined (a) GenAI can easily find the total current and (b) GenAI made minor mistakes in finding the total current.
Figure 3. GenAI was tested to find out the shape factor of this object.
Figure 4. Example of a Physics question that GenAI was partially able to answer correctly. GenAI was able to correctly find the values but made some miscalculations in terms of vector direction.
Figure 5. Example of physics question diagram (a), correct Free Body Diagram (b) and generated AI outputs: Copilot (c), Gemini (d), GPT-4 (d).
Figure 6. Sample charts produced by GPT-4 in response to a Manufacturing Technology question with given data.
Table 10. The Generative AI Assessment Security & Opportunity Matrix.