401
Views
2
CrossRef citations to date
0
Altmetric
Articles

Reevaluating the relationship between explaining, tracing, and writing skills in CS1 in a replication study

, ORCID Icon, , , ORCID Icon &
Pages 355-383 | Received 15 Nov 2020, Accepted 17 May 2022, Published online: 10 Jun 2022
 

ABSTRACT

Background and Context

Lopez and Lister first presented evidence for a skill hierarchy of code reading, tracing, and writing for introductory programming students. Further support for this hierarchy could help computer science educators sequence course content to best build student programming skill.

Objective

This study aims to replicate a slightly simplified hierarchy of skills in CS1 using a larger body of students (600+ vs. 38) in a non-major introductory Python course with computer-based exams. We also explore the validity of other possible hierarchies. 

Method

We collected student score data on 4 kinds of exam questions. Structural equation modeling was used to derive the hierarchy for each exam.

Findings

We find multiple best-fitting structural models. The original hierarchy does not appear among the “best” candidates, but similar models do. We also determined that our methods provide us with correlations between skills and do not answer a more fundamental question: what is the ideal teaching order for these skills?

Implications

This modeling work is valuable for understanding the possible correlations between fundamental code-related skills. However, analyzing student performance on these skills at a moment in time is not sufficient to determine teaching order. We present possible study designs for exploring this more actionable research question.

Disclosure statement

The authors have no relevant financial or non-financial competing interests to report.

Notes

1. For simplicity of exposition, we maintain BIC over other selection methods, such as bootstrapping (Preacher & Merkle, Citation2012). Initial explorations with bootstrapping suggest the overall conclusions of our work would not change with another selection criteria.

Additional information

Funding

This work was supported by the National Science Foundation [DUE 21-21424].

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.