Article 2025

Profiling the skill mastery of introductory programming students: A cognitive diagnostic modeling approach

Education and Information Technologies
Journal · Vol. 30 · Issue 5 · pp. 6455-6481
Abstract

The global shortage of skilled programmers remains a persistent challenge. High dropout rates in introductory programming courses pose a significant obstacle to graduation. Previous studies highlighted learning difficulties in programming students, but their specific weaknesses remained unclear. This gap exists due to the predominant focus on the overall academic performance evaluation. To address this gap, this study employed cognitive diagnostic modeling (CDM) to profile the skill mastery of programming students. An empirical analysis was conducted to select the most appropriate model for the data, and the linear logistic model (LLM) was determined to be the best fit. Final examination results from 308 information technology (IT) and 279 computer science (CS) students were analyzed using the LLM. Unfortunately, findings revealed that programming students exhibited proficiency primarily in code tracing and language proficiency but displayed deficits in theoretical understanding, logical reasoning, and algorithmic thinking. From a practical standpoint, this deficiency in fundamental skills sheds light on the factors contributing to academic failures and potentially eventual dropout in programming education. When comparing the student population by academic program, CS students demonstrated superior mastery compared to their IT counterparts, although both groups exhibited a lack of mastery in code tracing. These deviations underscore the pressing need for tailored educational strategies that address the unique strengths and weaknesses of each student group. Overall, this study offers valuable insights into programming education literature and contributes to the expanding application of CDM in educational research. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.

Keywords

Author Keywords

information technology Computer science Programming education Cognitive diagnostic modeling Educational assessment

Index Keywords

Author Affiliations
College of Education, University of the Philippines Diliman, Quezon City, Philippines, Educational Innovation and Technology Hub, FEU Institute of Technology, Manila, Philippines, College of Education, Korea University, Seoul, South Korea
Funding & Acknowledgements
No funding information
References 10 References
1 Agbo, Friday Joseph, A systematic review of computational thinking approach for programming education in higher education institutions, ACM International Conference Proceeding Series, (2019)
2 Akaike, Hirotsugu, A New Look at the Statistical Model Identification, IEEE Transactions on Automatic Control, 19, 6, pp. 716-723, (1974)
3 Angeli Valanides, Charoula Nicos, The effects of scaffolded programming scripts on pre-service teachers’ computational thinking: Developing algorithmic thinking through programming robots, International Journal of Child-Computer Interaction, 31, (2022)
4 Asian Development Bank, (2022)
5 Barlow-Jones, Glenda, Problem solving as a predictor of programming performance, Communications in Computer and Information Science, 730, pp. 209-216, (2017)
6 Chandía, Eugenio Del C., Nonparametric cognitive diagnosis of profiles of mathematical knowledge of teacher education candidates, Current Psychology, 42, 36, pp. 32498-32511, (2023)
7 Chen, Jinsong, Relative and absolute fit evaluation in cognitive diagnosis modeling, Journal of Educational Measurement, 50, 2, pp. 123-140, (2013)
8 Handbook of Diagnostic Classification Models, (2019)
9 de la Torre, Jimmy, The Generalized DINA Model Framework, Psychometrika, 76, 2, pp. 179-199, (2011)
10 de la Torre, Jimmy, A General Method of Empirical Q-matrix Validation, Psychometrika, 81, 2, pp. 253-273, (2016)
Quick Actions
Full Text via DOI
Citation Metrics
3
Times Cited (Scopus)

References 10
Document Identifiers