Article 2025

Leveraging ChatGPT for personalized reflective learning in programming education: effects on self-efficacy, higher-order thinking, and project implementation skills

Education and Information Technologies
Journal · Vol. 30 · Issue 17 · pp. 24815-24854
Abstract

Reflective learning is crucial in programming education, fostering critical thinking and problem-solving skills. However, traditional guided reflection often falls short in addressing individual challenges and providing personalized feedback. Recent studies exploring large language models like ChatGPT for personalized feedback have primarily focused on immediate solutions, potentially hindering the development of higher-order thinking skills (HOTS). This study investigates the efficacy of ChatGPT-generated personalized feedback reflective reports on undergraduate programming students’ self-efficacy, HOTS, and project implementation skills. Using a quasi-experimental design, 79 students in a Python programming course were divided into experimental and control groups over two semesters. The experimental group received ChatGPT-generated reports based on their error codes, while the control group engaged in traditional guided reflection. Results showed that the ChatGPT-facilitated approach significantly enhanced students’ self-efficacy in logical thinking, algorithm design, and debugging. Moreover, students demonstrated improved critical thinking and problem-solving skills. The experimental group also produced more logical, useful, and well-crafted projects, as evaluated using the Creative Product Analysis Matrix (CPAM). This research underscores the potential of AI-supported personalized feedback in enhancing reflective learning practices and HOTS development in undergraduate programming education. It offers valuable insights for educators and researchers in higher education contexts, potentially transforming how universities prepare students for the challenges of the digital age and contributing to the development of a more skilled and adaptable workforce. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.

Keywords

Author Keywords

Higher education self-efficacy ChatGPT Higher-order thinking skills Programming education Project implementation skills Reflective learning

Index Keywords

Author Affiliations
Graduate School of Technological and Vocational Education, National Yunlin University of Science and Technology, Douliou, Yunlin, Taiwan
Department of Engineering Science, National Cheng Kung University, Tainan, Taiwan
Funding & Acknowledgements
National Science and Technology Council, NSTC
Grant: NSTC 112-2410-H-006-053-MY3, 113-2410-H-224-036-MY3
This research was made possible through funding from the National Science and Technology Council (NSTC) of the Republic of China (R.O.C), under grant numbers NSTC 112-2410-H-006-053-MY3 and 113-2410-H-224-036-MY3.
References 10 References
1 Alahmed, Yazan, On the Education Effect of CHATGPT: Is AI CHATGPT to Dominate Education Career Profession?, 2023 International Conference on Intelligent Computing, Communication, Networking and Services, ICCNS 2023, pp. 79-84, (2023)
2 Al Shloul, Tamara, Role of activity-based learning and ChatGPT on students' performance in education, Computers and Education: Artificial Intelligence, 6, (2024)
3 Alt, Dorit, Problem-based learning, self- and peer assessment in higher education: towards advancing lifelong learning skills, Research Papers in Education, 37, 3, pp. 370-394, (2022)
4 Amini, Mahta, Coding with a Creative Twist: Investigating the Link Between Creativity Scores and Problem-solving Strategies, Proceedings - International Conference on Software Engineering, pp. 21-25, (2024)
5 Anderson, John Robert, Skill acquisition and the LISP tutor, Cognitive Science, 13, 4, pp. 467-505, (1989)
6 Anggraeni, Desak Made, Systematic review of problem based learning research in fostering critical thinking skills, Thinking Skills and Creativity, 49, (2023)
7 Azevedo, Roger, Using hypermedia as a metacognitive tool for enhancing student learning? The role of self-regulated learning, Educational Psychologist, 40, 4, pp. 199-209, (2005)
8 Azevedo, Roger, Lessons Learned and Future Directions of MetaTutor: Leveraging Multichannel Data to Scaffold Self-Regulated Learning With an Intelligent Tutoring System, Frontiers in Psychology, 13, (2022)
9 Bandura, Albert, Self-efficacy: Toward a unifying theory of behavioral change, Psychological Review, 84, 2, pp. 191-215, (1977)
10 Brazilian Journal of Motor Behavior, (2020)
Quick Actions
Full Text via DOI
Citation Metrics
2
Times Cited (Scopus)

References 10
Document Identifiers