Article Gold Open Access 2025

Assessing the Validity and Reliability of a Critical Thinking Test for Electrical Engineering Students Using Automation Studio Software

TEM Journal
Journal · Vol. 14 · Issue 3 · pp. 2579-2587
Abstract

This study developes and validates an Automation Studio-based critical thinking assessment instrument for electrical engineering students, focusing on the ladder diagram concepts in automation control systems. The multiple-choice instrument emphasises the significance of critical thinking in engineering education, particularly in the design and analysis of logic control systems. A quantitative methodology was employed with content validation conducted by experts, in addition to construct validity and reliability analysed statistically using SPSS. Out of the 45 items, 35 were deemed valid with item correlation values exceeding the significance threshold (r > 0.3). The reliability, measured using Cronbach's alpha, was 0.926, indicating excellent internal consistency. Difficulty levels and question differentiation confirmed the efficacy of the instrument in assessing critical thinking skills. This study contributes to the development of technology-based critical thinking evaluation tools that are appropriate for contemporary engineering education. Future research directions include adapting the instrument to other engineering disciplines, and refining it through broader population testing.The findings underscore the relevance of validated and reliable instruments for fostering critical thinking among engineering students. © 2025 Endryansyah Endryansyah et al.; published by UIKTEN. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 License.The article is published with Open Access at https://www.temjournal.com/

Keywords

Author Keywords

Critical thinking Assessment Automation Studio Engineering Education. Ladder Diagram Validity and Reliability

Index Keywords

Author Affiliations
Vocational Education Postgraduate, Universitas Negeri Surabaya, Surabaya, East Java, Indonesia
Department of Electrical Engineering, Universitas Negeri Surabaya, Surabaya, East Java, Indonesia
Funding & Acknowledgements
No funding information
References 10 References
1 Pahrudin, A., The effectiveness of science, technology, engineering, and mathematics-inquiry learning for 15-16 years old students based on K-13 Indonesian curriculum: The impact on the critical thinking skills, European Journal of Educational Research, 10, 2, pp. 681-692, (2021)
2 Ilyas, Muhammad, Improving students’ ability in learning mathematics by using the science, technology, engineering, and mathematics (STEM) approach, Frontiers in Education, 7, (2022)
3 Oduro-Okyireh, Theodore, The mediating role of higher-order thinking skill in the relationship between mathematics strength and achievement in electrical and electronic engineering education, Nurture, 18, 1, pp. 73-90, (2024)
4 Cognoscere J Komunikasi Dan Media Pendidikan, (2024)
5 Education Learning, (2024)
6 Mimbar Pgsd Undiksha, (2021)
7 Asean Journal of Engineering Education, (2019)
8 Oliva, Herberth Alexander, Critical Thinking and Digital Competence in College Students: A Cross-Sectional Study, International Journal of Engineering Pedagogy, 14, 2, pp. 92-99, (2024)
9 Open Journal of Educational Development, (2020)
10 Int J Sci Technol Manag, (2023)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)

References 10
Document Identifiers