Evaluation approach of the mechanical engineering competency test certification using the assessment evaluability and performance monitoring model

Abstract

This research aims to gain an overview of the evaluation results and the many challenges to implementing machining competency test certification (CTC) in Vocational High Schools (VHS). The research approach to evaluating this program is a qualitative method using the analysis of Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). The program evaluation design in this study uses the Assessment Evaluability and Performance Monitoring (AEPM) model, which has four evaluation components: Context, Inputs, Activities, and Performance Monitoring. The subjects involved in data collection through the distribution of questionnaires of five VHS in the Special Capital Region of Jakarta. The technique of determining all subjects using the Purposive Sampling technique. The results showed the level of effectiveness of the implementation of the machining CTC program. Some dimensions need to be strengthened, especially for the “less and “very lacking” category. Finally, the approach presented in this research using the AEPM model is a step forward in the analysis of the CTC program. This approach can easily be replicated in other countries with similar aims as this research. © 2024 by the authors; licensee Growing Science, Canada.

Keywords

Author Keywords

Evaluation Competency performance Vocational high schools Competency test Evaluability

Index Keywords

Author Affiliations

Department of Educational Research and Evaluation, Universitas Negeri Jakarta, Jakarta, Jakarta, Indonesia

Funding & Acknowledgements

Universitas Negeri Jakarta, UNJ

Authors would like to thank the Postgraduate Education Research and Evaluation Study Program, and Mechanical Engineering Education Study Program, State University of Jakarta. Teachers from various VHS who have provided support and assisted in the implementation of instrument filling and activities related to the CTC implementation program.

References 10 References

1 Aguiar, Everaldo, Who, when and why: A machine learning approach to prioritizing students at risk of not graduating high school on time, ACM International Conference Proceeding Series, 16-20-March-2015, pp. 93-102, (2015)

2 Jurnal Kiprah, (2018)

3 Asplund, Stig Börje, Lessons from the welding booth: theories in practice in vocational education, Empirical Research in Vocational Education and Training, 12, 1, (2020)

4 Bharambe, Yogesh, Assessing employability of students using data mining techniques, 2017 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2017, 2017-January, pp. 2110-2114, (2017)

5 Billett, Stephen Richard, Defining the demand side of vocational education and training: Industry, enterprises, individuals and regions, Journal of Vocational Education and Training, 52, 1, pp. 5-31, (2000)

6 Boyce, Ayesha S., An Exploration of Two Novice Evaluation Educators’ Experiences Developing and Implementing Introduction to Evaluation Courses, American Journal of Evaluation, 40, 1, pp. 119-136, (2019)

7 Jurnal Pendidikan Vokasi, (2020)

8 Conejero, José M., Applying data driven decision making to rank vocational and educational training programs with TOPSIS, Decision Support Systems, 142, (2021)

9 Cook, Judith A., Employment barriers for persons with psychiatric disabilities: Update of a report for the president's commission, Psychiatric Services, 57, 10, pp. 1391-1405, (2006)

10 Edwards, Rosalind, Reviewing challenges and the future for qualitative interviewing, International Journal of Social Research Methodology, 23, 5, pp. 581-592, (2020)

Evaluation approach of the mechanical engineering competency test certification using the assessment evaluability and performance monitoring model

How to Cite