MULTI-INDEX AND HIERARCHICAL COMPREHENSIVE EVALUATION SYSTEM FOR TRAINING QUALITY OF SCIENCE AND ENGINEERING POSTGRADUATES

Abstract

It is essential to establish a multi-dimensional postgraduate quality evaluation system for student assessment and training. This study aimed to explore the construction of the multi-index and hierarchical comprehensive evaluation system for postgraduate training in science and engineering based on the Context, Input, Process, Product (CIPP) model using Analytic Hierarchy Process. It involved 756 postgraduates in physics and engineering who were randomly selected via the Internet. Data were collected from the questionnaire about postgraduates’ basic information. After collection, Factor Analysis was used to verify the rationality of the design of second-level and third-level indicators, and adjust the corresponding weights. On this basis, Cluster Analysis was used to classify the training quality of the postgraduates based on their scores on academic ability, basic quality, and social ability indicators. The results revealed that the index system includes 4 first-level indicators,12 second-level indicators and 36 third-level indicators, and different weights being assigned to the indicators according to their influence on the training quality of postgraduates in science and engineering. This study also provides some reference for the quality of science and engineering postgraduate training in Chinese universities by proposing relevant measures, which could be interesting also for international audience. © 2022, Journal of Baltic Science Education. All rights reserved.

Keywords

Author Keywords

CIPP model Analytic Hierarchy Process multivariate statistical analysis postgraduate quality training

Index Keywords

Author Affiliations

Jiangsu Normal University, Xuzhou, Jiangsu, China

Postgraduate Student, Jiangsu Normal University, Xuzhou, Jiangsu, China

School of Physics and Electronic Engineering, Jiangsu Normal University, Xuzhou, Jiangsu, China

Funding & Acknowledgements

Grant: 2021-R-91911

The authors would like to thank a Project Funded the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) for the generous financial support. This research was founded by Jiangsu Normal University Postgraduate Training Quality Project-Education Teaching Reform and Research Key Project ‘’Research on Quality Evaluation of Engineering Postgraduate Training Based on CIPP Model ‘’ (Grant No. JGKTZ201921), and Jiangsu Modern Educational Technology Research Project ‘’Construction and Application of Adaptive Cognitive Diagnostic Evaluation System for Physics Learning’’(Grant No. 2021-R-91911). This research was also supported by the Educational Research Project of the Teaching Guidance Sub-committee of Optoelectronic Information Science and Engineering Specialty of the Teaching Guidance Committee of Electronic Information Specialty in Colleges and Universities of the Ministry of Education Fund of P.R. China (Grant No. 2020XGK26 and 2020SYL41).

Grant: 2020SYL41, 2020XGK26

The authors would like to thank a Project Funded the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) for the generous financial support. This research was founded by Jiangsu Normal University Postgraduate Training Quality Project-Education Teaching Reform and Research Key Project ‘’Research on Quality Evaluation of Engineering Postgraduate Training Based on CIPP Model ‘’ (Grant No. JGKTZ201921), and Jiangsu Modern Educational Technology Research Project ‘’Construction and Application of Adaptive Cognitive Diagnostic Evaluation System for Physics Learning’’(Grant No. 2021-R-91911). This research was also supported by the Educational Research Project of the Teaching Guidance Sub-committee of Optoelectronic Information Science and Engineering Specialty of the Teaching Guidance Committee of Electronic Information Specialty in Colleges and Universities of the Ministry of Education Fund of P.R. China (Grant No. 2020XGK26 and 2020SYL41).

Jiangsu Normal University, JSNU

Grant: JGKTZ201921

The authors would like to thank a Project Funded the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) for the generous financial support. This research was founded by Jiangsu Normal University Postgraduate Training Quality Project-Education Teaching Reform and Research Key Project ‘’Research on Quality Evaluation of Engineering Postgraduate Training Based on CIPP Model ‘’ (Grant No. JGKTZ201921), and Jiangsu Modern Educational Technology Research Project ‘’Construction and Application of Adaptive Cognitive Diagnostic Evaluation System for Physics Learning’’(Grant No. 2021-R-91911). This research was also supported by the Educational Research Project of the Teaching Guidance Sub-committee of Optoelectronic Information Science and Engineering Specialty of the Teaching Guidance Committee of Electronic Information Specialty in Colleges and Universities of the Ministry of Education Fund of P.R. China (Grant No. 2020XGK26 and 2020SYL41).

Priority Academic Program Development of Jiangsu Higher Education Institutions, PAPD

The authors would like to thank a Project Funded the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) for the generous financial support. This research was founded by Jiangsu Normal University Postgraduate Training Quality Project-Education Teaching Reform and Research Key Project ‘’Research on Quality Evaluation of Engineering Postgraduate Training Based on CIPP Model ‘’ (Grant No. JGKTZ201921), and Jiangsu Modern Educational Technology Research Project ‘’Construction and Application of Adaptive Cognitive Diagnostic Evaluation System for Physics Learning’’(Grant No. 2021-R-91911). This research was also supported by the Educational Research Project of the Teaching Guidance Sub-committee of Optoelectronic Information Science and Engineering Specialty of the Teaching Guidance Committee of Electronic Information Specialty in Colleges and Universities of the Ministry of Education Fund of P.R. China (Grant No. 2020XGK26 and 2020SYL41).

References 10 References

1 English Language Teaching Educational Journal, (2019)

2 Educational Research and Reviews, (2016)

3 Al-Shanawani, Hania M., Evaluation of Self-Learning Curriculum for Kindergarten Using Stufflebeam’s CIPP Model, SAGE Open, 9, 1, (2019)

4 Barton-Arwood, Sally M., Project IMPROVE: Improving teachers' ability to address students' social needs, Education and Treatment of Children, 28, 4, pp. 430-443, (2005)

5 Cencelj, Zvonka, Metacognitive model for developing science, technology and engineering functional literacy, Journal of Baltic Science Education, 19, 2, pp. 220-233, (2020)

6 Academic Degrees Graduate Education, (2010)

7 Chinta, Ravi R., A conceptual framework for evaluating higher education institutions, International Journal of Educational Management, 30, 6, pp. 989-1002, (2016)

8 Path Ward the Future of Graduate Education in the United States, (2015)

9 Dig into Learning A Program Evaluation of an Agricultural Literacy Innovation, (2016)

10 Everitt, Brian S., Cluster analysis, Quality and Quantity, 14, 1, pp. 75-100, (1980)

MULTI-INDEX AND HIERARCHICAL COMPREHENSIVE EVALUATION SYSTEM FOR TRAINING QUALITY OF SCIENCE AND ENGINEERING POSTGRADUATES

How to Cite