Article Gold Open Access 2022

Test sensitivity in assessing competencies in nursing education

Empirical Research in Vocational Education and Training
Journal · Vol. 14 · Issue 1 · Art. 3
Abstract

The identification of effects of vocational education and training conditions on competence development in nursing education requires longitudinal studies. An important precondition is the availability of a test of nursing competence which is economical in use, measures a homogeneous construct throughout years of nursing education and across nursing specializations, and can detect increases in the required competence, hence allowing for sensitive testing. This article describes a cross-sectional study that aimed to optimize a computer-based test measuring nursing competence in care for the elderly—the TEMA test—through the selection of items on the basis of measurement error, differential item functioning, and item difficulty. Evidence of the test sensitivity of the optimized TEMA-L instrument is presented for the second and third year of nursing education. The total sample consisted of n = 133 German nursing students from clinical and geriatric nursing. The resulting instrument includes two test booklets consisting of 36 (WLE = 0.72) and 35 items (WLE = 0.70) respectively for the second and third year of training. The cross-sectional data indicate that the test likely has good properties for sensitive testing of nursing competence in a future longitudinal study. Hence, it might be used to study factors contributing to increases in nursing competence in German VET and serve as an example for similar studies in other countries. Limitations of the current study and related subjects of future research are discussed. © 2022, The Author(s).

Keywords

Author Keywords

vocational education and training competence development Nursing education item response theory Computer-based testing Differential item functioning Test sensitivity

Index Keywords

Author Affiliations
Professur für Wirtschaftspädagogik, Universität Hohenheim, Stuttgart, Baden-Wurttemberg, Germany
Professur für Wirtschaftspädagogik und Personalentwicklung, Georg-August-Universität Göttingen, Gottingen, Niedersachsen, Germany
Professur für Erziehungswissenschaft mit dem Schwerpunkt Historische Schul- und Curriculumforschung, University of Münster, Munster, Nordrhein-Westfalen, Germany
Technische Universität München, Munich, Bayern, Germany
Funding & Acknowledgements
Bundesministerium für Bildung und Forschung, BMBF
Grant: 21AP006A
This research has been funded by the German Federal Ministry of Education and Research (21AP006A).
References 10 References
1 Resultate Und Probleme Der Berufsbildungsforschung Results and Problems of Vet Research Festschrift Fur Susanne Weber, (2021)
2 Feasibility Study Vet Lsa A Comparative Analysis of Occupational Profiles and Vet Programmes in 8 European Countries International Report in Cooperation with Schelten A Muller M Nickolaus R Geiel B Breuer K Hillen S Winther E Bals T Wittmann E Barke A Sofi, (2009)
3 Applying the Rasch Model Fundamental Measurement in the Human Sciences, (2025)
4 Berufsbildungsbericht 2021 Federal Report on Vocational Education 2021 Bonn, (2021)
5 Deutscher, Viola K., Instructional sensitivity in vocational education, Learning and Instruction, 53, pp. 21-33, (2018)
6 Technologiebasierte Kompetenzmessung in Der Beruflichen Bildung Ergebnisse Aus Der Bmbf Forderinitiative Ascot, (2016)
7 Fan, Junyu, Performance evaluation of nursing students following competency-based education, Nurse Education Today, 35, 1, pp. 97-103, (2015)
8 undefined
9 Pflegen Lernen, (2007)
10 Learning in Health and Social Care, (2005)
Quick Actions
Full Text via DOI
Citation Metrics
5
Times Cited (Scopus)

References 10
Document Identifiers