Article Green Open Access 2011

Self-evaluation of assessment programs: A cross-case analysis

Evaluation and Program Planning
Journal · Vol. 34 · Issue 3 · pp. 206-216
Abstract

The goal of this article is to contribute to the validation of a self-evaluation method, which can be used by schools to evaluate the quality of their Competence Assessment Program (CAP). The outcomes of the self-evaluations of two schools are systematically compared: a novice school with little experience in competence-based education and assessment, and an innovative school with extensive experience. The self-evaluation was based on 12 quality criteria for CAPs, including both validity and reliability, and criteria stressing the importance of the formative function of assessment, such as meaningfulness and educational consequences. In each school, teachers, management and examination board participated. Results show that the two schools use different approaches to assure assessment quality. The innovative school seems to be more aware of its own strengths and weaknesses, to have a more positive attitude towards teachers, students, and educational innovations, and to explicitly involve stakeholders (i.e., teachers, students, and the work field) in their assessments. This school also had a more explicit vision of the goal of competence-based education and could design its assessments in accordance with these goals. © 2011 Elsevier Ltd.

Keywords

Author Keywords

Case study Assessment validity self-evaluation

Index Keywords

Teaching human questionnaire Humans Article curriculum student psychometry qualitative research education professional competence qualitative analysis innovation Reliability analysis methodology reproducibility validation study Reproducibility of Results self evaluation Computer-Assisted Instruction Netherlands assessment method Psychometrics Self-assessment Questionnaires instrumentation
Author Affiliations
Universiteit Utrecht, Utrecht, Netherlands, Open Universiteit, Heerlen, Limburg, Netherlands
Universiteit Utrecht, Utrecht, Netherlands
Universiteit Maastricht, Maastricht, Limburg, Netherlands
Funding & Acknowledgements
Nederlandse Organisatie voor Wetenschappelijk Onderzoek, NWO
Grant: PROO 411-02-363
This research was supported by the Netherlands Organisation for Scientific Research (NWO) under project number PROO 411-02-363.
Nederlandse Organisatie voor Wetenschappelijk Onderzoek, NWO
This research was supported by the Netherlands Organisation for Scientific Research (NWO) under project number PROO 411-02-363.
References 10 References
1 Akkerman, Sanne Floor, Auditing quality of research in social sciences, Quality and Quantity, 42, 2, pp. 257-274, (2008)
2 Baartman, Liesbeth K.J., The wheel of competency assessment: Presenting quality criteria for competency assessment programs, Studies in Educational Evaluation, 32, 2, pp. 153-170, (2006)
3 Baartman, Liesbeth K.J., Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks, Educational Research Review, 2, 2, pp. 114-129, (2007)
4 Baartman, Liesbeth K.J., DETERMINING THE QUALITY OF COMPETENCE ASSESSMENT PROGRAMS: A SELF-EVALUATION PROCEDURE, Studies in Educational Evaluation, 33, 3-4, pp. 258-281, (2007)
5 Benett, Yves, The Validity and Reliability of Assessments and Self-assessments of Work-based Learning, Assessment & Evaluation in Higher Education, 18, 2, pp. 83-94, (1993)
6 Alternatives in Assessment of Achievements Learning Processes and Prior Knowledge, (1996)
7 Assessment in Education, (1998)
8 Vocations and Learning, (2008)
9 Learning and Teaching in Higher Education, (2004)
10 Chester, Mitchell D., Multiple measures and high-stakes decisions: A framework for combining measures, Educational Measurement: Issues and Practice, 22, 2, pp. 32-41, (2003)
Quick Actions
Full Text via DOI
Citation Metrics
18
Times Cited (Scopus)

References 10
Document Identifiers