Article Gold Open Access 2007

DETERMINING THE QUALITY OF COMPETENCE ASSESSMENT PROGRAMS: A SELF-EVALUATION PROCEDURE

Studies in Educational Evaluation
Journal · Vol. 33 · Issue 3-4 · pp. 258-281
Abstract

As assessment methods are changing, the way to determine their quality needs to be changed accordingly. This article argues for the use Competence Assessment Programs (CAPs), combinations of traditional tests and new assessment methods which involve both formative and summative assessments. To assist schools in evaluating their CAPs, a self-evaluation procedure was developed, based on 12 quality criteria for CAPs developed in earlier studies. A self-evaluation was chosen as it is increasingly used as an alternative to external evaluation. The CAP self-evaluation is carried out by a group of functionaries from the same school and comprises individual self-evaluations and a group interview. The CAP is rated on the 12 quality criteria and a piece of evidence is asked for to support these ratings. In this study, three functionaries from eight schools (N = 24) evaluated their CAP using the self-evaluation procedure. Results show that the group interview was very important as different perspectives on the CAP are assembled here into an overall picture of the CAP's quality. Schools seem to use mainly personal experiences to support their ratings and need to be supported in the process of carrying out a self-evaluation. © 2006 Elsevier Ltd. All rights reserved.

Keywords

Author Keywords

Not provided

Index Keywords

Author Affiliations
Universiteit Utrecht, Utrecht, Netherlands, Open Universiteit, Heerlen, Limburg, Netherlands
Universiteit Maastricht, Maastricht, Limburg, Netherlands
Universiteit Utrecht, Utrecht, Netherlands
Funding & Acknowledgements
Nederlandse Organisatie voor Wetenschappelijk Onderzoek, NWO
Grant: PROO 411-02-363
This research was supported by the Netherlands Organisation for Scientific Research (NWO) under project number PROO 411-02-363
References 10 References
1 Alderson, J. Charles, Does washback exist?, Applied Linguistics, 14, 2, pp. 115-129, (1993)
2 Baartman, Liesbeth K.J., The wheel of competency assessment: Presenting quality criteria for competency assessment programs, Studies in Educational Evaluation, 32, 2, pp. 153-170, (2006)
3 undefined, (2007)
4 Baume, David, What is happening when we assess, and how can we use our understanding of this to improve assessment?, Assessment and Evaluation in Higher Education, 29, 4, pp. 451-477, (2004)
5 Benett, Yves, The Validity and Reliability of Assessments and Self-assessments of Work-based Learning, Assessment & Evaluation in Higher Education, 18, 2, pp. 83-94, (1993)
6 undefined, (2007)
7 Birenbaum, Menucha, A learning Integrated Assessment System, Educational Research Review, 1, 1, pp. 61-67, (2006)
8 Assessment in Education, (1998)
9 Chester, Mitchell D., Multiple measures and high-stakes decisions: A framework for combining measures, Educational Measurement: Issues and Practice, 22, 2, pp. 32-41, (2003)
10 Clark, Douglas B., Analyzing the quality of argumentation supported by personally-seeded discussions, Computer Supported Collaborative Learning 2005: The Next 10 Years - Proceedings of the International Conference on Computer Supported Collaborative Learning 2005, CSCL 2005, pp. 76-85, (2005)
Quick Actions
Full Text via DOI
Citation Metrics
49
Times Cited (Scopus)

References 10
Document Identifiers