A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students

Abstract

This study explored the consistency and difference of teacher-, student self- and peer-assessment in the context of Web-based portfolio assessment. Participants were 72 senior high school students enrolled in a computer application course. Through the assessment system, the students performed portfolio creation, inspection, self- and peer-assessment; three teachers reviewed portfolios and evaluated learning performances. There were significant differences in the results of the three assessment methods, among which teacher-raters adopted the most rigorous scoring standards, while peer-raters tended to use the most lax standards. The results of self- and teacher-assessment were discovered to be consistent; however, consistency was not discovered between self- and peer-assessment as well as peer- and teacher-assessment. In analyzing their consistency with the end-of-course examination, teacher- and self-assessment demonstrated high consistency, whereas peer-assessment showed a low level of consistency. © 2011 Published by Elsevier Ltd. All rights reserved.

Keywords

Author Keywords

self-assessment Peer-assessment Web-based portfolio Web-based portfolio assessment

Index Keywords

Teaching Students High school students Learning performance Assessment system Self-assessment Peer assessment Computer applications Comparative analysis Assessment methods Low level Portfolio assessment Web-based portfolio Rating

Author Affiliations

Graduate Institute of Technological and Vocational Education, National Pingtung University of Science and Technology, Pingtung, Pingtung, Taiwan

Graduate Institute of Business and Management, Meiho University, Pingtung, Taiwan

Department of Technology Application and Human Resource Development, National Taiwan Normal University, Taipei, Taiwan

Funding & Acknowledgements

No funding information

References 10 References

1 A Taxonomy for Learning Teaching and Assessing A Revision of Bloom S Taxonomy of Educational Objectives, (2001)

2 Ballantyne, Roy R., Developing procedures for implementing peer assessment in large classes using an action research process, Assessment and Evaluation in Higher Education, 27, 5, pp. 427-441, (2002)

3 Barberà, Elena, Mutual feedback in e-portfolio assessment: An approach to the netfolio system, British Journal of Educational Technology, 40, 2, pp. 342-357, (2009)

4 Barrett, Helen C., Researching electronic portfolios and learner engagement: The REFLECT Initiative, Journal of Adolescent and Adult Literacy, 50, 6, pp. 436-449, (2007)

5 Educacao Formacao Tecnologias, (2010)

6 Barrett, Helen C., Online personal learning environments: Structuring electronic portfolios for lifelong and life-wide learning, On the Horizon, 17, 2, pp. 142-152, (2009)

7 Blackboard S Portfolio Creation Wizard, (2011)

8 Bloxham, Sue, Understanding the rules of the game: Marking peer assessment as a medium for developing students' conceptions of assessment, Assessment and Evaluation in Higher Education, 29, 6, pp. 721-733, (2004)

9 Bouzidi, L'hadi, Can online peer assessment be trusted?, Educational Technology and Society, 12, 4, pp. 257-268, (2009)

10 English Journal, (1997)

A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students

How to Cite