Article 2007

Examination of a clinical teaching effectiveness instrument used for summative faculty assessment

Evaluation and the Health Professions
Journal · Vol. 30 · Issue 4 · pp. 339-361
Abstract

This study explores whether a clinical teaching effectiveness (CTE) instrument provides valid scores for summative faculty assessment. The sample included all CTE instruments (n = 10,087) that learners (N = 1,194) completed to assess clinical teachers (N = 872) during 1 academic year. The authors investigated response processes (e.g., missing data, straight-line responses, level of learner), internal structure (e.g., confirmatory and exploratory factor analysis), teaching ratings by learner group (medical student or resident), and relation to other variables (e.g., correlation with global rating). Response processes identified a high prevalence of straight-line responses (same rating across all items) and differential patterns of missing data by learner group. Medical students rated their teachers higher than residents, and CTE scores had different factor structures depending on learner group. High correlation coefficients of CTE items with a single rating of overall teaching performance suggest that learners consider global performance when assessing clinical teaching performance. © 2007 Sage Publications.

Keywords

Author Keywords

validity Clinical teaching effectiveness

Index Keywords

Teaching clinical competence human medical education questionnaire Humans Internship and Residency Article curriculum psychological aspect United States medical student Students, Medical medical school program evaluation Education, Medical methodology competency-based education standard chi square distribution Ohio university hospital Faculty, Medical multivariate analysis Internet health care quality Academic Medical Centers Questionnaires Chi-Square Distribution
Author Affiliations
Case Western Reserve University, Cleveland, OH, United States
Funding & Acknowledgements
No funding information
References 10 References
1 Abrami, Philip C., The dimensionality of ratings and their use in personnel decisions, New Directions for Teaching and Learning, 1990, 43, pp. 97-111, (1990)
2 Albanese, Mark A., Challenges in using rater judgements in medical education, Journal of Evaluation in Clinical Practice, 6, 3, pp. 305-319, (2000)
3 Albanese, Mark A., The effect of right or left placement of the positive response on Likert-type scales used by medical students for rating instruction, Academic Medicine, 72, 7, pp. 627-630, (1997)
4 Standards for Educational and Psychological Testing, (1999)
5 Academic Medicine, (1993)
6 Student Ratings of Teaching Recommendations for Use, (1990)
7 Cashin, William E., Using Global Student Rating Items for Summative Evaluation, Journal of Educational Psychology, 84, 4, pp. 563-572, (1992)
8 Copeland, H. Liesel, Developing and testing an instrument to measure the effectiveness of clinical teaching in an academic medical center, Academic Medicine, 75, 2, pp. 161-166, (2000)
9 Mail and Internet Surveys the Tailored Design Method, (2000)
10 Paper Presented at the Annual Meeting of the American Statistical Association, (1998)
Quick Actions
Full Text via DOI
Citation Metrics
18
Times Cited (Scopus)

References 10
Document Identifiers