Validation of the clinical internship evaluation tool

Abstract

Background and Purpose: Graduates of physical therapist education programs should be expected to function as competent clinicians. Instead, the benchmark for many clinical performance assessment tools has been "as good as an entry-level graduate." The authors developed the Clinical Internship Evaluation Tool (CIET), which measures clinical performance of the student relative to a "competent clinician." The purpose of this study was to provide evidence for validity of the tool. Subjects and Methods: The CIET was used to evaluate physical therapist student clinical performance from 1999 to 2003. Data from 228 student evaluations, a survey of 26 clinical instructors (CIs), and an item review by 7 faculty members were used to collect validity evidence. The relevance of items on the CIET was examined by the survey and the item review. Coefficient alpha was calculated to estimate internal consistency among the items. A Spearman correlation was used to examine the relationship between 2 measures of clinical competence. A repeated-measures analysis of variance (ANOVA) compared the student scores at each clinical time frame to confirm expected improvements in performance longitudinally. Evidence for practicality was collected by the CI survey. Results: Based on the faculty item review and the CI survey, all items were representative of skills and behaviors considered important for a clinically competent physical therapist. The internal consistency (alpha) was .98 for the patient management items. The average correlation of the 2 measures of clinical competence was .76. The repeated-measures ANOVA was significant and demonstrated improved patient management scores as the student progressed through the program. The CI survey results indicated that 96% of respondents agreed or strongly agreed that the instrument was short and easy to use. Discussion and Conclusion: The results of the study suggest that the CIET is representative of skills and behaviors necessary for students to perform at the level of a competent therapist and that the instrument is practical to use for busy clinicians. The CIET appears to be a valid tool for measuring student clinical performance and can be a time-efficient alternative for CIs in today's demanding clinical environment. © 2007 American Physical Therapy Association.

Keywords

Author Keywords

Not provided

Index Keywords

clinical competence human Humans Article Vocational education student Evaluation patient care professional competence teacher Students, Health Occupations validation study Internship, Nonmedical statistical analysis physiotherapist Evaluation Studies Physical Therapy (Specialty) clinical internship evaluation tool

Author Affiliations

Department of Physical Therapy, University of Pittsburgh, Pittsburgh, PA, United States

Department of Orthopaedic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States

Funding & Acknowledgements

National Center for Advancing Translational Sciences, NCATS

Grant: UL1TR000005

References 10 References

1 Kaiser, Katherine Laux, Achieving Clarity in Evaluation of Community/Public Health Nurse Generalist Competencies through Development of a Clinical Performance Evaluation Tool, Public Health Nursing, 20, 3, pp. 216-227, (2003)

2 Standards of Practice for Physical Therapy, (2007)

3 Guide to Physical Therapist Practice. Second Edition. American Physical Therapy Association., Physical Therapy, 81, 1, pp. 9-746, (2001)

4 Guide for Professional Conduct

5 House of Delegates

6 Ladyshewsky, Richard K., A comparison of productivity and learning outcome in individual and cooperative physical therapy clinical education models, Physical Therapy, 78, 12, pp. 1288-1301, (1998)

7 MacKinnon, Joyce R., An analysis and comparison of the educational costs of clinical placements for occupational therapy, physical therapy, and speech pathology and audiology students., Journal of allied health, 15, 3, pp. 225-238, (1986)

8 Printen, Kenneth J., Clinical performance evaluation of junior medical students, Journal of Medical Education, 48, 4, pp. 343-348, (1973)

9 Kern, B. P., The development and use of an evaluation instrument for clinical education., Physical therapy, 51, 5, pp. 540-546, (1971)

10 Journal of Physical Therapy Education, (1988)

Validation of the clinical internship evaluation tool

How to Cite