Article 2014

Assessing medical students and residents perceptions of the learning environment: Exploring validity evidence for the interpretation of scores from existing tools

Academic Medicine
Journal · Vol. 89 · Issue 12 · pp. 1687-1693
Abstract

Purpose Although most agree that supportive learning environments (LEs) are essential for effective medical education, an accurate assessment of LE quality has been challenging for educators and administrators. Two previous reviews assessed LE tools used in the health professions; however, both have shortcomings. The primary goal of this systematic review was to explore the validity evidence for the interpretation of scores from LE tools. Method The authors searched ERIC, PsycINFO, and PubMed for peer-reviewed studies that provided quantitative data on medical students' and/ or residents' perceptions of the LE published through 2012 in the United States and internationally. They also searched SCOPUS and the reference lists of included studies for subsequent publications that assessed the LE tools. From each study, the authors extracted descriptive, sample, and validity evidence (content, response process, internal structure, relationship to other variables) information. They calculated a total validity evidence score for each tool. Results The authors identified 15 tools that assessed the LE in medical school and 13 that did so in residency. The majority of studies (17; 61%) provided some form of content validity evidence. Studies were less likely to provide evidence of internal structure, response process, and relationship to other variables. Conclusions Given the limited validity evidence for scores from existing LE tools, new tools may be needed to assess medical students' and residents' perceptions of the LE. Any new tools would need robust validity evidence testing and sampling across multiple institutions with trainees at multiple levels to establish their utility.

Keywords

Author Keywords

Not provided

Index Keywords

learning human medical education questionnaire Humans Internship and Residency psychometry medical student Students, Medical medical school attitude perception Education, Medical reproducibility Reproducibility of Results environment Schools, Medical Psychometrics Questionnaires
Author Affiliations
University of Utah School of Medicine, Salt Lake City, UT, United States
The University of Sydney School of Medicine, Sydney, NSW, Australia
Welch Medical Library, Johns Hopkins University School of Medicine, Baltimore, MD, United States
Colleges Advisory Program, Johns Hopkins University School of Medicine, Baltimore, MD, United States
Division of General Internal Medicine, Johns Hopkins Bayview Medical Center, Baltimore, MD, United States
Funding & Acknowledgements
No funding information
References 10 References
1 Educating Physicians A Call for Reform of Medical School and Residency, (2010)
2 Branch, William T., Supporting the moral development of medical students, Journal of General Internal Medicine, 15, 7, pp. 503-508, (2000)
3 Lcme Standards and Publications Standards, (2014)
4 Cler Pathways to Excellence, (2014)
5 Hutchins, Edwin B., The 1960 medical school graduate: His perception of his faculty, peers, and environment, Journal of Medical Education, 36, 4, pp. 322-329, (1961)
6 Pace, C. Robert, An approach to the measurement of psychological characteristics of college environments, Journal of Educational Psychology, 49, 5, pp. 269-277, (1958)
7 Seel1C, Charles B., Quantitating qualitative issues in residency training - Development and testing of a scaled program evaluation questionnaire, Journal of General Internal Medicine, 8, 11, pp. 610-613, (1993)
8 Soemantri, Diantha, Measuring the educational environment in health professions studies: a systematic review., Medical teacher, 32, 12, pp. 947-952, (2010)
9 Schonrock-Adema, Johanna, Key elements in assessing the educational environment: Where is the theory?, Advances in Health Sciences Education, 17, 5, pp. 727-742, (2012)
10 Shochet, Robert Bruce, Gauging events that influence students' perceptions of the medical school learning environment: Findings from one institution, Academic Medicine, 88, 2, pp. 246-252, (2013)
Quick Actions
Full Text via DOI
Citation Metrics
74
Times Cited (Scopus)

References 10
Document Identifiers