A Pilot Study Assessment of Medical Student Knowledge and System Citizenship Attitudes Pertaining to Health Systems Science

Abstract

Background and Purpose

Health system science (HSS) has been described as the third pillar of medical education. We introduced a new health system science and interprofessional practice (HSSIP) curriculum, and measured students’ HSS knowledge and attitudes concerning health system citizenship.

Methods

This pilot study involved first-year (M1) and fourth-year (M4) medical students in two cohorts across 2 years. Only M1 students in the second cohort participated in the new HSSIP curriculum. We compared student performance on a new National Board of Medical Examiners (NBME) HSS subject exam, and student attitudes toward system citizenship via a new attitudinal survey.

Results

Fifty-six eligible fourth-year students (68%) and 70 (76%) study eligible first-year students participated in the study. NBME HSS exam performance by M4 students was statistically significantly higher than M1 students for both cohorts, with moderate to large effect sizes. Exam performance for M1 students not experiencing the HSS curriculum was higher than for M1 students who received HSS curricular content. Attitudes toward HSS by M4 versus M1 students were statistically significantly different on several survey items with moderate effect sizes. Scale internal consistency for the HSS attitude survey was strong (0.83 or higher).

Discussion

There were differences among M4 and M1 medical students concerning knowledge of and attitudes toward HSS, with performance on the NBME subject exam similar to a national sample. Exam performance by M1 students was likely impacted by class size and other factors. Our results support the need for increased attention to HSS during medical education. Our health system citizenship survey has potential for further development and cross-institutional collaboration.

Keywords:

• health systems science
• medical education

Disclosure

Dr David W Musick reports this work was originally conceived as part of a fellowship experience that he completed with the American Medical Association. The fellowship itself did not provide any funding. The authors report no other conflicts of interest in this work.