Abstract
Purpose
Residency programs are continually attempting to predict the performance of both current and potential residents. Previous studies have supported the use of USMLE Step 1 and 2 as predictors of Orthopaedic In-Training Examination and eventual American Board of Orthopaedic Surgery board success, while others show no significant correlation. A strong performance on OITE exams does correlate with strong residency performance, and some believe OITE scores are good predictors of future written board success. The current study was designed to examine potential differences in resident assessment measures and their predictive value for written boards.
Method
A retrospective review of resident performance data was performed for the past 10 years. Personalized information was removed by the residency coordinator. USMLE Step 1, USMLE Step 2, in-training exams (from first to fifth years of training), and written orthopaedic specialty board scores were collected. Subsequently, the residents were separated into two groups, those scoring above the 35th percentile on in-training examinations and those scoring below. Data were analyzed using correlation and regression analyses to compare and contrast the scores across all tests.
Results
Significant difference was seen between the groups in regards to USMLE scores for both Step 1 and 2. Also, a significant difference was found between OITE scores for both the second and fifth years. Positive correlations were found for USMLE Step 1, Step 2, OITE 2 and OITE 5 when compared to performance on written boards. One resident initially failed written boards, but passed on the second attempt. This resident consistently scored in the 20th and 30th percentiles on the in-training exams.
Conclusion
These results demonstrate that all the written tools of assessment are helpful in defining a residents ability to pass written boards, though they do not directly predict performance, though USMLE Step 1 and 2 scores along with OITE scores are helpful in gauging an orthopaedic residents performance on written boards. Lower USMLE score along with consistently low OITE scores likely define a resident at risk of failing their written boards. Close monitoring of the annual OITE scores is recommended and may be useful to identify struggling residents. Future work involving multiple institutions is warranted and would ensure applicability of our findings to other orthopedic residency programs.
