As residency training programmes around the globe move towards competency-based medical education (CBME), there is a need to review current teaching and assessment practices as they relate to education in orthopaedic trauma. Assessment is the cornerstone of CBME, as it not only helps to determine when a trainee is fit to practice independently, but it also provides feedback on performance and guides the development of competence. Although a standardised core knowledge base for trauma care has been developed by the leading national accreditation bodies and international agencies that teach and perform research in orthopaedic trauma, educators have not yet established optimal methods for assessing trainees’ performance in managing orthopaedic trauma patients.

This review describes the existing knowledge from the literature on assessment in orthopaedic trauma and highlights initiatives that have recently been undertaken towards CBME in the United Kingdom, Canada and the United States.

In order to support a CBME approach, programmes need to improve the frequency and quality of assessments and improve on current formative and summative feedback techniques in order to enhance resident education in orthopaedic trauma.

Cite this article: Bone Joint J 2016;98-B:1320–5.

The aim of this study was to investigate the effect of training on the arthroscopic performance of a group of medical students and to determine whether all students could be trained to competence. Thirty-three medical students with no previous experience of arthroscopy were randomised to a ‘Trained’ or an ‘Untrained’ cohort. They were required to carry out 30 episodes of two simulated arthroscopic tasks (one shoulder and one knee). The primary outcome variable was task success at each episode. Individuals achieved competence when their learning curve stabilised. The secondary outcome was technical dexterity, assessed objectively using a validated motion analysis system. Six subjects in the ‘Untrained’ cohort failed to achieve competence in the shoulder task, compared with one in the ‘Trained’ cohort. During the knee task, two subjects in each cohort failed to achieve competence. Based on the objective motion analysis parameters, the ‘Trained’ cohort performed better on the shoulder task (p < 0.05) but there was no significant difference for the knee task (p > 0.05).

Although specific training improved the arthroscopic performance of novices, there were individuals who could not achieve competence despite focused training.These findings may have an impact on the selection process for trainees and influence individual career choices.

The aim of this study was to validate the use of three models of fracture fixation in the assessment of technical skills. We recruited 21 subjects (six experts, seven intermediates, and eight novices) to perform three procedures: application of a dynamic compression plate on a cadaver porcine model, insertion of an unreamed tibial intramedullary nail, and application of a forearm external fixator, both on synthetic bone models. The primary outcome measures were the Objective Structural Assessment of technical skills global rating scale on video recordings of the procedures which were scored by two independent expert observers, and the hand movements of the surgeons which were analysed using the Imperial College Surgical Assessment Device.

The video scores were significantly different for the three groups in all three procedures (p < 0.05), with excellent inter-rater reliability (α = 0.88). The novice and intermediate groups specifically were significantly different in their performance with dynamic compression plate and intramedullary nails (p < 0.05). Movement analysis distinguished between the three groups in the dynamic compression plate model, but a ceiling effect was demonstrated in the intramedullary nail and external fixator procedures, where intermediates and experts performed to comparable standards (p > 0.6). A total of 85% (18 of 21) of the subjects found the dynamic compression model and 57% (12 of 21) found all the models acceptable tools of assessment.

This study has validated a low-cost, high-fidelity porcine dynamic compression plate model using video rating scores for skills assessment and movement analysis. It has also demonstrated that Synbone models for the application of and intramedullary nail and an external fixator are less sensitive and should be improved for further assessment of surgical skills in trauma. The availability of valid objective tools of assessment of surgical skills allows further studies into improving methods of training.