Aims. To identify a core outcome set of postoperative radiographic measurements to assess technical skill in ankle fracture open reduction internal fixation (ORIF), and to validate these against Van der Vleuten’s criteria for effective assessment. Methods. An e-Delphi exercise was undertaken at a major trauma centre (n = 39) to identify relevant parameters. Feasibility was tested by two authors. Reliability and validity was tested using postoperative radiographs of ankle fracture operations performed by trainees enrolled in an educational trial (IRCTN 20431944). To determine construct validity, trainees were divided into novice (performed < ten cases at baseline) and intermediate groups (performed ≥ ten cases at baseline). To assess concurrent validity, the procedure-based assessment (PBA) was considered the gold standard. The inter-rater and intrarater reliability was tested using a randomly selected subset of 25 cases. Results. Overall, 235 ankle ORIFs were performed by 24 postgraduate year three to five trainees during ten months at nine NHS hospitals in England, UK. Overall, 42 PBAs were completed. The e-Delphi panel identified five ‘final product analysis’ parameters and defined acceptability thresholds: medial clear space (MCS); medial malleolar displacement (MMD); lateral malleolar displacement (LMD); tibiofibular clear space (TFCS) (all in mm); and talocrural angle (TCA) in degrees. Face validity, content validity, and feasibility were excellent. PBA global rating scale scores in this population showed excellent construct validity as continuous (p < 0.001) and categorical (p = 0.001) variables. Concurrent validity of all metrics was poor against PBA score. Intrarater reliability was substantial for all parameters (intraclass correlation coefficient (ICC) > 0.8), and inter-rater reliability was substantial for LMD, MMD, TCA, and moderate (ICC 0.61 to 0.80) for MCS and TFCS. Assessment was time efficient compared to PBA. Conclusion. Assessment of technical skill in ankle fracture surgery using the first postoperative radiograph satisfies the tested Van der Vleuten’s utility criteria for effective assessment. 'Final product analysis' assessment may be useful to assess skill transfer in the simulation-based research setting. Cite this article: Bone Jt Open 2022;3(6):502–509

A total of 80 patients with an acute rupture of tendo Achillis were randomised to operative repair using an open technique (39 patients) or non-operative treatment in a cast (41 patients). Patients were followed up for one year. Outcome measures included clinical complications, range of movement of the ankle, the Short Musculoskeletal Function Assessment (SMFA), and muscle function dynamometry evaluating dorsiflexion and plantar flexion of the ankle. The primary outcome measure was muscle dynamometry.

Re-rupture occurred in two of 37 patients (5%) in the operative group and four of 39 (10%) in the non-operative group, which was not statistically significant (p = 0.68). There was a slightly greater range of plantar flexion and dorsiflexion of the ankle in the operative group at three months which was not statistically significant, but at four and six months the range of dorsiflexion was better in the non-operative group, although this did not reach statistically significance either. After 12 weeks the peak torque difference of plantar flexion compared with the normal side was less in the operative than the non-operative group (47% vs 61%, respectively, p < 0.005). The difference declined to 26% and 30% at 26 weeks and 20% and 25% at 52 weeks, respectively. The difference in dorsiflexion peak torque from the normal side was less than 10% by 26 weeks in both groups, with no significant differences. The mean SMFA scores were significantly better in the operative group than the non-operative group at three months (15 vs 20, respectively, p < 0.03). No significant differences were observed after this, and at one year the scores were similar in both groups.

We were unable to show a convincing functional benefit from surgery for patients with an acute rupture of the tendo Achillis compared with conservative treatment in plaster.