Level of evidence (LOE) determination is a reliable tool to assess the strength of research based on study design. Improvements in LOE are necessary for the advancement of evidence-based clinical care. The objectives of this study were to determine if the LOE presented at the Musculoskeletal Tumour Society (MSTS) annual meeting has improved over time and to determine how the LOE presented at MSTS annual meetings compares to that of the Orthopaedic Trauma Association (OTA) annual meetings.

We reviewed abstracts from the MSTS and OTA annual meeting podium presentations from 2005 to 2014. Three independent reviewers evaluated a total of 1222 abstracts for study type and LOE. Changes in the distributions of study type and LOE over time were evaluated by Pearson Chi-Squared test.

There were a total of 577 podium abstracts from the MSTS and 645 from the OTA. Of the MSTS therapeutic studies, 0.5% (2/376) were level I, while 75% (281/376) were level IV. There was a seven-fold higher proportion of level I studies (3.4% [14/409]) and less than half as many level IV studies (32% [130/409]) presented at OTA. There was no improvement in the MSTS LOE for all study types (p=0.13) and therapeutic study types (p=0.36) over the study decade. In contrast, the OTA LOE increased significantly over this time period for all study types (p<0.01). The proportion of controlled therapeutic studies (LOE I through III) versus uncontrolled studies (LOE IV) increased significantly over time at the OTA (p<0.021), but not at the MSTS (p=0.10).

Uncontrolled case series continue to dominate the MSTS scientific program, whereas over the past decade, higher-level studies and more modern study methodology has been employed by members of the OTA.