Advertisement for orthosearch.org.uk
Results 1 - 2 of 2
Results per page:
Applied filters
Content I can access

Include Proceedings
Dates
Year From

Year To

To examine whether Natural Language Processing (NLP) using a state-of-the-art clinically based Large Language Model (LLM) could predict patient selection for Total Hip Arthroplasty (THA), across a range of routinely available clinical text sources. Data pre-processing and analyses were conducted according to the Ai to Revolutionise the patient Care pathway in Hip and Knee arthroplasty (ARCHERY) project protocol (. https://www.researchprotocols.org/2022/5/e37092/. ). Three types of deidentified Scottish regional clinical free text data were assessed: Referral letters, radiology reports and clinic letters. NLP algorithms were based on the GatorTron model, a Bidirectional Encoder Representations from Transformers (BERT) based LLM trained on 82 billion words of de-identified clinical text. Three specific inference tasks were performed: assessment of the base GatorTron model, assessment after model-fine tuning, and external validation. There were 3911, 1621 and 1503 patient text documents included from the sources of referral letters, radiology reports and clinic letters respectively. All letter sources displayed significant class imbalance, with only 15.8%, 24.9%, and 5.9% of patients linked to the respective text source documentation having undergone surgery. Untrained model performance was poor, with F1 scores (harmonic mean of precision and recall) of 0.02, 0.38 and 0.09 respectively. This did however improve with model training, with mean scores (range) of 0.39 (0.31–0.47), 0.57 (0.48–0.63) and 0.32 (0.28–0.39) across the 5 folds of cross-validation. Performance deteriorated on external validation across all three groups but remained highest for the radiology report cohort. Even with further training on a large cohort of routinely collected free-text data a clinical LLM fails to adequately perform clinical inference in NLP tasks regarding identification of those selected to undergo THA. This likely relates to the complexity and heterogeneity of free-text information and the way that patients are determined to be surgical candidates


Orthopaedic Proceedings
Vol. 85-B, Issue SUPP_II | Pages 177 - 177
1 Feb 2003
Hinsley D Softley I Garrick S
Full Access

Anti-personnel (AP) mines pose a serious threat to mine clearance personnel and developing effective foot/ leg protection is of benefit. In order to evaluate the effectiveness of a protective system it is necessary to have a physical model of the human leg and foot that replicates bony injury from AP mines. The purpose of this study was to develop and assess a lower limb model (LLM) that reflects human bony injury from AP mines. The LLM comprised a red deer tibia, calcaneum, talus, tarsus and metatarsal encased in 20% gelatine. A British Army combat boot was fitted onto the LLM. Two types of simulated AP mine were used comprising 29g and 50g of plastic explosive (PE). Mines were surface laid and the heel of the boot was placed directly over the top of the mine. Firings with both mine types were performed with the heel in contact with the mine. Further firings with the 50g PE mine included a variable stand-off (e.g. distance of the sole of the boot from the mine) of 25–100mm. The LLM was assessed for bony injury using the International Committee for the Red Cross (ICRC) mine injury system and a mine fracture score (MFS). The pattern of injury resulting from the two mine types, with no stand-off, was different. The 50g mine produced traumatic amputations in four out of five firings, fractures occuring at 3–11 cm from the ankle joint line (pattern 1 injury – ICRC classification). The 29g mine produced hindfoot injuries with comminuted fractures of the calcaneum and talus in all five firings. These are similar to the bony injuries seen in AP mine casualties in Croatia. Use of the MFS allowed comparison with previous cadaver experiments and demonstrated a graded response to increasing stand-off. The LLM replicated the pattern of some bony injuries seen in landmine casualties and could be used to assess the effectiveness of mine protective foot/leg wear