Advertisement for orthosearch.org.uk
Results 1 - 5 of 5
Results per page:
Orthopaedic Proceedings
Vol. 106-B, Issue SUPP_18 | Pages 55 - 55
14 Nov 2024
Vinco G Ley C Dixon P Grimm B
Full Access

Introduction. The ability to walk over various surfaces such as cobblestones, slopes or stairs is a very patient centric and clinically meaningful mobility outcome. Current wearable sensors only measure step counts or walking speed regardless of such context relevant for assessing gait function. This study aims to improve deep learning (DL) models to classify surfaces of walking by altering and comparing model features and sensor configurations. Method. Using a public dataset, signals from 6 IMUs (Movella DOT) worn on various body locations (trunk, wrist, right/left thigh, right/left shank) of 30 subjects walking on 9 surfaces were analyzed (flat ground, ramps (up/down), stairs (up/down), cobblestones (irregular), grass (soft), banked (left/right)). Two variations of a CNN Bi-directional LSTM model, with different Batch Normalization layer placement (beginning vs end) as well as data reduction to individual sensors (versus combined) were explored and model performance compared in-between and with previous models using F1 scores. Result. The Bi-LSTM architecture improved performance over previous models, especially for subject-wise data splitting and when combining the 6 sensor locations (e.g. F1=0.94 versus 0.77). Placement of the Batch Normalization layer at the beginning, prior to the convolutional layer, enhanced model understanding of participant gait variations across surfaces. Single sensor performance was best on the right shank (F1=0.88). Conclusion. Walking surface detection using wearable IMUs and DL models shows promise for clinically relevant real-world applications, achieving high F1 levels (>0.9) even for subject-wise data splitting enhancing the model applicability in real-world scenarios. Normalization techniques, such as Batch Normalization, seem crucial for optimizing model performance across diverse participant data. Also single-sensor set-ups can give acceptable performance, in particular for specific surface types of potentially high clinical relevance (e.g. stairs, ramps), offering practical and cost-effective solutions with high usability. Future research will focus on collecting ground-truth labeled data to investigate system performance in real-world settings


Orthopaedic Proceedings
Vol. 106-B, Issue SUPP_18 | Pages 57 - 57
14 Nov 2024
Birkholtz F Eken M Boyes A Engelbrecht A
Full Access

Introduction. With advances in artificial intelligence, the use of computer-aided detection and diagnosis in clinical imaging is gaining traction. Typically, very large datasets are required to train machine-learning models, potentially limiting use of this technology when only small datasets are available. This study investigated whether pretraining of fracture detection models on large, existing datasets could improve the performance of the model when locating and classifying wrist fractures in a small X-ray image dataset. This concept is termed “transfer learning”. Method. Firstly, three detection models, namely, the faster region-based convolutional neural network (faster R-CNN), you only look once version eight (YOLOv8), and RetinaNet, were pretrained using the large, freely available dataset, common objects in context (COCO) (330000 images). Secondly, these models were pretrained using an open-source wrist X-ray dataset called “Graz Paediatric Wrist Digital X-rays” (GRAZPEDWRI-DX) on a (1) fracture detection dataset (20327 images) and (2) fracture location and classification dataset (14390 images). An orthopaedic surgeon classified the small available dataset of 776 distal radius X-rays (Arbeidsgmeischaft für Osteosynthesefragen Foundation / Orthopaedic Trauma Association; AO/OTA), on which the models were tested. Result. Detection models without pre-training on the large datasets were the least precise when tested on the small distal radius dataset. The model with the best accuracy to detect and classify wrist fractures was the YOLOv8 model pretrained on the GRAZPEDWRI-DX fracture detection dataset (mean average precision at intersection over union of 50=59.7%). This model showed up to 33.6% improved detection precision compared to the same models with no pre-training. Conclusion. Optimisation of machine-learning models can be challenging when only relatively small datasets are available. The findings of this study support the potential of transfer learning from large datasets to improve model performance in smaller datasets. This is encouraging for wider application of machine-learning technology in medical imaging evaluation, including less common orthopaedic pathologies


Orthopaedic Proceedings
Vol. 106-B, Issue SUPP_2 | Pages 19 - 19
2 Jan 2024
Castagno S Birch M van der Schaar M McCaskie A
Full Access

Precision health aims to develop personalised and proactive strategies for predicting, preventing, and treating complex diseases such as osteoarthritis (OA). Due to OA heterogeneity, which makes developing effective treatments challenging, identifying patients at risk for accelerated disease progression is essential for efficient clinical trial design and new treatment target discovery and development. To create a reliable and interpretable precision health tool that predicts rapid knee OA progression over a 2-year period from baseline patient characteristics using an advanced automated machine learning (autoML) framework, “Autoprognosis 2.0”. All available 2-year follow-up periods of 600 patients from the FNIH OA Biomarker Consortium were analysed using “Autoprognosis 2.0” in two separate approaches, with distinct definitions of clinical outcomes: multi-class predictions (categorising disease progression into pain and/or radiographic progression) and binary predictions. Models were developed using a training set of 1352 instances and all available variables (including clinical, X-ray, MRI, and biochemical features), and validated through both stratified 10-fold cross-validation and hold-out validation on a testing set of 339 instances. Model performance was assessed using multiple evaluation metrics. Interpretability analyses were carried out to identify important predictors of progression. Our final models yielded higher accuracy scores for multi-class predictions (AUC-ROC: 0.858, 95% CI: 0.856-0.860) compared to binary predictions (AUC-ROC: 0.717, 95% CI: 0.712-0.722). Important predictors of rapid disease progression included WOMAC scores and MRI features. Additionally, accurate ML models were developed for predicting OA progression in a subgroup of patients aged 65 or younger. This study presents a reliable and interpretable precision health tool for predicting rapid knee OA progression. Our models provide accurate predictions and, importantly, allow specific predictors of rapid disease progression to be identified. Furthermore, the transparency and explainability of our methods may facilitate their acceptance by clinicians and patients, enabling effective translation to clinical practice


Orthopaedic Proceedings
Vol. 106-B, Issue SUPP_18 | Pages 105 - 105
14 Nov 2024
Spoo S Garcia F Braun B Cabri J Grimm B
Full Access

Introduction. The objective assessment of shoulder function is important for personalized diagnosis, therapies and evidence-based practice but has been limited by specialized equipment and dedicated movement laboratories. Advances in AI-driven computer vision (CV) using consumer RGB cameras (red-blue-green) and open-source CV models offer the potential for routine clinical use. However, key concepts, evidence, and research gaps have not yet been synthesized to drive clinical translation. This scoping review aims to map related literature. Method. Following the JBI Manual for Evidence Synthesis, a scoping review was conducted on PubMed and Scholar using search terms including “shoulder,” “pose estimation,” “camera”, and others. From 146 initial results, 27 papers focusing on clinical applicability and using consumer cameras were included. Analysis employed a Grounded Theory approach guided iterative refinement. Result. Studies primarily used Microsoft Kinect (infrared-based depth sensing, RGB camera; discontinued) or monocular consumer cameras with open-source CV-models, sometimes supplemented by LiDAR (laser-based depth sensing), wearables or markers. Technical validation studies against gold standards were scarce and too inconsistent for comparison. Larger range of motion (RoM) movements were accurately recorded, but smaller movements, rotations and scapula tracking remained challenging. For instance, one larger validation study comparing shoulder angles during arm raises to a marker-based gold-standard reported Pearson's R = 0.98 and a standard error of 2.4deg. OpenPose and Mediapipe were the most used CV-models. Recent efforts try to improve model performance by training with shoulder specific movements. Conclusion. Low-cost, routine clinical movement analysis to assess shoulder function using consumer cameras and CV seems feasible. It can provide acceptable accuracy for certain movement tasks and larger RoM. Capturing small, hidden or the entirety of shoulder movement requires improvements such as via training models with shoulder specific data or using dual cameras. Technical validation studies require methodological standardization, and clinical validation against established constructs is needed for translation into practice


Orthopaedic Proceedings
Vol. 105-B, Issue SUPP_16 | Pages 23 - 23
17 Nov 2023
Castagno S Birch M van der Schaar M McCaskie A
Full Access

Abstract. Introduction. Precision health aims to develop personalised and proactive strategies for predicting, preventing, and treating complex diseases such as osteoarthritis (OA), a degenerative joint disease affecting over 300 million people worldwide. Due to OA heterogeneity, which makes developing effective treatments challenging, identifying patients at risk for accelerated disease progression is essential for efficient clinical trial design and new treatment target discovery and development. Objectives. This study aims to create a trustworthy and interpretable precision health tool that predicts rapid knee OA progression based on baseline patient characteristics using an advanced automated machine learning (autoML) framework, “Autoprognosis 2.0”. Methods. All available 2-year follow-up periods of 600 patients from the FNIH OA Biomarker Consortium were analysed using “Autoprognosis 2.0” in two separate approaches, with distinct definitions of clinical outcomes: multi-class predictions (categorising patients into non-progressors, pain-only progressors, radiographic-only progressors, and both pain and radiographic progressors) and binary predictions (categorising patients into non-progressors and progressors). Models were developed using a training set of 1352 instances and all available variables (including clinical, X-ray, MRI, and biochemical features), and validated through both stratified 10-fold cross-validation and hold-out validation on a testing set of 339 instances. Model performance was assessed using multiple evaluation metrics, such as AUC-ROC, AUC-PRC, F1-score, precision, and recall. Additionally, interpretability analyses were carried out to identify important predictors of rapid disease progression. Results. Our final models yielded high accuracy scores for both multi-class predictions (AUC-ROC: 0.858, 95% CI: 0.856–0.860; AUC-PRC: 0.675, 95% CI: 0.671–0.679; F1-score: 0.560, 95% CI: 0.554–0.566) and binary predictions (AUC-ROC: 0.717, 95% CI: 0.712–0.722; AUC-PRC: 0.620, 95% CI: 0.616–0.624; F1-score: 0.676, 95% CI: 0.673–0679). Important predictors of rapid disease progression included the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) scores and MRI features. Our models were further successfully validated using a hold-out dataset, which was previously omitted from model development and training (AUC-ROC: 0.877 for multi-class predictions; AUC-ROC: 0.746 for binary predictions). Additionally, accurate ML models were developed for predicting OA progression in a subgroup of patients aged 65 or younger (AUC-ROC: 0.862, 95% CI: 0.861–0.863 for multi-class predictions; AUC-ROC: 0.736, 95% CI: 0.734–0.738 for binary predictions). Conclusions. This study presents a reliable and interpretable precision health tool for predicting rapid knee OA progression using “Autoprognosis 2.0”. Our models provide accurate predictions and offer insights into important predictors of rapid disease progression. Furthermore, the transparency and interpretability of our methods may facilitate their acceptance by clinicians and patients, enabling effective utilisation in clinical practice. Future work should focus on refining these models by increasing the sample size, integrating additional features, and using independent datasets for external validation. Declaration of Interest. (b) declare that there is no conflict of interest that could be perceived as prejudicing the impartiality of the research reported:I declare that there is no conflict of interest that could be perceived as prejudicing the impartiality of the research project