Abstract
Introduction
Inaccurate identification of implants on X-rays may lead to prolonged surgical duration as well as increased complexity and costs during implant removal. Deep learning models may help to address this problem, although they typically require large datasets to effectively train models in detecting and classifying objects, e.g. implants. This can limit applicability for instances when only smaller datasets are available. Transfer learning can be used to overcome this limitation by leveraging large, publicly available datasets to pre-train detection and classification models. The aim of this study was to assess the effectiveness of deep learning models in implant localisation and classification on a lower limb X-ray dataset.
Method
Firstly, detection models were evaluated on their ability to localise four categories of implants, e.g. plates, screws, pins, and intramedullary nails. Detection models (Faster R-CNN, YOLOv5, EfficientDet) were pre-trained on the large, freely available COCO dataset (330000 images). Secondly, classification models (DenseNet121, Inception V3, ResNet18, ResNet101) were evaluated on their ability to classify five types of intramedullary nails. Localisation and classification accuracy were evaluated on a smaller image dataset (204 images).
Result
The YOLOv5s model showed the best capacity to detect and distinguish between different types of implants (accuracy: plate=82.1%, screw=72.3%, intramedullary nail=86.9%, pin=79.9%). Screw implants were the most difficult implant to detect, likely due to overlapping screw implants visible in the image dataset. The DenseNet121 classification model showed the best performance in classifying different types of intramedullary nails (accuracy=73.7%). Therefore, a deep learning model pipeline with the YOLOv5s and DenseNet121 was proposed for the most optimal performance of automating implants localisation and classification for a relatively small dataset.
Conclusion
These findings support the potential of deep learning techniques in enhancing implant detection accuracy. With further development, AI-based implant identification may benefit patients, surgeons and hospitals through improved surgical planning and efficient use of theatre time.
