Aims. To compare the cost-utility of standard dressing with incisional negative-pressure wound therapy (iNPWT) in adults with closed surgical wounds associated with major trauma to the lower limbs. Methods. A within-trial economic evaluation was conducted from the UK NHS and personal social services (PSS) perspective based on data collected from the Wound Healing in Surgery for Trauma (WHiST) multicentre randomized clinical trial. Health resource utilization was collected over a six-month post-randomization period using trial case report forms and participant-completed questionnaires. Cost-utility was reported in terms of incremental
Aims. Our aim was to estimate the total costs of all hospitalizations for treating periprosthetic joint infection (PJI) by main management strategy within 24 months post-diagnosis using activity-based
Aims. The aim of this study was to compare the actual
Aims. Early detection of developmental dysplasia of the hip (DDH) is associated with improved outcomes of conservative treatment. Therefore, we aimed to evaluate a novel screening programme that included both the primary risk factors of breech presentation and family history, and the secondary risk factors of oligohydramnios and foot deformities. Methods. A five-year prospective registry study investigating every live birth in the study’s catchment area (n = 27,731), all of whom underwent screening for risk factors and examination at the newborn and six- to eight-week neonatal examination and review. DDH was diagnosed using ultrasonography and the Graf classification system, defined as grade IIb or above or rapidly regressing IIa disease (≥4. o. at four weeks follow-up). Multivariate odds ratios were calculated to establish significant association, and risk differences were calculated to provide quantifiable risk increase with DDH, positive predictive value was used as a measure of predictive efficacy. The cost-effectiveness of using these risk factors to predict DDH was evaluated using NHS tariffs (January 2021). Results. The prevalence of DDH that required treatment within our population was 5/1,000 live births. The rate of missed presentation of DDH was 0.43/1000 live births. Breech position, family history, oligohydramnios, and foot deformities demonstrated significant association with DDH (p < 0.0001). The presence of breech presentation increased the risk of DDH by 1.69% (95% confidence interval (CI) 0.93% to 2.45%), family history by 3.57% (95% CI 2.06% to 5.09%), foot deformities by 8.95% (95% CI 4.81% to 13.1%), and oligohydramnios nby 11.6% (95 % CI 3.0% to 19.0%). Primary risk factors family history and breech presentation demonstrated an estimated cost-per-case detection of £6,276 and £11,409, respectively. Oligohydramnios and foot deformities demonstrated a cost-per-case detected less than the
Controversy remains whether the contralateral
hip should be fixed in patients presenting with unilateral slipped capital
femoral epiphysis (SCFE). This retrospective study compares the
outcomes and
Aims. Tranexamic acid (TXA) is now commonly used in major surgical operations including orthopaedics. The TRAC-24 randomized control trial (RCT) aimed to assess if an additional 24 hours of TXA postoperatively in primary total hip (THA) and total knee arthroplasty (TKA) reduced blood loss. Contrary to other orthopaedic studies to date, this trial included high-risk patients. This paper presents the results of a
The
Aims. The aims of this study were to estimate the
Aims. The aim of this study was to test the null hypothesis that there
is no difference, from the payer perspective, in the
Many different designs of total hip arthroplasty
(THA) with varying performance and
There is little evidence on the
Aims. The aim of the Scaphoid Magnetic Resonance Imaging in Trauma (SMaRT) trial was to evaluate the clinical and
This paper reports the
Objectives. “Virtual fracture clinics” have been reported as a safe and effective alternative to the traditional fracture clinic. Robust protocols are used to identify cases that do not require further review, with the remainder triaged to the most appropriate subspecialist at the optimum time for review. The objective of this study was to perform a “top-down” analysis of the
The debate whether to use cemented or uncemented
components in primary total hip replacement (THR) has not yet been
considered with reference to the
To assess the sustainability of our institutional
bone bank, we calculated the final product
Aims. A pragmatic multicentre randomised controlled trial (PROFHER)
was conducted in United Kingdom National Health Service (NHS) hospitals
to evaluate the clinical effectiveness and
The demand for spinal surgery and its costs have
both risen over the past decade. In 2008 the aggregate hospital
bill for surgical care of all spinal procedures was reported to
be $33.9 billion. One key driver of rising costs is spinal implants.
In 2011 our institution implemented a
Aims. In the UK, fasciectomy for Dupuytren’s contracture is generally performed under general or regional anaesthetic, with an arm tourniquet and in a hospital setting. We have changed our practice to use local anaesthetic with adrenaline, no arm tourniquet, and perform the surgery in a community setting. We present the outcome of a consecutive series of 30 patients. Methods. Prospective data were collected for 30 patients undergoing open fasciectomy on 36 digits (six having two digits affected), over a one-year period and under the care of two surgeons. In total, 10 ml to 20 ml volume of 1% lidocaine with 1:100,000 adrenaline was used. A standard postoperative rehabilitation regime was used. Preoperative health scores, goniometer measurements of metacarpophalangeal (MCP), proximal interphalangeal (PIP) contractures, and Unité Rheumatologique des Affections de la Main (URAM) scores were measured pre- and postoperatively at six and 12 weeks. Results. The mean preoperative contractures were 35.3° (0° to 90°) at the metacarpophalangeal joint (MCPJ), 32.5° (0° to 90°) at proximal interphalangeal joint (PIPJ) (a combined deformity of 67.8°). The mean correction was 33.6° (0° to 90°) for the MCPJ and 18.2° (0° to 70°) for the PIPJ leading to a combined correction of 51.8°. There was a complete deformity correction in 21 fingers (59.5%) and partial correction in 14 digits (37.8%) with no correction in one finger. The mean residual deformities for the partial/uncorrected group were MCP 4.2° (0° to 30°), and PIP 26.1° (0° to 85°). For those achieving a full correction the mean preoperative contracture was less particularly at the PIP joint (15.45° (0° to 60°) vs 55.33° (0° to 90°)). Mean preoperative URAM scores were higher in the fully corrected group (17.4 (4 to 31) vs 14.0 (0 to 28)), but lower at three months post-surgery (0.5 (0 to 3) vs 4.40 (0 to 18)), with both groups showing improvements. Infections occurred in two patients (three digits) and both were successfully treated with oral antibiotics. No other complications were noted. The estimated
We present an economic evaluation using data
from the Distal Radius Acute Fracture Fixation Trial (DRAFFT) to compare
the relative
We evaluated the
Aims. Patellofemoral arthroplasty (PFA) has experienced significant
improvements in implant survivorship with second generation designs.
This has renewed interest in PFA as an alternative to total knee
arthroplasty (TKA) for younger active patients with isolated patellofemoral
osteoarthritis (PF OA). We analysed the cost-effectiveness of PFA versus TKA
for the management of isolated PF OA in the United States-based
population. Patients and Methods. We used a Markov transition state model to compare cost-effectiveness
between PFA and TKA. Simulated patients were aged 60 (base case)
and 50 years. Lifetime costs (2015 United States dollars), quality-adjusted
life year (QALY) gains and incremental cost-effectiveness ratio
(ICER) were calculated from a healthcare payer perspective. Annual rates
of revision were derived from the National Joint Registry for England,
Wales, Northern Ireland and the Isle of Man. Deterministic and probabilistic
sensitivity analysis was performed for all parameters against a
$50 000/QALY willingness to pay. . Results. PFA was more expensive ($49 811 versus $46 632)
but more effective (14.3 QALYs versus 13.3 QALYs)
over a lifetime horizon. The ICER associated with the additional
effectiveness of PFA was $3097. The model was mainly sensitive to utility
values, with PFA remaining cost-effective when its utility exceeded
that of TKA by at least 1.0%. PFA provided incremental benefits
at no increased
In March 2012, an algorithm for the treatment
of intertrochanteric fractures of the hip was introduced in our academic
department of Orthopaedic Surgery. It included the use of specified
implants for particular patterns of fracture. In this cohort study,
102 consecutive patients presenting with an intertrochanteric fracture
were followed prospectively (post-algorithm group). Another 117
consecutive patients who had been treated immediately prior to the
implementation of the algorithm were identified retrospectively
as a control group (pre-algorithm group). The total
Objectives. To assess the clinical and cost-effectiveness of a virtual fracture clinic (VFC) model, and supplement the literature regarding this service as recommended by The National Institute for Health and Care Excellence (NICE) and the British Orthopaedic Association (BOA). Methods. This was a retrospective study including all patients (17 116) referred to fracture clinics in a London District General Hospital from May 2013 to April 2016, using hospital-level data. We used interrupted time series analysis with segmented regression, and direct before-and-after comparison, to study the impact of VFCs introduced in December 2014 on six clinical parameters and on local Clinical Commissioning Group (CCG) spend. Student’s t-tests were used for direct comparison, whilst segmented regression was employed for projection analysis. Results. There were statistically significant reductions in numbers of new patients seen face-to-face (140.4, . sd. 39.6 versus 461.6, . sd. 61.63, p < 0.0001), days to first orthopaedic review (5.2, . sd. 0.66 versus 10.9, . sd. 1.5, p < 0.0001), discharges (33.5, . sd. 3.66 versus 129.2, . sd. 7.36, p < 0.0001) and non-attendees (14.82, . sd. 1.48 versus 60.47, . sd. 2.68, p < 0.0001), in addition to a statistically significant increase in number of patients seen within 72-hours (46.4% 3873 of 8345 versus 5.1% 447 of 8771, p < 0.0001). There was a non-significant increase in consultation time of 1 minute 9 seconds (14 minutes 53 seconds . sd. 106 seconds versus 13 minutes 44 seconds . sd. 128 seconds, p = 0.0878). VFC saved the local CCG £67 385.67 in the first year and is set to save £129 885.67 annually thereafter. Conclusions. We have shown VFCs are clinically and cost-effective, with improvement across several clinical performance parameters and substantial financial savings for CCGs. To our knowledge this is the largest study addressing clinical practice implications of VFCs in England, using robust methodology to adjust for pre-existing trends. Further studies are required to appreciate whether our results are reproducible with local variations in the VFC model and payment tariffs. Cite this article: A. McKirdy, A. M. Imbuldeniya. The clinical and
Recent recommendations by the National Institute
for Health and Care Excellence (NICE) suggest that all patients undergoing
elective orthopaedic surgery should be assessed for the risk of
venous thromboembolism (VTE). Little is known about the incidence of symptomatic VTE after
elective external fixation. We studied a consecutive series of adult
patients who had undergone elective Ilizarov surgery without routine
pharmacological prophylaxis to establish the incidence of symptomatic
VTE. . A review of a prospectively maintained database of consecutive
patients who were treated between October 1998 and February 2011
identified 457 frames in 442 adults whose mean age was 42.6 years
(16.0 to 84.6). There were 425 lower limb and 32 upper limb frames.
The mean duration of treatment was 25.7 weeks (1.6 to 85.3). According to NICE guidelines all the patients had at least one
risk factor for VTE, 246 had two, 172 had three and 31 had four
or more. . One patient (0.23%) developed a pulmonary embolus after surgery
and was later found to have an inherited thrombophilia. There were
27 deaths, all unrelated to VTE. The
We reviewed 78 femoral and tibial nonunions treated between January 1992 and December 2003. Of these, we classified 41 in 40 patients as complex cases because of infection (22), bone loss (6) or failed previous surgery (13). The complex cases were all treated with Ilizarov frames. At a mean time of 14.1 months (4 to 38), 39 had healed successfully. Using the Association for the Study and Application of the Methods of Ilizarov scoring system we obtained 17 excellent, 14 good, four fair and six poor bone results. The functional results were excellent in 14 patients, good in 14, fair in two and poor in two. A total of six patients were lost to follow-up and two had amputations so were not evaluated for final functional assessment. All but two patients were very satisfied with the results. The average
Revision operations after fracture of the hip are costly, in both monetary and personal terms. We have assessed whether these costs applied equally to all complications after the primary procedure. We studied 3154 consecutive patients with fracture of the hip and analysed the complications and financial implications related to reoperation within one year of injury. The results showed that revision surgery is not always associated with a significant increase in morbidity, financial
1. The relation of oxygen intake and walking speed has been investigated in a sixty-two-year-old patient before and after unilateral hip replacement for osteoarthritis. 2. Before operation walking speed was reduced to three to five kilometres per hour and stride length to 73 centimetres. Oxygen intake was 0·9-l·2 litres per minute and net energy
In a time of limited resources, the debate continues
over which types of hip prosthesis are clinically superior and more
cost-effective. Orthopaedic surgeons increasingly need robust economic
evidence to understand the full value of the operation, and to aid
decision making on the ‘package’ of procedures that are available
and to justify their practice beyond traditional clinical preference. In this paper we explore the current economic debate about the
merits of cemented and cementless total hip replacement, an issue
that continues to divide the orthopaedic community. Cite this article:
Aims. To perform an incremental cost-utility analysis and assess the impact of differential costs and case volume on the cost-effectiveness of robotic arm-assisted unicompartmental knee arthroplasty (rUKA) compared to manual (mUKA). Methods. This was a five-year follow-up study of patients who were randomized to rUKA (n = 64) or mUKA (n = 65). Patients completed the EuroQol five-dimension questionnaire (EQ-5D) preoperatively, and at three months and one, two, and five years postoperatively, which was used to calculate quality-adjusted life years (QALYs) gained. Costs for the primary and additional surgery and healthcare costs were calculated. Results. rUKA was associated with a relative 0.012 QALY gain at five years, which was associated with an incremental
Aims. The aim of this study was to evaluate the healthcare costs and benefits of enoxaparin compared to aspirin in the prevention of symptomatic venous thromboembolism (VTE) after total hip arthroplasty (THA) or total knee arthroplasty (TKA) using data from the CRISTAL trial. Methods. This trial-based economic analysis reports value for money as incremental
Aims. Total hip arthroplasty (THA) is considered the preferred treatment for displaced proximal femoral neck fractures. However, in many countries this option is economically unviable. To improve outcomes in financially disadvantaged populations, we studied the technique of concomitant valgus hip osteotomy and operative fixation (VOOF). This prospective serial study compares two treatment groups: VOOF versus operative fixation alone with cannulated compression screws (CCSs). Methods. In the first series, 98 hip fixation procedures were performed using CCS. After fluoroscopic reduction of the fracture, three CCSs were placed. In the second series, 105 VOOF procedures were performed using a closing wedge intertrochanteric osteotomy with a compression lag screw and lateral femoral plate. The alignment goal was to create a modified Pauwel’s fracture angle of 30°. After fluoroscopic reduction of fracture, lag screw was placed to achieve the calculated correction angle, followed by inter-trochanteric osteotomy and placement of barrel plate. Patients were followed for a minimum of two years. Results. Mean follow-up was 4.6 years (4.1 to 5.0) in the CCS group and 5.5 years (5.25 to 5.75) in the VOOF group. The mean Harris Hip Score at two-year follow-up was 83.85 in the CCS group versus 88.00 in the VOOF group (p < 0.001). At the latest follow-up, all-cause failure rate was 29.1% in the CCS group and 11.7% in the VOOF group (p = 0.003). The total
Aims. Patients with A1 and A2 trochanteric hip fractures represent a substantial proportion of trauma caseload, and national guidelines recommend that sliding hip screws (SHS) should be used for these injuries. Despite this, intramedullary nails (IMNs) are routinely implanted in many hospitals, at extra
Aims. To assess the cost-effectiveness of a two-layer compression bandage versus a standard wool and crepe bandage following total knee arthroplasty, using patient-level data from the Knee Replacement Bandage Study (KReBS). Methods. A cost-utility analysis was undertaken alongside KReBS, a pragmatic, two-arm, open label, parallel-group, randomized controlled trial, in terms of the
Aims. The aim of this trial was to assess the cost-effectiveness of a soft bandage and immediate discharge, compared with rigid immobilization, in children aged four to 15 years with a torus fracture of the distal radius. Methods. A within-trial economic evaluation was conducted from the UK NHS and personal social services (PSS) perspective, as well as a broader societal point of view. Health resources and quality of life (the youth version of the EuroQol five-dimension questionnaire (EQ-5D-Y)) data were collected, as part of the Forearm Recovery in Children Evaluation (FORCE) multicentre randomized controlled trial over a six-week period, using trial case report forms and patient-completed questionnaires. Costs and health gains (quality-adjusted life years (QALYs)) were estimated for the two trial treatment groups. Regression was used to estimate the probability of the new treatment being cost-effective at a range of ‘willingness-to-pay’ thresholds, which reflect a range of costs per QALY at which governments are typically prepared to reimburse for treatment. Results. The offer of a soft bandage significantly reduced
Aims. Prior cost-effectiveness analyses on osseointegrated prosthesis for transfemoral unilateral amputees have analyzed outcomes in non-USA countries using generic quality of life instruments, which may not be appropriate when evaluating disease-specific quality of life. These prior analyses have also focused only on patients who had failed a socket-based prosthesis. The aim of the current study is to use a disease-specific quality of life instrument, which can more accurately reflect a patient’s quality of life with this condition in order to evaluate cost-effectiveness, examining both treatment-naïve and socket refractory patients. Methods. Lifetime Markov models were developed evaluating active healthy middle-aged male amputees. Costs of the prostheses, associated complications, use/non-use, and annual costs of arthroplasty parts and service for both a socket and osseointegrated (OPRA) prosthesis were included. Effectiveness was evaluated using the questionnaire for persons with a transfemoral amputation (Q-TFA) until death. All costs and Q-TFA were discounted at 3% annually. Sensitivity analyses on those
Aims. The burden of revision total hip arthroplasty (rTHA) continues to grow. The surgery is complex and associated with significant costs. Regional rTHA networks have been proposed to improve outcomes and to reduce re-revisions, and therefore costs. The aim of this study was to accurately quantify the
Aims. We introduced a self-care pathway for minimally displaced distal radius fractures, which involved the patient being discharged from a Virtual Fracture Clinic (VFC) without a physical review and being provided with written instructions on how to remove their own cast or splint at home, plus advice on exercises and return to function. Methods. All patients managed via this protocol between March and October 2020 were contacted by a medical secretary at a minimum of six months post-injury. The patients were asked to complete the Patient-Rated Wrist Evaluation (PRWE), a satisfaction questionnaire, advise if they had required surgery and/or contacted any health professional, and were also asked for any recommendations on how to improve the service. A review with a hand surgeon was organized if required, and a
Aims. To compare the cost-effectiveness of high-dose, dual-antibiotic cement versus single-antibiotic cement for the treatment of displaced intracapsular hip fractures in older adults. Methods. Using data from a multicentre randomized controlled trial (World Hip Trauma Evaluation 8 (WHiTE-8)) in the UK, a within-trial economic evaluation was conducted. Resource usage was measured over 120 days post randomization, and cost-effectiveness was reported in terms of incremental
Aims. To compare the cost-utility of removable brace compared with cast in the management of adult patients with ankle fracture. Methods. A within-trial economic evaluation conducted from the UK NHS and personnel social services (PSS) perspective. Health resources and quality-of-life data were collected as part of the Ankle Injury Rehabilitation (AIR) multicentre, randomized controlled trial over a 12-month period using trial case report forms and patient-completed questionnaires. Cost-utility analysis was estimated in terms of the incremental
Aims. Access to total knee arthroplasty (TKA) is sometimes restricted for patients with severe obesity (BMI ≥ 40 kg/m. 2. ). This study compares the
Aims. The aim of this study was to perform the first population-based description of the epidemiological and health economic burden of fracture-related infection (FRI). Methods. This is a retrospective cohort study of operatively managed orthopaedic trauma patients from 1 January 2007 to 31 December 2016, performed in Queensland, Australia. Record linkage was used to develop a person-centric, population-based dataset incorporating routinely collected administrative, clinical, and health economic information. The FRI group consisted of patients with International Classification of Disease 10th Revision diagnosis codes for deep infection associated with an implanted device within two years following surgery, while all others were deemed not infected. Demographic and clinical variables, as well as healthcare utilization costs, were compared. Results. There were 111,402 patients operatively managed for orthopaedic trauma, with 2,775 of these (2.5%) complicated by FRI. The development of FRI had a statistically significant association with older age, male sex, residing in rural/remote areas, Aboriginal or Torres Strait Islander background, lower socioeconomic status, road traffic accident, work-related injuries, open fractures, anatomical region (lower limb, spine, pelvis), high injury severity, requiring soft-tissue coverage, and medical comorbidities (univariate analysis). Patients with FRI had an eight-times longer median inpatient length of stay (24 days vs 3 days), and a 2.8-times higher mean estimated inpatient hospitalization
Aims. To estimate the potential cost-effectiveness of adalimumab compared with standard care alone for the treatment of early-stage Dupuytren’s disease (DD) and the value of further research from an NHS perspective. Methods. We used data from the Repurposing anti-TNF for Dupuytren’s disease (RIDD) randomized controlled trial of intranodular adalimumab injections in patients with early-stage progressive DD. RIDD found that intranodular adalimumab injections reduced nodule hardness and size in patients with early-stage DD, indicating the potential to control disease progression. A within-trial cost-utility analysis compared four adalimumab injections with no further treatment against standard care alone, taking a 12-month time horizon and using prospective data on EuroQol five-dimension five-level questionnaire (EQ-5D-5L) and resource use from the RIDD trial. We also developed a patient-level simulation model similar to a Markov model to extrapolate trial outcomes over a lifetime using data from the RIDD trial and a literature review. This also evaluated repeated courses of adalimumab each time the nodule reactivated (every three years) in patients who initially responded. Results. The within-trial economic evaluation found that adalimumab plus standard care
Aims. The tibial component of total knee arthroplasty can either be an all-polyethylene (AP) implant or a metal-backed (MB) implant. This study aims to compare the five-year functional outcomes of AP tibial components to MB components in patients aged over 70 years. Secondary aims are to compare quality of life, implant survivorship, and cost-effectiveness. Methods. A group of 130 patients who had received an AP tibial component were matched for demographic factors of age, BMI, American Society of Anesthesiologists (ASA) grade, sex, and preoperative Knee Society Score (KSS) to create a comparison group of 130 patients who received a MB tibial component. Functional outcome was assessed prospectively by KSS, quality of life by 12-Item Short-Form Health Survey questionnaire (SF-12), and range of motion (ROM), and implant survivorships were compared. The SF six-dimension (6D) was used to calculate the incremental
Aims. Current levels of hip fracture morbidity contribute greatly to the overall burden on health and social care services. Given the anticipated ageing of the population over the coming decade, there is potential for this burden to increase further, although the exact scale of impact has not been identified in contemporary literature. We therefore set out to predict the future incidence of hip fracture and help inform appropriate service provision to maintain an adequate standard of care. Methods. Historical data from the Scottish Hip Fracture Audit (2017 to 2021) were used to identify monthly incidence rates. Established time series forecasting techniques (Exponential Smoothing and Autoregressive Integrated Moving Average) were then used to predict the annual number of hip fractures from 2022 to 2029, including adjustment for predicted changes in national population demographics. Predicted differences in service-level outcomes (length of stay and discharge destination) were analyzed, including the associated financial
Aims. The aim of this study was to compare the cost-effectiveness of cemented hemiarthroplasty (HA) versus hydroxyapatite-coated uncemented HA for the treatment of displaced intracapsular hip fractures in older adults. Methods. A within-trial economic evaluation was conducted based on data collected from the World Hip Trauma Evaluation 5 (WHiTE 5) multicentre randomized controlled trial in the UK. Resource use was measured over 12 months post-randomization using trial case report forms and participant-completed questionnaires. Cost-effectiveness was reported in terms of incremental
Aims. Due to the recent rapid expansion of scooter sharing companies, there has been a dramatic increase in the number of electric scooter (e-scooter) injuries. Our purpose was to conduct a systematic review to characterize the demographic characteristics, most common injuries, and management of patients injured from electric scooters. Methods. We searched PubMed, EMBASE, Scopus, and Web of Science databases using variations of the term “electric scooter”. We excluded studies conducted prior to 2015, studies with a population of less than 50, case reports, and studies not focused on electric scooters. Data were analyzed using t-tests and p-values < 0.05 were considered significant. Results. We studied 5,705 patients from 34 studies. The mean age was 33.3 years (SD 3.5), and 58.3% (n = 3,325) were male. The leading mechanism of injury was falling (n = 3,595, 74.4%). Injured patients were more likely to not wear a helmet (n = 2,114; 68.1%; p < 0.001). The most common type of injury incurred was bony injuries (n = 2,761, 39.2%), of which upper limb fractures dominated (n = 1,236, 44.8%). Head and neck injuries composed 22.2% (n = 1,565) of the reported injuries, including traumatic brain injuries (n = 455; 2.5%), lacerations/abrasions/contusions (n = 500; 7.1%), intracerebral brain haemorrhages (n = 131; 1.9%), and concussions (n = 255; 3.2%). Standard radiographs comprised most images (n = 2,153; 57.7%). Most patients were treated and released without admission (n = 2,895; 54.5%), and 17.2% (n = 911) of injured patients required surgery. Qualitative analyses of the
Aims. The purpose of this study was to evaluate the