ASSESSING THE RISK ASSESSORS

Abstract

Introduction and Aims: Private companies now offer risk assessment packages to hospital trusts. Data is collected using ICD coding and complication rates for individual surgeons are calculated and published. A risk assessment document was recently published at the Royal Gwent Hospital presenting complication rates and misadventures on league tables of specialty and consultants. Serious concerns were raised about the quality of the data.

Method: We undertook a study to independently evaluate the accuracy of data used to calculate these complication rates. Two orthopaedic surgeons with the highest published complication rates were studied. The notes of patients who had suffered complications were retrieved and the published complication data was compared with the clinical interpretation of the actual complication. One hundred and fifty reported complications were analysed.

Results: In most cases data accuracy was woefully inadequate (table 1). For example, revision procedures were counted as complications for the revision surgeon irrespective of who carried out the primary procedure. The normal work up of these patients, including procedures to investigate the presence of infection, are recorded as complications, with some patients being recorded as having up to four separate complications. Misadventures published for surgeons included dural tap during epidural anaesthesia.

Conclusion: The results of this study highlight the potentially devastating consequences of data inaccuracy. Inaccurate published data on complications, used to form league tables for individual surgeons can be career jeopardising. We advocate that consultation with the clinicians involved should always occur before data is published so that these inaccuracies can be picked up and the potentially damning consequences of falsely high complication rates can be avoided.