Objective: To better understand the differences between two iatrogenic injury studies of hospitalized patients in 1992 which used ostensibly similar methods and similar sample sizes, but had quite different findings. The Quality in Australian Health Care Study (QAHCS) reported that 16.6% of admissions were associated with adverse events (AE), whereas the Utah, Colorado Study (UTCOS) reported a rate of 2.9%.
Setting: Hospitalized patients in Australia and the USA.
Design: Investigators from both studies compared methods and characteristics and identified differences. QAHCS data were then analysed using UTCOS methods.
Main outcome measures: Differences between the studies and the comparative AE rates when these had been accounted for.
Results: Both studies used a two-stage chart review process (screening nurse review followed by confirmatory physician review) to detect AEs; five important methodological differences were found: (i) QAHCS nurse reviewers referred records that documented any link to a previous admission, whereas UTCOS imposed age-related time constraints; (ii) QAHCS used a lower confidence threshold for defining medical causation; (iii) QAHCS used two physician reviewers, whereas UTCOS used one; (iv) QAHCS counted all AEs associated with an index admission whereas UTCOS counted only those determining the annual incidence; and (v) QAHCS included some types of events not included in UTCOS. When the QAHCS data were analysed using UTCOS methods, the comparative rates became 10.6% and 3.2%, respectively.
Conclusions: Five methodological differences accounted for some of the discrepancy between the two studies. Two explanations for the remaining three-fold disparity are that quality of care was worse in Australia and that medical record content and/or reviewer behaviour was different.