Hospital safety is routinely measured via Patient Safety Indicators (PSIs), which can influence public perception, hospital rankings and reimbursement rates. A new study from the August issue of The Joint Commission Journal on Quality and Patient Safety, “Variation in the Reporting of Elective Surgeries and Its Influence on Patient Safety Indicators,” suggests that some hospitals may classify admissions in a way that exempts them from elective-based PSI scores, a practice that may lead to less reliable PSIs.
Researchers at Rush University Medical Center, Chicago, analyzed Medicare inpatient claims data reported by 3,484 hospitals during the 2015-2017 PSI measurement period. They examined the average percentage of elective (APE) admissions across surgical diagnosis-related groups (DRGs) in relation to hospital characteristics, surgical claims volumes, and numbers and types of surgical DRGs. The study asked whether hospitals with exceptionally low APE shared particular characteristics, reported claims for similar DRGs or were disproportionately exempted from elective-based PSIs.
The researcher’s intersection of machine learning and traditional statistics explained a 73.9% variation in APE among hospitals. In particular, surgical claims volume and 16 surgical DRGs were identified as the only consistently important variables and, by themselves, explained 70% of variation in APE. Moreover, hospitals with exceptionally low APE were disproportionately exempt from elective-based PSI scores. These outlier hospitals were not explained by their characteristics, geography, or surgical claims volume, or the types of surgical DRGs among claims. Due to the depth and extent of their analyses and the lack of any tenable explanation for APE outliers, the researchers suggest that some hospitals may have classified admissions in a way that exempted them from elective-based PSI scores.
The study shows that transparency into admission classification policies is needed to ensure fair and reliable use of PSIs when ranking hospitals and adjusting payments. Alternatively, PSIs may need modifications to rely on externally validated criteria.
- Variation in reporting of elective surgeries impacts Patient Safety Indicators. The Joint Commission Journal on Quality and Patient Safety. Aug 2 2022.