A recent report from the Lown Institute that ranks hospitals on what they deem to be unnecessary hospital services, tests and procedures attempts to make sweeping conclusions about hospital value based on data that are not only incomplete, but also not current. 

The only data source for the analysis is Medicare billing data for a dozen or so services, which represent only a portion of hospitals’ patient population and are not reflective of all the care hospitals provide. In addition, it is problematic to use only billing data to reach sweeping judgments about whether procedures are “unnecessary,” let alone to construct a hospital ranking or rating. 

The need for a clinical procedure is based on many factors, chief among them a physician’s judgment, informed by her or his evaluation of the totality of a patient’s medical needs, history and circumstances. Patient preferences regarding the risks and benefits of a procedure are also important factors when making decisions about care. Billing data alone simply do not fully reflect all of these complex factors.

Moreover, the report lacks important clinical and methodological details, and it is unclear how hospitals can use this ranking to improve care. For example, according to the American College of Obstetricians and Gynecologists, there are several acceptable reasons for hysterectomies other than cancer. Yet, Lown’s methodology appears to count all hysterectomies performed for non-cancer diagnoses as unnecessary procedures. The methodology does not say why they made this determination. 

Finally, the precise approach for translating numerical scores into rankings is not clear. Instead, hospitals get a confusing hodgepodge of data points — an overall letter grade for overuse, a star rating for each procedure, an overall numerical ranking compared to other hospitals in their state and nationally and a percentile score. Unfortunately, Lown does not provide any information on what data they use to assign a star rating or letter grade, nor do they describe how the procedure star ratings, letter grades or percentile score relate to one another.

America’s hospitals and health systems are constantly working to improve the quality and value of the care they provide, and have made important progress, but the narrow focus on Medicare patients, use of claims data and gaps in the methodology means this report will be of little value in these efforts. 
 

Ashley Thompson is AHA's senior vice president for public policy analysis and development. 

Related News Articles

Headline
The latest Lown Institute report ranking hospitals on so-called “unnecessary” services contains many of the same flaws as last year’s report, says Aaron…
Headline
The AHA today urged the Centers for Medicare & Medicaid Services to “take swift action to hold Medicare Advantage plans accountable for inappropriately and…
Blog
A recent op-ed in the online publication STAT (Turn off the spigot for hospitals’ COVID-19 relief funding) contains blatant factual inaccuracies but also omits…
Headline
Last year, 42% of all Medicare beneficiaries received benefits through private Medicare Advantage plans, with enrollment in these plans growing by nearly 10%…
Headline
The Centers for Medicare & Medicaid Services Friday finalized policy and technical changes to the Medicare Advantage and prescription drug benefit for…
Headline
Researchers are taking an “off-base” approach to setting benchmarks for commercial insurance rates, and in the process wrongly painting hospitals as the source…