The Fund supports networks of state health policy decision makers to help identify, inspire, and inform policy leaders.
A bipartisan group of state health policymakers from both the executive and legislative branches who are focused on improving population health.
Networks of state officials, advocates, and others aiming to invest in and transform primary care.
A program dedicated to advancing state-based efforts to make health care more affordable for residents, employers, and states.
The Milbank Memorial Fund supports two state leadership programs for legislative and executive branch state government officials committed to improving population health.
A leadership development program for early and mid-career state government officials who are committed to improving the health of all people in their communities.
A leadership program for senior state government officials who are committed to improving population health.
The Fund focuses on creating an affordable health care system built on strong primary care and partnerships that improve health outcomes for all.
Improving state leaders’ ability to enact and implement evidence-based health policies.
Advancing policies that create a more prevention- and primary care-oriented health system.
Improving population health through policies that contain health care cost growth.
Our state health policy resources offer relevant data analysis and best practices.
The Fund publishes reports, issues briefs, and case studies on state health policy issues.
Short takes on health policy issues from Milbank staff and guest authors.
Insights from Milbank President Debra Lubar on state health policymaking.
Reported articles and Q&As on timely health policy issues, as well as foundation updates.
Milbank Memorial Fund and Milbank Quarterly webinars featuring state health policymakers and researchers.
Updates and expert contact information for reporters.
The Milbank Memorial Fund is a private foundation that works to improve population health and health equity.
March 2019 (Volume 97)
Quarterly Article
Semira Manaseki-Holland
Richard Lilford
An P. Te
Yen-Fu Chen
Keshav K. Gupta
Peter J. Chilton
Timothy P. Hofer
Sep 25, 2026
Sep 23, 2026
Sep 22, 2026
Back to The Milbank Quarterly
Policy Points:
Context: There is interest in monitoring avoidable or preventable deaths measured directly or indirectly through standardized mortality rates (SMRs). While there have been numerous studies in recent years on adverse events, including preventable deaths, using implicit case note reviews by clinicians, no systematic reviews have aimed to summarize the estimates or the variations in methodologies used to derive these estimates. We reviewed studies that use implicit case note reviews to estimate the range of preventable death rates observed, the measurement characteristics of those estimates, and the measurement procedures used to generate them.We comment on the implications for monitoring SMRs and illustrate a way to calculate the number of reviews needed to establish a reliable estimate of the preventability of one death or the hospital preventable death rate.
Methods: We conducted a systematic review of the literature supplemented by a reanalysis of authors’ previously published and unpublished data and measurement design calculations.We conducted initial searches in PubMed, MEDLINE (OvidSP), and ISI Web of Knowledge in June 2010 and updated them in June 2012 and December 2017. Eligibility criteria included studies of hospital-wide admissions from general and acute medical wards where preventable death rates are provided or can be estimated and that can provide interobserver variations.
Findings: Twenty-three studies were included from 1985 to 2017. Recent larger studies suggest consistently low rates of preventable deaths (interquartile range of 3.0%-6.0% since 2008). Reliability of a single review for distinguishing between individual cases with regard to the preventability of death had a Kappa statistic of 0.10-0.50 for deaths and 0.21-0.76 for adverse events. A Kappa of 0.35 would require an average of 8 to 17 reviews of a single case to be precise enough to have confidence in high-stakes decisions to change care procedures or impose sanctions within a hospital as a result.No study estimated the variation in preventable deaths across hospitals, although we were able to reanalyze one study to obtain an estimate. Based on this estimate, 200 to 300 total case note reviews per hospital could be required to reliably distinguish between hospitals. The studies displayed considerable heterogeneity: 13/23 studies defined preventable death with a threshold of greater than or equal to four in a six-category Likert scale and 11/24 involved a two-stage screening process with nurses at the first stage and physicians at the second. Fifteen studies provided expert clinical review support for reviewer disagreements, advice, and quality control. A “generalist/internist” was the modal physician specialty for reviewers and they received one to three days of generic tools orientation and case note review practice. Methods did not consider the influence of human or environmental factors.
Conclusions: The literature provides limited information about the measurement characteristics of preventable deaths, suggesting that substantial numbers of reviews may be needed to create reliable estimates of preventable deaths at the individual or hospital level.Any operational program would require population-specific estimates of reliability. Preventable death rates are low, which is likely to make it difficult to use SMRs based on all deaths to validly profile hospitals. The literature provides little information to guide improvements in the measurement procedures.
Keywords: avoidable, preventable, hospital deaths, hospital mortality, systematic review, variation.
Read on Wiley Online Library
Volume 97, Issue 1 (pages 228-284) DOI: 10.1111/1468-0009.12375 Published in 2019