Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection

December 2017 | Jeremy Veillard, Krycia Cowling, Asaf Bitton, Hannah Ratcliffe, Meredith Kimball, Shannon Barkley, Laure Mercereau, Ethan Wong, Chelsea Taylor, Lisa R. Hirschhorn, Hong Wang | Original Investigation

Policy Points:

  • Strengthening accountability through better measurement and reporting is vital to ensure progress in improving quality primary health care (PHC) systems and achieving universal health coverage (UHC).
  • The Primary Health Care Performance Initiative (PHCPI) provides national decision makers and global stakeholders with opportunities to benchmark and accelerate performance improvement through better performance measurement.
  • Results from the initial PHC performance assessments in low- and middle-income countries (LMICs) are helping guide PHC reforms and investments and improve the PHCPI’s instruments and indicators. Findings from future assessment activities will further amplify cross-country comparisons and peer learning to improve PHC.
  • New indicators and sources of data are needed to better understand PHC system performance in LMICs.

Context: The Primary Health Care Performance Initiative (PHCPI), a collaboration between the Bill and Melinda Gates Foundation, The World Bank, and the World Health Organization, in partnership with Ariadne Labs and Results for Development, was launched in 2015 with the aim of catalyzing improvements in primary health care (PHC) systems in 135 low- and middle-income countries (LMICs), in order to accelerate progress toward universal health coverage. Through more comprehensive and actionable measurement of quality PHC, the PHCPI stimulates peer learning among LMICs and informs decision makers to guide PHC investments and reforms. Instruments for performance assessment and improvement are in development; to date, a conceptual framework and 2 sets of performance indicators have been released.

Methods: The PHCPI team developed the conceptual framework through literature reviews and consultations with an advisory committee of international experts.We generated 2 sets of performance indicators selected from a literature review of relevant indicators, cross-referenced against indicators available from international sources, and evaluated through 2 separate modified Delphi processes, consisting of online surveys and in-person facilitated discussions with experts.

Findings: The PHCPI conceptual framework builds on the current understanding of PHC system performance through an expanded emphasis on the role of service delivery. The first set of performance indicators, 36 Vital Signs, facilitates comparisons across countries and over time. The second set, 56 Diagnostic Indicators, elucidates underlying drivers of performance. Key challenges include a lack of available data for several indicators and a lack of validated indicators for important dimensions of quality PHC.

Conclusions: The availability of data is critical to assessing PHC performance, particularly patient experience and quality of care. The PHCPI will continue to develop and test additional performance assessment instruments, including composite indices and national performance dashboards. Through country engagement, the PHCPI will further refine its instruments and engage with governments to better design and finance primary health care reforms.

Keywords: primary health care, measurement, health systems, performance assessment.

Read on Wiley Online Library

Volume 95, Issue 4 (pages 836-883)
DOI: 10.1111/1468-0009.12301
Published in 2017