TY - JOUR
T1 - Withdrawing performance indicators: retrospective analysis of general practice performance under UK Quality and Outcomes Framework
AU - Kontopantelis, Evangelos
AU - Springate, David
AU - Reeves, David
AU - Ashcroft, Darren M.
AU - Valderas, Jose M.
AU - Doran, Tim
N1 - This study was funded by the National Institute for Health Research (NIHR) School for Primary Care Research, under the title “An investigation of the Quality and Outcomes Framework using the general practice research database†(project #141). This paper presents independent research funded by the NIHR. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health.
PY - 2014/1/27
Y1 - 2014/1/27
N2 - Objectives: To investigate the effect of withdrawing incentives on recorded quality of care, in the context of the UK Quality and Outcomes Framework pay for performance scheme. Design: Retrospective longitudinal study. Setting: Data for 644 general practices, from 2004/05 to 2011/12, extracted from the Clinical Practice Research Datalink. Participants: All patients registered with any of the practices over the study period-13 772 992 in total. Intervention: Removal of financial incentives for aspects of care for patients with asthma, coronary heart disease, diabetes, stroke, and psychosis. Main outcome measures: Performance on eight clinical quality indicators withdrawn from a national incentive scheme: influenza immunisation (asthma) and lithium treatment monitoring (psychosis), removed in April 2006; blood pressure monitoring (coronary heart disease, diabetes, stroke), cholesterol concentration monitoring (coronary heart disease, diabetes), and blood glucose monitoring (diabetes), removed in April 2011. Multilevel mixed effects multiple linear regression models were used to quantify the effect of incentive withdrawal. Results: Mean levels of performance were generally stable after the removal of the incentives, in both the short and long term. For the two indicators removed in April 2006, levels in 2011/12 were very close to 2005/06 levels, although a small but statistically significant drop was estimated for influenza immunisation. For five of the six indicators withdrawn from April 2011, no significant effect on performance was seen following removal and differences between predicted and observed scores were small. Performance on related outcome indicators retained in the scheme (such as blood pressure control) was generally unaffected. Conclusions: Following the removal of incentives, levels of performance across a range of clinical activities generally remained stable. This indicates that health benefits from incentive schemes can potentially be increased by periodically replacing existing indicators with new indicators relating to alternative aspects of care. However, all aspects of care investigated remained indirectly or partly incentivised in other indicators, and further work is needed to assess the generalisability of the findings when incentives are fully withdrawn.
AB - Objectives: To investigate the effect of withdrawing incentives on recorded quality of care, in the context of the UK Quality and Outcomes Framework pay for performance scheme. Design: Retrospective longitudinal study. Setting: Data for 644 general practices, from 2004/05 to 2011/12, extracted from the Clinical Practice Research Datalink. Participants: All patients registered with any of the practices over the study period-13 772 992 in total. Intervention: Removal of financial incentives for aspects of care for patients with asthma, coronary heart disease, diabetes, stroke, and psychosis. Main outcome measures: Performance on eight clinical quality indicators withdrawn from a national incentive scheme: influenza immunisation (asthma) and lithium treatment monitoring (psychosis), removed in April 2006; blood pressure monitoring (coronary heart disease, diabetes, stroke), cholesterol concentration monitoring (coronary heart disease, diabetes), and blood glucose monitoring (diabetes), removed in April 2011. Multilevel mixed effects multiple linear regression models were used to quantify the effect of incentive withdrawal. Results: Mean levels of performance were generally stable after the removal of the incentives, in both the short and long term. For the two indicators removed in April 2006, levels in 2011/12 were very close to 2005/06 levels, although a small but statistically significant drop was estimated for influenza immunisation. For five of the six indicators withdrawn from April 2011, no significant effect on performance was seen following removal and differences between predicted and observed scores were small. Performance on related outcome indicators retained in the scheme (such as blood pressure control) was generally unaffected. Conclusions: Following the removal of incentives, levels of performance across a range of clinical activities generally remained stable. This indicates that health benefits from incentive schemes can potentially be increased by periodically replacing existing indicators with new indicators relating to alternative aspects of care. However, all aspects of care investigated remained indirectly or partly incentivised in other indicators, and further work is needed to assess the generalisability of the findings when incentives are fully withdrawn.
U2 - 10.1136/bmj.g330
DO - 10.1136/bmj.g330
M3 - Article
C2 - 24468469
SN - 0959-535X
VL - 348
JO - Bmj
JF - Bmj
M1 - g330
ER -
