Clinical performance comparators in audit and feedback: A review of theory and evidence

Wouter Gude, Benjamin Brown, Sabine N van der Veer, Heather L Colquhoun, Noah M Ivers, Jamie C Brehaut, Zach Landis-Lewis, Christopher J Armitage, Nicolette F de Keizer, Niels Peek

Research output: Contribution to journalArticlepeer-review

Abstract

BACKGROUND: Audit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator.

METHODS: We described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis.

RESULTS: We found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies.

CONCLUSION: Clinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

Original languageEnglish
Pages (from-to)39
JournalImplementation Science
Volume14
Issue number1
Early online date24 Apr 2019
DOIs
Publication statusPublished - 24 Apr 2019

Keywords

  • Benchmarking
  • Medical audit
  • Feedback
  • Quality improvement

Fingerprint

Dive into the research topics of 'Clinical performance comparators in audit and feedback: A review of theory and evidence'. Together they form a unique fingerprint.

Cite this