An evaluation of methods used in health technology assessments produced for the Medical Services Advisory Committee

Objective: To examine the methods used in health technology assessments (HTAs) produced for the Medical Services Advisory Committee (MSAC) reviewing the effectiveness of a technology or procedure. Design and setting: Data were extracted from the effectiveness section of HTA application assessment reports published between 1 January 1998 and 17 July 2006 and available on the MSAC website. Only HTAs of effectiveness interventions were examined, as the methods used to undertake such reviews are well established. Main outcome measures: Variables reflecting methods used in the HTAs to evaluate the effectiveness of health technologies or procedures. Results: Of 56 MSAC HTA reports available, 31 met the inclusion criteria. Considerable variability was shown to exist between the various indicators of quality and the methodology used within the HTAs. Reports did not describe potential conflicts of interest of participants. The majority of reports (19/31) did not formally state the research question that the assessment was attempting to answer. Just over half of the reports (18/31) provided details of validity assessment of the included studies. Conclusions: Minimum and consistent standards of methodology and reporting are required in Australian HTAs, using international recommendations of best practice to increase the transparency and applicability of these reports.