Editors: Julian PT Higgins and Douglas G Altman on behalf of the Cochrane Statistical Methods Group and the Cochrane Bias Methods Group.
Key points
Problems with the design and execution of individual studies of healthcare interventions raise questions about the validity of their findings; empirical evidence provides support for this concern;
An assessment of the validity of studies included in a Cochrane review should emphasize the risk of bias in their results, i.e. the risk that they will overestimate or underestimate the true intervention effect;
Numerous tools are available for assessing methodological quality of clinical trials. We recommend against the use of scales yielding a summary score;
The Cochrane Collaboration recommends a specific tool for assessing risk of bias in each included study. This comprises a description and a judgement for each entry in a ‘Risk of bias’ table, where each entry addresses a specific feature of the study. The judgement for each entry involves answering a question, with answers ‘Yes’ indicating low risk of bias, ‘No’ indicating high risk of bias, and ‘Unclear’ indicating either lack of information or uncertainty over the potential for bias;
Plots of ‘Risk of bias’ assessments can be created in RevMan;
For parallel group trials, the features of interest in a standard ‘Risk of bias’ table of a Cochrane review are sequence generation, allocation sequence concealment, blinding, incomplete outcome data, selective outcome reporting and other potential sources of bias;
Detailed considerations for the assessment of these features are provided in this chapter.
8.3 Tools for assessing quality and risk of bias
8.4 Introduction to sources of bias in clinical trials
Table 8.4.a: A common classification scheme for bias
8.5 The Cochrane Collaboration’s tool for assessing risk of bias
8.6 Presentation of assessments of risk of bias
Figure 8.6.a: Example of a ‘Risk of bias’ table
Figure 8.6.b: Example of a ‘Risk of bias graph’ Figure
Figure 8.6.c: Example of a ‘Risk of bias summary’ Figure
8.7 Summary assessments of risk of bias
Table 8.7.a: Possible approach for summary assessments
8.8 Incorporating assessments into analyses
8.10 Allocation sequence concealment
8.11 Blinding of participants, personnel and outcome assessors
8.13 Selective outcome reporting
8.14 Other potential threats to validity