Skip to main content

Table 11 Inter-rater agreement

From: A comparison of two assessment tools used in overviews of systematic reviews: ROBIS versus AMSTAR-2

Question No. of studies Gwet’s AC1/Gwet’s AC2 95% CI p-value
1 16 0.73 0.43, 1.00 < 0.001
2 16 0.83 0.64, 1.00 < 0.001
3 16 0.68 0.40, 0.96 < 0.001
4 16 0.58 0.34, 0.83 < 0.001
5 16 0.72 0.38, 1.00 < 0.001
6 16 0.56 0.18, 0.95 0.006
7 16 0.91 0.81, 1.00 < 0.001
8 16 0.61 0.35, 0.87 < 0.001
9 16 0.87 0.69, 1.00 < 0.001
10 16 0.67 0.36, 0.97 < 0.001
11 12 0.49 0.02, 0.96 0.042
12 12 0.34 − 0.12, 0.80 0.133
13 16 0.43 0.03, 0.84 0.038
14 16 0.22 − 0.23, 0.66 0.321
15 12 0.58 0.16, 0.99 0.011
16 16 0.15 − 0.25, 0.55 0.444
  1. Fifteen missing ratings. Italicised areas are considered the critical questions