Table 11 Inter-rater agreement
From: A comparison of two assessment tools used in overviews of systematic reviews: ROBIS versus AMSTAR-2
Question | No. of studies | Gwet’s AC1/Gwet’s AC2 | 95% CI | p-value |
|---|---|---|---|---|
1 | 16 | 0.73 | 0.43, 1.00 | < 0.001 |
2 | 16 | 0.83 | 0.64, 1.00 | < 0.001 |
3 | 16 | 0.68 | 0.40, 0.96 | < 0.001 |
4 | 16 | 0.58 | 0.34, 0.83 | < 0.001 |
5 | 16 | 0.72 | 0.38, 1.00 | < 0.001 |
6 | 16 | 0.56 | 0.18, 0.95 | 0.006 |
7 | 16 | 0.91 | 0.81, 1.00 | < 0.001 |
8 | 16 | 0.61 | 0.35, 0.87 | < 0.001 |
9 | 16 | 0.87 | 0.69, 1.00 | < 0.001 |
10 | 16 | 0.67 | 0.36, 0.97 | < 0.001 |
11 | 12 | 0.49 | 0.02, 0.96 | 0.042 |
12 | 12 | 0.34 | − 0.12, 0.80 | 0.133 |
13 | 16 | 0.43 | 0.03, 0.84 | 0.038 |
14 | 16 | 0.22 | − 0.23, 0.66 | 0.321 |
15 | 12 | 0.58 | 0.16, 0.99 | 0.011 |
16 | 16 | 0.15 | − 0.25, 0.55 | 0.444 |