Table 1 Interventions and novice reviewer agreement with reference scores
From: Checklist to operationalize measurement characteristics of patient-reported outcome measures
Reviewer | Written | Kappa (range) | 1st teaching | Kappa (range) | 2nd teaching | Kappa (range) |
|---|---|---|---|---|---|---|
1 | X | 0.63 (0.50–0.82) |  |  |  |  |
2 | X | 0.59 (0.25–0.77) | X | 0.66 (0.56–0.77) |  |  |
3 | X | 0.34 (0.02–0.61) | X | 0.66 (0.56–0.82) |  |  |
4 | X | 0.51 (0.27–1.00) | X | 0.72 (0.54–1.00) |  |  |
5 | X | 0.64 (0.49–1.00) | X | 0.66 (0.51–1.00) |  |  |
6 | X | 0.54 (0.09–0.85) | X | 0.65 (0.33–1.00) | X | 0.87 (0.68–1.00) |