Table 2

Summary of intraclass correlation coefficients* indicating agreement and consistency between 2 expert raters for pretest scores

Measurement toolMethod; ICC (95% CI)
Absolute agreementConsistency
Global rating scale0.64 (0.20–0.84)0.73 (0.51–0.87)
Checklist0.55 (0.21–0.77)0.61 (0.32–0.80)
Final product analysis0.50 (0.20–0.71)0.55 (0.27–0.74)
  • CI = confidence interval; ICC = intraclass correlation coefficient.

  • * Single measures ICC based on 2 raters; 95% CI for estimate of ICC.