SPSS (version 21.0, Inc., Chicago, IL) was used to perform statistical analysis. Cohen’s kappa and the intraclass correlation coefficients (ICC) two-way absolute agreement method were computed to compare the readings. The first reading by reader 1 was used to evaluate inter-observer analysis. The mean value of 2nd and 3rd observations was obtained. We then categorized the mean value thus obtained into stages T3a, T3b, T3c and T3d, according to the depth of mesorectal extension (T3a = 0 - 1 mm, T3b = 1 - 5 mm, T3c = 5 - 15 mm, T3d = > 15 mm), which was used for intra-observer analysis. The criteria used for inter-/intra-observer agreements of mrDME measurements using Cohen’s kappa and ICC were set as follows: (Kappa statistics (κ) ranging from -1 to 1, with 1 indicating perfect agreement, 0 indicating completely random agreement, and -1 indicating “perfect” disagreement. Values from 0.0 to 0.2 indicate slight agreement, 0.21 to 0.40 indicate fair agreement, 0.41 to 0.60 indicate moderate agreement, 0.61 to 0.80 indicate substantial agreement, and 0.81 to 1.0 indicate almost perfect or perfect agreement. Similarly, ICCs values less than 0 indicate no agreement, 0 - 0.20 as poor correlation, 0.21 - 0.40 as fair, 0.41 - 0.60 as moderate, 0.61 - 0.80 as substantial, and 0.81 - 1 as excellent) (
15,
16). We also performed Bland-Altman analysis between two readers (
Figure 4). The mean and difference between two readers were obtained. We performed one sample T test. The P value for one sample T test was obtained which was not statistically significant. So we further calculated upper and lower 95% confidence intervals. Bland-Altman plot was obtained. Finally, we ran a linear regression test to check whether the data had any potential bias. A statistically non-significant P value (P > 0.05) meant there was no proportional bias.