Comparison of Machine and Human Expert Evaluation of Capsulorrhexis Creation Performance Through Analysis of Surgical Video Recordings

Figures & data

Figure 1 Capsulorrhexis frame before tracing (A) and after tracing (B).

Table 1 Interrater Analysis (n=208)

	Centration	Size	Roundness	Eccentricity
Mean difference	0.072	0.024	−0.15	−0.087
95% CI	−0.028 to 0.17	−0.082 to 0.13	−0.24 to −0.054	−0.19 to 0.013
p-value	0.16	0.66	0.0023 *	0.089
Correlation	0.73	0.63	0.76	0.76
95% CI	0.66 to 0.80	0.53 to 0.72	0.69 to 0.83	0.69 to 0.83

Note: *p<0.05.

Abbreviation: CI, confidence interval.

Figure 2 Sunflower plots showing the bivariate distributions of scores given by subjective graders for each measure. Each petal represents a single observation.

Table 2 Intrarater Analysis (n=208)

	Centration	Size	Roundness	Eccentricity
Mean difference
BT	0.40	0.33	0.53	0.30
95% CI	0.066 to 0.73	−0.025 to 0.69	0.14 to 0.92	−0.042 to 0.64
p-value	0.021*	0.067	0.0089*	0.083
NN	0.60	0.23	0.53	0.50
95% CI	0.19 to 1.010	−0.087 to 0.55	0.24 to 0.82	0.087 to 0.91
p-value	0.0057*	0.067	0.00080*	0.019*
Correlation
BT	0.49	0.47	0.34	0.61
95% CI	0.12 to 0.86	0.088 to 0.85	−0.11 to 0.78	0.29 to 0.94
NN	−0.030	0.44	0.75	0.28
95% CI	−0.49 to 0.43	0.046 to 0.84	0.52 to 0.98	−0.14 to 0.70

Note: *p<0.05.

Abbreviation: CI, confidence interval.

Table 3 Objective vs Subjective Analysis (n=208)

	Centration	Size	Roundness	Eccentricity
Correlation	0.11	0.090	0.39	0.24
95% CI	−0.27 to 0.25	−0.047 to 0.23	0.28 to 0.50	0.12 to 0.37

Abbreviation: CI, confidence interval.

Figure 3 Scatterplots showing bivariate distributions of objective score with each grader’s subjective score and the average of the subjective scores. Each circle represents a single observation.