Deep Dive Into Visual Representation and Interrater Agreement Using Data From a High-School Diving Competition

Figures & data

Table 1 Table of variables in the diving dataset.

Variable name	Description	Level of measurement	Range
Meet score	Official final score for each diver after 11 dives	Interval	174.7–467.1
Place	Final rank in the competition	Ordinal	1–13 for girls, 1–12 for boys
Gender	Gender of the diver	Categorical	Male or female
Order	Diving order for the competition	Categorical	1–13 for girls, 1–12 for boys
Seed	Placement of diver prior to competition	Ordinal	1–13 for girls, 1–12 for boys
Round	Round of the competition	Categorical	1–11
Dive	FINA number indicating the dive performed	Categorical	103–5223
Position	Position of the diver’s body in the dive	Categorical	Tuck, pike, straight, or free
Approach	Direction of the dive	Categorical	Forward, backward, reverse, inward, twist
DD	FINA degree of difficulty (DD) of the dive	Ordinal	1.2–2.8
Judge 1	Scores from Judge 1	Ordinal	0–10
Judge 2	Scores from Judge 2	Ordinal	0–10
Judge 3	Scores from Judge 3	Ordinal	0–10
Judge 4	Scores from Judge 4	Ordinal	0–10
Judge 5	Scores from Judge 5	Ordinal	0–10
Round score	Score for each diver in each round	Interval	0.0–52.00
Running total	Cumulative score in each round	Interval	13.6–468.4

Table 2 Table of summary data for the diving dataset.

Gender	MeetScore	Position	Approach	DD	Judge1	Judge2	Judge3	Judge4	Judge5	RoundScore
Boys:132	Min.:174.7	Free: 57	Backward:50	Min.:1.200	Min.:0.000	Min.:0.000	Min.:0.000	Min.:0.000	Min.:0.000	Min.: 0.00
Girls:143	1st Qu.:235.9	Pike: 66	Forward:58	1st Qu.:1.600	1st Qu.:4.000	1st Qu.:4.000	1st Qu.:4.000	1st Qu.:4.000	1st Qu.:4.000	1st Qu.:20.90
	Median:271.1	Straight: 29	Inward:50	Median:1.700	Median:4.500	Median:5.000	Median:4.500	Median:4.500	Median:4.500	Median:24.00
	Mean:272.8	Tuck:122	Reverse:53	Mean:1.832	Mean:4.387	Mean:4.555	Mean:4.524	Mean:4.524	Mean:4.597	Mean:24.71
	3rd Qu.:310.1	NA’s: 1	Twist:63	3rd Qu.:2.200	3rd Qu.:5.000	3rd Qu.:5.000	3rd Qu.:5.000	3rd Qu.:5.000	3rd Qu.:5.000	3rd Qu.:27.57
	Max.:467.1		NA’s: 1	Max.:2.800	Max.:8.000	Max.:7.500	Max.:7.500	Max.:8.000	Max.:7.500	Max.:52.00
				NA’s:1	NA’s:1	NA’s:1	NA’s:1	NA’s:1	NA’s:1	NA’s:1

NOTE: Ordinal variables, such as place, order, and seed, have been deleted from the table. For numeric variables, the five-number summary plus the mean is given. For categorical variables, the count of reach category is given.

Fig. 1 Visual representations of the final meet score.

Fig. 2 Boxplots of judges’ scores by judge and gender of diver.

Fig. 3 Trajectories of round scores for each diver. Lines represent scores across rounds for each diver.

Fig. 4 Trajectories of round scores for each diver by gender. Lines represent scores across rounds for each diver.

Fig. 5 Average of middle three judges’ scores for each dive by place of the diver. Girls scores are on the left, boys on the right. Each dot represents a different judge’s score for a particular dive. Low DD dives ($\text{DD}\le 1.7$) are colored blue while high DD dives are colored gold.

Fig. 6 Official meet scores (with round off error) on the left versus calculated scores (no round off error) on the right for male and female divers. The lines connect scores corresponding to the same diver.

Table 3 Pearson and Spearman correlations for average DD and median DD versus 20% trimmed mean judges’ scores.

	Mean DD versus trimmed mean score		Median DD versus trimmed mean score		Rounds as Independent
Correlation	Boys	Girls	Boys	Girls	Boys	Girls
Pearson	0.669	–0.261	0.774	–0.461	–0.002	–0.311
Spearman	0.764	–0.401	0.781	–0.543	–0.044	–0.289

Fig. 7 Average DD (top row), median DD (middle row), and final score (bottom row) for each diver. Boys’ scores are labeled with cyan squares and girls’ scores are labeled with coral circles.

Table 4 Example method of assigning categories for computation of Cohen’s kappa.

Category	Low quality	Medium quality	High quality	Excellent
Judge’s rating	<3.5	4–5	5.5–6.5	>7

Fig. 8 Measures of agreement for each round. Agreement for girls is represented by the solid purple line and agreement for boys is represented by the green dashed line in both figures.