The validity, objectivity, and reliability of a soccer-specific behaviour measurement tool

ABSTRACT

Purpose: The purpose of the study was to assess the validity, objectivity, and reliability of a Soccer-Specific Behaviour Measurement Tool (S-SBMT) in relation to the soccer philosophy of a Category One Premier League soccer academy. Methods: A 30 minute, 8 vs. 8 small-sided game (SSG), played by the U12 squad of the participating academy was used for analyses. Validity was ensured through formulating the S-SBMT definitions with experienced soccer coaches from the same soccer academy. Percentage agreement with a reference value of ±1, 95% Confidence Intervals, median sign and Yule’s Q were used to assess objectivity and reliability. Results: High levels of objectivity were found for the number of passes (98.8% agreement), runs with the ball (97.5% agreement), and goal attempts (100%). Reduced objectivity was apparent for forward zonal transitions (75.3%), along with tackles (70.4%), interceptions, (63%), and loose balls (48.1%). Reliability was tested after 1- and 4-weeks, with levels of percentage agreement found to be above the 85% acceptable threshold for most behaviours (passing = 95.1%, runs with the ball = 92.6%, goal attempts = 100%, tackles = 100%). Conclusions: The study demonstrated acceptable objectivity and reliability for S-SBMT behaviours and these findings demonstrate the potential utility of the S-SBMT in monitoring technical actions in a Category One Premier League soccer academy, and a methodological process for other academies to follow in ensuring the quality of performance data.

KEYWORDS:

• Soccer
• analysis
• validity
• objectivity
• reliability

Practical implications

Performance analysts need to be aware of the procedure for creating valid, objective, and reliable observation analysis tools to ensure the quality of their data. Practitioners may follow the methodological procedure to create and evaluate their own analysis tools in light of the potential issues outlined throughout this study.

Acknowledgements

The authors would like to thank the coaching staff and players in the Category 1 professional soccer academy for their cooperation and support throughout the data collection process.

Disclosure statement

No potential conflict of interest was reported by the authors.