Disagreement between talent scouts: Implications for improved talent assessment in youth football

References

• Anderson, J. M. , Kling, J. R., & Stith, K. (1999). Measuring interjudge sentencing disparity: Before and after the federal sentencing guidelines. The Journal of Law and Economics, 42(S1), 271–308. https://doi.org/10.1086/467426
   Google Scholar
• Baker, J., Cobley, S., & Schorer, J. (Eds.). (2020). Talent identification and development in sport: International perspectives. (2nd ed.). Routledge. https://doi.org/10.4324/9781003049111
   Google Scholar
• Bergkamp, T. L. G., Frencken, W. G. P., Niessen, A. S. M., Meijer, R. R., & den Hartigh, R. J. R. (2022). How soccer scouts identify talented players. European Journal of Sport Science, 22(7), 994–1004. https://doi.org/10.1080/17461391.2021.1916081
   PubMed Web of Science ®Google Scholar
• Bergkamp, T. L. G., Meijer, R. R., den Hartigh, R. J. R., Frencken, W. G. P., & Niessen, A. S. M. (2022). Examining the reliability and predictive validity of performance assessments by soccer coaches and scouts: The influence of structured collection and mechanical combination of information. Psychology of Sport & Exercise, 102257, 102257. https://doi.org/10.1016/j.psychsport.2022.102257
   Google Scholar
• Blake, R., & Logothetis, N. K. (2002). Visual competition. Nature Reviews Neuroscience, 3(1), 13–21. https://doi.org/10.1038/nrn701
   PubMed Web of Science ®Google Scholar
• Brown, J. (2001). Sports Talent. Human Kinetics.
   Google Scholar
• Campbell, D. J. (1988). Task Complexity: A Review and Analysis. The Academy of Management Review, 13(1), 40–52. https://doi.org/10.5465/amr.1988.4306775
   Web of Science ®Google Scholar
• Christensen, M. K. (2009). “An eye for talent”: Talent identification and the “practical sense” of top-level soccer coaches. Sociology of Sport Journal, 26(3), 365–382. https://doi.org/10.1123/ssj.26.3.365
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences. L. Erlbaum Associates.
   Google Scholar
• Dana, J., & Thomas, R. P. (2006). In defense of clinical judgment … and mechanical prediction. Journal of Behavioral Decision Making, 19(5), 413–428. https://doi.org/10.1002/bdm.537
   Web of Science ®Google Scholar
• Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus Actuarial Judgment. Science: Advanced Materials and Devices, 243(4899), 1668–1674. https://doi.org/10.1126/science.2648573
   Google Scholar
• Den Hartigh, R. J. R., Niessen, A. S. M., Frencken, W. G. P., & Meijer, R. R. (2018). Selection procedures in sports: Improving predictions of athletes’ future performance. European Journal of Sport Science, 18(9), 1191–1198. https://doi.org/10.1080/17461391.2018.1480662
   PubMed Web of Science ®Google Scholar
• Gigerenzer, G. (2008). Why heuristics work. Perspectives on Psychological Science, 3(1), 20–29. https://doi.org/10.1111/j.1745-6916.2008.00058.x
   Web of Science ®Google Scholar
• Gulbin, J. P., Croser, M. J., Morley, E. J., & Weissensteiner, J. R. (2013). An integrated framework for the optimisation of sport and athlete development: A practitioner approach. Journal of Sports Sciences, 31(12), 1319–1331. https://doi.org/10.1080/02640414.2013.781661
   PubMed Web of Science ®Google Scholar
• Güllich, A. (2014). Selection, de-selection and progression in German football talent promotion. European Journal of Sport Science, 14(6), 530–537. https://doi.org/10.1080/17461391.2013.858371
   PubMed Web of Science ®Google Scholar
• Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77–89. https://doi.org/10.1080/19312450709336664
   Google Scholar
• Huffcutt, A. I., & Arthur, W. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79(2), 184–190. https://doi.org/10.1037/0021-9010.79.2.184
   Web of Science ®Google Scholar
• Hughes, J. (2021). Krippendorffsalpha: An R package for measuring agreement using krippendorff’s alpha coefficient. https://doi.org/10.32614/RJ-2021-046
   Google Scholar
• Hughes, J. (2022). Measuring agreement using krippendorff’s alpha coefficient (version 1.1-2) [Package]: RStudio.
   Google Scholar
• Johansson, A., & Fahlén, J. (2017). Simply the best, better than all the rest? Validity issues in selections in elite sport. International Journal of Sports Science & Coaching, 12(4), 470–480. https://doi.org/10.1177/1747954117718020
   Web of Science ®Google Scholar
• Johnston, K., & Baker, J. (2020). Waste reduction strategies: Factors affecting talent wastage and the efficacy of talent selection in sport. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02925
   Google Scholar
• Jokuschies, N., Gut, V., & Conzelmann, A. (2017). Systematizing coaches’ ‘eye for talent’: Player assessments based on expert coaches’ subjective talent criteria in top-level youth soccer. International Journal of Sports Science & Coaching, 12(5), 565–576. https://doi.org/10.1177/1747954117727646
   Web of Science ®Google Scholar
• Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1991). Anomalies: The endowment effect, loss aversion, and status quo bias. Journal of Economic Perspectives, 5(1), 193–206. https://doi.org/10.1257/jep.5.1.193
   Web of Science ®Google Scholar
• Kahneman, D., Sibony, O., & Sunstein, C. R. (Eds.). (2021). Structure in Hiring . In Noise: A Flaw in Human Judgment (pp. 300–311). Little, Brown Spark.
   Google Scholar
• Knäbel, P. (2014). The Swiss Football Association’s youth development concept. Retrieved from. https://www.football.ch/portaldata/27/Resources/dokumente/nachwuchsfoerderung/footeco/de/5.35._Nachwuchsfoerderungskonzept.pdfKuncel
   Google Scholar
• Kuncel, N. R., Klieger, N. R., Connelly, D. M. B. S., & Ones, D. S. (2013). Mechanical versus clinical data combination in selection and admissions decisions: A meta-analysis. Journal of Applied Psychology, 98(6), 1060–1072. https://doi.org/10.1037/a0034156
   PubMed Web of Science ®Google Scholar
• Larkin, P., O’Connor, D., & Sampaio, J. (2017). Talent identification and recruitment in youth soccer: Recruiter’s perceptions of the key attributes for player recruitment. PLOS ONE, 12(4), e0175716. https://doi.org/10.1371/journal.pone.0175716
   PubMed Web of Science ®Google Scholar
• Larkin, P., & Reeves, M. J. (2018). Junior-elite football: Time to re-position talent identification? Soccer and Society, 19(8), 1183–1192. https://doi.org/10.1080/14660970.2018.1432389
   Web of Science ®Google Scholar
• Lüdin, D., Donath, L., Cobley, S., Mann, D., & Romann, M. (2022). Player-labelling as a solution to overcome maturation selection biases in youth football. Journal of Sports Sciences, 40(14), 1641–1647. https://doi.org/10.1080/02640414.2022.2099077
   PubMed Web of Science ®Google Scholar
• Lund, S., & Söderström, T. (2017). To see or not to see: Talent identification in the Swedish Football Association. Sociology of Sport Journal, 34(3), 248–258. https://doi.org/10.1123/ssj.2016-0144
   Web of Science ®Google Scholar
• Mackenzie, R., & Cushion, C. (2013). Performance analysis in football: A critical review and implications for future research. Journal of Sports Sciences, 31(6), 639–676. https://doi.org/10.1080/02640414.2012.746720
   PubMed Web of Science ®Google Scholar
• Meylan, C., Cronin, J., Oliver, J., & Hughes, M. (2010). Talent identification in soccer: The role of maturity status on physical, physiological and technical characteristics. International Journal of Sports Science & Coaching, 5(4), 571–592. https://doi.org/10.1260/1747-9541.5.4.571
   Web of Science ®Google Scholar
• Miller, G. A. (1956). The magical number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81–97. https://doi.org/10.1037/h0043158
   PubMed Web of Science ®Google Scholar
• Nickerson, R. S. (1998). Confirmation Bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220. https://doi.org/10.1037/1089-2680.2.2.175
   Google Scholar
• Nisbett, R. E., & Wilson, T. D. (1977). The halo effect: Evidence for unconscious alteration of judgments. Journal of Personality and Social Psychology, 35(4), 250–256. https://doi.org/10.1037/0022-3514.35.4.250
   Web of Science ®Google Scholar
• Plessner, H., & Haar, T. (2006). Sports performance judgments from a social cognitive perspective. Psychology of Sport and Exercise, 7(6), 555–575. https://doi.org/10.1016/j.psychsport.2006.03.007
   Web of Science ®Google Scholar
• Reep, C., & Benjamin, B. (1968). Skill and Chance in Association Football. Journal of the Royal Statistical Society Series A (General), 131(4), 581–585. https://doi.org/10.2307/2343726
   Web of Science ®Google Scholar
• Reeves, M. J., Littlewood, M. A., McRobert, A. P., & Roberts, S. J. (2018). The nature and function of talent identification in junior-elite football in English category one academies. Soccer and Society, 19(8), 1122–1134. https://doi.org/10.1080/14660970.2018.1432385
   Web of Science ®Google Scholar
• Reeves, M. J., McRobert, A. P., Lewis, C. J., Roberts, S. J., & Sunderland, C. (2019). A case study of the use of verbal reports for talent identification purposes in soccer: A Messi affair! PLOS ONE, 14(11), e0225033. https://doi.org/10.1371/journal.pone.0225033
   PubMed Web of Science ®Google Scholar
• Roberts, S. J., McRobert, A. P., Lewis, C. J., & Reeves, M. J. (2019). Establishing consensus of position-specific predictors for elite youth soccer in England. Science and Medicine in Football, 3(3), 205–213. https://doi.org/10.1080/24733938.2019.1581369
   Google Scholar
• Sarmento, H., Anguera, M. T., Pereira, A., & Araújo, D. (2018). Talent identification and development in male football: a systematic review. Sports Medicine, 48(4), 907–931. https://doi.org/10.1007/s40279-017-0851-7
   PubMed Web of Science ®Google Scholar
• Smith, M. J., Greenlees, I., & Manley, A. (2009). Influence of order effects and mode of judgement on assessments of ability in sport. Journal of Sports Sciences, 27(7), 745–752. https://doi.org/10.1080/02640410902939647
   PubMed Web of Science ®Google Scholar
• Stratton, G., Reilly, T., Richardson, D., & Williams, A. M. (2004). Youth Soccer: From Science to Performance. Routledge. https://doi.org/10.4324/9780203644133
   Google Scholar
• Unnithan, V., White, J., Georgiou, A., Iga, J., & Drust, B. (2012). Talent identification in youth soccer. Journal of Sports Sciences, 30(15), 1719–1726. https://doi.org/10.1080/02640414.2012.731515
   PubMed Web of Science ®Google Scholar
• Vaeyens, R., Lenoir, M., Williams, A. M., & Philippaerts, R. M. (2008). Talent identification and development programmes in sport: Current models and future directions. Sports Medicine, 38(9), 703–714. https://doi.org/10.2165/00007256-200838090-00001
   PubMed Web of Science ®Google Scholar
• Williams, A. M., & Reilly, T. (2000). Talent identification and development in soccer. Journal of Sports Sciences, 18(9), 657–667. https://doi.org/10.1080/02640410050120041
   PubMed Web of Science ®Google Scholar
• Wiseman, A. C., Bracken, N., Horton, S., & Weir, P. L. (2014). The difficulty of talent identification: Inconsistency among coaches through skill-based assessment of youth hockey players. International Journal of Sports Science & Coaching, 9(3), 447–455. https://doi.org/10.1260/1747-9541.9.3.447
   Web of Science ®Google Scholar
• Wood, R. E. (1986). Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes, 37(1), 60–82. doi: https://doi.org/10.1016/0749-5978(86)90044-0
   Web of Science ®Google Scholar