3,484
Views
15
CrossRef citations to date
0
Altmetric
Research Article

Development of an observational measure assessing program quality processes in youth sport

ORCID Icon, , , & | (Reviewing Editor)
Article: 1467304 | Received 30 May 2017, Accepted 11 Apr 2018, Published online: 14 Jun 2018

References

  • Allan, V., Turnnidge, J., Vierimaa, M., Davis, P., & Côté, J. (2016). Development of the assessment of coach emotions systematic observation instrument: A tool to evaluate coaches’ emotions in the youth sport context. International Journal of Sports Science and Coaching, 11, 859–35. doi:10.1177/1747954116676113
  • Allen, G., Rhind, D., & Koshy, V. (2015). Enablers and barriers for male students transferring life skills from the sports hall into the classroom. Qualitative Research in Sport, Exercise and Health, 7, 53–67. doi:10.1080/2159676X.2014.893898
  • Baldwin, C. K., Stromwall, K., & Wilder, Q. (2015). Afterschool youth program design and structural quality: Implications for quality improvement. Child & Youth Services, 36, 226–247. doi:10.1080/0145935X.2015.1046592
  • Baldwin, C. K., & Wilder, Q. (2014). Inside quality: Examination of quality improvement processes in afterschool programs. Child & Youth Services, 35, 152–168. doi:10.1080/0145935X.2014.924346
  • Bean, C., & Forneris, T. (2017). Is life skill development a by-product of sport participation? Perceptions of youth sport coaches. Journal of Applied Sport Psychology, 29, 234–250. doi:10.1080/10413200.2016.1231723
  • Bean, C., Kramers, S., Forneris, T., & Camiré, M. (2018). The implicit/explicit continuum of life skills development and transfer for youth sport. Quest (advanced online publication). doi:10.1080/00336297.2018.1451348
  • Bean, C., & Forneris, T. (2016a). Examining the importance of intentionally structuring the youth sport context to facilitate psychosocial development. Journal of Applied Sport Psychology, 28, 410–425. doi:10.1080/10413200.2016.1164764
  • Bean, C., & Forneris, T. (2016b). Re-examining the youth program quality survey as a tool to assess quality within youth programming. Cogent Psychology, 3, 1–14. doi:10.1080/23311908.2016.1149265
  • Bean, C., & Forneris, T. (2016c). Examining program quality and needs support within two physical activity-based mentoring programs. PHEnex Journal, 8, 1–16.
  • Beauchamp, M. R., Barling, J., & Morton, K. L. (2011). Transformational teaching and adolescent self-determined motivation, self-efficacy, and intentions to engage in leisure time physical activity: A randomized controlled pilot trial. Applied Psychology: Health and Well-being, 3, 127-150. doi:10.1111/j.1758-0854.2011.01048.x
  • Botvin, G. J. (2004). Advancing prevention science and practice: Challenges, critical issues, and future directions. Prevention Science, 5, 69–72. doi:10.1023/B:PREV.0000013984.83251.8b
  • Brewer, C. J., & Jones, R. L. (2002). A five-stage process for establishing contextually valid systematic observation instruments: The case of rugby union. The Sport Psychologist, 16, 139–161. doi:10.1123/tsp.16.2.138
  • Camiré, M., Forneris, T., Trudel, P., & Bernard, D. (2011). Strategies for helping coaches facilitate positive youth development through sport. Journal of Sport Psychology in Action, 2, 92-99. doi:10.1080/21520704.2011.584246
  • Camiré, M., Trudel, P., & Forneris, T. (2012). Examining how model youth sport coaches learn to facilitate positive youth development. Physical Education and Sport Pedagogy, 19(1), 1–17. doi:10.1080/17408989.2012.726975
  • Catalano, R. F., Berglund, M. L., Ryan, J. A., Lonczak, H. S., & Hawkins, J. D. (2004). Positive youth development in the united states: Research findings on evaluations of positive youth development programs. The Annals of the American Academy of Political and Social Science, 591, 98-124.
  • Clayton, M. J. (1997). Delphi: A technique to harness expert opinon for critical descion-making tasks in education. Education Pscyhology, 17, 373–386. doi:10.1080/0144341970170401
  • Coakley, J., & Donnelly, P. (2009). Sports in society: Issues and controversies (2nd ed.). Toronto: McGraw-Hill Ryerson.
  • Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–104. doi:10.1037/0021-9010.78.1.98
  • Côté, J., & Abernethy, B. (2012). A developmental approach to sport expertise. In S. Murphy (Ed.), The Oxford handbook of sport and performance psychology (pp. 435–447). New York: Oxford University Press.
  • Côté, J., & Fraser-Thomas, J. (2011). Youth involvement and positive development in sport. In P. Crocker (Ed.), Sport psychology: A Canadian perspective (2nd ed., pp. 226–255). Toronto: Pearson.
  • Côté, J., & Hancock, D. J. (2014). Evidence-based policies for youth sport programmes. International Journal of Sport Policy Politics, 8(1), 1-15. doi:10.1080/19406940.2014.919338
  • Côté, J., & Mallett, C. J. (2013). Review of junior sport framework briefing paper: Positive youth development through sport. Canberra: Australian Sports Commission.
  • Côté, J., Strachan, L., & Fraser-Thomas, J. (2008). Participation, personal development and performance through youth sport. In N. L. Holt (Ed.), Positive youth development through sport (pp. 34–45). New York: Routledge.
  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity for psychological tests. Psychological Bulletin, 52, 281–302. doi:10.1037/h0040957
  • Damon, W. (2004). What is positive youth development? The ANNALS of the American Academy of Political and Social Science, 59, 13–24. doi:10.1177/0002716203260092
  • Danish, S. J., Forneris, T., Hodge, K., & Heke, I. (2004). Enhancing youth development through sport. World Leiure Journal, 46, 38–49. doi:10.1080/04419057.2004.9674365
  • Danish, S. J., Petitpas, A. J., & Hale, B. D. (1993). Life development intervention for athletes: Life skills through sports. The Counseling Psychologist, 21, 352-385.
  • Dryfoos, J. G. (1990). Adolescents at risk: Prevalence and prevention. New York: Oxford University Press.
  • Duda, J. L. (1989). The relationship between task and ego orientation and the perceived purpose of sport among male and female high school athletes. Journal of Sport and Exercise Psychology, 11, 318-335.
  • Duda, J. L. (2013). The conceptual and empirical foundations of empowering coaching: Setting the stage for the PAPA project. International Journal of Sport and Exercise Psychology, 11, 311-318. doi:10.1080/1612197X.2013.839414
  • Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399–412. doi:10.1111/bjop.12046
  • Durlak, J. A., Mahoney, J., Bohnert, A., & Parente, M. (2010). Developing and improving after-school programs to enhance youth’s personal growth and adjustment: A special issue of AJCP. American Journal of Community Psychology, 45, 285–293. doi:10.1007/s10464-010-9298-9
  • Durlak, J. A., & Weissberg, R. P. (2007). The impact of after-school programs that promote personal and social skills. Chicago, IL: Collaborative for Academic, Social, and Emotional Learning.
  • Eccles, J. S., & Gootman, J. A. (2002). Community programs to promote youth development. Washington, DC: National Academy Press.
  • Eime, R. M., Young, J. A., Harvey, J. T., Charity, M. J., & Payne, W. R. (2013). A systematic review of the psychological and social benefits of participation in sport for children and adolescents: Informing development of a conceptual model of health through sport. International Journal of Behavioral Nutrition and Physical Activity, 10, 1–14. doi:10.1186/1479-5868-10-98
  • Erickson, K., & Côté, J. (2015). The intervention tone of coaches’ behaviour: Development of the Assessment of Coaching Tone (ACT) observational coding system. International Journal of Sports Science & Coaching, 10, 699–716. doi:10.1260/1747-9541.10.4.699
  • Erickson, K., Côté, J., Hollenstein, T., & Deakin, J. (2011). Examining coach-athlete interactions using state space grids: An observational analysis in competitive youth sport. Psychology of Sport and Exercise, 12, 645–654. doi:10.1016/j.psychsport.2011.06.006
  • Flett, M. R., Gould, D. R., & Lauer, L. (2012). A study of an underserved youth sports program using the youth program quality assessment. Journal of Applied Sport Psychology, 24, 275–289. doi:10.1080/10413200.2011.641061
  • Fraser-Thomas, J., Côté, J., & Deakin, J. (2005). Youth sport programs: An avenue to foster positive youth development. Physical Education and Sport Pedagogy, 10, 19–40. doi:10.1080/1740898042000334890
  • Gould, D., & Carson, S. (2008). Life skills development through sport: Current status and future directions. International Review of Sport and Exercise Psychology, 1, 58–78. doi:10.1080/17509840701834573
  • Guèvremont, A., Findlay, L., & Kohen, D. (2008). Organized extracurricular activities of Canadian children and youth. Health Reports, 19, 65–69. doi:10.1111/josh.12154
  • Haerens, L., Aelterman, N., Van den Berghe, L., De Meyer, J., Soenens, B., & Vansteenkiste, M. (2013). Observing physical education teachers’ need-supportive interactions in classroom settings. Journal of Sport & Exercise Psychology, 35, 3–17. doi:10.1123/jsep.35.1.3
  • Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutor Quantitative Methods Psychology, 8, 23–34. doi:10.20982/tqmp.08.1.p023
  • Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.
  • HighScope Educational Research Foundation. (2005). Youth program quality assessment. Ypsilanti, MI: High/Scope Press.
  • Hodge, K., Danish, S., Forneris, T., & Miles, A. (2016). Life skills and basic psychological needs. In N. L. Holt (Ed.), Positive youth development through sport (2nd ed., pp. 45–56). New York: Routledge.
  • Holt, N. L. (Ed.). (2016). Positive youth development through sport (2nd ed.). New York: Routledge.
  • Holt, N. L., Deal, C. J., & Smyth, C. (2016). Future directions for positive youth development throughsport. In N. L. Holt (Ed.), Positive youth development through sport (2nd ed., pp. 229–240). New York: Routledge.
  • Holt, N. L., & Jones, M. I. (2008). Future directions for positive youth development and sport research. In N. L. Holt (Ed.), Positive youth development through sport (pp. 122–132). New York: Routledge.
  • Holt, N. L., & Sehn, Z. L. (2008). Processes associated with positive youth development and participation in competitive youth sport. In N. L. Holt (Ed.), Positive youth development through sport (pp. 24–33). New York: Routledge.
  • Jones, M. I. (2015). Research methods for sports studies (3rd ed.). New York: Routledge.
  • Jones, M. I., & Lavallee, D. (2009). Exploring perceived life skills development and participation in sport. Qualitative Research in Sport and Exercise, 1, 36–50. doi:10.1080/19398440802567931
  • Kendellen, K., Camiré, M., Bean, C., Forneris, T., & Thompson, J. (2017). Integrating life skills into golf canada's youth programs: Insights into a successful research to practice partnership. Journal of Sport Psychology in Action, 8, 34-46. doi: 10.1080/21520704.2016.1205699
  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. doi:10.2307/2529310
  • Larson, R. W., & Walker, K. C. (2010). Dilemmas of practice: Challenges to program quality encountered by youth program leaders. American Journal of Community Psychology, 45(3–4), 338–349. doi:10.1007/s10464-010-9307-z
  • Larson, R. W., Walker, K. C., Rusk, N., & Diaz, L. B. (2015). Understanding youth development from the practitioner’s point of view: A call for research on effective practice. Applied Developmental Science, 19, 74-86. doi: 10.1080/10888691.2014.972558
  • MacDonald, D. J., Côté, J., Eys, M., & Deakin, J. (2012). Psychometric properties of the youth experience survey with young athletes. Psychology of Sport and Exercise, 13, 332–340. doi:10.1016/j.psychsport.2011.09.001
  • MacDonald, D. J., & McIssac, T. (2016). Quantitative assessment of positive youth development in sport. In N. L. Holt (Ed.), Positive youth development through sport (2nd ed., pp. 83–96). New York: Routledge.
  • Maxwell, J. A., Chmiel, M., & Rogers, S. E. (2015). Designing integration in multimethod and mixed methods research. In S. N. Hesse-Biber & R. B. Johnson (Eds.), Oxford handbook of multimethod and mixed methods research inquiry (pp. 688–706). New York: Oxford University Press.
  • McCarthy, P.J., Jones, M.V., & Clark-Carter, D. (2008). Understanding enjoyment in youth sport: A developmental perspective. Psychology of Sport and Exercise, 9, 142-156.
  • McHugh, M. L. (2012). Interrater relaibility: The kappa statistics. Biochemia Medica, 22, 276–282. doi:10.11613/BM.2012.031
  • McLaughlin, M. W. (2000). Community counts: How youth organizations matter for youth development.Washington, DC: Public Education Network.
  • Merkel, D. L. (2013). Youth sport: Positive and negative impact on young athletes. Open Access Journal of Sports Medicine, 4, 151–160. doi:10.2147/OAJSM.S33556
  • Merry, S. (2000). Beyond home and school: The role of primary supports in youth development. Chicago, IL: Chaplin Hall Center for Children.
  • Nakaha, J. R., Grimes, L. M., Nadler, C. B., & Roberts, M. W. (2016). A treatment selection model for sibling conflict based on observational measurements. Journal of Child and Family Studies, 25, 124–135. doi:10.1007/s10826-015-0210-y
  • Nunnally, J. C. (1967). Psychometric theory. New York: McGraw Hill.
  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
  • Nunnally, J. C., & Bernstein, I. (1994). Elements of statistical description and estimation. In J. C. Nunnally & I. H. Bernstein (Eds.), Psychometric theory (3rd ed.). New York: McGraw-Hill.
  • Papacharisis, V., Goudas, M., Danish, S.J., & Theodorakis, Y. (2005). The effectiveness of teaching a life skills program in a sport context. Journal of Applied Sport Psychology, 17, 247-254.
  • Patton, Q. M. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage.
  • Pechman, E. M., Russell, C. A., & Birmingham, J. (2008). Out-of-school time (OST) instrument. Retieved from http://www.most.ie/webreports/Fatima%20reports/OST/OST%20Observation%20Instrument.pdf
  • Peterson, R. A. (1994). A meta-analysis of Cronbach’s coefficient alpha. Journal of Consumer Research, 21, 381–391. doi:10.1086/jcr.1994.21.issue-2
  • Petitpas, A. J., Cornelius, A. E., Van Raalte, J. L., & Jones, T. (2005). A framework for planning youth sport programs that foster psychosocial development. The Sport Psychologist, 19, 63–80. doi:10.1123/tsp.19.1.63
  • Petitpas, A. J., Cornelius, A. E., & Van Raalte, J. L. (2008). Youth development through sport: It’s all about relationships. In N. L. Holt (Ed.), Positive youth development through sport (pp. 61–70). New York: Routledge.
  • Pierce, S., Gould, D., & Camiré, M. (2017). Definition and model of life skills transfer. International Review of Sport and Exercise Psychology, 10, 186–211. doi:10.1080/1750984X.2016.1199727
  • Povilaitis, V., & Tamminen, K. A. (2017). Delivering positive youth devleopment at a residential summer sport camp. Journal of Adolescent Research. doi:10.1177/0743558417702478
  • Reeves, C. A., & Bednar, D. A. (1994). Defining quality: Alternatives and implications. Academy of Management Review, 19, 419–445. doi:10.5465/amr.1994.9412271805
  • Rolls, L., & Relf, M. (2006). Bracketing interviews: Addressing methodological challenges in qualitative interviewing in bereavement and palliative care. Mortality, 11, 286–305. doi:10.1080/13576270600774893
  • Roth, J. L., & Brooks-Gunn, J. (2015). Evaluating youth development programs: Progress and promise. Applied Developmental Science, 20, 188–202. doi:10.1080/10888691.2015.1113879
  • Schutz, R. W., & Park, I. (2004). Some methodological considerations in developmental sport and exercise psychology. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 73–99). Morgantown, WV: Fitness Information Technology.
  • Search Institute. (2015). Youth and program strengths survey. Retrieved from www.search-institute.org/surveys/youth-and-program-strengths-survey
  • Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107–120. doi:10.1007/s11336-008-9103-y
  • Silliman, B. (2008). Youth program climate survey. Raleigh, NC: North Carolina Cooperative Extension Service.
  • Silliman, B., & Schumm, W. R. (2013). Youth program quality survey: Youth assessment of program quality. Marriage & Family Review, 49, 647–670. doi:10.1080/01494929.2013.803010
  • Silliman, B., & Shutt, R. E. (2010). Weaving evaluation into the fabric of youth development. Journal of Youth Development, 5(Article 100503FA003). doi:10.5195/JYD.2010.207
  • Singer, J., Newman, J., & Moroney, D. (2018). Building quality in out-of-school time. In H. J. Malone & T. Donahue (Ed.), The growing out-of-school time field: Past, present and future (pp. 195–210). Charlotte, NC: Information Age Publishing.
  • Smith, C., & Hohmann, C. (2005). Full findings from the Youth PQA validation study. Ypsilanti, MI: High/Scope Educational Research Foundation.
  • Smith, N., Quested, E., Appleton, P. R., & Duda, J. L. (2016). A review of observational instruments to assess the motivational environment in sport and physical education settings. International Review of Sport Exercise Psychology, 9, 4–22. doi:10.1080/1750984X.2015.1132334
  • Standage, M., & Vallerand, R. J. (2014). Motivation in sport and exercise groups. In M. R. Beauchamp & M. A. Eys (Eds.), Group dynamics in exercise and Sport Psychology (2nd ed., pp. 259-278). New York: Routledge.
  • Stein, J., Bloom, G. A., & Sabiston, C. M. (2012). Influence of perceived and preferred coach feedback on youth athletes’ perceptions of team motivational climate. Psychology of Sport Andexercise and Exercise, 13, 484-490.
  • Steinberg, L. (2000). Youth violence: Do parents and families make a difference? National Institute of Justice Journal, 243, 31-38.
  • Strachan, L., Côté, J., & Deakin, J. (2011). A new view: Exploring positive youth development in elite sport contexts. Qualitative Research in Sport, Exercise and Health, 3, 9–32. doi:10.1080/19398441.2010.541483
  • Sullivan, P. J., LaForge-MacKenzie, K., & Marini, M. (2015). Confirmatory factor analysis of the Youth Experiences Survey for Sport (YES-S). Open Journal of Statistics, 5, 421–429. doi:10.4236/ojs.2015.55044
  • Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. doi:10.5116/ijme.4dfb.8dfd
  • Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16, 837–851. doi:10.1177/1077800410383121
  • Turnnidge, J., Côté, J., & Hancock, D. J. (2014). Positive youth development from sport to life: Explicit or implicit transfer? Quest, 66, 203–217. doi:10.1080/00336297.2013.867275
  • United States Census Bureau. (2014). Nearly 6 out of 10 children participate in extracurricular activities, Census Bureau Reports. Retrieved from http://www.census.gov/newsroom/press-releases/2014/cb14-224.html
  • Vella, S., Oades, L., & Crowe, T. (2011). The role of the coach in facilitating positive youth development: Moving from theory to practice. Journal of Applied Sport Psychology, 23, 33–48. doi:10.1080/10413200.2010.511423
  • Walker, J., Marczak, M., Blyth, D., & Borden, L. (2005). Designing youth development programs: Toward a theory of developmental intentionality. In J. L. Mahoney, R. W. Larson, & J. S. Eccles (Eds.), Organized activities as contexts of development: Extracurricular activities, after-school and community programs (pp. 399–418). Mahwah, NJ: Lawrence Erlbaum Associates.
  • Weiss, M. R. (2008). “Field of dreams”: Sport as a context for youth development. Research Quarterly for Exercise and Sport, 79, 434–449. doi:10.1080/02701367.2008.10599510
  • Weiss, M. R., Stuntz, C. P., Bhalla, J. A., Bolter, N. D., & Price, M. S. (2013). ‘More than a game’: Impact of The First Tee life skills programme on positive youth development: Project introduction and Year 1 findings. Qualitative Research in Sport, Exercise and Health, 5, 214–244. doi:10.1080/2159676X.2012.712997
  • Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage.
  • Yohalem, N., & Wilson-Ahlstrom, A. (2010). Inside the black box: Assessing and improving quality in youth programs. American Journal of Community Psychology, 45, 350–357. doi:10.1007/s10464-010-9311-3
  • Yohalem, N., Wilson-Ahlstrom, A., Fischer, S., & Shinn, M. (2009). Measuring youth program quality: A guide to assessment tools (2nd ed.). Washington, DC: The Forum for Youth Investment.
  • Zamanzadeh, V., Rassouli, M., Abbaszadeh, M., Majd, H. A., Nikanfar, A., & Ghahramanian, A. (2014). Details of content validity and objectifying it in instrument development. Nursing Practice Today, 1, 163–171.
  • Zarrett, N., Lerner, R. M., Carrano, J., Fay, K., Peltz, J. S., & Li, Y. (2008). Variations in adolescent engagement in sports and its influence on positive youth development. In N. L. Holt (Ed.), Positive youth development through sport (pp. 9–23). New York: Routledge.