Confidence crisis of results in biomechanics research

References

• Abramson, J. H. (2011). WINPEPI updated: Computer programs for epidemiologists, and their teaching potential. Epidemiologic Perspectives & Innovations, 8, 1. Retrieved from http://epi-perspectives.com/content/8/1/110.1186/1742-5573-8-1
   PubMedGoogle Scholar
• Austin, P. C., Mamdani, M. M., Huurlink, D. N., & Hux, J. E. (2006). Testing multiple statistical hypotheses resulted in spurious associations: A study of astrological signs and health. Journal of Clinical Epidemiology, 59, 964–969.10.1016/j.jclinepi.2006.01.012
   PubMed Web of Science ®Google Scholar
• Barton, C. J., Levinger, P., Menz, H. B., & Webster, K. E. (2009). Kinematic gait characteristics associated with patellofemoral pain syndrome: A systematic review. Gait & Posture, 30, 405–416. doi:10.1016/j.gaitpost.2009.07.109
   PubMed Web of Science ®Google Scholar
• Batterham, A. M., & Atkinson, G. (2005). How big does my sample need to be? A primer on the murky world of sample size estimation. Physical Therapy in Sport, 6, 153–163. doi:10.1016/j.ptsp.2005.05.004
   Web of Science ®Google Scholar
• Begley, C. G., & Ellis, L. M. (2012). Drug development: Raise standards for preclinical cancer research. Nature, 483, 531–533.10.1038/483531a
   PubMed Web of Science ®Google Scholar
• Bogaerts, S., Desmet, H., Slagmolen, P., & Peers, K. (2016). Strain mapping in the Achilles tendon—A systematic review. Journal of Biomechanics, 49, 1411–1419. doi:10.1016/j.jbiomech.2016.02.057
   PubMed Web of Science ®Google Scholar
• Brown, S. R., Brughelli, M., & Hume, P. A. (2014). Knee mechanics during planned and unplanned sidestepping: A systematic review and meta-analysis. Sports Medicine, 44, 1573–1588. doi:10.1007/s40279-014-0225-3
   PubMed Web of Science ®Google Scholar
• Buchanan, T. L., & Lohse, K. R. (2016). Researchers’ perceptions of statistical significance contribute to bias in health and exercise science. Measurement in Physical Education and Exercise Science, 20, 131–139. doi:10.1080/1091367X.2016.1166112
   Web of Science ®Google Scholar
• Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafo, M. R. (2013). Power failure: Why small sample size undermines the reliability of. Neuroscience, 14, 365–376. doi:10.1038/nm3475
   PubMed Web of Science ®Google Scholar
• Cheung, R. T. C., Chung, R. C. K., & Ng, G. Y. F. (2011). Efficacies of different external controls for excessive foot pronation: a meta-analysis. British Journal of Sports Medicine, 45, 743–751. doi:10.1136/bjsm.2010.079780
   PubMed Web of Science ®Google Scholar
• Curran-Everett, D., & Benos, D. J. (2004). Guidelines for reporting statistics in journals published by the American Physiological Society. American Journal of Physiology: Heart and Circulatory Physiology, 287, H447–H449.
   Web of Science ®Google Scholar
• Csada, R. D., James, P. C., & Espie, R. H. M. (1996). The ‘file drawer problem’ of non-significant results: does it apply to biological research? Oikos, 76, 591–593.10.2307/3546355
   Web of Science ®Google Scholar
• Fernando, M., Crowther, R., Lazzarini, P., Sangla, K., Cunningham, M., Buttner, P., & Golledge, J. (2013). Biomechanical characteristics of peripheral diabetic neuropathy:A systematic review and meta-analysis of findings from the gait cycle, muscle activity and dynamic barefoot plantar pressure. Clinical Biomechanics, 28, 831–845. doi:10.1016/j.clinbiomech.2013.08.004
   PubMed Web of Science ®Google Scholar
• Fraley, R. C., & Vazire, S. (2014). The N-pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PLoS One, 9(10), e109019. doi:10.1371/journal.pone.0109019
   PubMed Web of Science ®Google Scholar
• Fransz, D. P., Huurnink, A., Kingma, I., Verhagen, E. A. L. M., & van Dieën, J. H. (2013). A systematic review and meta-analysis of dynamic tests and related force plate parameters used to evaluate neuromusculoskeletal function in foot and ankle pathology. Clinical Biomechanics, 28, 591–601. doi:10.1016/j.clinbiomech.2013.06.002
   PubMed Web of Science ®Google Scholar
• Gelman, A., & Carlin, J. (2014). Beyond power calculations: Assessing type S (Sign) and type M (magnitude) errors. Perspectives on Psychological Science, 9, 641–651. doi:10.1177/1745691614551642
   Web of Science ®Google Scholar
• Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31, 337–350. doi:10.1007/s10654—16-0149-3
   PubMed Web of Science ®Google Scholar
• Hall, J. P. L., Barton, C., Remy, C., & Morrissey, D. (2013). The biomechanical differences between barefoot and shod distance running: A systematic review and preliminary meta-analysis. Sports Medicine, 43, 1335–1353. doi:10.1007/s40279-013-0084-3.
   PubMed Web of Science ®Google Scholar
• Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21, 1157–1164. doi:10.3758/s13423-013-0572-3
   PubMed Web of Science ®Google Scholar
• Hopkins, W. G. (2006). Estimating sample size for magnitude-based inferences. Sportscience, 10, 63–70.
   Google Scholar
• Hopkins, W. G., & Batterham, A. M. (2016). Error rates, decisive outcomes and publication bias with several inferential methods. Sports Medicine, 46, 1563–1573. doi:10.1007/s40279-016-0517-x
   PubMed Web of Science ®Google Scholar
• Hopkins, W. G., Marshall, S. W., Batterham, A. M., & Hanin, J. (2009). Progressive statistics for studies in sports medicine and exercise science. Medicine in Science in Sports & Exercise, 41, 3–13. doi:10.1249/MSS.0b013e31818cb278
   PubMed Web of Science ®Google Scholar
• International Committee of Medical Journal Editors. (1997). Uniform requirements for manuscripts submitted to biomedical journals. Journal of the American Medical Association, 277, 927–934.
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, 696–701.
   Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2008). Why most discovered true associations are inflated. Epidemiology, 19, 640–648. doi:10.1097/EDE.0b013e31818131e7
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2012). Why science is not necessarily self-correcting. Perspectives in Psychological Science, 7, 645–654. doi:10.1177/1745691612464056
   Web of Science ®Google Scholar
• Ioannidis, J. P. A. (2014). How to make more published research true. PLoS Medicine, 11, e1001747. doi:10.1371/journal.pmed.1001747
   PubMed Web of Science ®Google Scholar
• James, C. R., & Bates, B. T. (1997). Experimental and statistical design issues in human movement research. Measurement in Physical Education and Exercise Science, 1, 55–69.10.1207/s15327841mpee0101_4
   Google Scholar
• Kirk, R. E. (2001). Promoting good statistical practices: Some suggestions. Educational and Psychological Measurement, 61, 213–218.10.1177/00131640121971185
   Web of Science ®Google Scholar
• Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahnik, S., Bernstein, M. J., … Nosek, B. A. (2014). Investigating variation in replicability: A ‘many labs’ replication project. Social Psychology, 45, 142–152. doi:10.1027/1864-0335/a000178
   Web of Science ®Google Scholar
• Knudson, D. (2005). Statistical and reporting errors in applied biomechanics research. In Q. Wang (Eds.), Proceedings of XXIII International Symposium on Biomechanics in Sports: Volume 2 (pp. 811–814). Beijing: China Institute of Sport Science.
   Google Scholar
• Knudson, D. (2007). Analysis of multiple comparison errors using ground reaction force data. In H.-J. Menzel & M. H. Chagas (Eds.), Proceedings of the XXVth International Symposium on Biomechanics in Sports (pp. 176–179). Belo Horizontae: Federal University of Mineas Gerais.
   Google Scholar
• Knudson, D. (2009). Significant and meaningful effects in sports biomechanics research. Sports Biomechanics, 8, 97–105. doi:10.1080/14763140802629966
   Web of Science ®Google Scholar
• Knudson, D. (2011). Authorship and sampling practice in selected biomechanics and sports science journals. Perceptual & Motor Skills, 112, 838–844. doi:10.2466/17.PMS.112.3.838-844
   PubMed Web of Science ®Google Scholar
• Knudson, D. (2012). Twenty-year trends of authorship and sampling in applied biomechanics research. Perceptual & Motor Skills, 114, 16–20. doi:10.2466/11.PMS.114.1.16-20
   PubMed Web of Science ®Google Scholar
• Knudson, D., & Bahamonde, R. (2012). Twenty-five year trends of authorship and sampling in ISBS proceedings. In E. Bradshaw, A. Burnett, & P. A. Hume (Eds.), Proceedings of the 30th Conference of the International Society of Biomechanics in Sports (Vol. 4, pp. 381–384). Melbourne: Australian Catholic University.
   Google Scholar
• Knudson, D., Elliott, B., & Hamill, J. (2014). Proposing application of results in sport and exercise research reports. Sports Biomechanics, 13, 195–203. doi:10.1080/14763141.2014.959551
   PubMed Web of Science ®Google Scholar
• Knudson, D., Morrow, J., & Thomas, J. (2014). Advancing kinesiology through improved peer review. Research Quarterly for Exercise and Sport, 85, 127–135. doi:10.1080/02701367.2014.898117
   PubMed Web of Science ®Google Scholar
• Lang, T., & Altman, D. (2013). Basic statistical reporting for articles published in biomedical journals: The ‘statistical analyses and methods in the published literature’ or the SAMPL guidelines. In P. Smart, H. Maisonneuvre, & A. Polderman (Eds.), Science editors handbook (pp. 1–8). Exeter, UK: European Association of Science Editors. Retrieved from http://classroom.takasila.org/classroom/dataupload/takasila/13/file/Words/SAMPL_Guidelines.pdf
   Google Scholar
• Lang, T., & Secic, M. (2006). How to report statistics in medicine: Annotated guidelines for authors, editors, and reviewers. (2nd ed.). Philadelphia, PA: American College of Physicians.
   Google Scholar
• Lenth, R. V. (2001). Some practical guidelines for effective sample size determination. American Statistician, 55, 187–193.10.1198/000313001317098149
   Web of Science ®Google Scholar
• Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537–542. doi:10.1177/1745691612460688
   Web of Science ®Google Scholar
• Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147–163. doi:10.1037/1082-989X.9.2.147
   PubMed Web of Science ®Google Scholar
• Mills, K., Hunt, M. A., Leigh, R., & Ferber, R. (2013). A systematic review and meta-analysis of lower limb neuromuscular alterations associated with knee osteoarthritis during level walking. Clinical Biomechanics, 28, 713–724. doi:10.1016/j.clinbiomech.2013.07.008
   PubMed Web of Science ®Google Scholar
• Morris, H. H. (1981). Statistics and biomechanics: Selected considerations. In J. M. Cooper & B. Haven (Eds.), Proceedings of the CIC symposium: Biomechanics (pp. 216–225). Bloomington, IN: Indiana State Board of Health.
   Google Scholar
• Mullineaux, D. R., Bartlett, R. M., & Bennett, S. (2001). Research design and statistics in biomechanics and motor control. Journal of Sports Sciences, 19, 739–760.10.1080/026404101317015410
   PubMed Web of Science ®Google Scholar
• Napier, C., Cochrane, C. K., Taunton, J. E., & Hunt, M. A. (2015). Gait modifications to change lower extremity gait biomechanics in runners: A systematic review. British Journal of Sports Medicine, 49, 1382–1388. doi:10.1136/bjsports-2014-094393
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives in Psychological Science, 7, 615–631. doi:10.1177/1745691612459058
   Web of Science ®Google Scholar
• Pashler, H., & Harris, C. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives in Psychological Science, 7, 531–536. doi:10.1177/1745691612463401
   Web of Science ®Google Scholar
• Pataky, T. C., Vanrenterghem, J., & Robinson, M. A. (2015). Zero-vs. one-dimensional, parametric vs. non-parametric, and confidence interval vs. hypothesis testing procedures in one-dimensional biomechanical trajectory analysis. Journal of Biomechanics, 48, 1277–1285. doi:10.1016/j.jbiomech.2015.02.051
   PubMed Web of Science ®Google Scholar
• Pataky, T. C., Vanrenterghem, J., & Robinson, M. A. (2016). The probability of false positives in zero-dimensional analyses of one-dimensional kinematic, force and EMG trajectories. Journal of Biomechanics, 49, 1468–1476. doi:10.1016/j.jbiomech.2016.03.032
   PubMed Web of Science ®Google Scholar
• Schweizer, G., & Furley, P. (2016). Reproducible research in sport and exercise psychology: The role of sample sizes. Psychology of Sport and Exercise, 23, 114–122. doi:10.1016/j.psychsport.2015.11.005
   Web of Science ®Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. doi:10.1177/0956797611417632
   PubMed Web of Science ®Google Scholar
• Wasserstein, R. L., & Lazar, N. A. (2016). The ASA's statement on p-values: Context, process, and purpose. The American Statistician, 70, 129–133. doi:10.1080/00031305.2016.1154108
   Web of Science ®Google Scholar
• Welsh, A. H., & Knight, E. J. (2015). ‘Magnitude-based inference’: A statistical review. Medicine & Science in Sports & Exercise, 47, 874–884. doi:10.1249/MSS.0000000000000451
   PubMed Web of Science ®Google Scholar
• Wicke, J., Keeley, D. W., & Oliver, G. D. (2013). Comparison of pitching kinematics between youth and adult baseball pitchers: A meta-analytic approach. Sports Biomechanics, 12, 315–323. doi:10.1080/14763141.2013.838692
   PubMed Web of Science ®Google Scholar