Notes
1 In a 2016 letter to the editor in response to a study (Bossio, Pukall, & Steele, Citation2016) confirming the findings reported by Sorrells et al. (Citation2007), Morris and Krieger continue to demonstrate their ignorance of marginal mixed models and the proper application of the Bonferroni adjustment. They continue to insist that the Bonferroni adjustment should be applied to the data reported by Sorrell and colleagues (Citation2007) although they cite a clear explanation of why the adjustment is only appropriate when multiple comparisons are being made or multiple hypotheses are being tested (Van Howe, Citation2014). They also expressed incredulity over the inclusion Hispanic ethnicity and type of underwear worn in the multivariate analysis. A marginal mixed model incorporating multiple measurements from each participant made one comparison to test a single hypothesis that had been developed using pilot data, so it would inappropriate to apply the Bonferroni adjustment. There is an association between ethnicity and circumcision status that is potentially confounding and the type of underwear worn may also impact penile sensitivity. Someone with primary source expertise would know that Bonferroni adjustments are not used with marginal mixed models (Brown & Prescott, Citation1999; Littell, Millikein, Stroup, Wolfinger, & Schabenberger, Citation2006; Verbeke & Molenberghs, Citation2000; West, Welch, & Galecki, Citation2014) and understand the importance of identifying and evaluating potentially confounding factors (Mendenhall & Sincich, Citation2011).
2 While past rebuttals from these authors have revealed an ignorance of basic statistics and mathematics, let alone more complicated statistical models (Svoboda & Van Howe, Citation2014; Young, Citation2007), and past performance is the strongest predictor of future performance, past transgressions will not be a part of evaluating the current critique.
3 Odds ratios derived from raw data were used in the meta-analysis (Tian et al., Citation2013) that one of the authors (BJM) took credit for (Morris, Bailis & Wiswell, Citation2014b), the meta-analysis one of the authors (BJM) was involved in (Morris & Wiswell, Citation2013), and the Cochrane systematic review on studies of HIV infection and male circumcision (Siegfried et al., Citation2003).
4 For example, Bossio et al. (Citation2015) describe a review by Morris and Krieger (Citation2013) as being of ‘low quality’ on account of the ‘high risk of bias … introduced by the authors’ well-documented, unconditional support of the practice of circumcision’ (p. 1306).
5 Similar search techniques were employed by two of the authors (BMJ, JNK) in systematic reviews that they have authored (Morris & Krieger, Citation2013; Morris & Wiswell, Citation2013).
6 As Petitti (Citation2000) notes,
Published reports of studies that meet all the eligibility criteria for a meta-analysis may not present an estimate of effect size, and the raw data that would allow an estimate to be calculated may not be available in the study report. These studies cannot contribute to the summary estimate of effect. (p. 87)
7 For example, in the 2003 Cochrane review only 4 of the 34 studies available at that time were case-control studies (Siegfried et al., Citation2003).
8 In regression analysis, the terms effect modifier, interaction, and multiplier all refer to the same thing. In a regression model with two variables, the most common model evaluated is:
When evaluating for interaction between x1 and x2, one must add a term that multiplies the two variables (x1 × x2), then evaluate whether the parameter β3 is statistically significant using the equation:![](//:0)
9 For these authors, it is not uncommon for a cited reference to fail to support the assertion made in the statement cited. In the critique, the authors mischaracterize the findings of Bärnighausen and colleagues (Citation2012).
10 Generally, see Collier (Citation2012). The Clinton Health Access Initiative has sponsored studies assessing the effectiveness of the roll-out of circumcision in Africa (Vandament et al., Citation2016). PEPFAR is a sponsor of the circumcision roll-out in Africa and studies assessing the effectiveness of the roll-out (Osaka et al., Citation2015) and has funded studies promoting infant circumcision in Africa (Amuri et al., Citation2016; Fitzgerald et al., Citation2016). The Bill and Melinda Gates Foundation also promotes infant circumcision in Africa, (for example, Mavhu et al., Citation2016; Mangenah et al., Citation2016) and funded a trial of circumcision in Africa (Wawer et al., Citation2009) that was clearly unethical (Berer, Citation2009; Gupta & Goel, Citation2009; Okwuosa, Citation2009). A member of the Editorial Board for Global Health: Science and Practice represents the Gates Foundation (http://www.ghspjournal.org/site/misc/edboard.xhtml). There is no evidence of an association between infant circumcision and the risk of HIV infection.
11 Gish gallop refers to the creation of so much unsubstantiated material, at such a pace, that those who are committed to a more careful scholarly investigation do not have the time nor energy to rebut each point.
Bossio, J. A., Pukall, C. F., & Steele, S. S. (2016). Examining penile sensitivity in neonatally circumcised and intact men using quantitative sensory testing. Journal of Urology, 195, 1848–1853. doi:10.1016/j.juro.2015.12.080 Sorrells, M. L., Snyder, J. L., Reiss, M. D., Eden, C., Milos, M. F., … Van Howe, R. S. (2007). Fine-touch pressure thresholds in the adult penis. BJU International, 99, 864–869. doi:10.111/j.1464-410X.2006.06685.x Sorrells, M. L., Snyder, J. L., Reiss, M. D., Eden, C., Milos, M. F., … Van Howe, R. S. (2007). Fine-touch pressure thresholds in the adult penis. BJU International, 99, 864–869. doi:10.111/j.1464-410X.2006.06685.x Brown, H., & Prescott, R. (1999). Applied mixed models in medicine. Chichester: John Wiley & Sons, Ltd. Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS for Mixed Models (2nd ed.). Cary, NC: SAS Institute. Verbeke, G., & Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York, NY: Springer-Verlag. West, B. T., Welch, K. B., & Galecki, A. T. (2014). Linear mixed models: A practical guide using statistical software (2nd ed.). London: Chapman and Hall/CRC Press. Mendenhall, W., & Sincich, T. T. (2011). A second course in statistics: Regression analysis (7th ed.). Boston, MA: Pearson Education. Young, H. (2007). Fine-touch pressure thresholds in the adult penis [letter]. BJU International, 100, 699. doi: 10.1111/j.1464-410X.2007.07072_1.x Tian, Y., Liu, W., Wang, J.-Z., Wazir, R., Yue, X., & Wang, K.-J. (2013). Effect of circumcision on male sexual functions: A systematic review and meta-analysis. Asian Journal of Andrology, 15, 662–666. doi:10.1038/aja.2013.47 Morris, B. J., Bailis, S. A., & Wiswell, T. E. (2014b). In reply – Bias and male circumcision. Mayo Clinic Proceedings, 89, 1588–1589. doi:10.1016/j.mayocp.2014.09.002 Morris, B. J., & Wiswell, T. E. (2013). Circumcision and lifetime risk or urinary tract infection: A systematic review and meta-analysis. Journal of Urology, 189, 2118–2124. doi:10.1016/j.juro.2012.11.114 Siegfried, N., Muller, M., Volmink, J., Deeks, J., Egger, M., Low, N., … Williamson, P. (2003). Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Systematic Reviews, 3, CD003362. Bossio, J. A., Pukall, C. F., & Steele, S. (2015). Response to: The literature supports policies promoting neonatal male circumcision in N. America. Journal of Sexual Medicine, 12, 1306–1307. doi:10.1111/jsm.12852 Morris, B. J., & Krieger, J. N. (2013). Does male circumcision affect sexual function, sensitivity, or satisfaction? A systematic review. Journal of Sexual Medicine, 10, 2644–2657. doi:10.1111/jsm.12293 Morris, B. J., & Krieger, J. N. (2013). Does male circumcision affect sexual function, sensitivity, or satisfaction? A systematic review. Journal of Sexual Medicine, 10, 2644–2657. doi:10.1111/jsm.12293 Morris, B. J., & Wiswell, T. E. (2013). Circumcision and lifetime risk or urinary tract infection: A systematic review and meta-analysis. Journal of Urology, 189, 2118–2124. doi:10.1016/j.juro.2012.11.114 Petitti, D. B. (2000). Meta-analysis, decision analysis, and cost-effectiveness analysis: Methods for quantitative synthesis in medicine (2nd ed.). New York, NY: Oxford University Press. Siegfried, N., Muller, M., Volmink, J., Deeks, J., Egger, M., Low, N., … Williamson, P. (2003). Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Systematic Reviews, 3, CD003362. Bärnighausen, T., Bloom, D. E., & Humair, S. (2012). Economics of antiretroviral treatment vs. circumcision for HIV prevention. Proceedings of the National Academy of Sciences USA, 109, 21271–21276. doi:10.1073/pnas.1209017110 Collier, R. (2012). The study that launched a thousand snips. Canadian Medical Association Journal, 184, E37–E38. doi:10.1503/cmaj.109-4029 Vandament, L., Chintu, N., Yano, N., Mugurungi, O., Tambatamba, B., … Hatzold, K. (2016). Evaluating opportunities for achieving cost efficiencies through the introduction of PrePex device male circumcision in adult VMMC programs in Zambia and Zimbabwe. Journal of Acquired Immune Deficiency Syndrome, 72(Suppl. 1), S90–S95. doi:10.1097/QAI.0000000000000722 Osaka, H., Mshana, G., Wambura, M., Grund, J., Neke, N., … Changalucha, J. (2015). ‘If you are not circumcised, I cannot say yes’: The role of women in promoting the uptake of voluntary medical male circumcision in Tanzania. PLoS One, 10(9), e0139009. doi:10.1371/journal.pone.0139009 Amuri, M., Msemo, G., Plotkin, M., Christensen, A., Boyee, D., … Lija, J. (2016). Bringing early infant male circumcision information home to the family: Demographic characteristics and perspectives of clients in a pilot project in Tanzania. Global Health: Science and Practice, 4(Suppl. 1), S29–S41. doi:10.9745/GHSP-D-15-00210 Fitzgerald, L., Benzerga, W., Mirira, M., Adamu, T., Shissler, T., … Maziyaet, V. (2016). Scaling up early infant male circumcision: Lessons from the Kingdom of Swaziland. Global Health: Science and Practice, 4(Suppl. 1), S76–S86. doi:10.9745/GHSP-D-15-00186 Mavhu, W., Larke, N., Hatzold, K., Ncube, G., Weiss, H. A., … Ticklay, I. (2016). Safety, acceptability, and feasibility of early infant male circumcision conducted by nurse-midwives using the AccuCirc device: Results of a field study in Zimbabwe. Global Health: Science and Practice, 4(Suppl. 1), S42–S54. doi:10.9745/GHSP-D-15-00199 Mangenah, C., Mavhu, W., Hatzold, K., Biddle, A. K., Ncube, G., … Thirumurthy, H. (2016). Comparative cost of early infant male circumcision by nurse-midwives and doctors in Zimbabwe. Global Health: Science and Practice, 4(Suppl. 1), S68–S75. doi:10.9745/GHSP-D-15-00201 Wawer, M. J., Makumbi, K., Kigozi, G., Serwadda, D., Watya, S., … Gray, R. H. (2009). Circumcision in HIV-infected men and its effect on HIV transmission to female partners in Rakai, Uganda: A randomised controlled trial. Lancet, 374, 229–237. doi:10.1016/S0140-6736(09)60998-3 Berer, M. (2009). Male circumcision and risk of HIV in women. Lancet, 374, 1497–1498. doi:10.1016/S0140-6736(09)61898-5 Gupta, V., & Goel, A. (2009). Male circumcision for prevention of HIV transmission. Lancet, 374, 1497. doi:10.1016/S0140-6736(09)61897-3 Okwuosa, T. M. (2009). Male circumcision for prevention of HIV transmission. Lancet, 374, 1497. doi:10.1016/S0140-6736(09)61896-1