A Cronbach’s Alpha Generalization Meta-Analysis Study of the Problematic Pornography Consumption Scale

References

• Abell, J. W., Steenbergh, T. A., & Boivin, M. J. (2006). Cyberporn use in the context of religiosity. Journal of Psychology and Theology, 34(2), 165–171. doi:10.1177/009164710603400206
   Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: American Psychiatric Association. doi:10.1176/appi.books.9780890425596
   Google Scholar
• Antons, S., & Brand, M. (2021). Diagnostic and classification considerations related to compulsive sexual behavior disorder and problematic pornography use. Current Addiction Reports, 8, 452–457. doi:10.1007/s40429-021-00383-7
   Google Scholar
• Bay, K. S. (1973). The effect of non‐normality on the sampling distribution and standard error of reliability coefficient estimates under an analysis of variance model. British Journal of Mathematical and Statistical Psychology, 26(1), 45–57. doi:10.1111/j.2044-8317.1973.tb00505.x
   Google Scholar
• Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1. doi:10.2307/2533446
   PubMed Web of Science ®Google Scholar
• Bikmaz Bilgen, O., & Doğan, N. (2017). The comparison of interrater reliability estimating techniques Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 8, 63–63. doi:10.21031/epod.294847
   Google Scholar
• Bobak, C. A., Barr, P. J., & O’Malley, A. J. (2018). Estimation of an inter-rater intra-class correlation coefficient that overcomes common assumption violations in the assessment of health measurement scales. BMC Medical Research Methodology, 18(1), 1–11. doi:10.1186/s12874-018-0550-6
   PubMedGoogle Scholar
• Bonett, D. G. (2002). Sample size requirements for estimating intraclass correlations with desired precision. Statistics in Medicine, 21(9), 1331–1335. doi:10.1002/sim.1108
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research Synthesis Methods, 1(2), 97–111. doi:10.1002/jrsm.12
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L., & Rothstein, H. (2007). Meta-analysis: Fixed effect vs. Random effects. Meta-Analysis. Com, doi:10.1002/jrsm.12
   Google Scholar
• Borgogna, N. C., Duncan, J., & McDermott, R. C. (2018). Is scrupulosity behind the relationship between problematic pornography viewing and depression, anxiety, and stress? Sexual Addiction & Compulsivity, 25(4), 293–318. doi:10.1080/10720162.2019.1567410
   Web of Science ®Google Scholar
• *Bőthe, B., Tóth-Király, I., Bella, N., Potenza, M. N., Demetrovics, Z., & Orosz, G. (2021). Why do people watch pornography? The motivational basis of pornography use. Psychology of Addictive Behaviors: Journal of the Society of Psychologists in Addictive Behaviors, 35(2), 172–186. doi:10.1037/adb0000603
   PubMed Web of Science ®Google Scholar
• *Bőthe, B., Tóth-Király, I., Demetrovics, Z., & Orosz, G. (2021). The short version of the problematic pornography consumption scale (PPCS-6): A reliable and valid measure in general and treatment-seeking populations. Journal of Sex Research, 58(3), 342–352. doi:10.1080/00224499.2020.1716205
   PubMed Web of Science ®Google Scholar
• Bőthe, B., Tóth-Király, I., Griffiths, M. D., Potenza, M. N., Orosz, G., & Demetrovics, Z. (2021). Are sexual functioning problems associated with frequent pornography use and/or problematic pornography use? Results from a large community survey including males and females. Addictive Behaviors, 112, 106603. doi:10.1111/j.1745-3984.2009.01067.x
   PubMed Web of Science ®Google Scholar
• *Bőthe, B., Tóth-Király, I., Potenza, M. N., Orosz, G., & Demetrovics, Z. (2020). High-frequency pornography use may not always be problematic. The Journal of Sexual Medicine, 17(4), 793–811. doi:10.1016/j.jsxm.2020.01.007
   PubMed Web of Science ®Google Scholar
• *Bőthe, B., Tóth-Király, I., Zsila, Á., Griffiths, M. D., Demetrovics, Z., & Orosz, G. (2018). The development of the problematic pornography consumption scale (PPCS). Journal of Sex Research, 55(3), 395–406. doi:10.1080/00224499.2017.1291798
   PubMed Web of Science ®Google Scholar
• *Bőthe, B., Vaillancourt-Morel, M.-P., Dion, J., Štulhofer, A., & Bergeron, S. (2021). Validity and reliability of the short version of the Problematic Pornography Consumption Scale (PPCS-6-A) in adolescents. Psychology of Addictive Behaviors: Journal of the Society of Psychologists in Addictive Behaviors, 35(4), 486–500. doi:10.1037/adb0000722
   PubMed Web of Science ®Google Scholar
• Bőthe, B., Koós, M., Nagy, L., Kraus, S. W., Potenza, M. N., & Demetrovics, Z. (2021). International Sex Survey: Study protocol of a large, cross-cultural collaborative study in 45 countries. Journal of Behavioral Addictions, 10(3), 632–645. doi:10.1556/2006.2021.00063
   PubMed Web of Science ®Google Scholar
• Brand, M., Laier, C., Pawlikowski, M., Schächtle, U., Schöler, T., & Altstötter-Gleich, C. (2011). Watching pornographic pictures on the Internet: Role of sexual arousal ratings and psychological–psychiatric symptoms for using Internet sex sites excessively. Cyberpsychology, Behavior and Social Networking, 14(6), 371–377. doi:10.1089/cyber.2010.0222
   PubMed Web of Science ®Google Scholar
• Cacioppo, M., Gori, A., Schimmenti, A., Baiocco, R., Laghi, F., & Caretti, V. (2018). Development of a new screening tool for cyber pornography: Psychometric properties of the Cyber Pornography Addiction Test (CYPAT). Clinical Neuropsychiatry, 15(1), 60–65. doi:2018-11717-008
   Google Scholar
• Chen, L., & Jiang, X. (2020). The assessment of problematic internet pornography use: A comparison of three scales with mixed methods. International Journal of Environmental Research and Public Health, 17(2). doi:10.3390/ijerph17020488
   Web of Science ®Google Scholar
• *Chen, L., Jiang, X., Luo, X., Kraus, S. W., & Bőthe, B. (2021). The role of impaired control in screening problematic pornography use: Evidence from cross-sectional and longitudinal studies in a large help-seeking male sample. Psychology of Addictive Behaviors: Journal of the Society of Psychologists in Addictive Behaviors, 36(5), 537–546. doi:10.1037/adb0000714
   PubMed Web of Science ®Google Scholar
• Chen, L., Luo, X., Bőthe, B., Jiang, X., Demetrovics, Z., & Potenza, M. N. (2021). Properties of the Problematic Pornography Consumption Scale (PPCS-18) in community and subclinical samples in China and Hungary. Addictive Behaviors, 112, 106591. doi:10.1037/adb0000714
   PubMed Web of Science ®Google Scholar
• Chen, L., Yang, Y., Su, W., Zheng, L., Ding, C., & Potenza, M. N. (2018). The relationship between sexual sensation seeking and problematic Internet pornography use: A moderated mediation model examining roles of online sexual activities and the third-person effect. Journal of Behavioral Addictions, 7(3), 565–573. doi:10.1556/2006.7.2018.77
   PubMed Web of Science ®Google Scholar
• Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284
   Google Scholar
• Delmonico, D., & Miller, J. (2003). The Internet Sex Screening Test: A comparison of sexual compulsives versus non-sexual compulsives. Sexual and Relationship Therapy, 18(3), 261–276. doi:10.1080/1468199031000153900
   Google Scholar
• Ebel, R. L. (1972). Why is a longer test usually a more reliable test? Educational and Psychological Measurement, 32(2), 249–253. doi:10.4995/HEAd20.2020.11303
   Web of Science ®Google Scholar
• Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ (Clinical Research ed.), 315(7109), 629–634. doi:10.1136/bmj.315.7109.629
   PubMed Web of Science ®Google Scholar
• Fernandez, D. P., & Griffiths, M. D. (2021). Psychometric instruments for problematic pornography use: A systematic review. Evaluation & the Health Professions, 44(2), 111–141. doi doi:10.1177/0163278719861688
   PubMed Web of Science ®Google Scholar
• Giordano, A. L., & Cashwell, C. S. (2017). Cybersex addiction among college students: A prevalence study. Sexual Addiction & Compulsivity, 24(1-2), 47–57. doi:10.1080/10720162.2017.1287612
   Web of Science ®Google Scholar
• Gliem, J. A., & Gliem, R. R. (2003). Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales. doi:10.4236/aid.2023.131001
   Google Scholar
• Green, C. E., Chen, C. E., Helms, J. E., & Henze, K. T. (2011). Recent reliability reporting practices in Psychological Assessment: Recognizing the people behind the data. Psychological Assessment, 23(3), 656–669. doi:10.1037/a0023089
   PubMed Web of Science ®Google Scholar
• Griffiths, M. (2005). A ‘components’ model of addiction within a biopsychosocial framework. Journal of Substance Use, 10(4), 191–197. doi:10.1080/14659890500114359
   Google Scholar
• Grubbs, J. B., & Kraus, S. W. (2021). Pornography use and psychological science: A call for consideration. Current Directions in Psychological Science, 30(1), 68–75. doi:10.1177/09637214209795
   Web of Science ®Google Scholar
• Grubbs, J. B., & Perry, S. L. (2019). Moral incongruence and pornography use: A critical review and integration. Journal of Sex Research, 56(1), 29–37. doi:10.1080/00224499.2018.1427204
   PubMed Web of Science ®Google Scholar
• Grubbs, J. B., Sessoms, J., Wheeler, D. M., & Volk, F. (2010). The Cyber-Pornography Use Inventory: The development of a new assessment instrument. Sexual Addiction & Compulsivity, 17(2), 106–126. doi:10.1080/10720161003776166
   Google Scholar
• Herbenick, D., Fu, T.-C., Wright, P., Paul, B., Gradus, R., Bauer, J., & Jones, R. (2020). Diverse sexual behaviors and pornography use: Findings from a nationally representative probability survey of Americans aged 18 to 60 years. The Journal of Sexual Medicine, 17(4), 623–633. doi:10.1016/j.jsxm.2020.01.013
   PubMed Web of Science ®Google Scholar
• Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. doi:10.1136/bmj.327.7414.557
   PubMed Web of Science ®Google Scholar
• Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006). Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychological Methods, 11(2), 193–206. doi:10.1037/1082-989X.11.2.193
   PubMed Web of Science ®Google Scholar
• Huynh, Q.-L., Howell, R. T., & Benet-Martínez, V. (2009). Reliability of bidimensional acculturation scores: A meta-analysis. Journal of Cross-Cultural Psychology, 40(2), 256–274. doi:10.1177/0022022108328919
   Web of Science ®Google Scholar
• Imrey, P. B. (2020). Limitations of meta-analyses of studies with high heterogeneity. JAMA Network Open, 3(1), e1919325–e1919325. doi:10.1037/1082-989X.11.2.193
   Web of Science ®Google Scholar
• Jain, S., & Pandey, N. (2020). Exploring the Connection between Problematic Pornography, Personality and Emotional Adjustment. International Journal of Current Research and Review, 12(20), 173–176. doi:10.31782/IJCRR.2020.122023
   Google Scholar
• *Kadavala, B. N., Vasavada, D. A., Kumar, P., Bhatt, R. B., Patel, V. K., & Tiwari, D. S. (2021). A multicenter study on problematic pornography consumption: Prevalence and correlates among undergraduate medical students. Asian Journal of Social Health and Behavior, 4(3), 122. doi:10.4103/shb.shb_18_21
   Google Scholar
• Kafka, M. P. (2010). Hypersexual disorder: A proposed diagnosis for DSM-V. Archives of Sexual Behavior, 39(2), 377–400. doi:10.1007/s10508-009-9574-7
   PubMed Web of Science ®Google Scholar
• Kor, A., Zilcha-Mano, S., Fogel, Y. A., Mikulincer, M., Reid, R. C., & Potenza, M. N. (2014). Psychometric development of the problematic pornography use scale. Addictive Behaviors, 39(5), 861–868. doi:10.1016/j.addbeh.2014.01.027
   PubMed Web of Science ®Google Scholar
• Kraus, S. W., Gola, M., Grubbs, J. B., Kowalewska, E., Hoff, R. A., Lew-Starowicz, M., … Potenza, M. N. (2020). Validation of a brief pornography screen across multiple samples. Journal of Behavioral Addictions, 9(2), 259–271. doi:10.1556/2006.2020.00038
   PubMed Web of Science ®Google Scholar
• Kraus, S. W., Krueger, R. B., Briken, P., First, M. B., Stein, D. J., Kaplan, M. S., … Atalla, E. (2018). Compulsive sexual behaviour disorder in the ICD‐11. World Psychiatry: Official Journal of the World Psychiatric Association (Wpa)), 17(1), 109–110. doi:10.1002/wps.20499
   PubMed Web of Science ®Google Scholar
• Kraus, S., & Rosenberg, H. (2014). The pornography craving questionnaire: Psychometric properties. Archives of Sexual Behavior, 43(3), 451–462. doi:10.1007/s10508-013-0229-3
   PubMed Web of Science ®Google Scholar
• *Kumar, P., Patel, V. K., Bhatt, R. B., Vasavada, D. A., Sangma, R. D., & Tiwari, D. S. (2021). Prevalence of problematic pornography use and attitude toward pornography among the undergraduate medical students. Journal of Psychosexual Health, 3(1), 29–36. doi:10.1177/263183182198967
   Google Scholar
• López-Pina, J., A., Sánchez-Meca, J., López-López, J. A., Marín-Martínez, F., Núñez-Núñez, R. M., Rosa-Alcázar, A. I., … Ferrer-Requena, J. (2015). The Yale–Brown obsessive compulsive scale: A reliability generalization meta-analysis. Assessment, 22(5), 619–628. doi:10.1177/1073191114551954
   PubMed Web of Science ®Google Scholar
• Marshall, E. A., & Miller, H. A. (2019). Consistently inconsistent: A systematic review of the measurement of pornography use. Aggression and Violent Behavior, 48, 169–179. doi:10.1016/j.avb.2019.08.019
   Web of Science ®Google Scholar
• McCormack, M., & Wignall, L. (2017). Enjoyment, exploration and education: Understanding the consumption of pornography among young men with nonexclusive sexual orientations. Sociology, 51(5), 975–991. doi:10.1177/0038038516629909
   PubMedGoogle Scholar
• Mennig, M., Tennie, S., & Barke, A. (2020). Self-perceived problematic use of online pornography is linked to clinically relevant levels of psychological distress and psychopathological symptoms. Archives of Sexual Behavior, 51(2):1313–1321. doi:10.1007/s10508-021-02101-w
   Web of Science ®Google Scholar
• McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. doi:10.1037/met0000144
   PubMed Web of Science ®Google Scholar
• Noor, S. W., Rosser, B. S., & Erickson, D. J. (2014). A brief scale to measure problematic sexually explicit media consumption: Psychometric properties of the Compulsive Pornography Consumption (CPC) scale among men who have sex with men. Sexual Addiction & Compulsivity, 21(3), 240–261. doi:10.1080/10720162.2014.938849
   PubMedGoogle Scholar
• Oronsky, B., Larson, C., Hammond, T. C., Oronsky, A., Kesari, S., Lybeck, M., & Reid, T. R. (2021). A review of persistent post-COVID syndrome (PPCS). Clinical Reviews in Allergy & Immunology, 64(1), 66–74. doi:10.1007/s12016-021-08848-3
   PubMed Web of Science ®Google Scholar
• Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. doi:10.1007/s12016-021-08848-3
   Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Brennan, S. E. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1), 89. doi:10.1136/bmj.n71
   PubMed Web of Science ®Google Scholar
• Park, B. Y., Wilson, G., Berger, J., Christman, M., Reina, B., Bishop, F., Klam, W. P., & Doan, A. P. (2016). Is internet pornography causing sexual dysfunctions? A review with clinical reports. Behavioral Sciences, 6(3), 17. doi:10.3390/bs6030017
   Web of Science ®Google Scholar
• Pizzol, D., Bertoldo, A., & Foresta, C. (2016). Adolescents and web porn: A new era of sexuality. International Journal of Adolescent Medicine and Health, 28(2), 169–173. doi:10.1515/ijamh-2015-0003
   PubMedGoogle Scholar
• Reid, R. C., Li, D. S., Gilliland, R., Stein, J. A., & Fong, T. (2011). Reliability, validity, and psychometric development of the pornography consumption inventory in a sample of hypersexual men. Journal of Sex & Marital Therapy, 37(5), 359–385. doi:10.1080/0092623X.2011.607047
   PubMed Web of Science ®Google Scholar
• Rothman, E. F., Beckmeyer, J. J., Herbenick, D., Fu, T.-C., Dodge, B., & Fortenberry, J. D. (2021). The prevalence of using pornography for information about how to have sex: Findings from a nationally representative survey of US adolescents and young adults. Archives of Sexual Behavior, 50(2), 629–646. doi:10.1007/s10508-020-01877-7
   PubMed Web of Science ®Google Scholar
• Sánchez‐Meca, J., Marín‐Martínez, F., López‐López, J. A., Núñez‐Núñez, R. M., Rubio‐Aparicio, M., López‐García, J. J., … López‐Nicolás, R. (2021). Improving the reporting quality of reliability generalization meta‐analyses: The REGEMA checklist. Research Synthesis Methods, 12(4), 516–536. doi:10.1002/jrsm.1487
   PubMed Web of Science ®Google Scholar
• Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120. doi:10.1007/s11336-008-9101-0
   PubMed Web of Science ®Google Scholar
• Sen, S. (2022). A Reliability Generalization Meta-Analysis of Runco Ideational Behavior Scale. Creativity Research Journal, 34(2), 178–194. doi:10.1080/10400419.2021.1960719
   Web of Science ®Google Scholar
• *Stefanska, E. B., Longpré, N., & Rogerson, H. (2022). Relationship between atypical sexual fantasies, behavior, and pornography consumption. International Journal of Offender Therapy and Comparative Criminology, 0306624X221086569, 306624X221086569. doi:10.21428/cb6ab371.2bac3707
   Google Scholar
• Svedin, C. G., Åkerman, I., & Priebe, G. (2011). Frequent users of pornography. A population based epidemiological study of Swedish male adolescents. Journal of Adolescence, 34(4), 779–788. doi:10.1016/j.adolescence.2010.04.010
   PubMed Web of Science ®Google Scholar
• Symonds, P. M. (1928). Factors influencing test reliability. Journal of Educational Psychology, 19(2), 73–87. doi:10.1037/h0071867
   Google Scholar
• Szymanski, D. M., & Stewart-Richardson, D. N. (2014). Psychological, relational, and sexual correlates of pornography use on young adult heterosexual men in romantic relationships. The Journal of Men’s Studies, 22(1), 64–82. doi:10.3149/jms.2201.64
   Google Scholar
• Tan, S.-A., Goh, Y. S., Mohd Zaharim, N., Gan, S. W., Yap, C. C., Nainee, S., & Lee, L. K. (2022). Problematic Internet Pornography Use and Psychological Distress among Emerging Adults in Malaysia: Gender as a Moderator. International Journal of Environmental Research and Public Health, 19(6), 3682. doi:10.3390/ijerph19063682
   PubMed Web of Science ®Google Scholar
• Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837–847. doi:10.1177/0013164495055002019
   Google Scholar
• Thorndike, R. M. (1995). Book review: Psychometric theory by Jum Nunnally and Ira Bernstein New York: McGraw-hill, 1994, xxiv+ 752 pp. Applied Psychological Measurement, 19(3), 303–305. doi:10.1177/01466216950190030
   Google Scholar
• Ursachi, G., Horodnic, I. A., & Zait, A. (2015). How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Economics and Finance, 20, 679–686. (15)00123-9 doi:10.1016/S2212-5671
   Google Scholar
• Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58(1), 6–20. doi:10.1177/0013164498058001002
   Web of Science ®Google Scholar
• Varma, K. S., Tayade, R. J., Shah, K. J., Joshi, P. A., Shukla, A. D., & Gandhi, V. G. (2020). Photocatalytic degradation of pharmaceutical and pesticide compounds (PPCs) using doped TiO2 nanomaterials: A review. Water-Energy Nexus., 3, 46–61. doi:10.1016/j.wen.2020.03.008
   Google Scholar
• Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. doi:10.18637/jss.v036.i03
   Web of Science ®Google Scholar
• World Health Organization (2023). International Statistical Classification of Diseases and related health problems: Alphabetical index (Vol. 3). Geneve, Switzerland: World Health Organization.
   Google Scholar
• Zhang, H., & Weng, Y. (2021). Safety Risks of Plant Fiber/Plastic Composites (PPCs) Intended for Food Contact: A Review of Potential Hazards and Risk Management Measures. Toxics, 9(12), 343. doi:10.3390/toxics9120343
   PubMed Web of Science ®Google Scholar
• Zimmerman, D. W. (2009). The Reliability of Difference Scores in Populations and Samples. Journal of Educational Measurement, 46(1), 19–42. doi:10.1111/j.1745-3984.2009.01067.x
   Web of Science ®Google Scholar