Using pre-test and post-test data to understand spirituality programs: opportunities and limitations

References

• Astin, A. W., H. S. Astin, and J. A. Lindholm. 2010. Spirituality in Higher Education: A National Study of College Students’ Search for Meaning and Purpose. Los Angeles: University of California.
   Google Scholar
• Barrett, M. C. S. 2016. “Dimensions of Spirituality Fostered through the PULSE Program for Service Learning.” Journal of Catholic Education 20: 1.
   Google Scholar
• Bormann, J. E., T. L. Smith, S. Becker, M. Gershwin, L. Pada, A. H. Grudzinski, and E. A. Nurmi. 2005. “Efficacy of Frequent Mantram Repetition on Stress, Quality of Life, and Spiritual Well-Being in Veterans: A Pilot Study.” Journal of Holistic Nursing 23 (4): 395–414. doi:10.1177/0898010105278929.
   PubMedGoogle Scholar
• Card, D., and L. Giuliano. 2016. “Can Tracking Raise the Test Scores of High-Ability Minority Students?” American Economic Review 106 (10): 2783–2816.
   Web of Science ®Google Scholar
• Case-Smith, J., T. Holland, A. Lane, and S. White. 2012. “Effect of a Coteaching Handwriting Program for First Graders: One-Group Pretest–Posttest Design.” American Journal of Occupational Therapy 66 (4): 396–405. doi:10.5014/ajot.2012.004333.
   PubMed Web of Science ®Google Scholar
• Coyle, A. 2008. “Qualitative Methods and ‘The (Partly) Ineffable’ in Psychological Research on Religion and Spirituality.” Qualitative Research in Psychology 5 (1): 56–67. doi:10.1080/14780880701863583.
   Google Scholar
• Dill, L. J. 2017. “‘Wearing My Spiritual Jacket’: The Role of Spirituality as a Coping Mechanism among African American Youth.” Health Education & Behavior 44 (5): 696–704. doi:10.1177/1090198117729398.
   PubMed Web of Science ®Google Scholar
• Dimitrov, D. M., and P. D. Rumrill. 2003. “Pretest-Posttest Designs and Measurement of Change.” Work 20 (2003): 159–165.
   PubMedGoogle Scholar
• Dobbie, W., and R. G. Fryer Jr. 2011. “Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children’s Zone.” American Economic Journal: Applied Economics 3 (3): 158–187.
   Web of Science ®Google Scholar
• Edwards, A., N. Pang, V. Shiu, and C. Chan. 2010. “The Understanding of Spirituality and the Potential Role of Spiritual Care in End-Of-Life and Palliative Care: A Meta-Study of Qualitative Research.” Palliative Medicine 24 (8): 753–770. doi:10.1177/0269216310375860.
   PubMed Web of Science ®Google Scholar
• Ekşi, H., and K. Selami. 2017. “Spiritual Well-Being: Scale Development and Validation.” Spiritual Psychology and Counseling 2: 1. doi:10.12738/spc.2017.1.0022.
   Google Scholar
• Fives, A., D. W. Russell, J. Canavan, R. Lyons, P. Eaton, C. Devaney, N. Kearns, and A. O’Brien. 2015. “The Ethics of Randomized Controlled Trials in Social Settings: Can Social Trials Be Scientifically Promising and Must There Be Equipoise?” International Journal of Research & Method in Education 38 (1): 56–71. doi:10.1080/1743727X.2014.908338.
   Web of Science ®Google Scholar
• Flasch, P., D. Taylor, R. N. Clauber, and E. Robinson. 2017. “Examining Students’ Self-Perceived Competence and Comfort in an Experiential Play Therapy Counseling Course: A Single Group Pretest-Posttest Investigation.” International Journal for the Scholarship of Teaching and Learning 11 (1). https://eric.ed.gov/?id=EJ1136117.
   Google Scholar
• Genia, V. 2001. “Evaluation of the Spiritual Well-Being Scale in a Sample of College Students.” The International Journal for the Psychology of Religion 11 (1): 25–33. doi:10.1207/S15327582IJPR1101_03.
   Google Scholar
• Goggin, M. L. 1986. “The ‘Too Few Cases/Too Many Variables’ Problem in Implementation Research.” The Western Political Quarterly 39 (2): 328–347. doi:10.2307/448302.
   Google Scholar
• Gray, J. 2006. “Measuring Spirituality: Conceptual and Methodological Considerations.” Journal of Theory Construction & Testing 10 (2): 58–64.
   Google Scholar
• Gribbons, B., and J. Herman. 1997. True and Quasi-Experimental Designs. ERIC/AE Digest. Washington, DC: ERIC Clearinghouse on Assessment and Evaluation. https://eric.ed.gov/?id=ED421483.
   Google Scholar
• Hatch, R. L., M. A. Burg, D. S. Naberhaus, and L. K. Hellmich. 1998. “The Spiritual Involvement and Beliefs Scale: Development and Testing of a New Instrument.” The Journal of Family Practice 46 (6): 476–486.
   PubMed Web of Science ®Google Scholar
• Hennig, C., D. Müllensiefen, and J. Bargmann. 2010. “Within-Subject Comparison of Changes in a Pretest-Posttest Design.” Applied Psychological Measurement 34 (5): 291–309. doi:10.1177/0146621608329889.
   Web of Science ®Google Scholar
• Hodge, D. R. 2003. “The Intrinsic Spirituality Scale.” Journal of Social Service Research 30 (1): 41–61. doi:10.1300/J079v30n01_03.
   Web of Science ®Google Scholar
• Karoly, L. A., M.R. Kilburn, and J. S. Cannon. 2005. “What Works in Early Childhood Intervention Programs.” In Early Childhood Interventions: Proven Results, Future Promise. Santa Monica, CA: RAND Corporation.
   Google Scholar
• Kincheloe, D. D., L. M. Stallings Welden, and A. White. 2018. “A Spiritual Care Toolkit: An Evidence‐Based Solution to Meet Spiritual Needs.” Journal of Clinical Nursing 27 (7/8): 1612.
   PubMed Web of Science ®Google Scholar
• Laird, L. D., C. E. Curtis, and J. R. Morgan. 2017. “Finding Spirits in Spirituality: What are We Measuring in Spirituality and Health Research?” Journal Of Religion And Health 56 (1): 1–20. doi:10.1007/s10943-016-0316-6.
   PubMed Web of Science ®Google Scholar
• Mariotti, M., and J. Meinecke. 2015. “Partial Identification and Bound Estimation of the Average Treatment Effect of Education on Earnings for South Africa.” Oxford Bulletin of Economics & Statistics 77 (2): 210–233. doi:10.1111/obes.12059.
   Web of Science ®Google Scholar
• Marsden, E., and C. J. Torgerson. 2012. “Single Group, Pre- and Post-Test Research Designs: Some Methodological Concerns.” Oxford Review of Education 38 (5): 583–616.
   Web of Science ®Google Scholar
• Morgan, S. L., and J. J. Todd. 2009. “Intergenerational Closure and Academic Achievement in High School: A New Evaluation of Coleman’s Conjecture.” Sociology of Education 82 (3): 267–285.
   Web of Science ®Google Scholar
• Morris, S. B. 2008. “Estimating Effect Sizes From Pretest-Posttest-Control Group Designs.” Organizational Research Methods 11 (2): 364–386. doi:10.1177/1094428106291059.
   Web of Science ®Google Scholar
• Morris, S. B., and R. P. DeShon. 2002. “Combining Effect Size Estimates in Meta-Analysis with Repeated Measures and Independent-Groups Design.” Psychological Methods 7 (1): 105–125.
   PubMed Web of Science ®Google Scholar
• Ngware, M. W., B. Abuya, M. Oketch, K. Admassu, M. Mutisya, and P. Musyoka. 2015. “Randomized Impact Evaluation of Education Interventions: Experiences and Lessons from a Reading to Learn Intervention in East Africa.” International Journal of Research & Method in Education 38 (4): 430–451. doi:10.1080/1743727X.2014.965252.
   Web of Science ®Google Scholar
• Oxhandler, H. K., and K. I. Pargament. 2018. “Measuring Religious and Spiritual Competence across Helping Professions: Previous Efforts and Future Directions.” Spirituality in Clinical Practice 5 (2): 120–132. doi:10.1037/scp0000149.
   Web of Science ®Google Scholar
• Pratt, C. C., W. M. McGuigan, and A. R. Katzev. 2000. “Measuring Program Outcomes: Using Retrospective Pretest Methodology.” The American Journal of Evaluation 21 (3): 341–349. doi:10.1016/S1098-2140(00)00089-8.
   Web of Science ®Google Scholar
• Schneller, B. E., M. W. Minardi, and T. L. Lake. 2016. “Assessing Spiritual Growth and Development at Belmont University.” Assessment Update 28 (1): 1–16. doi:10.1002/au.30043.
   Google Scholar
• Schuetz, J. 2017. “Quantifying the Spiritual: Incorporating Subjective Spirituality in Biomedical Research.” The Hilltop Review 9 (2): 146–153.
   Google Scholar
• Sigel, D. 2016. “Prayer and Adolescence: Can Formal Instruction Make a Difference?” Religious Education 111 (2): 200–221. doi:10.1080/00344087.2016.1111042.
   Web of Science ®Google Scholar
• Singleton, A., M. Mason, and R. Webber. 2004. “Spirituality in Adolescence and Young Adulthood: A Method for A Qualitative Study.” International Journal of Children’s Spirituality 9 (3): 247–262. doi:10.1080/1364436042000292176.
   Google Scholar
• Spieth, P. M., A. S. Kubasch, A. I. Penzlin, B. M.-W. Illigens, K. Barlinn, and T. Siepman. 2016. “Randomized Controlled Trials–A Matter of Design.” Neuropsychiatric Disease and Treatment, 12(1): 1341–1349.
   PubMedGoogle Scholar
• Stewart, C. 2004. “An Empirical Exploration of Spirituality and Religiousness in Addiction Treatment.” American Journal of Pastoral Counseling 7 (4): 71–83. doi:10.1300/J062v07n04_05.
   Google Scholar
• Sullivan, G. M. 2011. “Getting off the ‘Gold Standard’: Randomized Controlled Trials and Education Research.” Journal of Graduate Medical Education 3 (3): 285–289. doi:10.4300/JGME-D-11-00147.1.
   PubMedGoogle Scholar
• Trinidad, J. E. 2018. “Towards a Model for Evaluating Spiritual Recollections.” International Journal of Children’s Spirituality. online first (March). 1–18. doi:10.1080/1364436X.2018.1456411.
   Google Scholar
• Underwood, L. G., and J. A. Teresi. 2002. “The Daily Spiritual Experience Scale: Development, Theoretical Description, Reliability, Exploratory Factor Analysis, and Preliminary Construct Validity Using Health-Related Data.” Annals of Behavioral Medicine 24 (1): 22–33. doi:10.1207/S15324796ABM2401_04.
   PubMed Web of Science ®Google Scholar
• Voci, A., G. L. Bosetti, and C. A. Veneziani. 2017. “Measuring Religion as End, Means, and Quest: The Religious Life and Orientation Scale.” TPM - Testing, Psychometrics, Methodology in Applied Psychology 24 (1): 83–98. doi:10.4473/TPM24.1.5.
   Web of Science ®Google Scholar
• Wu, X. W., and D. Lai. 2015. “Comparison of Statistical Methods for Pretest–Posttest Designs in Terms of Type I Error Probability and Statistical Power.” Communications in Statistics - Simulation and Computation 44 (2): 284–294. doi:10.1080/03610918.2013.775295.
   Web of Science ®Google Scholar