Challenges and solutions for N-of-1 design studies in health psychology

References

• Abras, C., Maloney-Krichmar, D., & Preece, J. (2004). User-centered design. In W. Bainbridge (Ed.), Berkshire encyclopedia of human-computer interaction (pp. 763–768). Great Barrington, MA: Berkshire.
   Google Scholar
• Barlow, D. H. D. H., & Hersen, M. (1984). Single case experimental designs; strategies for studying behavior change. Oxford: Pergamon Press.
   Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289–300.
   Web of Science ®Google Scholar
• Bolger, N., & Laurenceau, J. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. New York: Guilford Press.
   Google Scholar
• Bolger, N., Stadler, G., & Laurenceau, J. P. (2012). Power analysis for intensive longitudinal studies. In M. R. Mehl, & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 285–301). New York: Guilford Press.
   Google Scholar
• Borckardt, J. J., Nash, M. R., & Balliet, W. (2011). Statistical analysis of single-case data. In G. J. Madden, T. Hackenberg, & K. A. Lattal (Eds.), APA Handbook of Behavior analysis. Washington, DC: APA.
   Google Scholar
• Brannon, E. E., Cushing, C. C., Walters, R. W., Crick, C., Noser, A. E., & Mullins, L. L. (2018). Goal feedback from whom? A physical activity intervention using an N-of-1 RCT. Psychology & Health, 33(6), 701–712. doi: 10.1080/08870446.2017.1385783
   PubMed Web of Science ®Google Scholar
• Burg, M. M., Schwartz, J. E., Kronish, I. M., Diaz, K. M., Alcantara, C., Duer-Hefele, J., & Davidson, K. W. (2017). Does stress result in you exercising less? Or does exercising result in you being less stressed? Or is it both? Testing the bi-directional stress-exercise association at the group and person (N of 1) level. Annals of Behavioral Medicine, 51(6), 799–809. doi: 10.1007/s12160-017-9902-4
   PubMed Web of Science ®Google Scholar
• Cain, A. E., Depp, C. A., & Jeste, D. V. (2009). Ecological momentary assessment in aging research: A critical review. Journal of Psychiatric Research, 43(11), 987–996. doi: 10.1016/j.jpsychires.2009.01.014
   PubMed Web of Science ®Google Scholar
• Charness, G., Gneezy, U., & Kuhn, M. A. (2012). Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior & Organization, 81(1), 1–8. doi: 10.1016/j.jebo.2011.08.009
   Web of Science ®Google Scholar
• Chen, X., & Chen, P. (2014). A comparison of four methods for the analysis of N-of-1 trials. PLoS ONE, 9(2), e87752.
   PubMed Web of Science ®Google Scholar
• Collins, L. M., Murphy, S. A., & Strecher, V. (2007). The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. American Journal of Preventive Medicine, 32(5), S112–S118. doi: 10.1016/j.amepre.2007.01.022
   PubMed Web of Science ®Google Scholar
• Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: The new medical research council guidance. BMJ, 337, a1655. doi: 10.1136/bmj.a1655
   PubMed Web of Science ®Google Scholar
• Dallery, J., Kurti, A., & Erb, P. (2015). A new frontier: Integrating behavioral and digital technology to promote health behavior. The Behavior Analyst, 38(1), 19–49. doi: 10.1007/s40614-014-0017-y
   PubMed Web of Science ®Google Scholar
• Daughters, S. B., Magidson, J. F., Schuster, R. M., & Safren, S. A. (2010). Act healthy: A combined cognitive-behavioral depression and medication adherence treatment for HIV-infected substance users. Cognitive and Behavioral Practice, 17(3), 309–321. doi: 10.1016/j.cbpra.2009.12.003
   PubMed Web of Science ®Google Scholar
• Davidson, K. W., & Cheung, Y. K. (2017). Envisioning a future for precision health psychology: Innovative applied statistical approaches to N-of-1 studies. Health Psychology Review, 11(3), 292–294. doi: 10.1080/17437199.2017.1347514
   PubMed Web of Science ®Google Scholar
• Davidson, K. W., Peacock, J., Kronish, I. M., & Edmondson, D. (2014). Personalizing behavioral interventions through single-patient (N-of-1) trials. Social and Personality Psychology Compass, 8(8), 408–421. doi: 10.1111/spc3.12121
   PubMedGoogle Scholar
• Deeg, D. J., van Tilburg, T., Smit, J. H., & de Leeuw, E. D. (2002). Attrition in the longitudinal aging study Amsterdam: The effect of differential inclusion in side studies. Journal of Clinical Epidemiology, 55(4), 319–328. doi: 10.1016/S0895-4356(01)00475-9
   PubMed Web of Science ®Google Scholar
• Duan, N., Kravitz, R. L., & Schmid, C. H. (2013). Single-patient (n-of-1) trials: A pragmatic clinical decision methodology for patient-centered comparative effectiveness research. Journal of Clinical Epidemiology, 66(8), S21–S28. doi: 10.1016/j.jclinepi.2013.04.006
   PubMed Web of Science ®Google Scholar
• Dunton, G. F. (2018). Sustaining health-protective behaviors such as physical activity and healthy eating. JAMA, doi: 10.1001/jama.2018.6621
   PubMed Web of Science ®Google Scholar
• Edgington, E. S. (1996). Randomized single-subject experimental designs. Behaviour Research and Therapy, 34(7), 567–574. doi: 10.1016/0005-7967(96)00012-5
   PubMed Web of Science ®Google Scholar
• Elbourne, D. R., Altman, D. G., Higgins, J. P., Curtin, F., Worthington, H. V., & Vail, A. (2002). Meta-analyses involving cross-over trials: Methodological issues. International Journal of Epidemiology, 31(1), 140–149. doi: 10.1093/ije/31.1.140
   PubMed Web of Science ®Google Scholar
• Feng, D., Cong, Z., & Silverstein, M. (2012). Missing data and attrition. In J. T. Newsom, R. N. Jones, & S. M. Hofer (Eds.), Longitudinal data analysis: A practical guide for researchers in aging, health, and social sciences (pp. 71–96). New York: Routledge.
   Google Scholar
• Gabler, N. B., Duan, N., Vohra, S., & Kravitz, R. L. (2011). N-of-1 trials in the medical literature: A systematic review. Medical Care, 49(8), 761–768.
   PubMed Web of Science ®Google Scholar
• Garcia, J. C. (2014). Beyond the numbers: A user-centered design approach for personal reflective healthcare technologies (Doctoral dissertation). Retrieved from https://research.utwente.nl/files/6088735/Thesis-JuanJimenez.pdf.
   Google Scholar
• Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. doi: 10.1146/annurev.psych.58.110405.085530
   PubMed Web of Science ®Google Scholar
• Guyatt, G., Keller, J. L., Jaeschke, R., Rosenbloom, D., Adachi, J. D., & Newhouse, M. T. (1990). The n-of-1 randomized controlled trial: Clinical usefulness. Our three-year experience. Annals of Internal Medicine, 112(4), 293–299. doi: 10.7326/0003-4819-112-4-293
   PubMed Web of Science ®Google Scholar
• Guyatt, G., McGinn, T. G., Wyer, P. C., Naylor, C. D., Stiell, I. G., Richardson, W. S., & for the Evidence-Based Medicine Working Group. (2000). Users’ guides to the medical literature: XXII: How to use articles about clinical decision rules. Evidence-based medicine working group. JAMA, 284(1), 79–84. doi: 10.1001/jama.284.1.79
   PubMed Web of Science ®Google Scholar
• Guyatt, G., Sackett, D., Adachi, J., Roberts, R., Chong, J., Rosenbloom, D., & Keller, J. (1988). A clinician's guide for conducting randomized trials in individual patients. Canadian Medical Association Journal, 139(6), 497.
   Web of Science ®Google Scholar
• Hogarth, R. M. (2005). The challenge of representative design in psychology and economics. Journal of Economic Methodology, 12(2), 253–263. doi: 10.1080/13501780500086172
   Google Scholar
• Honaker, J., & King, G. (2010). What to do about missing values in time-series cross-section data. American Journal of Political Science, 54(2), 561–581. doi: 10.1111/j.1540-5907.2010.00447.x
   Web of Science ®Google Scholar
• Hood, L., & Friend, S. H. (2011). Predictive, personalized, preventive, participatory (P4) cancer medicine. Nature Reviews Clinical Oncology, 8(3), 184–187. doi: 10.1038/nrclinonc.2010.227
   PubMed Web of Science ®Google Scholar
• Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179. doi: 10.1177/001440290507100203
   Web of Science ®Google Scholar
• Horton, N. J., & Kleinman, K. P. (2007). Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. The American Statistician, 61(1), 79–90. doi: 10.1198/000313007X172556
   PubMed Web of Science ®Google Scholar
• Inauen, J., Bolger, N., Shrout, P. E., Stadler, G., Amrein, M., Rackow, P., & Scholz, U. (2017). Using smartphone-based support groups to promote healthy eating in daily life: A randomised trial. Applied Psychology: Health and Well-Being, 9(3), 303–323. doi: 10.1111/aphw.12093
   PubMed Web of Science ®Google Scholar
• Inauen, J., Shrout, P. E., Bolger, N., Stadler, G., & Scholz, U. (2016). Mind the gap? An intensive longitudinal study of between-person and within-person intention-behavior relations. Annals of Behavioral Medicine, 50(4), 516–522. doi: 10.1007/s12160-016-9776-x
   PubMed Web of Science ®Google Scholar
• Janosky, J. (2005). Use of the single subject design for practice based primary care research. Postgraduate Medical Journal, 81(959), 549–551. doi: 10.1136/pgmj.2004.031005
   PubMed Web of Science ®Google Scholar
• Johnston, D. W., & Johnston, M. (2013). Useful theories should apply to individuals. British Journal of Health Psychology, 18(3), 469–473. doi: 10.1111/bjhp.12049
   PubMed Web of Science ®Google Scholar
• Kennedy, C. H. (2005). Single-case designs for educational research. London: Pearson.
   Google Scholar
• Kent, A., & Bush, P. (2018). Co-designing for care: Craft and wearable wellbeing. In R. Lynch, & C. Farrington (Eds.), Quantified lives and vital data: Exploring health and technology through personal medical devices (pp. 251–280). Basingstoke, UK: Palgrave Macmillan.
   Google Scholar
• Kravitz, R., Duan, N., Duan, N., Eslick, I., Gabler, N., Kaplan, H., … Schmid, C. (2014). Design and implementation of N-of-1 trials: A user’s guide. Agency for healthcare research and quality. Rockville, MD: Agency for Healthcare Research and Quality.
   Google Scholar
• Kwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. F. (2015). Data-prompted interviews: Using individual ecological data to stimulate narratives and explore meanings. Health Psychology, 34(12), 1191–1194. doi: 10.1037/hea0000234
   PubMed Web of Science ®Google Scholar
• Kwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. F. (2017). N-of-1 study of weight loss maintenance assessing predictors of physical activity, adherence to weight loss plan and weight change. Psychology & Health, 32(6), 686–708. doi: 10.1080/08870446.2017.1293057
   PubMed Web of Science ®Google Scholar
• Lillie, E. O., Patay, B., Diamant, J., Issell, B., Topol, E. J., & Schork, N. J. (2011). The n-of-1 clinical trial: The ultimate strategy for individualizing medicine? Personalized Medicine, 8(2), 161–173. doi: 10.2217/pme.11.7
   PubMed Web of Science ®Google Scholar
• McDonald, S., Quinn, F., Vieira, R., O’Brien, N., White, M., Johnston, D. W., & Sniehotta, F. F. (2017). The state of the art and future opportunities for using longitudinal n-of-1 methods in health behaviour research: A systematic literature overview. Health Psychology Review, 11(4), 307–323. doi: 10.1080/17437199.2017.1316672
   PubMed Web of Science ®Google Scholar
• Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., … Wood, C. E. (2013). The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine, 46(1), 81–95. doi: 10.1007/s12160-013-9486-6
   PubMed Web of Science ®Google Scholar
• Moeller, J. D., Dattilo, J., & Rusch, F. (2015). Applying quality indicators to single-case research designs used in special education: A systematic review. Psychology in the Schools, 52(2), 139–153. doi: 10.1002/pits.21801
   Web of Science ®Google Scholar
• Munafò, M. R., & Smith, G. D. (2018). Robust research needs many lines of evidence. Nature, 553, 399–401. doi: 10.1038/d41586-018-01023-3
   PubMed Web of Science ®Google Scholar
• Naughton, F., Hopewell, S., Lathia, N., Schalbroeck, R., Brown, C., Mascolo, C., … Sutton, S. (2016). A context-sensing mobile phone app (Q sense) for smoking cessation: A mixed-methods study. JMIR MHealth and UHealth, 4(3), doi: 10.2196/mhealth.5787
   PubMed Web of Science ®Google Scholar
• Naughton, F., & Johnston, D. (2014). A starter kit for undertaking n-of-1 trials. European Health Psychologist, 16(5), 196–205.
   Google Scholar
• Nurmi, J., Knittle, K., Helf, C., Zwickl, P., Palacios, P. L., Tejedor, C. C., … Haukkala, A. (2015). A personalised, sensor-based smart phone intervention for physical activity and Diet–PRECIOUS N-of-1 trial. Frontiers in Public Health, 4(1), 1–1. doi: 10.3389/conf.FPUBH.2016.01.00098
   Google Scholar
• Nyman, S. R., Goodwin, K., Kwasnicka, D., & Callaway, A. (2016). Increasing walking among older people: A test of behaviour change techniques using factorial randomised N-of-1 trials. Psychology & Health, 31(3), 313–330. doi: 10.1080/08870446.2015.1088014
   PubMed Web of Science ®Google Scholar
• Onnela, J.-P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41(7), 1691. doi: 10.1038/npp.2016.7
   PubMed Web of Science ®Google Scholar
• Orlowski, S. K., Lawn, S., Venning, A., Winsall, M., Jones, G. M., Wyld, K., … Smith, D. (2015). Participatory research as one piece of the puzzle: A systematic review of consumer involvement in design of technology-based youth mental health and well-being interventions. JMIR Human Factors, 2(2), doi: 10.2196/humanfactors.4361
   PubMedGoogle Scholar
• Pennebaker, J. W., Francis, M. E., & Booth, R. J. (2001). Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates, 71(2001), 2001.
   Google Scholar
• Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581–592. doi: 10.2307/2335739
   Web of Science ®Google Scholar
• Sackett, D. L. (1997). Evidence-based medicine how to practice and teach EBM. London: Churchill Livingstone.
   Google Scholar
• Sainsbury, K., Walburn, J., Araujo-Soares, V., & Weinman, J. (2017). Challenges and proposed solutions for formative research to inform systematic intervention development in rare and unstudied conditions: The case example of Xeroderma Pigmentosum. British Journal of Health Psychology, 23(2), 229–237. doi: 10.1111/bjhp.12287
   PubMed Web of Science ®Google Scholar
• Schüz, N., Walters, J. A., Frandsen, M., Bower, J., & Ferguson, S. G. (2013). Compliance with an EMA monitoring protocol and its relationship with participant and smoking characteristics. Nicotine & Tobacco Research, 16(Suppl_2), S88–S92. doi: 10.1093/ntr/ntt142
   PubMedGoogle Scholar
• Senn, S. (2002). Cross-over trials in clinical research (Vol. 5). West Sussex: John Wiley & Sons.
   Google Scholar
• Sidman, M. (1960). Tactics of scientific research: Evaluating experimental data in psychology. New York: Basic Books.
   Google Scholar
• Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017). Clarifying the concept of adherence to eHealth technology: Systematic review on when usage becomes adherence. Journal of Medical Internet Research, 19(12), doi: 10.2196/jmir.8578
   PubMed Web of Science ®Google Scholar
• Skinner, A. L., Stone, C. J., Doughty, H., & Munafò, M. R. (2018). Stopwatch: The preliminary evaluation of a smartwatch-based system for passive detection of cigarette smoking. Nicotine & Tobacco Research, 0(0), 1–5. doi: 10.1093/ntr/nty008
   Google Scholar
• Smith, G., Williams, L., O’Donnell, C., & McKechnie, J. (2018). A series of n-of-1 studies examining the interrelationships between social cognitive theory constructs and physical activity behaviour within individuals. Psychology & Health, 1–16. doi: 10.1080/08870446.2018.1500576
   PubMedGoogle Scholar
• Sniehotta, F. F., Presseau, J., Hobbs, N., & Araújo-Soares, V. (2012). Testing self-regulation interventions to increase walking using factorial randomized N-of-1 trials. Health Psychology, 31(6), 733–737. doi: 10.1037/a0027337
   PubMed Web of Science ®Google Scholar
• Stappers, P., & Giaccardi, E. (2017). Research through design. In M. Soegaard & R. Friis-Dam (Eds.), The encyclopedia of human-computer interaction (pp. chapter 43). Aarhus N: The Interaction Design Foundation.
   Google Scholar
• Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment (EMA) in behavorial medicine. Annals of Behavioral Medicine, 16(3), 199–202.
   Google Scholar
• Tate, R., Perdices, M., McDonald, S., Togher, L., & Rosenkoetter, U. (2014). The design, conduct and report of single-case research: Resources to improve the quality of the neurorehabilitation literature. Neuropsychological Rehabilitation, 24(3-4), 315–331. doi: 10.1080/09602010802009201
   PubMed Web of Science ®Google Scholar
• Trull, T. J., & Ebner-Priemer, U. (2014). The role of ambulatory assessment in psychological science. Current Directions in Psychological Science, 23(6), 466–470. doi: 10.1177/0963721414550706
   PubMed Web of Science ®Google Scholar
• Twisk, J., & de Vente, W. (2002). Attrition in longitudinal studies: How to deal with missing data. Journal of Clinical Epidemiology, 55(4), 329–337. doi: 10.1016/S0895-4356(01)00476-0
   PubMed Web of Science ®Google Scholar
• Versluis, A., Verkuil, B., Spinhoven, P., van der Ploeg, M. M., & Brosschot, J. F. (2016). Changing mental health and positive psychological well-being using ecological momentary interventions: A systematic review and meta-analysis. Journal of Medical Internet Research, 18(6), e152. doi: 10.2196/jmir.5642
   PubMed Web of Science ®Google Scholar
• Vieira, R., McDonald, S., Araújo-Soares, V., Sniehotta, F. F., & Henderson, R. (2017). Dynamic modelling of n-of-1 data: Powerful and flexible data analytics applied to individualised studies. Health Psychology Review, 11(3), 222–234. doi: 10.1080/17437199.2017.1343680
   PubMed Web of Science ®Google Scholar
• Wen, C. K. F., Schneider, S., Stone, A. A., & Spruijt-Metz, D. (2017). Compliance with mobile ecological momentary assessment protocols in children and adolescents: A systematic review and meta-analysis. Journal of Medical Internet Research, 19(4), doi: 10.2196/jmir.6641
   Google Scholar
• Yaffee, R. (2012). An Introduction to Forecasting time series with Stata. New York: Taylor & Francis.
   Google Scholar
• Yoon, S., Schwartz, J. E., Burg, M. M., Kronish, I. M., Alcantara, C., Julian, J., … Diaz, K. M. (2018). Using behavioral analytics to increase exercise: A randomized N-of-1 study. American Journal of Preventive Medicine, 54(4), 559–567. doi: 10.1016/j.amepre.2017.12.011
   PubMed Web of Science ®Google Scholar