Recruitment and retention in mobile application-based intervention studies: a critical synopsis of challenges and opportunities

References

• Zhou X, Snoswell CL, Harding LE, Bambling M, Edirippulige S, Bai X, Smith AC. The role of telehealth in reducing the mental health burden from covid-19. Telemed e-Health. 2020;26(4):377–79. doi:10.1089/tmj.2020.0068.
   PubMed Web of Science ®Google Scholar
• Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mhealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res. 2015;17(2):e52. doi:10.2196/jmir.3951.
   PubMedGoogle Scholar
• Al‐Shamsi HO, Alhazzani W, Alhuraiji A, Coomes EA, Chemaly RF, Almuhanna M, Wolff RA, Ibrahim NK, Chua MLK, Hotte SJ, et al. A practical approach to the management of cancer patients during the novel coronavirus disease 2019 (covid‐19) pandemic: an international collaborative group. The Oncologist. 2020;25(6):e936–e945. doi:10.1634/theoncologist.2020-0213.
   PubMed Web of Science ®Google Scholar
• Rathbone AL, Prescott J. The use of mobile apps and sms messaging as physical and mental health interventions: systematic review. J Med Internet Res. 2017;19(8):e295. doi:10.2196/jmir.7740.
   PubMed Web of Science ®Google Scholar
• Lee M, Lee H, Kim Y, Kim J, Cho M, Jang J, Jang H. Mobile app-based health promotion programs: a systematic review of the literature. Int J Environ Res Public Health. 2019;15(12):2838. doi:10.3390/ijerph15122838.
   Web of Science ®Google Scholar
• Mccabe C, Mccann M, Brady AM. Computer and mobile technology interventions for self-management in chronic obstructive pulmonary disease. Cochrane Database Systematic Rev. 2017; doi:10.1002/14651858.CD011425.pub2.
   Web of Science ®Google Scholar
• The evolution of smartphones during a global pandemic. 2020. [accessed National Initiative for Cybersecurity Careers and Studies]. niccs.cisa.gov/about-niccs/featured-stories/evolution-smartphones-during-global-pandemic.
   Google Scholar
• Wang Y, Xue H, Huang Y, Huang L, Zhang D. A systematic review of application and effectiveness of mhealth interventions for obesity and diabetes treatment and self-management. Adv Nutr. 2017;8(3):449–62. doi:10.3945/an.116.014100.
   PubMed Web of Science ®Google Scholar
• Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mhealth? A systematic review of economic evaluations of mhealth solutions. PLOS ONE. 2017;12(2):e0170581. doi:10.1371/journal.pone.0170581.
   PubMed Web of Science ®Google Scholar
• Gandapur Y, Kianoush S, Kelli HM, Misra S, Urrea B, Blaha MJ, Graham G, Marvel FA, Martin SS. The role of mhealth for improving medication adherence in patients with cardiovascular disease: a systematic review. Eur Heart J. 2016;2(4):237–44. doi:10.1093/ehjqcco/qcw018.
   Google Scholar
• Akeel AU, Mundy D. Re-thinking technology and its growing role in enabling patient empowerment. Health Inf J. 2019;25(4):1278–89. doi:10.1177/1460458217751013.
   PubMed Web of Science ®Google Scholar
• Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mhealth apps: a systematic literature review. J Med Syst. 2015;39(2). doi:10.1007/s10916-014-0182-2.
   PubMed Web of Science ®Google Scholar
• Bergin AD, Vallejos EP, Davies EB, Daley D, Ford T, Harold G, Hetrick S, Kidner M, Long Y, Merry S, et al. Preventive digital mental health interventions for children and young people: a review of the design and reporting of research. Npj Digital Med. 2020;3(1). doi:10.1038/s41746-020-00339-7.
   PubMed Web of Science ®Google Scholar
• Galileo vs. The web. Online Library Learning Center. [accessed 2021 Jan 25]. https://www.usg.edu/galileo/skills/unit07/internet07_09.phtml.
   Google Scholar
• Quinn CC, Shardell MD, Terrin ML, Barr EA, Ballew SH, Gruber-Baldini AL. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care. 2011;34(9):1934–42. doi:10.2337/dc11-0366.
   PubMed Web of Science ®Google Scholar
• Cafazzo JA, Casselman M, Hamming N, Katzman DK, Palmert MR. Design of an mhealth app for the self-management of adolescent type 1 diabetes: a pilot study. J Med Internet Res. 2012;14(3):e70. doi:10.2196/jmir.2058.
   PubMed Web of Science ®Google Scholar
• Montoya JL, Jankowski CM, O’Brien KK, Webel AR, Oursler KK, Henry BL, Moore DJ, Erlandson KM. Evidence-informed practical recommendations for increasing physical activity among persons living with hiv. Aids. 2019;33(6):931–39. doi:10.1097/QAD.0000000000002137.
   PubMed Web of Science ®Google Scholar
• Monney G, Penzenstadler L, Dupraz O, Etter J, Khazaal Y. Mhealth app for cannabis users: satisfaction and perceived usefulness. Front Psychiatry. 2015;6. doi:10.3389/fpsyt.2015.00120.
   Web of Science ®Google Scholar
• Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR mHealth uHealth. 2016;4(3):e111. doi:10.2196/mhealth.5960.
   PubMed Web of Science ®Google Scholar
• Chung A, Skinner A, Hasty S, Perrin E. Tweeting to health. Clin Pediatr (Phila). 2016;56:26–32. doi:10.1177/0009922816653385.
   PubMed Web of Science ®Google Scholar
• Walsh JC, Corbett T, Hogan M, Duggan J, Mcnamara A. An mhealth intervention using a smartphone app to increase walking behavior in young adults: a pilot study. JMIR mHealth uHealth. 2016;4(3):e109. doi:10.2196/mhealth.5227.
   PubMed Web of Science ®Google Scholar
• Povey J, Ppjr M, Dingwall KM, Lowell A, Singer J, Rotumah D, Bennett-Levy J, Nagel T. Acceptability of mental health apps for aboriginal and torres strait islander Australians: a qualitative study. J Med Internet Res. 2016;18(3):e65. doi:10.2196/jmir.5314.
   PubMed Web of Science ®Google Scholar
• Garety PA, Ward T, Freeman D, Fowler D, Emsley R, Dunn G, Kuipers E, Bebbington P, Waller H, Greenwood K, et al. Slowmo, a digital therapy targeting reasoning in paranoia, versus treatment as usual in the treatment of people who fear harm from others: study protocol for a randomised controlled trial. Trials. 2017;18(1). doi:10.1186/s13063-017-2242-7.
   Google Scholar
• Boisseau C, Schwartzman C, Lawton J, Mancebo M. App-guided exposure and response prevention for obsessive compulsive disorder: an open pilot trial. Cogn Behav Ther. 2017;46:447–58. doi:10.1080/16506073.2017.1321683.
   PubMed Web of Science ®Google Scholar
• Gregory J, Sukhera J, Taylor-Gates M. Integrating smartphone technology at the time of discharge from a child and adolescent inpatient psychiatry unit. J Can Acad Child Adolesc Psychiatry. 2017;26:45–50.
   PubMed Web of Science ®Google Scholar
• Hardy A, Wojdecka A, West J, Matthews E, Golby C, Ward T, Lopez ND, Freeman D, Waller H, Kuipers E, et al. How inclusive, user-centered design research can improve psychological therapies for psychosis: development of slowmo. JMIR Mental Health. 2018;5(4):e11222. doi:10.2196/11222.
   PubMed Web of Science ®Google Scholar
• Lee RA, Jung ME. Evaluation of an mhealth app (destressify) on university students’ mental health: pilot trial. JMIR Mental Health. 2018;5(1):e2. doi:10.2196/mental.8324.
   PubMed Web of Science ®Google Scholar
• Selter A, Tsangouri C, Ali SB, Freed D, Vatchinsky A, Kizer J, Sahuguet A, Vojta D, Vad V, Pollak J, et al. An mhealth app for self-management of chronic lower back pain (limbr): pilot study. JMIR mHealth uHealth. 2018;6(9):e179. doi:10.2196/mhealth.8256.
   PubMed Web of Science ®Google Scholar
• Moberg C, Niles A, Beermann D. Guided self-help works: randomized waitlist controlled trial of pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J Med Internet Res. 2019;21(6):e12556. doi:10.2196/12556.
   PubMed Web of Science ®Google Scholar
• Economides M, Ranta K, Nazander A, Hilgert O, Goldin PR, Raevuori A, Forman-Hoffman V. Long-term outcomes of a therapist-supported, smartphone-based intervention for elevated symptoms of depression and anxiety: quasiexperimental, pre-postintervention study. JMIR mHealth uHealth. 2019;7(8):e14284. doi:10.2196/14284.
   PubMed Web of Science ®Google Scholar
• Ramos RM, Cheng PGF, Jonas SM. Validation of an mhealth app for depression screening and monitoring (psychologist in a pocket): correlational study and concurrence analysis. JMIR mHealth uHealth. 2019;7(9):e12051. doi:10.2196/12051.
   PubMed Web of Science ®Google Scholar
• Whelan ME, Velardo C, Rutter H, Tarassenko L, Farmer AJ. Mood monitoring over one year for people with chronic obstructive pulmonary disease using a mobile health system: retrospective analysis of a randomized controlled trial. JMIR mHealth uHealth. 2019;7(11):e14946. doi:10.2196/14946.
   PubMed Web of Science ®Google Scholar
• Huberty J, Green J, Glissmann C, Larkey L, Puzia M, Lee C. Efficacy of the mindfulness meditation mobile app “calm” to reduce stress among college students: randomized controlled trial. JMIR mHealth uHealth. 2019;7(6):e14273. doi:10.2196/14273.
   PubMed Web of Science ®Google Scholar
• Simblett S, Matcham F, Siddi S, Bulgari V, Barattieri Di San Pietro C, Hortas López J, Ferrão J, Polhemus A, Haro JM, De Girolamo G, et al. Barriers to and facilitators of engagement with mhealth technology for remote measurement and management of depression: qualitative analysis. JMIR mHealth uHealth. 2019;7(1):e11325. doi:10.2196/11325.
   PubMed Web of Science ®Google Scholar
• Guo Y, Hong YA, Cai W, Li L, Hao Y, Qiao J, Xu Z, Zhang H, Zeng C, Liu C, et al. Effect of a wechat-based intervention (run4love) on depressive symptoms among people living with HIV in China: a randomized controlled trial. J Med Internet Res. 2020;22(2):e16715. doi:10.2196/16715.
   PubMed Web of Science ®Google Scholar
• Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N. Effectiveness of ehealth interventions for reducing mental health conditions in employees: a systematic review and meta-analysis. PLOS ONE. 2017;12(12):e0189904. doi:10.1371/journal.pone.0189904.
   PubMed Web of Science ®Google Scholar
• Helweg-Jørgensen S, Beck Lichtenstein M, Fruzzetti A, Møller Dahl C, Pedersen S. Daily self-monitoring of symptoms and skills learning in patients with borderline personality disorder through a mobile phone app: protocol for a pragmatic randomized controlled trial. JMIR Res Protoc. 2020;9(e17737):e17737. doi:10.2196/17737.
   PubMedGoogle Scholar
• Statista. Number of apps from the apple app store 2019. 2019.
   Google Scholar
• Google play store: number of apps 2019. Statista. 2019. www.statista.com/statistics/266210/number-of-available-applications-in-the-google-play-store/.
   Google Scholar
• Mhealth apps market size, share, trends. 2019.
   Google Scholar
• Milliard M. Tsunami of growth,’ says frost & sullivan. HIMSS Media: Healthcare IT News; 2020.
   Google Scholar
• Faber J, Fonseca LM. How sample size influences research outcomes. Dental Press J Orthod. 2014;19(4):27–29. doi:10.1590/2176-9451.19.4.027-029.ebo.
   PubMedGoogle Scholar
• Ogie RI. Adopting incentive mechanisms for large-scale participation in mobile crowdsensing: from literature review to a conceptual framework. Human-centric Comput Inf Sci. 2016;6(1). doi:10.1186/s13673-016-0080-3.
   Google Scholar
• Benjumea J, Ropero J, Rivera-Romero O, Dorronzoro-Zubiete E, Carrasco A. Assessment of the fairness of privacy policies of mobile health apps: scale development and evaluation in cancer apps. JMIR mHealth uHealth. 2020;8(7):e17134. doi:10.2196/17134.
   PubMed Web of Science ®Google Scholar
• Brower J, Labarge MC, White L, Mitchell MS. Examining responsiveness to an incentive-based mobile health app: longitudinal observational study. J Med Internet Res. 2020;22:e16797.
   PubMed Web of Science ®Google Scholar
• Statista. Retention rate of day 1 and day 30 of mobile app installs worldwide as of August 2020, by category. 2020.
   Google Scholar
• Al-Garadi MA, Yang YC, Lakamana S, Lin J, Li S, Xie A, Hogg-Bremmer W, Torres M, Banerjee I, Sarker A. Automatic Breast Cancer Cohort Detection from Social Media for Studying Factors Affecting Patient-Centered Outcomes. In: Michalowski, M., Moskovitch, R. (eds) Artificial Intelligence in Medicine. AIME 2020. Lecture Notes in Computer Science. Artif Intell Med. 2022;12299. Springer, Cham. https://doi.org/10.1007/978-3-030-59137-3_10
   Google Scholar
• Khatri C, Chapman SJ, Glasbey J, Kelly M, Nepogodiev D, Bhangu A, Fitzgerald JE. Social media and internet driven study recruitment: evaluating a new model for promoting collaborator engagement and participation. PLOS ONE. 2015;10(3):e0118899. doi:10.1371/journal.pone.0118899.
   PubMed Web of Science ®Google Scholar
• Whitaker C, Stevelink S, Fear N. The use of Facebook in recruiting participants for health research purposes: a systematic review. J Med Internet Res. 2017;19(8):e290. doi:10.2196/jmir.7071.
   PubMed Web of Science ®Google Scholar
• Wasilewski MB, Stinson JN, Webster F, Cameron JI. Using twitter to recruit participants for health research: an example from a caregiving study. Health Informatics J. 2019;25(4):1485–97. doi:10.1177/1460458218775158.
   PubMed Web of Science ®Google Scholar
• Shatz I. Fast, free, and targeted. Soc Sci Comput Rev. 2016;35:537–49. doi:10.1177/0894439316650163.
   Web of Science ®Google Scholar
• Pew Research Center. Social media use in 2021. 2021
   Google Scholar
• Pew Research Center. Social media usage. 2015;2005–15.
   Google Scholar