Rural longitudinal integrated clerkships and medical workforce outcomes: A scoping review

Figures & data

Table 1. Inclusion and exclusion criteria.

Inclusion	Exclusion
Peer-reviewed articles published in English from any country	Peer-reviewed articles not published in English and non-peer-review articles
Any publication date
Location of LIC programme rural	Location of LIC programme metropolitan
LIC programme duration 6 months of longer	LIC programme duration less than 6 months
LIC programme for medical students	LIC programme for other health disciplines
Studies of any design	Study not reporting LIC graduates separately
LIC programmes to meet the typology of the CLIC	Study on rural workforce intentions
LIC programme was in medical school	LIC programme was post-medical school

Figure 1. PRISMA Flow diagram.

Table 2. Demographic description of studies.

Publication year	Categories	Number of articles	studies
	1980–1999	2 (8%)	Verby (1988) Verby et al. (1991)
	2000–2009	3 (12%)	Halaas et al. (2008) Stagg et al. (2009) Worley et al. (2008)
	2010–2019	13 (52%)	Bentley et al. (2019) Campbell et al. (2019) Hogenbirk et al. (2016) Kitchener et al. (2015) Myhre et al. (2016) Playford and Cheonget (2012) Playford et al. (2014) Playford et al. (2015) Playford et al. (2016) Playford and Puddey (2017) Playford et al. (2019) Strasser et al. (2013) Zink et al. (2010)
	2020–2021	7 (28%)	Bennet et al. (2021) Butler et al. (2021) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Kitchener (2021) Playford et al. (2021) Walker et al. (2021) Woolley et al. (2020)
Article type
	Observational or retrospective cohort study	21 (84%)	Bennett et al. (2021) Bentley et al. (2019) Butler et al. (2021) Campbell et al. (2019) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Halaas et al. (2008) Hogenbirk et al. (2016) Kitchener et al. (2015) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford et al. (2016) Playford and Puddey (2017) Playford et al. (2019) Playford et al. (2021) Stagg et al. (2009) Strasser et al. (2013) Woolley et al. (2020) Walker et al. (2021) Worley et al. (2008) Zink et al. (2010)
	Matched cohort study	1 (4%)	Myhre et al. (2016)
	Case Study	3 (12%)	Verby (1988) Kitchener (2021) Verby et al. (1991)
Data collection methods
	Graduate surveys	9 (36%)	Bentley et al. (2019) Halaas et al. (2008) Hogenbirk et al. (2016) Playford et al. (2016) Playford et al. (2021) Stagg et al. (2009) Strasser et al. (2013) Worley et al. (2008) Zink et al. (2010)
	Data linkage (University database and database with workforce locations/speciality)	14 (56%)	Bennet et al. (2021) Butler et al. (2021) Campbell et al. (2019) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Kitchener et al. (2015) Kitchener (2021) Myhre et al. (2016) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford and Puddey (2017) Playford et al. (2019) Walker et al. (2021) Woolley et al. (2020)
	Unclear	2 (8%)	Verby (1988) Verby et al. (1991)
Country of origin
	Australia	15 (60%)	Bentley et al. (2019) Campbell et al. (2019) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Kitchener et al. (2015) Kitchener (2021) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford et al. (2016) Playford and Puddey (2017) Playford et al. (2019) Playford et al. (2021) Stagg et al. (2009) Walker et al. (2021) Worley et al. (2008)
	Canada	4 (16%)	Hogenbirk et al. (2016) Myhre et al. (2016) Strasser et al. (2013) Woolley et al. (2020)
	United States of America	6 (24%)	Bennet et al. (2021) Butler et al. (2021) Halaas et al. (2008) Verby (1988) Verby et al. (1991) Zink et al. (2010)
LIC duration
	>1 year	2 (8%)	Kitchener et al. (2015) Kitchener (2021)
	1 year	17 (68%)	Bentley et al. (2019) Campbell et al. (2019) Hogenbirk et al. (2016) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Myhre et al. (2016) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford et al. (2016) Playford and Puddey (2017) Playford et al. (2019) Playford et al. (2021) Stagg et al. (2009) Strasser et al. (2013) Walker et al. (2021) Woolley et al. (2020) Worley et al. (2008)
	6 months to <1 year	6 (24%)	Bennett et al. (2021) Butler et al. (2021) Halaas et al. (2008) Verby (1988) Verby et al. (1991) Zink et al. (2010)
Course type
	Postgraduate	17 (68%)	Bennett et al. (2021) Bentley et al. (2019) Butler et al. (2021) Fuller, Beattie, et al. (2021; Fuller, Lawson, et al. (2021) Halaas et al. (2008) Hogenbirk et al. (2016) Kitchener et al. (2015) Kitchener (2021) Myhre et al. (2016) Stagg et al. (2009) Strasser et al. (2013) Verby (1988) Verby et al. (1991) Walker et al. (2021) Woolley et al. (2020) Worley et al. (2008) Zink et al. (2010)
	Both undergraduate and postgraduate	8 (32%)	Campbell et al. (2019) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford and Puddey (2017) Playford et al. (2016) Playford et al. (2019) Playford et al. (2021)
Outcome measure
	Geographic work location only	11 (44%)	Campbell et al. (2019) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Kitchener et al. (2015) Kitchener (2021) Myhre et al. (2016) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford et al. (2016) Playford et al. (2019) Playford et al. (2021)
	Geographic work location and specialty	14 (56%)	Bennett et al. (2021) Bentley et al. (2019) Butler et al. (2021) Halaas et al. (2008) Hogenbirk et al. (2016) Playford et al. (2016) Stagg et al. (2009) Strasser et al. (2013) Verby (1988) Verby et al. (1991) Walker et al. (2021) Worley et al. (2008) Woolley et al. (2020) Zink et al. (2010)
Participant groups
	LIC graduates only	8 (32%)	Bennett et al. (2021) Bentley et al. (2019) Kitchener (2021) Playford et al. (2016) Stagg et al. (2009) Strasser et al. (2013) Verby (1988) Woolley et al. (2020)
	LIC graduates compared to other clinical training pathways within the same university (during medical degree)	15 (60%)	Butler et al. (2021) Campbell et al. (2019) Fuller, Beattie, et al. (2021); Fuller, Lawson, et al. (2021) Kitchener et al. (2015) Myhre et al. (2016) Playford and Cheong (2012) Playford et al. (2014) Playford et al. (2015) Playford and Puddey (2017) Playford et al. (2019) Playford et al. (2021) Verby et al. (1991) Walker et al. (2021) Worley et al. (2008) Zink et al. (2010)
	LIC graduates compared by the university they had undertaken their vocational/specialist training	1 (4%)	Hogenbirk et al. (2016)
	LIC graduates compared to graduates at the same university and to national trends	1 (4%)	Halaas et al. (2008)

Verby JE. 1988. The Minnesota Rural Physician Associate Program for medical students. J Med Educ. 63(6):427–437. doi: 10.1097/00001888-198806000-00001.

 PubMedGoogle Scholar

Verby JE, Newell JP, Andresen SA, Swentko WM. 1991. Changing the medical school curriculum to improve patient access to primary care. Jama. 266(1):110–113. doi: 10.1001/jama.1991.03470010114041.

 PubMed Web of Science ®Google Scholar

Halaas GW, Zink T, Finstad D, Bolin K, Center B. 2008. Recruitment and retention of rural physicians: outcomes from the rural physician associate program of Minnesota. J Rural Health. 24(4):345–352. doi: 10.1111/j.1748-0361.2008.00180.x.

 PubMed Web of Science ®Google Scholar

Stagg P, Greenhill J, Worley PS. 2009. A new model to understand the career choice and practice location decisions of medical graduates. Rural Remote Health. 9(4):1245.

 PubMed Web of Science ®Google Scholar

Worley P, Martin A, Prideaux D, Woodman R, Worley E, Lowe M. 2008. Vocational career paths of graduate entry medical students at Flinders University: a comparison of rural, remote and tertiary tracks. Med J Aust. 188(3):177–178. doi: 10.5694/j.1326-5377.2008.tb01567.x.

 PubMed Web of Science ®Google Scholar

Bentley M, Dummond N, Isaac V, Hodge H, Walters L. 2019. Doctors’ rural practice self-efficacy is associated with current and intended small rural locations of practice. Aust J Rural Health. 27(2):146–152. doi: 10.1111/ajr.12486.

 PubMed Web of Science ®Google Scholar

Campbell DG, McGrail MR, O’Sullivan B, Russell DJ. 2019. Outcomes of a 1-year longitudinal integrated medical clerkship in small rural Victorian communities. Rural Remote Health. 19(2):4987. doi: 10.22605/RRH4987.

 PubMed Web of Science ®Google Scholar

Hogenbirk JC, Timony PE, French MG, Strasser R, Pong RW, Cervin C, Graves L. 2016. Milestones on the social accountability journey: family medicine practice locations of Northern Ontario School of Medicine graduates. Can Fam Physician. 62(3):e138–145.

 Web of Science ®Google Scholar

Kitchener S, Day R, Faux D, Hughes M, Koppen B, Manahan D, Lennox D, Harrison C, Broadley SA. 2015. Longlook: initial outcomes of a longitudinal integrated rural clinical placement program. Aust J Rural Health. 23(3):169–175. doi: 10.1111/ajr.12164.

 PubMed Web of Science ®Google Scholar

Myhre DL, Bajaj S, Woloschuk W. 2016. Practice locations of longitudinal integrated clerkship graduates: a matched-cohort study. Can J Rural Med. 21(1):13–16.

 PubMed Web of Science ®Google Scholar

Playford DE, Cheong E. 2012. Rural undergraduate support and coordination, rural clinical school, and rural Australian medical undergraduate scholarship: rural undergraduate initiatives and subsequent rural medical workforce. Aust Health Rev. 36(3):301–307. doi: 10.1071/AH11072.

 PubMed Web of Science ®Google Scholar

Playford DE, Evans SF, Atkinson DN, Auret KA, Riley GJ. 2014. Impact of the Rural Clinical School of Western Australia on work location of medical graduates. Med J Aust. 200(2):104–107. doi: 10.5694/mja13.11082.

 PubMed Web of Science ®Google Scholar

Playford DE, Nicholson A, Riley GJ, Puddey IB. 2015. Longitudinal rural clerkships: increased likelihood of more remote rural medical practice following graduation. BMC Med Educ. 15(1):55. doi: 10.1186/s12909-015-0332-3.

 PubMedGoogle Scholar

Playford DE, Ng WQ, Burkitt T. 2016. Creation of a mobile rural workforce following undergraduate longitudinal rural immersion. Med Teach. 38(5):498–503. doi: 10.3109/0142159X.2015.1060304.

 PubMed Web of Science ®Google Scholar

Playford D, Puddey IB. 2017. Interest in rural clinical school is not enough: participation is necessary to predict an ultimate rural practice location. Aust J Rural Health. 25(4):210–218. doi: 10.1111/ajr.12324.

 PubMed Web of Science ®Google Scholar

Playford D, Ngo H, Atkinson D, Puddey IB. 2019. Graduate doctors’ rural work increases over time. Med Teach. 41(9):1073–1080. doi: 10.1080/0142159X.2019.1621278.

 PubMed Web of Science ®Google Scholar

Strasser R, Hogenbirk JC, Minore B, Marsh DC, Berry S, McCready WG, Graves L. 2013. Transforming health professional education through social accountability: Canada’s Northern Ontario School of Medicine. Med Teach. 35(6):490–496. doi: 10.3109/0142159X.2013.774334.

 PubMed Web of Science ®Google Scholar

Zink T, Center B, Finstad D, Boulger JG, Repesh LA, Westra R, Christensen R, Brooks KD. 2010. Efforts to graduate more primary care physicians and physicians who will practice in rural areas: examining outcomes from the university of Minnesota-Duluth and the rural physician associate program. Acad Med. 85(4):599–604. doi: 10.1097/ACM.0b013e3181d2b537.

 PubMed Web of Science ®Google Scholar

Bennett JMK, Raymond C, Kirb y C, Paula MT. 2021. Independent-academic vs. university-based surgical residency. Does rural medical training impact residency match? JRMC. doi: 10.24926/jrmc.v4i3.3621.

 Google Scholar

Butler L, Rosenberg ME, Miller-Chang YM, Gauer JL, Melcher E, Olson APJ, Clark K. 2021. Impact of the rural physician associate program on workforce outcomes. Fam Med. 53(10):864–870. doi: 10.22454/FamMed.2021.563022.

 PubMed Web of Science ®Google Scholar

Fuller L, Beattie J, Versace V. 2021. Graduate rural work outcomes of the first 8 years of a medical school: what can we learn about student selection and clinical school training pathways? Aust J Rural Health. 29(2):181–190. doi: 10.1111/ajr.12742.

 PubMed Web of Science ®Google Scholar

Fuller L, Lawson M, Beattie J. 2021. The impact of clerkship model and clinical setting on medical student’s participation in the clinical workplace: a comparison of rural LIC and rural block rotation experience. Med Teach. 43(3):307–313. doi: 10.1080/0142159X.2020.1839032.

 PubMed Web of Science ®Google Scholar

Kitchener S. 2021. Local and regional workforce return on investment from sponsoring rural generalist-based training for medical students. Aust Health Rev. 45(2):230–234. doi: 10.1071/AH19090.

 PubMed Web of Science ®Google Scholar

Playford D, Ngo H, Puddey I. 2021. Intention mutability and translation of rural intention into actual rural medical practice. Med Educ. 55(4):496–504. doi: 10.1111/medu.14404.

 PubMed Web of Science ®Google Scholar

Walker L, Isaac V, Walters L, Craig J. 2021. Flinders University rural medical school student program outcomes. Aust J Gen Pract. 50(5):319–321. doi: 10.31128/AJGP-06-20-5492.

 PubMed Web of Science ®Google Scholar

Woolley T, Hogenbirk JC, Strasser R. 2020. Retaining graduates of non-metropolitan medical schools for practice in the local area: the importance of locally based postgraduate training pathways in Australia and Canada. Rural Remote Health. 20(3):5835.

 PubMed Web of Science ®Google Scholar