Development and validation of the ExPRESS instrument for primary health care providers’ evaluation of external supervision

References

• All-Party Parliamentary Group on Global Health, Africa All-Party Parliamentary Group. All the talents [Internet]. 2012. Available from: www.appg-globalhealth.org.uk
   Google Scholar
• Moosa S, Wojczewski S, Hoffmann K, et al. The inverse primary care law in sub-Saharan Africa. Britiish J Gen Pract. 2014 June;64(623);321–15.
   Web of Science ®Google Scholar
• De Cordova MIP, Mier N, Quirarte NHG, et al. Role and working conditions of nurses in public health in Mexico and Peru: a binational qualitative study. J Nurs Manag. 2013;21:1034–1043.
   Web of Science ®Google Scholar
• Cubaka VK, Schriver M, Flinkenflögel M, et al. The evolving role of physicians - don’t forget the generalist primary care providers. Int J Heal Policy Manag. 2016;5:605–606.
   Web of Science ®Google Scholar
• Kilminster SM, Jolly BC. Effective supervision in clinical practice settings: a literature review. Med Educ. 2000;34:827–840.
   PubMed Web of Science ®Google Scholar
• Bosch-Capblanch X, Liaqat S, Garner P. Managerial supervision to improve primary health care in low- and middle-income countries. Cochrane Database Syst Rev. 2011 September;(9):CD006413.
   Web of Science ®Google Scholar
• Bosch-Capblanch X, Garner P. Primary health care supervision in developing countries. Trop Med Int Heal. 2008 Mar;13:369–383.
   PubMed Web of Science ®Google Scholar
• Bailey C, Blake C, Schriver M, et al. A systematic review of supportive supervision as a strategy to improve primary healthcare services in Sub-Saharan Africa. Int J Gynecol Obstet. 2016 Nov;132:117–125.
   PubMed Web of Science ®Google Scholar
• Vasan A, Mabey DC, Chaudhri S, et al. Support and performance improvement for primary health care workers in low- and middle-income countries: a scoping review of intervention design and methods. Health Policy Plan. 2017;32:437–452.
   Web of Science ®Google Scholar
• The United Republic of Tanzania Ministry of Health and Social Welfare. A manual for comprehensive supportive supervision and mentoring on HIV and AIDS health services [Internet]. 2014. Available from: www.nacp.go.tz/site/download/Manual_CSSM_2nd_Edition_2014.pdf
   Google Scholar
• Government of Uganda Ministry of Health. Health Sector Strategic Plan III 2010/11-2014/15 [Internet]. 2010. Available from: http://www.docucu-archive.com/view/3fd03570993e100299701841c04adae9/Health-Sector-Strategic-Plan-III-2010/11-2014/15.pdf
   Google Scholar
• Federal Democratic Republic of Ethiopea Ministry of Health. Health Sector Development Programme IV 2010/11-2014/15 [Internet]. 2010. Available from: https://phe-ethiopia.org/admin/uploads/attachment-721-HSDPIVFinalDraft11Octoberr2010.pdf
   Google Scholar
• Marquez L, Kean L. Making supervision supportive and sustainable: new approaches to old problems. Washington (DC): Maximizing Access Qual Initiat USAID; 2002. MAQ Paper.
   Google Scholar
• Schriver M, Cubaka VK, Itangishaka S, et al. Perceptions on evaluative and formative functions of external supervision of Rwandan primary healthcare facilities. A qualitative study. PLoS One. 2018;13(2).
   Web of Science ®Google Scholar
• John Clements C, Streefland PH, Malau C, et al. Supervision in primary health care-can it be carried out effectively in developing countries? Curr Drug Saf. 2007;2:19–23.
   Google Scholar
• Wheeler S, Barkham M. A core evaluation battery for supervision. In: Watkins CE Jr, Milne DL, editors. The Wiley international handbook of clinical supervision. Chichester:John Wiley & Sons; 2014. p. 367–385.
   Google Scholar
• Vonk ME, Thyer BA. Evaluating the quality of supervision: A review of instruments for use in field instruction. Clin Superv. 1997;15:103–113.
   Google Scholar
• Fluit CRMG, Bolhuis S, Grol R, et al. Assessing the quality of clinical teachers: a systematic review of content and quality of questionnaires for assessing clinical teachers. J Gen Intern Med. 2010;25:1337–1345.
   PubMed Web of Science ®Google Scholar
• Schriver M, Cubaka VK, Nyirazinyoye L, et al. The relationship between primary healthcare providers and their external supervisors in Rwanda. African J Prim Heal Care Fam Med. 2017;9:1.
   Web of Science ®Google Scholar
• Hegarty WH. Using subordinate ratings to elicit behavioral changes in supervisors. J Appl Psychol. 1974;59:764–766.
   Web of Science ®Google Scholar
• Coltman T, Devinney TM, Midgley DF, et al. Formative versus reflective measurement models: two applications of formative measurement. J Bus Res Elsevier Inc. 2008;61:1250–1262.
   Web of Science ®Google Scholar
• Proctor B. Supervision: a co-operative excercise in accountability. In: Marken M, Payne M, editors. Enabling & ensuring supervision in practice. Leicester: National Youth Bureau; 1987. p. 21–34.
   Google Scholar
• Rohde J. Supportive supervision to improve integrated primary health care. Manag Sci Heal Occas Pap. 2006;2:1–44.
   Google Scholar
• WHO, The Department of Immunization V and B. Module 4: supportive supervision [Internet]. Training for mid-level managers series. Geneva: WHO Document Production Services; 2008. Available from: www.who.int/vaccines-documents/
   Google Scholar
• EngenderHealth. Facilitative supervision handbook [Internet]. Engender Health’s Quality Improvement Series. New York; 2001. Available from: https://www.engenderhealth.org/pubs/quality/facilitative-supervision-handbook.php
   Google Scholar
• EngenderHealth, USAID. Facilitative supervision for quality improvement: participant handbook [Internet]. The ACQUIRE Project, editor. 2008. Available from: http://www.acquireproject.org/fileadmin/user_upload/ACQUIRE/Facilitative-Supervision/Participants-Handbook/FS_PartHandbk_main_text.pdf
   Google Scholar
• Bhana R, The Health Systems Trust SA. Supportive supervision system for district health management teams : a guide to primary health care supervison [Internet]. 2010. Available from: www.hst.org.za
   Google Scholar
• Management and Leadership Program. Supervision guidelines [Internet]. Available from: https://www.k4health.org/sites/default/files/SupervisionGuidelines_MSH.pdf
   Google Scholar
• Children’s Vaccine Program at PATH. Guidelines for Implementing Supportive Supervision: A step-by-step guide with tools to support immunization [Internet]. Seattle:PATH; 2003. Available from: http://www.path.org/vaccineresources/files/Guidelines_for_Supportive_Supervision.pdf
   Google Scholar
• Benavente J, Madden C, editors. Improving supervision: a team approach. The family planning manager: management strategies for improving family planning service delivery. 1993. p. 1–17. Available from: http://www.wahooas.org/mshdvd2/pdf_managers_Eng/HRM_HCD/Imp_Sup_2_5_Eng_issue.pdf
   Google Scholar
• Tavrow P, Kim Y-M, Malianga L. Measuring the quality of supervisor-provider interactions in health care facilities in Zimbabwe. Int J Qual Heal Care. 2002 Dec;14:57–66.
   Web of Science ®Google Scholar
• Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–3191.
   PubMed Web of Science ®Google Scholar
• García AA. Cognitive interviews to test and refine questionnaires. Public Health Nurs. 2011;28:444–450.
   PubMed Web of Science ®Google Scholar
• de Vet HCW, Terwee CB, Mokkink LB, et al. Measurement in medicine: a practical guide. Cambridge, UK: Cambridge University Press; 2011. p. 338.
   Google Scholar
• Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assessment Res Eval. 2005;10:1–9.
   Google Scholar
• Hair JF, Black WC, Babin BJ, et al. Multivariate data analysis. 7th ed. Essex: Pearson Educated Limited; 2014.
   Google Scholar
• Song J, Belin TR. Choosing an appropriate number of factors in factor analysis with incomplete data. Comput Stat Data Anal. 2008;52:3560–3569.
   Web of Science ®Google Scholar
• Williams B, Brown T, Onsman A. Exploratory factor analysis: a five-step guide for novices. Aust Jounal Paramed. 2010;8:3.
   Google Scholar
• Kottner J, Audige L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. Int J Nurs Stud. 2011;48:661–671.
   PubMed Web of Science ®Google Scholar
• Vanbelle S. A new interpretation of the weighted kappa coefficients. Psychometrika. 2016;81:399–410.
   PubMed Web of Science ®Google Scholar
• Polit DF, Beck CT. The content validity index: are you sure you know what ’ s being reported? critique and recommendations. Res Nurs Heal. 2006;29:489–497.
   PubMed Web of Science ®Google Scholar
• Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30:459–467.
   PubMed Web of Science ®Google Scholar
• Bello DA, Hassan ZI, Afolaranmi TO, et al. Supportive supervision: an effective intervention in achieving high quality malaria case management at primary health care level in Jos, Nigeria. Ann Afr Med. 2013;12:243–251.
   Google Scholar
• Langston A, Weiss J, Landegger J, et al. Plausible role for CHW peer support groups in increasing care-seeking in an integrated community case management project in Rwanda: a mixed methods evaluation. Glob Heal Sci Pract. 2014;2:342–354.
   PubMedGoogle Scholar
• Curran PJ, West SG, Finch JF. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychol Methods. 1996;1:16–29.
   Web of Science ®Google Scholar
• Satorra A, Bentler PM. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika. 2001;66:507–514.
   Web of Science ®Google Scholar
• McDonald RP, Ho M-HR. Principles and practice in reporting structural equation analyses. Psychol Methods. 2002;7:64–82.
   PubMed Web of Science ®Google Scholar
• Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model A Multidiscip J. 1999;6:1–55.
   Web of Science ®Google Scholar
• Hoyle RH. Handbook of structural equation modeling. New York, NY: Guilford Press; 2012. p. 740.
   Google Scholar
• UCAR Finance and administration. Employee evaluation of supervision - form [Internet]. 2001. Available from: http://www.fin.ucar.edu/forms/HR/supereval_form/supereval_form.shtml
   Google Scholar
• Holloway EL, Wampold BE, University of Utah. Dimensions of satisfaction in the supervision interview. In: Annual convention of the American Psychological Association (92nd); 1984 Aug 24–28; Toronto, ON.
   Google Scholar
• South Africa National Department of Health. 4.6 Checklist: PHC supervisor/supervisee relationship. In: Primary health care supervision manual: a guide to primary health care facility supervision. Pretoria; 2009.
   Google Scholar
• Oklahoma State University. Supervisory staff performance evaluation [Internet]. Available from: https://hr.okstate.edu/sites/default/files/docfiles/evaluation_form_supervisors.doc
   Google Scholar
• Shapiro M, Pogosjana M, Rylander A, et al. What about supervision matters? - The influence of supervision satisfaction on turnover intentions. In: Annual Convention of Association of Behavior Analysis International; 2011; Denver, CO. Available from: https://klab-csun.weebly.com/conference-presentations.htm
   Google Scholar
• Ladany N, Hill CE, Corbett MM, et al. Nature, extent, and importance of what psychotherapy trainees do not disclose to their supervisors. J Couns Psychol Nondisclosure. 1996;43:10–24.
   Web of Science ®Google Scholar
• Löfmark A, Thorkildsen K, Råholm MB, et al. Nursing students’ satisfaction with supervision from preceptors and teachers during clinical practice. Nurse Educ Pract. 2012;12:164–169.
   Google Scholar
• Noe RA. An investigation of the determinants of successful assigned mentoring relationships. Pers Psychol. 1988;41:457–479.
   Web of Science ®Google Scholar
• O’Donovan A, Halford WK, Walters B. Towards best practice supervision of clinical psychology trainees. Aust Psychol. 2011;46:101–112.
   Web of Science ®Google Scholar
• Suen LKP, Chow FLW. Students’ perceptions of the effectiveness of mentors in an undergraduate nursing programme in Hong Kong. J Adv Nurs. 2001;36:505–511.
   PubMed Web of Science ®Google Scholar
• Uys LR, Minnaar A, Reid S, et al. The perceptions of nurses in a district health system in KwaZulu-Natal of their supervision, self-esteem and job satisfaction. Curationis. 2004;27:50–56.
   Google Scholar
• Boerboom T, Dolmans D, Jaarsma A, et al. Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers’ supervisory skills during clinical rotations. Med Teach. 2011;33:e84–91.
   PubMed Web of Science ®Google Scholar
• Dilmore TC, Rubio DM, Cohen E, et al. Psychometric properties of the mentor role instrument when used in an academic medicine setting. Clin Transl Sci. 2010;3:104–108.
   Web of Science ®Google Scholar
• Fleming M, House S, Hanson VS, et al. The mentoring competency assessment. Acad Med. 2013;88:1002–1008.
   PubMed Web of Science ®Google Scholar
• Horton S, de Lourdes Drachler M, Fuller A, et al. Development and preliminary validation of a measure for assessing staff perspectives on the quality of clinical group supervision. Int J Lang Commun Disord. 2008;43:126–134.
   PubMed Web of Science ®Google Scholar
• McGilton KS. Development and psychometric testing of the supportive supervisory scale. J Nurs Sch. 2010 July 14;42:223–232.
   Web of Science ®Google Scholar
• Palomo M, Beinart H, Cooper MJ. Development and validation of the Supervisory Relationship Questionnaire (SRQ) in UK trainee clinical psychologists. Br J Clin Psychol. 2010 Jun;49:131–149.
   PubMed Web of Science ®Google Scholar
• Rogers J, Monteiro FM, Nora A. Toward measuring the domains of mentoring. Fam Med. 2008;40:259–263.
   Web of Science ®Google Scholar
• Seki Sakakibara K, Ishikawa H, Kiuchi T. Reliability and validity of the Japanese version of the mentoring functions questionnaire 9-item version. Sangyo Eiseigaku Zasshi. 2013;55:125–134.
   Google Scholar
• Stebnicki MA, Allen HA, Janikowski TP. Development of an instrument to assess perceived helpfulness of clinical supervisory behaviours. Rehabil Educ. 1997;11:307–322.
   Google Scholar
• Winstanley J, White E. The MCSS-26: revision of the Manchester clinical supervision scale; using the rasch measurement model. J Nurs Meas. 2011;19:160–178.
   PubMedGoogle Scholar
• Zarbock G, Drews M, Bodansky A, et al. The evaluation of supervision: construction of brief questionnaires for the supervisor and the supervisee. Psychother Res. 2009;19:194–204.
   PubMed Web of Science ®Google Scholar
• Makoul G, Krupat E, Chang CH. Measuring patient views of physician communication skills: development and testing of the communication assessment tool. Patient Educ Couns. 2007;67:333–342.
   PubMed Web of Science ®Google Scholar
• Mercer SW, Maxwell M, Heaney D, et al. The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract. 2004;21:699–705.
   PubMed Web of Science ®Google Scholar
• Bresick G, Sayed AR, Le Grange C, et al. Adaptation and cross-cultural validation of the United States primary care assessment tool (expanded version) for use in South Africa. African J Prim Heal Care Fam Med. 2015;7:1–11.
   Web of Science ®Google Scholar
• Kent P, Lauridsen HH. Managing missing scores on the roland morris disability questionnaire. Spine (Phila Pa 1976). 2011;36:1878–1884.
   PubMed Web of Science ®Google Scholar
• Stalmeijer RE, Dolmans DHJM, Wolfhagen IH, et al. The Maastricht Clinical Teaching Questionnaire (MCTQ) as a valid and reliable instrument for the evaluation of clinical teachers. Acad Med. 2010;85:1732–1738.
   PubMed Web of Science ®Google Scholar
• Martinko MJ, Harvey P, Brees JR, et al. A review of abusive supervision research. J Organ Behav. 2013;34:120–137.
   Web of Science ®Google Scholar
• Brees J, Martinko M, Harvey P. Abusive supervision: subordinate personality or supervisor behavior? J Manag Psychol. 2016;31:405–419.
   Web of Science ®Google Scholar
• LaVela S, Gallan A. Evaluation and measurement of patient experience. Patient Exp J. 2014;1:28–36.
   Google Scholar
• Haddad S, Potvin L, Roberge D, et al. Patient perception of quality following a visit to a doctor in a primary care unit. Fam Pract. 2000;17:21–29.
   PubMed Web of Science ®Google Scholar