Quantitative process measures in interventions to improve employees’ mental health: A systematic literature review and the IPEF framework

References

• The full list of references included in the literature review can be found in Figshare: https://figshare.com/articles/dataset/References_docx/19626708
   Google Scholar
• Abildgaard, J. S., Nielsen, K., & Saksvik, P. O. (2016). How to measure the intervention process? An assessment of qualitative and quantitative approaches to data collection in the process evaluation of organizational interventions. Frontiers in Psychology: Organizational Psychology. https://doi.org/10.3389/fpsyg.2016.01380
   Google Scholar
• Abildgaard, J. S., Nielsen, K., & Sverke, M. (2018). Can job insecurity be managed? Evaluating an organizational-level intervention addressing the negative effects of restructuring. Work & Stress, 32(2), 105–123. https://doi.org/10.1080/02678373.2017.1367735
   Web of Science ®Google Scholar
• Abildgaard, J. S., Nielsen, K., Wåhlin-Jacobsen, C. D., Maltesen, T., Christensen, K. B., & Holtermann, A. (2019). Same, but different’: A mixed-methods realist evaluation of a cluster-randomized controlled participatory organizational intervention. Human Relations. https://doi.org/10.1177/0018726719866896.
   PubMed Web of Science ®Google Scholar
• Arapovic-Johansson, B., Wåhlin, C., Hagberg, J., Kwak, L., Björklund, C., & Jensen, I. (2018). Participatory work place intervention for stress prevention in primary health care. A randomized controlled trial. European Journal of Work and Organizational Psychology, 27(2), 219–234. https://doi.org/10.1080/1359432X.2018.1431883
   Web of Science ®Google Scholar
• Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., … Hawe, P. (2008). Improving the reporting of public health intervention research: Advancing TREND and CONSORT. Journal of Public Health, 30(1), 103–109. https://doi.org/10.1093/pubmed/fdm082
   PubMed Web of Science ®Google Scholar
• Augustsson, H., von Thiele Schwarz, U., Stenfors-Hayes, T., & Hasson, H. (2015). Investigating variations in implementation fidelity of an organizational-level occupational health intervention. International Journal of Behavioral Medicine, 22(3), 345–355. https://doi.org/10.1007/s12529-014-9420-8
   PubMed Web of Science ®Google Scholar
• Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41(1), 63–105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x
   Web of Science ®Google Scholar
• Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic review. Journal of Management, 36(4), 1065–1105. https://doi.org/10.1177/0149206309352880
   Web of Science ®Google Scholar
• Blume, B. D., Ford, J. K., Surface, E. A., & Olenick, J. (2019). A dynamic model of training transfer. Human Resource Management Review, 29(2), 270–283. https://doi.org/10.1016/j.hrmr.2017.11.004
   Web of Science ®Google Scholar
• Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149
   PubMed Web of Science ®Google Scholar
• Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A. J., Czajkowski, S., Breger, R., … Orwig, D. (2005). A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. Journal of Consulting and Clinical Psychology, 73(5), 852–860. http://doi.org/10.1037/0022-006X.73.5.852
   PubMed Web of Science ®Google Scholar
• Bryman, A. (2006). Integrating quantitative and qualitative research: How is it done? Qualitative Research, 6(1), 97–113. https://doi.org/10.1177/1468794106058877
   Google Scholar
• Burke, L. A., & Hutchins, H. M. (2007). Training transfer: An integrative literature review. Human Resource Development Review, 6(3), 263–296. https://doi.org/10.1177/1534484307303035
   Google Scholar
• Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40. https://doi.org/10.1186/1748-5908-2-40
   PubMed Web of Science ®Google Scholar
• Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8(1), 22. https://doi.org/10.1186/1748-5908-8-22
   PubMed Web of Science ®Google Scholar
• Coffeng, J. K., Hendriksen, I. J., van Mechelen, W., & Boot, C. R. (2013). Process evaluation of a worksite social and physical environmental intervention. Journal of Occupational and Environmental Medicine, 55(12), 1409–1420. https://doi.org/10.1097/JOM.0b013e3182a50053
   PubMed Web of Science ®Google Scholar
• Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Sage.
   Google Scholar
• Day, A., & Nielsen, K. (2017). What does our organization do to help our well-being? Creating healthy workplaces and workers. In N. Chmiel, F. Fraccaroli, & M. Sverke (Eds.), An introduction of work and organizational psychology (pp. 295–314). Wiley Blackwell.
   Google Scholar
• Dimoff, J. K., Kelloway, E. K., & Burnstein, M. D. (2016). Mental health awareness training (MHAT): The development and evaluation of an intervention for workplace leaders. International Journal of Stress Management, 23(2), 167–189. https://doi.org/10.1037/a0039479
   Web of Science ®Google Scholar
• Egan, M., Bambra, C., Petticrew, M., & Whitehead, M. (2009). Reviewing evidence on complex social interventions: Appraising implementation in systemic reviews of the health effects of organisational-level workplace interventions. Journal of Epidemiology & Community Health, 63(1), 4–11. https://doi.org/10.1136/jech.2007.071233
   PubMed Web of Science ®Google Scholar
• Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013). The RE-AIM framework: A systematic review of use over time. American Journal of Public Health, 103(6), e38–e46. https://doi.org/10.2105/AJPH.2013.301299
   PubMed Web of Science ®Google Scholar
• Gjerde, S., & Alvesson, M. (2020). Sandwiched: Exploring role and identity of middle managers in the genuine middle. Human Relations, 73(1), 124–151. https://doi.org/10.1177/0018726718823243
   Web of Science ®Google Scholar
• Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327. https://doi.org/10.2105/AJPH.89.9.1322
   PubMed Web of Science ®Google Scholar
• Gupta, N., Wåhlin-Jacobsen, C. D., Abildgaard, J. S., Henriksen, L. N., Nielsen, K. N., & Holtermann, A. (2018). Effectiveness of a participatory physical and psychosocial intervention for balancing the demands and resources of industrial workers: A cluster-randomized controlled trial. Scandinavian Journal of Work, Environment, and Health, 44(1), 58–68. https://doi.org/10.5271/sjweh.3689
   PubMed Web of Science ®Google Scholar
• Haims, M. C., & Carayon, P. (1998). Theory and practice for the implementation of ‘in-house’, continuous improvement participatory ergonomic programs. Applied Ergonomics, 29(6), 461–472. https://doi.org/10.1016/S0003-6870(98)00012-X
   PubMed Web of Science ®Google Scholar
• Hasson, H., Brown, C., & Hasson, D. (2010). Factors associated with high use of a workplace web-based stress management program in a randomized controlled intervention study. Health Education Research, 25(4), 596–607. https://doi.org/10.1093/her/cyq005
   PubMed Web of Science ®Google Scholar
• Hasson, H., Villaume, K., von Thiele Schwarz, U., & Palm, K. (2014). Managing implementation: Roles of line managers, senior managers, and human resource professionals in an occupational health intervention. Journal of Occupational and Environmental Medicine, 56(1), 58–65. https://doi.org/10.1097/JOM.0000000000000020
   PubMed Web of Science ®Google Scholar
• Havermans, B. M., Schelvis, R. M., Boot, C. R., Brouwers, E. P., Anema, J. R., & van der Beek, A. J. (2016). Process variables in organizational stress management intervention evaluation research: A systematic review. Scandinavian Journal of Work, Environment & Health, 42, 371–381. https://doi.org/10.5271/sjweh.3570
   PubMed Web of Science ®Google Scholar
• Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106
   Web of Science ®Google Scholar
• International Labor Office. (2012). International standard classification of occupations: ISCO–08. International Labor Office. Retrieved July 13, 2020, from https://www.ilo.org/wcmsp5/groups/public/—dgreports/—dcomm/—publ/documents/publication/wcms_172572.pdf
   Google Scholar
• Ipsen, C., Gish, L., & Poulsen, S. (2015). Organizational-level interventions in small and medium-sized enterprises: Enabling and inhibiting factors in the PoWRS program. Safety Science, 71, 264–274. https://doi.org/10.1016/j.ssci.2014.07.017
   Web of Science ®Google Scholar
• Jenny, G. J., Brauchli, R., Inauen, A., Füllemann, D., Fridrich, A., & Bauer, G. F. (2015). Process and outcome evaluation of an organizational-level stress management intervention in Switzerland. Health Promotion International, 30(3), 573–585. https://doi.org/10.1093/heapro/dat091
   PubMed Web of Science ®Google Scholar
• Kelloway, E. K., & Barling, J. (2010). Leadership development as an intervention in occupational health psychology. Work & Stress, 24(3), 260–279. https://doi.org/10.1080/02678373.2010.518441
   Web of Science ®Google Scholar
• Keyes, C. L. (2014). Mental health as a complete state: How the salutogenic perspective completes the picture. In G. F. Bauer & O. Hämmig (Eds.), Bridging occupational, organizational and public health (pp. 179–192). Springer.
   Google Scholar
• Kobayashi, Y., Kaneyoshi, A., Yokota, A., & Kawakami, N. (2008). Effects of a worker participatory program for improving work environments on job stressors and mental health among workers: A controlled trial. Journal of Occupational Health, 50(6), 455–470. https://doi.org/10.1539/joh.L7166
   PubMed Web of Science ®Google Scholar
• LaMontagne, A. D., Keegel, T., Louie, A. M., Ostry, A., & Landsbergis, P. A. (2007). A systematic review of the job-stress intervention evaluation literature, 1990–2005. International Journal of Occupational and Environmental Health, 13(3), 268–280. https://doi.org/10.1179/oeh.2007.13.3.268
   PubMed Web of Science ®Google Scholar
• LaMontagne, A. D., Martin, A., Page, K. M., Reavley, N. J., Noblet, A. J., Milner, A. J., Keegel, T., & Smith, P. M. (2014). Workplace mental health: Developing an integrated intervention approach. BMC Psychiatry, 14(1), 1–11. https://doi.org/10.1186/1471-244X-14-131
   Web of Science ®Google Scholar
• Lundmark, R., Hasson, H., von Thiele Schwarz, U., Hasson, D., & Tafvelin, S. (2017). Leading for change: Line managers’ influence on the outcomes of an occupational health intervention. Work & Stress, 31(3), 276–296. https://doi.org/10.1080/02678373.2017.1308446
   Web of Science ®Google Scholar
• Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59(1), 537–563. https://doi.org/10.1146/annurev.psych.59.103006.093735
   PubMed Web of Science ®Google Scholar
• Montano, D., Hoven, H., & Siegrist, J. (2014). Effects of organisational-level interventions at work on employees’ health: A systematic review. BMC Public Health, 14(1), 135. http://www.biomedcentral.com/1471-2458/14/135.
   PubMed Web of Science ®Google Scholar
• Morgeson, F. P., & Humphrey, S. E. (2006). The work design questionnaire (WDQ): Developing and validating a comprehensive measure for assessing job design and the nature of work. Journal of Applied Psychology, 91(6), 1321–1339. https://doi.org/10.1037/0021-9010.91.6.1321
   PubMed Web of Science ®Google Scholar
• Murta, S. G., Sanderson, K., & Oldenburg, B. (2007). Process evaluation in occupational stress management programs: A systematic review. American Journal of Health Promotion, 21(4), 248–254. https://doi.org/10.4278/0890-1171-21.4.248
   PubMed Web of Science ®Google Scholar
• Nastasi, B. K., Hitchcock, J., Sarkar, S., Burkholder, G., Varjas, K., & Jayasena, A. (2007). Mixed methods in intervention research: Theory to adaptation. Journal of Mixed Methods Research, 1(2), 164–182. https://doi.org/10.1177/1558689806298181
   Web of Science ®Google Scholar
• Nelson, T. D., & Steele, R. G. (2006). Beyond efficacy and effectiveness: A multifaceted approach to treatment evaluation. Professional Psychology: Research and Practice, 37(4), 389–397. https://doi.org/10.1037/0735-7028.37.4.389
   Web of Science ®Google Scholar
• Nielsen, K. (2013). Review article: How can we make organizational interventions work? Employees and line managers as actively crafting interventions. Human Relations, 66(8), 1029–1050. http://doi.org/10.1177/0018726713477164
   Web of Science ®Google Scholar
• Nielsen, K., & Abildgaard, J. S. (2013). Organizational interventions: A research-based framework for the evaluation of both process and effects. Work & Stress, 27(3), 278–297. https://doi.org/10.1080/02678373.2013.812358
   Web of Science ®Google Scholar
• Nielsen, K., Abildgaard, J. S., & Daniels, K. (2014). Putting context into organizational intervention design: Using tailored questionnaires to measure initiatives for worker well-being. Human Relations, 67(12), 1537–1560. https://doi.org/10.1177/0018726714525974
   Web of Science ®Google Scholar
• Nielsen, K., Nielsen, M. B., Ogbonnaya, C., Känsälä, M., Saari, E., & Isaksson, K. (2017). Workplace resources to improve both employee well-being and performance: A systematic review and meta-analysis. Work & Stress, 31(2), 101–120. https://doi.org/10.1080/02678373.2017.1304463
   Web of Science ®Google Scholar
• Nielsen, K., & Noblet, A. (2018). Introduction: Organizational interventions: Where we are, where we go from here? In K. Nielsen & A. Noblet (Eds.), Organizational interventions for health and well-being: A handbook for evidence-based practice (pp. 1–23). Routledge.
   Google Scholar
• Nielsen, K., & Randall, R. (2012). The importance of employee participation and perceptions of changes in procedures in a teamworking intervention. Work & Stress, 26(2), 91–111. https://doi.org/10.1080/02678373.2012.682721
   PubMed Web of Science ®Google Scholar
• Nielsen, K., & Randall, R. (2013). Opening the black box: Presenting a model for evaluating organizational-level interventions. European Journal of Work and Organizational Psychology, 22(5), 601–617. https://doi.org/10.1080/1359432X.2012.690556
   Web of Science ®Google Scholar
• Nielsen, K., Randall, R., & Albertsen, K. (2007). Participants’ appraisals of process issues and the effects of stress management interventions. Journal of Organizational Behavior, 28(6), 793–810. https://doi.org/10.1002/job.450
   Web of Science ®Google Scholar
• Nielsen, K., Randall, R., & Christensen, K. B. (2010). Does training managers enhance the effects of implementing team-working? A longitudinal, mixed methods field study. Human Relations, 63(11), 1719–1741. https://doi.org/10.1177/0018726710365004
   Web of Science ®Google Scholar
• Nytrø, K., Saksvik, P. Ø., Mikkelsen, A., Bohle, P., & Quinlan, M. (2000). An appraisal of key factors in the implementation of occupational stress interventions. Work & Stress, 14(3), 213–225. https://doi.org/10.1080/02678370010024749
   Web of Science ®Google Scholar
• OECD/EU. (2018). Health at a glance: Europe 2018: State of health in the EU cycle. OECD Publishing. https://doi.org/10.1787/health_glance_eur-2018-en
   Google Scholar
• Parsonage, M., & Saini, G. (2017). Mental health at work. Center for Mental Health.
   Google Scholar
• Pawson, R., & Tilley, N. (1997). Realistic evaluation. Sage.
   Google Scholar
• Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
   PubMed Web of Science ®Google Scholar
• Queirós, A., Faria, D., & Almeida, F. (2017). Strengths and limitations of qualitative and quantitative research methods. European Journal of Education Studies, 3(9), 369–387. https://doi.org/10.46827/ejes.v0i0.1017
   Google Scholar
• Randall, R., Nielsen, K., & Tvedt, S. D. (2009). The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work & Stress, 23(1), 1–23. https://doi.org/10.1080/02678370902815277
   Web of Science ®Google Scholar
• Richardson, K. M., & Rothstein, H. R. (2008). Effects of occupational stress management intervention programs: A meta-analysis. Journal of Occupational Health Psychology, 13(1), 69–93. https://doi.org/10.1037/1076-8998.13.1.69
   PubMed Web of Science ®Google Scholar
• Roozeboom, M. C. B., Schelvis, R. M., Houtman, I. L., Wiezer, N. M., & Bongers, P. M. (2020). Decreasing employees’ work stress by a participatory, organizational level work stress prevention approach: A multiple-case study in primary education. BMC Public Health, 20(1), 1–16. https://doi.org/10.1186/s12889-020-08698-2
   PubMed Web of Science ®Google Scholar
• Schelvis, R. M., Wiezer, N. M., Blatter, B. M., van Genabeek, J. A., Hengel, K. M. O., Bohlmeijer, E. T., & van der Beek, A. J. (2016). Evaluating the implementation process of a participatory organizational level occupational health intervention in schools. BMC Public Health, 16(1), 1212. https://doi.org/10.1186/s12889-016-3869-0
   PubMed Web of Science ®Google Scholar
• Semmer, N. K. (2011). Job stress interventions and organization of work. In J. C. Quick & L. E. Tetrick (Eds.), Handbook of occupational health psychology (2nd ed., pp. 299–318). APA.
   Google Scholar
• Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ, 349, g7647–g7647, https://doi.org/10.1136/bmj.g764
   PubMed Web of Science ®Google Scholar
• Sorensen, G., Sparer, E., Williams, J. A., Gundersen, D., Boden, L. I., Dennerlein, J. T., Hashimoto, D., Katz, J. N., McLellan, D. L., Okechukwu, C. A., Pronk, N. P., Revette, A., & Wagner, G. R. (2018). Measuring best practices for workplace safety, health and wellbeing: The workplace integrated safety and health assessment. Journal of Occupational and Environmental Medicine, 60(5), 430–439. https://doi.org/10.1097/JOM.0000000000001286
   PubMed Web of Science ®Google Scholar
• Steckler, A. B., & Linnan, L. (2002). Process evaluation for public health interventions and research (pp. 1–23). Jossey-Bass.
   Google Scholar
• Suri, H., & Clarke, D. (2009). Advancements in research synthesis methods: From a methodologically inclusive perspective. Review of Educational Research, 79(1), 395–430. https://doi.org/10.3102/0034654308326349
   Web of Science ®Google Scholar
• Tafvelin, S., von Thiele Schwarz, U., Nielsen, K., & Hasson, H. (2019). Employees’ and line managers’ active involvement in participatory organizational interventions: Examining direct, reversed, and reciprocal effects on well-being. Stress and Health, 35(1), 69–80. https://doi.org/10.1002/smi.2841
   PubMed Web of Science ®Google Scholar
• Van der Klink, J. J., Blonk, R. W., Schene, A. H., & Van Dijk, F. J. (2001). The benefits of interventions for work-related stress. American Journal of Public Health, 91(2), 270–276. https://doi.org/10.2105/AJPH.91.2.270
   PubMed Web of Science ®Google Scholar
• von Thiele Schwarz, U., Augustsson, H., Hasson, H., & Stenfors-Hayes, T. (2015). Promoting employee health by integrating health protection, health promotion, and continuous improvement: A longitudinal quasi-experimental intervention study. Journal of Occupational and Environmental Medicine, 57(2), 217–225. https://doi.org/10.1097/JOM.0000000000000344
   PubMed Web of Science ®Google Scholar
• von Thiele Schwarz, U., Nielsen, K. M., Stenfors-Hayes, T., & Hasson, H. (2017). Using kaizen to improve employee well-being: Results from two organizational intervention studies. Human Relations, 70(8), 966–993. https://doi.org/10.1177/0018726716677071
   PubMed Web of Science ®Google Scholar
• Weiner, B. J. (2020). A theory of organizational readiness for change. In P. Nilsen & S. A. Birken (Eds.), Handbook on implementation science (pp. 215–232). Edward Elgar Publishing.
   Google Scholar