Publication Cover
Work & Stress
An International Journal of Work, Health & Organisations
Latest Articles
1,707
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Validation of the Intervention Preparedness Tool: a short measure to assess important precursors for successful implementation of organisational interventions

, ORCID Icon, , ORCID Icon, , & show all
Received 17 Mar 2021, Accepted 07 Jun 2023, Published online: 30 Jul 2023

References

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T
  • Ajzen, I. (2015). The theory of planned behaviour is alive and well, and not ready to retire: a commentary on Sniehotta, Presseau, and Araújo-Soares. Health Psychology Review, 9(2), 131–137. https://doi.org/10.1080/17437199.2014.883474
  • Augustsson, H., von Thiele Schwarz, U., Stenfors-Hayes, T., & Hasson, H. (2015). Investigating variations in implementation fidelity of an organizational-level occupational health intervention. International Journal of Behavioral Medicine, 22(3), 345–355. https://doi.org/10.1007/s12529-014-9420-8
  • Bagozzi, R., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74–94. https://doi.org/10.1007/BF02723327
  • Bakhuys Roozeboom, M. C., Schelvis, R. M., Houtman, I. L., Wiezer, N. M., & Bongers, P. M. (2020). Decreasing employees’ work stress by a participatory, organizational level work stress prevention approach: A multiple-case study in primary education. BMC Public Health, 20(1), 1–16. https://doi.org/10.1186/s12889-020-08698-2
  • Bamberger, M., Tarsilla, M., & Hesse-Biber, S. (2016). Why so many “rigorous” evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute. Evaluation and Program Planning, 55, 155–162. https://doi.org/10.1016/j.evalprogplan.2016.01.001
  • Bambra, C., Gibson, M., Sowden, A. J., Wright, K., Whitehead, M., & Petticrew, M. (2009). Working for health? Evidence from systematic reviews on the effects on health and health inequalities of organisational changes to the psychosocial work environment. Preventive Medicine, 48(5), 454–461. https://doi.org/10.1016/j.ypmed.2008.12.018
  • Barbaranelli, C., Ghezzi, V., Di Tecco, C., Ronchetti, M., Fida, R., Ghelli, M., Persechino, B., & Iavicoli, S. (2018). Assessing objective and verifiable indicators associated with work-related stress: validation of a structured checklist for the assessment and management of work-related stress. Frontiers in Psychology, 9, 2424. https://doi.org/10.3389/fpsyg.2018.02424
  • Biron, M., Farndale, E., & Paauwe, J. (2011). Performance management effectiveness: lessons from world-leading firms. The International Journal of Human Resource Management, 22(6), 1294–1311. https://doi.org/10.1080/09585192.2011.559100
  • Cohen, J. (1988). Statistical power analysis for the Behavioral Sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
  • Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. B. (2001). The job demands-resources model of burnout. Journal of Applied Psychology, 86(3), 499–512. https://doi.org/10.1037/0021-9010.86.3.499
  • Diedenhofen, B., & Musch, J. (2015). cocor: A comprehensive solution for the statistical comparison of correlations. PLoS ONE, 10(4), e0121945. https://doi.org/10.1371/journal.pone.0121945
  • Di Tecco, C., Nielsen, K., Ghelli, M., Ronchetti, M., Marzocchi, I., Persechino, B., & Iavicoli, S. (2020). Improving working conditions and Job satisfaction in healthcare: A study concept design on a participatory organizational level intervention in psychosocial risks management. International Journal of Environmental Research and Public Health, 17(10), 3677. https://doi.org/10.3390/ijerph17103677
  • Di Tecco, C., Ronchetti, M., Ghelli, M., Russo, S., Persechino, B., & Iavicoli, S. (2015). Do Italian companies manage work-related stress effectively? A process evaluation in implementing the Inail methodology. Biomed Research International, 2015, 197156. https://doi.org/10.1155/2015/197156
  • Edwards, J. A., Webster, S., Van Laar, D., & Easton, S. (2008). Psychometric analysis of the UK Health and safety executive’s management standards work-related stress indicator tool. Work & Stress, 22(2), 96–107. https://doi.org/10.1080/02678370802166599
  • Eisinga, R., Grotenhuis, M. T., & Pelzer, B. (2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58(4), 637–642. https://doi.org/10.1007/s00038-012-0416-3
  • EU-OSHA. (2010). European Agency for Safety and Health at Work. European Survey of Enterprises on New and Emerging Risks. https://www.esener.eu.
  • European Trade Union Confederation. (2004). Framework agreement on work-related stress. Brussels. https://resourcecentre.etuc.org/sites/default/files/2019-09/Work-related%20Stress%202004_Framework%20Agreement%20-%20EN.pdf.
  • Field, A. (2013). Discovering statistics using IBM SPSS Statistics. Sage.
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
  • Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological Methods, 21(1), 93–111. https://doi.org/10.1037/met0000064
  • Groemping, U. (2006). Relative importance for linear regression in R: The package relaimpo. Journal of Statistical Software, 17(1), 1–27. https://doi.org/10.1360/jos170001
  • Hackman, J. R., & Oldham, G. R. (1974). “The job diagnostic survey: an instrument for the diagnosis of jobs and the evaluation of job redesign projects”, Technical Report No. 4. Department of Administrative Sciences, Yale University.
  • Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate data analysis: A global perspective. Pearson.
  • Health and Safety Executive. (2019). HSE Management Standards Indicator Tool. http://www.hse.gov.uk/stress/standards/pdfs/indicatortool.pdf.
  • Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106
  • Hobfoll, S. E. (1989). Conservation of resources: A new attempt at conceptualizing stress. American Psychologist, 44(3), 513–524. https://doi.org/10.1037/0003-066X.44.3.513
  • Hu, L.-t., & Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
  • International Labour Organization. (2001). Guidelines on occupational safety and health management systems. International Labor Office.
  • Istituto Nazionale per l’Assicurazione contro gli Infortuni sul Lavoro (2018). The Methodology for the Assessment and Management of Work-Related Stress Risk. Handbook for Companies, in Compliance with LEGISLATIVE. Decree 81/2008 and Subsequent Integrations and Modifications. INAIL.
  • Kalm, K., & Norris, D. (2018). Visual recency bias is explained by a mixture model of internal representations. Journal of Vision, 18(7), 1–1. https://doi.org/10.1167/18.7.1
  • Kline, R. B. (2005). Methodology in the social sciences. Principles and practice of structural equation modeling (2nd ed.). Guilford Press.
  • Kristof-Brown, A. L., Zimmerman, R. D., & Johnson, E. C. (2005). Consequences of individuals’ fit at work: A meta-analysis of person–job, person–organization, person–group, and person–supervisor fit. Personnel Psychology, 58(2), 281–342. https://doi.org/10.1111/j.1744-6570.2005.00672.x
  • Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722
  • Lundmark, R., Hasson, H., von Thiele Schwarz, U., Hasson, D., & Tafvelin, S. (2017). Leading for change: line managers’ influence on the outcomes of an occupational health intervention. Work & Stress, 31(3), 276–296. https://doi.org/10.1080/02678373.2017.1308446
  • Lundmark, R., von Thiele Schwarz, U., Hasson, H., Stenling, A., & Tafvelin, S. (2018). Making it fit: Associations of line managers' behaviours with the outcomes of an organizational-level intervention. Stress and Health, 34(1), 163–174. https://doi.org/10.1002/smi.2770
  • Mardia, K. (1970). Measures of multivariate Skewness and Kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
  • Montano, D., Hoven, H., & Siegrist, J. (2014). Effects of organisational-level interventions at work on employees’ health: A systematic review. BMC Public Health, 14(1), 1–9. https://doi.org/10.1186/1471-2458-14-135
  • Muthén, L. K., & Muthén, B. O. (2017). Mplus User’s Guide (ver 8). Muthén & Muthén.
  • Nielsen, K. (2013). Review Article: How can we make organizational interventions work? Employees and line managers as actively crafting interventions. Human Relations, 66(8), 1029–1050. https://doi.org/10.1177/0018726713477164
  • Nielsen, K. (2023). Improving employee well-being through improving working conditions: A review. In L. E. Tetrick, G. G. Fisher, M. T. Ford, & J. C. Quick (Eds.), Handbook of occupational health psychology. APA.
  • Nielsen, K., & Abildgaard, J. S. (2013). Organizational interventions: A research-based framework for the evaluation of both process and effects. Work & Stress, 27(3), 278–297. https://doi.org/10.1080/02678373.2013.812358
  • Nielsen, K., Abildgaard, J. S., & Daniels, K. (2014). Putting context into organizational intervention design: using tailored questionnaires to measure initiatives for worker well-being. Human Relations, 67(12), 1537–1560. https://doi.org/10.1177/0018726714525974
  • Nielsen, K., Antino, M., Rodríguez-Muñoz, A., & Sanz-Vergel, A. (2021). What about me? The impact of employee change agents’ person-role fit on their job satisfaction during organisational change. Work & Stress, 35(1), 57–73. https://doi.org/10.1080/02678373.2020.1730481
  • Nielsen, K., De Angelis, M., Innstrand, S. T., & Mazzetti, G. (2023). Quantitative process measures in interventions to improve employees’ mental health: A systematic literature review and the IPEF framework. Work & Stress, 37(1), 1–26. https://doi.org/10.1080/02678373.2022.2080775
  • Nielsen, K., & Miraglia, M. (2017). What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research. Human Relations, 70(1), 40–62. https://doi.org/10.1177/0018726716670226
  • Nielsen, K., Nielsen, M. B., Ogbonnaya, C., Känsälä, M., Saari, E., & Isaksson, K. (2017). Workplace resources to improve both employee well-being and performance: A systematic review and meta-analysis. Work & Stress, 31(2), 101–120. https://doi.org/10.1080/02678373.2017.1304463
  • Nielsen, K., & Noblet, A. (Eds.). (2018). Organizational interventions for health and well-being. Routledge.
  • Nielsen, K., & Randall, R. (2009). Managers’ active support when implementing teams: The impact on employee well-being. Applied Psychology: Health and Well-Being, 1(3), 374–390. https://doi.org/10.1111/j.1758-0854.2009.01016.x
  • Nielsen, K., & Randall, R. (2013). Opening the black box: Presenting a model for evaluating organizational-level interventions. European Journal of Work and Organizational Psychology, 22(5), 601–617. https://doi.org/10.1080/1359432X.2012.690556
  • Nielsen, K. & Randall, R. (2015). Addressing the fit of planned interventions to the organizational context. In M. Karanika-Murray & C. Biron (Eds.), Derailed organizational stress and well-being interventions: Confessions of failure and solutions for success (pp. 107-118) Springer. https://doi.org/10.1007/978-94-017-9867-9.
  • Nielsen, K., Randall, R., & Albertsen, K. (2007). Participants' appraisals of process issues and the effects of stress management interventions. Journal of Organizational Behavior, 28(6), 793–810. https://doi.org/10.1002/job.450
  • Nielsen, K., Randall, R., Holten, A.-L., & González, E. R. (2010). Conducting organizational-level occupational health interventions: What works? Work & Stress, 24(3), 234–259. https://doi.org/10.1080/02678373.2010.515393
  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
  • Nytrø, K., Saksvik, PØ, Mikkelsen, A., Bohle, P., & Quinlan, M. (2000). An appraisal of key factors in the implementation of occupational stress interventions. Work & Stress, 14(3), 213–225. https://doi.org/10.1080/02678370010024749
  • Randall, R., Nielsen, K. M., & Tvedt, S. D. (2009). The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work & Stress, 23(1), 1–23. https://doi.org/10.1080/02678370902815277
  • Richardson, K. M., & Rothstein, H. R. (2008). Effects of occupational stress management intervention programs: A meta-analysis. Journal of Occupational Health Psychology, 13(1), 69–93. https://doi.org/10.1037/1076-8998.13.1.69
  • Rondinone, B. M., Persechino, B., Castaldi, T., Valenti, A., Ferrante, P., Ronchetti, M., & Iavicoli, S. (2013). Work-Related stress risk assessment in Italy: A methodological proposal adapted to regulatory guidelines. Safety and Health at Work, 4, 95–99. https://doi.org/10.1016/j.shaw.2013.05.002
  • Schelvis, R. M., Wiezer, N. M., Blatter, B. M., van Genabeek, J. A., Hengel, K. M. O., Bohlmeijer, E. T., & van der Beek, A. J. (2016). Evaluating the implementation process of a participatory organizational level occupational health intervention in schools. BMC Public Health, 16(1), 1–20. https://doi.org/10.1186/s12889-016-3869-0
  • Schwab, D. P. (1980). Construct validity in organizational behavior. In L. L. Cummings, & B. M. Staw (Eds.), Research in organizational behavior: An annual series of analytical essays and critical reviews, 2 (pp. 3–43). JAI Press.
  • Sorensen, G., Sparer, E., Williams, J. A., Gundersen, D., Boden, L. I., Dennerlein, J. T., … & Wagner, G. R. (2018). Measuring best practices for workplace safety, health and wellbeing: The workplace integrated safety and health assessment. Journal of Occupational & Environmental Medicine, 60(5), 430-439. https://doi.org/10.1097/JOM.0000000000001286
  • Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87(2), 245–251. https://doi.org/10.1037/0033-2909.87.2.245
  • Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn & Bacon/Pearson Education.
  • Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). Allyn & Bacon/Pearson Education.
  • von Thiele Schwarz, U., Nielsen, K., Edwards, K., Hasson, H., Ipsen, C., Savage, C., Abildgaard, J., Richter, A., Lornudd, C., Mazzocato, P., & Reed, J. E. (2021). How to design, implement and evaluate organizational interventions for maximum impact: the Sigtuna Principles. European Journal of Work and Organizational Psychology, 415–427. https://doi.org/10.1080/1359432x.2020.1803960
  • Weick, K. E. (1995). Sensemaking in organizations.
  • Weiner, B. J., Amick, H., & Lee, S.-Y. D. (2008). Review: Conceptualization and measurement of organizational readiness for change. Medical Care Research and Review, 65(4), 379–436. https://doi.org/10.1177/1077558708317802
  • Wood, S., Ghezzi, V., Barbaranelli, C., Di Tecco, C., Fida, R., Farnese, M. L., Ronchetti, M., & Iavicoli, S. (2019). Assessing the risk of stress in organizations: Getting the measure of organizational-level stressors. Frontiers in Psychology, 10, 2776. https://doi.org/10.3389/fpsyg.2019.02776