2,014
Views
7
CrossRef citations to date
0
Altmetric
Research Paper

Use of a mental health guideline by occupational physicians and associations with return to work in workers sick-listed due to common mental disorders: a retrospective cohort study

, , , , &
Pages 2623-2631 | Received 16 Sep 2016, Accepted 22 Jun 2017, Published online: 07 Jul 2017

Abstract

Purpose: The aim of this study was to evaluate (1) whether adherence to the Dutch occupational mental health guideline by occupational physicians was associated with time to return to work in workers sick-listed due to common mental disorders; and (2) whether adherence to specific guideline items was associated with time to return to work.

Methods: Twelve performance indicators were developed to assess occupational physicians’ guideline adherence. Medical records of 114 sick-listed workers were audited. Performance indicators were scored as indicating no (0), minimal (1) or adequate adherence (2). Cox regression analysis was used to assess the association between guideline adherence and first or full return to work.

Results: Guideline adherence was predominantly minimal on most performance indicators. This low overall adherence was not associated with first return to work (Hazard Ratio 1.07, p = 0.747) or with full return to work (Hazard Ratio 1.25, p = 0.301). Only one performance indicator (regular contact between occupational physician and employer) was significantly associated with earlier full return to work (Hazard Ratio 1.87, p = 0.021).

Conclusions: Overall, the guideline adherence of occupational physicians was not related to earlier return to work. However, there was considerable room for improvement in guideline use. Whether this leads to earlier return to work is still an ununanswered question.

    Implications for Rehabilitation

  • Adherence of occupational physicians to an evidence-based occupational mental health guideline was low.

  • Regular contact between occupational physician and employer was associated with earlier full return to work in workers with common mental disorders.

  • It is important to focus on how implementation problems and barriers for guideline use can be overcome, in order to improve the quality of occupational mental health care and to potentially reduce sickness absence duration in workers with common mental disorders.

Introduction

Considering the fact that in many countries mental health problems account for high numbers of sick-listed workers [Citation1–3], it is surprising that, so far, very few evidence-based guidelines exist in the occupational health care context worldwide [Citation4]. Medical evidence-based practice guidelines are considered to be effective tools to improve the quality of care, including occupational health care [Citation5,Citation6]. In the Netherlands, seven guidelines for professionals exist that focus on the management of workers with mental health and stress issues [Citation4]. Some of these guidelines are interdisciplinary [Citation7], whereas others focus on specific professionals such as occupational physicians [Citation8] or psychologists [Citation9,Citation10]. Specifically, for occupational physicians, the Netherlands Society of Occupational Medicine developed (2000) and revised (2007) an evidence-based practice guideline named 'Management of mental health problems of workers by occupational physicians' [Citation8,Citation11]. This guideline was distributed among Dutch occupational physicians, and it became part of their continuing medical education.

The evidence-based occupational mental health guideline promotes an active approach by the occupational physician in monitoring and enhancing the problem solving capacity of the worker, aiming to establish early and sustained work resumption [Citation8,Citation11]. Previous research supports the effectiveness of the methods incorporated in the guideline [Citation12,Citation13]. However, research on the use of the first edition of this Dutch occupational mental health guideline showed that, in general, the guideline adherence by occupational physicians was limited [Citation14–16] and that a three-day training for occupational physicians did not shorten the time to return to work [Citation15]. This, despite the fact that occupational physicians’ attitudes toward the first edition of this guideline were found to be fairly positive [Citation17] and that some promising associations were found between better guideline adherence by occupational physicians and reduced sickness absence duration in workers with adjustment disorders [Citation16]. The impact of guideline use on return to work in workers sick-listed due to common mental disorders had never been evaluated after the guideline was revised in 2007, despite the fact that it has now been used in practice for 10 years. Therefore, the focus of the present study was on the associations between occupational physicians’ guideline adherence and workers’ return to work.

Specifically, the present study addressed the following research questions: (1) Is better guideline adherence by occupational physicians associated with earlier return to work in workers with common mental disorders? (2) Which specific guideline items are associated with earlier return to work?

Methods

Study context

In the Netherlands, the Dutch Gatekeeper Improvement Act [Citation18] holds both employer and worker responsible for the recovery and the return to work of the sick-listed worker, and both parties risk financial fines. The employer is obliged to pay at least 70% of the wages for a period of two years after the start of the sickness absence period, during which time sick-listed workers cannot have their employment terminated. The employer is also obliged to provide access to occupational health care for the sick-listed worker, and to make work adaptations if necessary. Employers contract an independently operating occupational health service or an independent occupational physician. The occupational physician has a central role in the Dutch social security system, he/she guides the worker during the recovery and the return to work process, and he/she gives advice to the employer. The occupational physician should monitor the recovery and the return to work process, and document this in the worker’s medical record.

Guideline-based care

The central aim of the guideline is early and sustained work resumption of workers sick-listed due to mental health problems. The guideline consists of four consecutive steps [Citation8], as described in .

Table 1. Summery of the Dutch occupational mental health guideline [Citation8].

Study subjects and procedure

The data of the current study were gathered as part of a larger study, a cluster-randomized controlled trial, examining the effect of an intervention to enhance guideline adherence in occupational physicians [Citation19]. In the larger study, the inclusion criteria were: age 18–64 years, a first period of sickness absence between January 1st 2012 and January 15th 2013, receiving guidance by an occupational physician who participated in the study and who had diagnosed that mental health problems were the primary reason for sick absence (according to the Dutch Classification of Diseases, based on the ICD-10 [Citation20], and adequate mastery of the Dutch language). Exclusion criteria were: being suicidal, and a physical problem being the primary reason for sickness absence. In the larger study, 116 workers gave their written informed consent for auditing their medical records and using their sickness absence data. The data from 114 of these 116 workers guided by 34 occupational physicians were available for the present study. One record was not available at the occupational health service, and the audit of another record revealed that mental health problems were not the primary reason for sickness absence. In addition to the medical records, participating workers had filled out a baseline questionnaire for the larger study, from which some data were used in the analyses to check for potential confounders (see: potential confounders). Participating occupational physicians were not informed about which workers were included in the study, although they did know which workers were being invited to participate (about 500 workers in total).

The data on the sickness absence and the return to work of the 114 workers were retrospectively obtained from the registration system of the occupational health service 1.5 years after the last worker was included in the trial. The audited period in the medical records was 12 months from the first day of the sickness absence of each worker.

Ethical approval was provided by the Medical Research Ethics Committee of St. Elisabeth Hospital in Tilburg (MREC number 1162). Trial registration: ISRCTN86605310.

Measures

Guideline adherence

We developed a set of 12 guideline-based performance indicators (PIs) to assess occupational physicians’ guideline adherence as documented in the workers’ medical records, as one of the guideline recommendations is that occupational physicians should document their findings in the medical records (see ). The PIs were systematically developed using an iterative consensus rating procedure for deriving indicators from guidelines [Citation21–24]. First, the 24 most important guideline recommendations that would have an impact on the quality of occupational care were independently preselected by three experts (an occupational physician, a psychologist, and a researcher). Second, in an expert meeting, nine experts with expertise on mental health, occupational health, and quality of care, discussed the relevance of the 24 recommendations for occupational physicians’ performance. This resulted in a selection of 20 recommendations categorized in five key recommendations. Finally, from each selected recommendation, a PI was created. For instance, from the recommendation that relapse prevention is an important part of the guidance, the PI 'Relapse prevention' was created. This PI could be scored in the medical record as 0 (no attention had been given to relapse prevention as based on the medical record), 1 (minimal attention had been given) or 2 (relapse prevention had adequately been addressed during guidance). Two researchers pilot tested the PIs and scoring set by auditing ten medical records. Based on their findings, the PIs were adapted to the final set of 12 PIs categorized in five key indicators [Joosen et al., submitted] (see ).

Table 2. Description of 12 performance indicators for occupational physicians’ guideline adherence in workers’ medical records and criteria for their scoring [Joosen et al., submitted].

Table 3. Guideline adherence per performance indicator (percentages of workers, n = 114).

The PIs were rated as 0 (no guideline adherence), 1 (minimal adherence) or 2 (adequate adherence). The difference between minimal and adequate adherence represented, for most of the PIs, a difference in how often a PI was documented or the extent of argumentation why certain actions were taken or nor taken by the occupational physician. Because there were too few medical records showing adequate adherence, post hoc, the audit ratings were dichotomized by collapsing ‘minimal adherence’ (score 1) and ‘adequate adherence’ (score 2) into one category of ‘minimal-to-adequate adherence’. Overall, guideline adherence was dichotomized by using the median score of the sum score of all performance indicators (scale range 0–24) as cut off score.

Two researchers independently audited the anonymized medical records. The auditors were blinded for the identity of the occupational physicians and their group allocation. In case of no consensus, a third researcher audited the medical record and decided on the final PI score. shows the distribution of the PI scores for the intervention and control groups.

Return to work

Time to first return to work was calculated as the number of calendar days between the first day of sickness absence and the first day of return to work, irrespective of the number of working hours per week and the occurrence of sickness absence relapses. Time to full return to work was calculated as the number of calendar days between the first day of sickness absence and the first day of full return to work. Full return to work was defined as working the number of hours of their employment contract, for at least 4 consecutive weeks.

Potential confounders

As this study was part of a larger study, more data on the participants were available than from just the medical records. Therefore, to check for possible confounding, some of these data were used. They concerned age, gender, severity of distress, depression, anxiety and somatization (measured by the Four-Dimensional Symptom Questionnaire (4-DSQ)) [Citation25], work-related self-efficacy (measured by the return to work self-efficacy (RTW-SE) scale) [Citation26], and perceived workability (measured using a single question of the workability index (WAI)) [Citation27,Citation28]. These data were measured at baseline within 13 weeks after the start of the sickness absence. More detailed information about this questionnaire have been described elsewhere [Citation19].

Statistical analyses

Guideline adherence

Descriptive analyses were used to calculate the percentage of medical records in which guideline-based care was documented (performance rate).

Return to work

Descriptive analyses were used to calculate the mean and median time to first and full return to work.

Guideline adherence and time to return to work

Cox regression analysis was used to assess the impact of guideline adherence (overall and per item) on (time to) first and full return to work. To correct for the clustered design, the frailty random effect was used in this analysis [Citation29,Citation30]. Workers were censored when first or full return to work was not established within the follow-up period, or when the sickness absence period ended before their return to work was established. It is likely that these workers resigned or that the employer contracted another occupational health service, but it was not possible to retrieve this information from the registration system of the occupational health service.

The potential confounders were added one by one to the base model to test if they influenced the regression coefficient by more than 10%, or, in case the base model was non-significant, they changed the significance of the model. All variables that were shown to be confounders were included in the final model.

We merged data from the intervention and control groups of the larger study, which was adequate, provided that the intervention was not effective [Citation31]. Although the intervention did not affect return to work [Citation32] and did not substantially affect the degree of guideline adherence [Joosen et al., submitted], we could not rule out the possibility that the intervention might have had a modifying effect on the association between guideline adherence and return to work. Therefore, we tested the intervention for effect modification in all analyses. If the intervention proved to be a significant effect modifier, we reported results for the intervention and control groups separately. Otherwise, results were reported for the merged groups.

Analyses were performed with SPSS version 19.0 and R statistical program version 3.1.2. with the frailtypack [Citation29].

Results

Baseline characteristics

shows the baseline characteristics of the 114 workers. The average age of the workers was 46 years (SD 10.7), the majority were female. The average age of the occupational physicians was 54 years, and the majority were male (77%). Distress was the most prevalent mental health problem (74.3% of the workers scoring above the cutoff for moderate distress).

Table 4. Baseline characteristics of the workers.

Guideline adherence

Overall guideline adherence

The actual degree of overall guideline adherence was low, since the median score of the sum score of all PIs was 8 (range 0–18) on a scale of 0–24 (results not shown).

Adherence to specific guideline items

The adherence to specific items per PI is shown in . Concerning the mean percentages of 'adequate guideline adherence' of both groups, there were only two PIs with more than 20% 'adequate guideline adherence': 'Rapid first consultation worker' (52.6%), and 'Regular contact worker' (26.3%).

Return to work

After one year, 84% of the 114 workers established a first return to work, whereas 79% of the 114 workers established full return to work. The mean time to first return to work was 159 calendar days (SD 124) and the median time was 117 calendar days (range 0–365). The mean time to full return to work was 220 calendar days (SD 112) and the median time was 204 calendar days (range 27–365).

Guideline adherence and time to return to work

Is better guideline adherence by occupational physicians associated with earlier return to work in workers?

Overall guideline adherence (PI sum score ≥8 versus <8) was not associated with earlier first return to work (Hazard Ratio 1.07 (95%CI 0.52 – 1.21), p = 0.747) nor with earlier full return to work (Hazard Ratio 1.25 (95%CI 0.82 – 1.89), p = 0.301).

Which specific guideline items are associated with earlier return to work?

The results are presented in (first return to work) and (full return to work). A Hazard Ratio greater than 1 indicated earlier return to work; a Hazard Ratio less than 1 indicated delayed return to work. Group allocation turned out to be an effect modifier of 2 associations. The 'Assessment of the employer’s perspective' was associated with significantly delayed return to work in the control group, but not in the intervention group. The 'Evaluation of the course of the recovery process' tended to be associated with delayed return to work in the control group whereas it tended to be associated with earlier return to work in the intervention group. The difference between the groups was statistically significant but within the separate groups the effects were not significant. In several analyses, confounders had to be taken into account.

Table 5. Effect of guideline adherence per performance indicator on time to first return to work, adjusted for significant confounders (n = 114).

Table 6. Effect of guideline adherence per performance indicator on time to full return to work, adjusted for significant confounders (n = 114).

In almost none of the PIs, was guideline adherence associated with return to work (see and ). Regular contact between the occupational physician and the employer (PI 5.3) was significantly associated with earlier full return to work but not with first return to work. Regular contact between the occupational physician and the worker showed a similar pattern although the association was not statistically significant. Unexpectedly, 'Monitoring the recovery phase of the worker' was significantly associated with delayed full return to work and almost significantly with first return to work. Similarly, 'Assessment of the employers’ perspective' was significantly associated with delayed first and full return to work, but the latter only in the control group.

Discussion

The findings of our study indicate that occupational physicians’ documented guideline adherence was, at most, minimal. Because we observed so little adequate levels of guideline adherence, we could not evaluate the impact of adequate guideline adherence on the return to work of workers sick-listed with common mental disorders. Occupational physicians’ low overall adherence to the guideline was associated with neither earlier first return to work nor earlier full return to work in sick-listed workers.

An important question that arises from the results of this study is: why did occupational physicians adhere so minimally to the guideline? We can only speculate about possible explanations. The low degree of guideline adherence adds to previous research showing low guideline adherence among health care professionals in general [Citation33–35]. Although several implementation strategies have been developed and evaluated, it is still challenging to implement and improve professionals’ guideline adherence [Citation5,Citation17,Citation36–38]. Results from other studies have shown that barriers to the use of guidelines play a crucial role in professionals’ degree of guideline adherence. According to the framework of Cabana and colleagues, specific barriers for guideline use are: knowledge-related, attitude-related, and related to external factors [Citation33]. In a qualitative study, Lugtenberg and colleagues [Citation39] found that occupational physicians reported considerable external barriers to using the Dutch occupational mental health guideline (e.g. lack of time, limited number of contacts between occupational physician and worker, and conflicting policy on, and lack of collaboration with, for example, employer and other health care providers). These external barriers were difficult to overcome, whereas several other – internal – barriers related to knowledge and attitude (skills and motivation) could readily be removed. These findings underline what Cabana and colleagues [Citation33] already pointed out, namely that external barriers can affect the ability of occupational physicians to execute the guideline recommendations. It seems likely that, in general, elimination of external barriers is conditional for better guideline adherence by professionals.

Despite the minimal adherence, regular contact between the occupational physician and the employer (and the worker) was associated with earlier return to work. As about 80% of the medical records showed no regular contact between the occupational physician and the employer, this suggests there is considerable room for improvement in the care of sick-listed workers. In the current study, it remains unclear whether the established contacts were mostly initiated by the occupational physician, the employer, or the worker, and whether more contacts between the occupational physician and the employer caused earlier return to work, or vice-versa. The importance of the involvement of the employer (e.g. supervisor, human resource management or managers) in the recovery and return to work process underlines the findings of other studies [Citation40–43]. Apparently, if occupational physicians can invest time in contact with the worker and the employer or when employers themselves are inclined to contact their occupational physicians and their workers more often, this study found that this tended to be associated with earlier return to work, a finding which is in line with previous studies [Citation12,Citation43]. Regular contact between the employer and the occupational physician might contribute to the perceived social support of the worker. Moreover, the employer has a key role in the recovery and the return to work process as the employer is familiar with the characteristics of the work and has the ability to implement (temporary) work adjustments that might be necessary for earlier work resumption. In addition, research has indicated that work is beneficial for health, particularly for depression and general mental health [Citation44].

The finding that the occupational physicians’ monitoring of the recovery phase of the worker and assessment of the employers’ perspective were associated with delayed return to work seems counter-intuitive. There are several possible explanations for these findings. First, perhaps occupational physicians who conducted a more thorough assessment of the 'Process diagnosis' found more complaints and problems and, as a result, may have allowed the worker to take more time for the recovery and return to work process. Alternatively, and equally plausibly, imminent delayed return to work may have urged the occupational physician to pay more attention to the worker’s recovery process (phases) and the employer’s perspective on the return to work of the worker. Further exploration is needed about how better assessment and more complex cases can be optimally incorporated in the guidance by occupational physicians.

However, contrary the expectation that the initial group allocation would have no influence on the associations, the association between delayed full return to work and the ‘assessment of employers’ perspective’ was only seen in the initial control group and not in the intervention group. A possible explanation for this might be that the occupational physicians in the intervention group developed more skills and a habit of assessing the employers’ perspective regardless of how the recovery and return to work process progressed, whereby they had the ability to intervene in time and to avoid delayed return to work of the worker.

Strengths and limitations

The present study has several strengths and limitations that need to be discussed. First, a strength is the conscientious and careful procedure used to develop the PIs. Another strength is the low risk for bias, as data were obtained from the registration system of the occupational health service. An audit of medical records is susceptible to bias. The risk for recording desired performance by the occupational physician is minimal, since the data collection started 3.5 years after the occupational physicians, and 1.5 years after the workers, had given informed consent. To prevent interpretation bias, all medical records were blindly assessed independently by two researchers and by a third researcher in cases where no consensus was reached.

A limitation of this study is that medical records do not necessarily reflect the actual behavior of the occupational physician, for example due to habit, lack of time, or an inadequate record system. However, the method of auditing medical records is also a strength; it is more accurate than self-perceived adherence [Citation45]. Also, it does not interfere with actual performance, as for example, actual or video observation of consultations would have done, since occupational physicians were not aware of which records were assessed. A second limitation is that no information was available from workers who did not participate in the study, for which reason a non-response analysis could not be conducted. Another limitation is that it was assumed in this study that all individual PIs influenced the degree of guideline adherence equally. However, some PIs might be conditional for others: notably if an occupational physician does not have regular contacts with the worker or the employer, it can hardly be expected that increased knowledge and skills will optimize the guidance. Furthermore, time to return to work may not be the best workers’ outcome to evaluate, because time to return to work does not reflect the quality of workers functioning after work resumption. Similarly, we chose a Dutch social security definition of sustained return to work implying a minimum of four weeks of full return to work without relapse into sickness absence. This definition, however, provides little information on the quality of the work or the long-term sustainability. Measurement of the quality of workers’ functioning provides additional and essential information besides time to return to work [Citation46,Citation47], which might be more important in more complex cases and in general.

Conclusion and implications

Because of the low percentage of adequate guideline adherence, it was not possible to evaluate the associations between adequate guideline adherence and the time to return to work in workers with common mental disorders. Overall guideline adherence was not associated with earlier return to work in workers with common mental disorders (first research question). However, when evaluating specific items of the guideline (second research question), regular contact between the occupational physician and the employer was found to be associated with earlier return to work in workers, even with minimal-to-adequate adherence. On the other hand, two specific parts of the guideline ('Monitoring the recovery phase of the worker' and 'Assessment of the employers’ perspective') were associated with delayed return to work in workers. Future research should explore these associations further, and also explore the importance of individual PIs, as some may be more important than others for successful return to work. Furthermore, future research should focus on how implementation problems and conditional external barriers for guideline use can be overcome, so as to improve the quality of guideline-based occupational mental health care. A suggestion would be that future implementation should also target the level of commitment of organizations to reducing organizational constraints to enable professionals to provide high-quality occupational health care. If future guideline implementation proves to be able to achieve truly adequate guideline adherence, instead of the current minimal adherence, new studies can assess the impact of adequate adherence on workers’ return to work and functioning.

Acknowledgements

We would like to thank all participating occupational physicians and workers for participating in the study. We also thank Remmy Kiers for extracting the data from the registration system of the occupational health service and Wobbe Zijlstra for his statistical support and data management of the extracted data. We also thank David Rebergen and Monique Loo for their support in the audit of workers’ medical records.

Disclosure statement

JvdK was the manager and main author of the NVAB guideline. JvdK did not receive fees for the use of the guideline. JvdK, MJ, and EB developed the training for occupational physicians in this study. MJ was the trainer of the training for occupational physicians. The authors did not receive fees for conducting the training. KvB, BT, and JvW declare that they have no conflicts of interests.

Additional information

Funding

This work was supported by The Netherlands Organization for Health Research and Development (ZonMw) [grant number 208030001].

References

  • OECD. Sick on the Job. Myths and Realities about Mental Health and Work: OECD; 2011 [cited 2014 14 April]. Available from: http://www.oecd.org/els/emp/sickonthejob2011.htm
  • Vaez M, Rylander G, Nygren Å, et al. Sickness absence and disability pension in a cohort of employees initially on long-term sick leave due to psychiatric disorders in Sweden. Soc Psychiat Epidemiol. 2007;42:381–388.
  • Sanderson K, Andrews G. Common mental disorders in the workforce: recent findings from descriptive and social epidemiology. Can J Psychiatry Revue Canadienne De Psychiatrie. 2006;51:63–75.
  • Joosen MC, Brouwers EP, van Beurden KM, et al. An international comparison of occupational health guidelines for the management of mental disorders and stress-related psychological symptoms. Occup Environ Med. 2015;72:313–322.
  • Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Q Safe Health Care. 2009;18:385–392.
  • Grimshaw J, Eccles M, Tetroe J. Implementing clinical guidelines: current evidence and future implications. J Continuing Educ Health Profess. 2004;24(Suppl 1):S31–S37.
  • Bastiaanssen M, Loo M, Terluin B, et al. Landelijke Eerstelijns Samenwerkings Afspraak Overspanning en burn-out. Herziening 2011. Huisarts Wetenschap. 2011;54:S11–S16.
  • Van der Klink JJL, Ausems CMM, Beijderwellen BD, et al. Richtlijn: Handelen van de bedrijfsarts bij werkenden met psychische problemen, herziene uitgave. [Guideline:The management of mental health problems of workers by occupational physicians; revised version]. Utrecht: NVAB [Netherlands Society of Occupational Medicine]; 2007.
  • NIP L. Werk en psychische klachten. Richtlijn voor psychologen. Utrecht: NIP, LVE; 2005.
  • Oomens PCJ, Huijs JJJM. RWB B. Effectiviteit van de richtlijn 'Werk en psychische klachten' voor psychologen [Effectiveness of guideline 'Work and mental health problems' for psychologists]. Hoofddorp: TNO [Dutch Organization for Applied Scientific Research]; 2009.
  • van der Klink JJL, Ausems CMM, Beijderwellen BD, et al. Richtlijn: Handelen van de bedrijfsarts bij werkenden met psychische problemen [Guideline: The management of mental health problems of workers by occupational physicians]. Eindhoven: NVAB [Netherlands Society of Occupational Medicine]; 2000.
  • van der Klink JJ, Blonk RW, Schene AH, et al. Reducing long term sickness absence by an activating intervention in adjustment disorders: a cluster randomised controlled design. Occup Environ Med. 2003;60:429–437.
  • Blonk RWB, Brenninkmeijer V, Lagerveld SE, et al. Return to work: a comparison of two cognitive behavioural interventions in cases of work-related psychological complaints among the self-employed. Work Stress. 2006;20:129–144.
  • Rebergen DS, Bruinvels DJ, Bos CM, et al. Return to work and occupational physicians' management of common mental health problems: process evaluation of a randomized controlled trial. Scand J Work Environ Health. 2010;36:488–498.
  • Rebergen DS, Bruinvels DJ, Bezemer PD, et al. Guideline-based care of common mental disorders by occupational physicians (CO-OP study): a randomized controlled trial. J Occup Environ Med/Am College Occup Environ Med. 2009;51:305–312.
  • Nieuwenhuijsen K, Verbeek JHAM, Siemerink JCMJ, et al. Quality of rehabilitation among workers with adjustment disorders according to practice guidelines; a retrospective cohort study. Occup Environ Med. 2003;60:i21–i25.
  • Rebergen D, Hoenen J, Heinemans A, et al. Adherence to mental health guidelines by Dutch occupational physicians. Occup Med (Lond). 2006;56:461–468.
  • Korthals AH. Wet verbetering poortwachter. [Dutch Gatekeeper Improvement Act] Den Haag: Ministerie van Justitie; 2001 [cited 2014 22 December]. Available from: http://wetten.overheid.nl/BWBR0013063.
  • van Beurden KM, Brouwers EP, Joosen MC, et al. Effectiveness of guideline-based care by occupational physicians on the return-to-work of workers with common mental disorders: design of a cluster-randomised controlled trial. BMC Public Health. 2013;13:193.
  • World Health Organization. International Statistical Classification of Deseases and Related Health Problems-10th revision, edition 2010. Geneva: WHO; 2011.
  • Grol R, Wensing M, Eccles M. Improving patient care: the implementation of change in clinical practice. Edinburgh: Elsevier Butterworth Heinemann; 2005.
  • Campbell SM, Braspenning J, Hutchinson A, et al. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326:816–819.
  • Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15:523–530.
  • Rubin HR, Pronovost P, Diette GB. From a process of care to a measure: the development and testing of a quality indicator. Int J Qual Health Care 2001;13:489–496.
  • Terluin B, van Marwijk H, Ader H, et al. The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry. 2006;6:34.
  • Lagerveld SE, Blonk RWB, Brenninkmeijer V, et al. Return to work among employees with mental health problems: development and validation of a self-efficacy questionnaire. Work Stress. 2010;24:359–375.
  • Ilmarinen J, Tuomi K. Work ability index for aging workers. Helsinki: Finnish Institute of Occupational Health; 1993.
  • Ahlstrom L, Grimby-Ekman A, Hagberg M, et al. The Work Ability Index and single-item Question: associations with sick leave, symptoms, and health-a prospective study of women on long-term sick leave. Scand J Work Environ Health. 2010;36:404–412.
  • Rondeau V, Mazroui Y, Gonzalez J. Frailtypack: an R package for the analysis of correlated survival data with frailty models using penalized likelihood estimation or parametrical estimation. J Stat Soft. 2012;47:1–28.
  • Andersen P, Gill R. Cox's regression model for counting processes: a large sample study. Ann Stat. 1982;10:1100–1120.
  • Moons KG, Royston P, Vergouwe Y, et al. Prognosis and prognostic research: what, why, and how? BMJ. 2009;338:b375
  • van Beurden KM, Brouwers EPM, Joosen MCW, et al. Effectiveness of an intervention to enhance occupational physicians’ guideline adherence on sickness absence duration in workers with common mental disorders: a cluster-randomized controlled trial. J Occup Rehabil. 2016;15:796.
  • Cabana MD, Rand CS, Powe NR, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–1465.
  • Kennedy PJ, Leathley CM, Hughes CF. Clinical practice variation. Med J Australia. 2010;193:S97–S99.
  • Mulley AG. Inconvenient truths about supplier induced demand and unwarranted variation in medical practice. BMJ. 2009;339:b4073.
  • Giguere A, Legare F, Grimshaw J, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(10):Cd004398.
  • Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):Cd000259.
  • Wallin L. Knowledge translation and implementation research in nursing. Int J Nurs Stud. 2009;46:576–587.
  • Lugtenberg M, van Beurden KM, Brouwers EP, et al. Occupational physicians' perceived barriers and suggested solutions to improve adherence to a guideline on mental health problems: analysis of a peer group training. BMC Health Serv Res. 2016;16:271.
  • Abma FI, Bultmann U, Varekamp I, et al. Workers with health problems: three perspectives on functioning at work. Disabil Rehabil. 2013;35:20–26.
  • Brouwer S, Reneman MF, Bultmann U, et al. A prospective study of return to work across health conditions: perceived work attitude, self-efficacy and perceived social support. J Occup Rehabil. 2010;20:104–112.
  • Holmgren K, Dahlin Ivanoff S. Supervisors' views on employer responsibility in the return to work process. A focus group study. J Occup Rehabil. 2007;17:93–106.
  • Nieuwenhuijsen K, Verbeek JH, de BAG, et al. Supervisory behaviour as a predictor of return to work in employees absent from work due to mental health problems. Occup Environ Med. 2004;61:817–823.
  • van der Noordt M, HIJ, Droomers M, Proper KI. Health effects of employment: a systematic review of prospective studies. Occup Environ Med. 2014;71:730–736.
  • Adams AS, Soumerai SB, Lomas J, et al. Evidence of self-report bias in assessing adherence to guidelines. Int J Q Health Care. 1999;11:187–192.
  • Hees HL, Nieuwenhuijsen K, Koeter MW, et al. Towards a new definition of return-to-work outcomes in common mental disorders from a multi-stakeholder perspective. PLoS One. 2012;7:e39947.
  • Abma FI, van der Klink JJ, Bultmann U. The work role functioning questionnaire 2.0 (Dutch version): examination of its reliability, validity and responsiveness in the general working population. J Occup Rehabil. 2013;23:135–147.