5,439
Views
21
CrossRef citations to date
0
Altmetric
Original Articles

Nursing Staff Factors Contributing to Seclusion in Acute Mental Health Care – An Explorative Cohort Study

, RN, MSc, , RN, PhD, , RN, PhD, , RN, PhD, , PhD, , MD, PhD, , MD, PhD & , MD, PhD show all

ABSTRACT

Background: Seclusion is a controversial intervention. Efficacy with regard to aggressive behaviour has not been demonstrated, and seclusion is only justified for preventing safety hazards. Previous studies indicate that nursing staff factors may be predictors for seclusion, although methodological issues may have led to equivocal results. Objective: To perform a prospective cohort study to determine whether nursing staff characteristics are associated with seclusion of adult inpatients admitted to a closed psychiatric ward. Method: We studied the association between nurses' demographics and incidence of seclusion during every shift. Data were collected during five months in 2013. Multiple logistic regression was used for analysis. Results: In univariable analysis, we found a non-significant association between seclusion and female gender, odds ratio (OR) = 5.27 (0.98–28.49) and a significant association between seclusion and nurses' large physical stature, OR = 0.21 (0.06–0.72). We found that physical stature is the most substantial factor, although not significant: ORadjusted = 0.27 (0.07–1.04). Conclusion: Nurses' gender may be a predictor for seclusion, but it seems to be mediated by the effect of physical stature. We used a rigorous, census-based, prospective design to collect data on a highly detailed level and found a large effect of physical stature of nurses on seclusion. We found nurses' physical stature to be the most substantial predictor for seclusion. These and other factors need to be explored in further research with larger sample size.

Introduction

Background

Seclusion is an intervention still widely used in mental health care (Bak & Aggernaes, Citation2012; Janssen et al., Citation2014). There are large differences in the use of seclusion or other coercive interventions across countries in Europe (Bak & Aggernaes, Citation2012; Janssen et al., Citation2009; Steinert, Noorthoorn, & Mulder, Citation2014). Serious safety hazards in psychiatric hospitals – such as aggression and violence of patients against staff, fellow patients or goods – are the main reason to use coercive interventions (Happell et al., Citation2012).

Seclusion is a controversial intervention, and therapeutic effects have never been shown (Busch & Shore, Citation2000; Moran et al., Citation2009; Sailas & Fenton, Citation2000). On the contrary, patients reported negative effects such as anxiety, anger, feelings of being abandoned and traumatic experiences of being secluded (Fisher, Citation1994; Frueh et al., Citation2005; Van Der Merwe, Muir-Cochrane, Jones, Tziggili, & Bowers, Citation2013). Even in healthy subjects, seclusion causes feelings of anxiety and suspicion (Kuosmanen, Makkonen, Lehtila, & Salminen, Citation2015). For this reason, the Dutch Ministry of Health, Welfare and Sports ordered in 2004 that Dutch mental health care should decrease seclusion rates by at least 10% each year (GGZ-Nederland, Citation2004). The use of seclusion and duration of seclusion episodes decreased more than 50% in 2012 compared to 2008 (Janssen et al., Citation2014). In Citation2012, 6.5% of the patients admitted in a psychiatric hospital in the Netherlands were secluded during their hospital stay, with a median duration of 17.7 hours per seclusion episode (Janssen et al., Citation2014). The Dutch Mental Health Act only permits seclusion in case of severe danger on a psychiatric ward due to aggressive or violent behaviour of patients, and the coercive measures must be used proportional, as short as possible, safe, humane and respectful (IGZ, Citation2011).

Several studies reported factors associated with seclusion in mental health care, which can be categorized into patient, nursing staff and unit characteristics. Larue, Dumais, Ahern, Bernheim, and Mailhot (Citation2009) identified younger age, male gender and diagnosis of schizophrenia or bipolar disorder as patient characteristics associated with a higher risk of being secluded during an admission. Vruwink et al. (Citation2012) and Tunde-Ayinmode and Little (Citation2004) also found a younger age of patients to be associated with a higher risk of being secluded. Furthermore, aggression during previous admissions or prior to the current admission and involuntary admission are found to be associated with being secluded (Vruwink et al., Citation2012). Findings concerning the effect of nursing staff and unit characteristics on seclusion are equivocal. Nijman, Duangto, Ravelli, Merckelbach, and Vorel (Citation1994) found no significant associations between seclusion and the nurses' gender, years of experience and patient-staff ratio in a closed long-stay psychiatric ward. Vollema, Hollants, Severs, and Hondius (Citation2012) reported significant associations between seclusion and the subjective feelings of safety among nurses (OR = 1.77, p =.005). In other words, when nurses felt safer they were less likely to seclude a patient. Janssen, Noorthoorn, Linge, and Lendemeijer (Citation2007) found male-female staff ratio and variability in the amount of professional experience in a team to be significantly associated with seclusion rates. More female nurses and low variety in the experience as a psychiatric nurse resulted in higher seclusion rates. On the other hand, Bowers et al. (Citation2010) reported that seclusion was significantly associated with more male nurses on duty (IRR = 1.30, p <.05). Furthermore, lower patient/staff ratios were significantly associated with seclusion (Morrison & Lehane, Citation1995; Tunde-Ayinmode & Little, Citation2004), but not all authors found this association (e.g. Vollema et al. (Citation2012) and Husum, Bjorngaard, Finset, and Ruud (Citation2010)). These studies, however, all had methodological limitations, e.g., a retrospective or cross-sectional design and/or small sample size. Summarizing, previous studies indicate that not only patient but also nursing staff factors may be predictors for seclusion, although methodological issues may have led to equivocal results.

Objective

The objective of the study was to perform a prospective study to determine whether nursing staff characteristics are associated with seclusion of adult inpatients admitted to a closed psychiatric ward.

Methods

Study design

We conducted a naturalistic prospective cohort study. The manuscript was drafted using the Strengthening the Reporting of Observational studies in Epidemiology (STROBE) reporting guidelines.

Ethical considerations

In our study, we used only anonymized data, obtained from the patients' medical chart. Data could not be traced back to either an individual patient or nurse. The nursing staff was informed about the study confidentiality and about the option not to reveal their personal information. By filling in the case record form, the nurses gave their consent to the use of their anonymized details. The Medical Ethics Review Committee reviewed our study protocol and decided that no ethical approval was required according to the Dutch Medical Research Involving Human Subject Act (WMO).

Setting and participants

The study was conducted at a closed admission ward on the psychiatric department of an academic hospital in Amsterdam, the Netherlands.

All nurses working in the ward and all patients admitted to the ward during the data collection period were included in our study. The ward consists of two separate units, and each unit consists of six patient rooms and one seclusion room located outside the ward. Each patient has a private bedroom and bathroom. Both units have their own living room, conversation room, kitchen and a room where patients are allowed to smoke cigarettes. Both units have access to a central garden. The nursing station is situated at the centre of the ward and serves both units. Patients who are secluded are monitored closely; nurses check on them at least every 15 minutes (by camera or through a window in the door) and visit them regularly for basic care and activities.

The nurses at the ward are registered in the Dutch registration of health care professionals. All registered nurses are trained every six months in techniques of verbal de-escalation, safe physical restraint and the care for patients in seclusion rooms. Student nurses are included in our study, but always work on a supernumerary basis. Patients were aged 18–65 years and were mostly admitted to the ward on an involuntary basis, because of acute danger for the patient or their surroundings, due to their psychiatric condition.

Data collection and variables

Data were collected between 1 January 2013 and 30 June 2013. Our sample size was dependent on the admission rates and the number of nurses at the ward. By including all nurses and patients, we maximized the possible sample size for this study. For the current study, we wanted to include at least 20 incidents.

In the Netherlands, seclusion is defined as the restraint of a patient for care and treatment in a designated seclusion room (containing only a mattress and a blanket) approved by the Dutch Health Care Inspectorate (IGZ, Citation2011). Nursing staff characteristics were obtained by a case record form (gender, age, length, weight, registered nurse y/n, level of education, level of employment, years of employment, years of experience in mental health care, years of experience with seclusion, permanent staff/temporary staff, nurse manager y/n, senior nurse y/n).

To assess whether a large or small physique of the nurse was a predictor of seclusion, we categorized ‘physical stature’, into three categories: small (smaller than a same sex person of similar age), average (comparable to a same sex person of similar age) and large (larger than a same sex person of similar age), based on length, weight and (observed) physique. Physical stature was visually determined by two independent assessors because of the subjective nature of this variable. They assessed the nurses by looking at length, weight and width to determine whether the nurse had a small, average or large stature. The assessors had a substantial interobserver agreement (Cohen's κ =.74) (Landis & Koch, Citation1977). Consensus between both assessors was reached for the remaining cases. Patient characteristics were obtained from the electronic patient record and used to correct for possible confounding due to patient variance.

Data were collected three times every 24 hours at each turn of the shift. We selected these variables based on suggestions in existing literature on this subject (Abdul Rahman, Jarrar, & Don, Citation2015; Bowers et al., Citation2010; Husum et al., Citation2010; Janssen et al., Citation2007; Morrison & Lehane, Citation1995; Nijman et al., Citation1994; Tunde-Ayinmode & Little, Citation2004; Vollema et al., Citation2012) and based on our own hypothesis that nurses' stature may be an important factor.

The dependent variable (involuntary seclusion) was measured at patient level, and the predictor variables of interest were measured at nursing staff and unit level. Seclusion data were obtained from the Argus registration system, which contains information on involuntary admissions and coerced treatment. Its use is obligatory for every psychiatric hospital in the Netherlands. Argus provides reliable information of the number and duration of seclusions on the ward (Janssen, Citation2012). No voluntary seclusion was used on the ward during the study period.

Analysis

To assess staff characteristics predicting seclusion, we used a two-step approach proposed by Hosmer and Lemeshow (Citation2000).

In the first step, we selected the predictors for the multiple logistic regression analysis. In this step, separate univariate logistic regression analyses with seclusion as dependent variable were conducted for each potential predictor. Nursing staff characteristics were collected for the nursing team working at the ward on shift level. The nursing staff characteristics are analysed in an aggregated manner. A propensity score is the predictive value of group membership and can be used to correct for multiple possible confounders (Rubin, Citation1997) The propensity score is found by predicting the exposed group membership from the patients' baseline characteristics by a logistic regression analysis and added to the prediction model.

Predictors with a p value <.20 in the first step were selected for the second step. In this second step, a multiple logistic regression model was conducted with the selected predictors of the first step and the propensity score. SPSS, version 19 (SPPS Inc. USA) was used for all analyses.

Bias

Staff participants were blinded for the hypotheses of our study to prevent performance bias. Patients at the ward were unaware of the study being performed. We included all patients and staff members at the ward to prevent selection bias. Our primary endpoint (involuntary seclusion) is an explicit, dichotomous endpoint, suitable for logistic regression analysis. We use multiple logistic regression analysis to correct for any confounding variables. We are conservative in using independent variables in our logistic regression model to prevent the model from overfitting.

Results

Participants

The total group of nurses (n = 47) consisted of subgroups of permanent staff of registered nurses (n = 20), registered nurses with a temporary employment (n = 18) and student nurses (n = 9). Nurses were mostly female (61.7%) with a median age of 35.8 years. Twelve of the nurses worked full time (25.5%). The nurses worked for a median of 2.8 years at the ward and had a median of four years of experience in clinical mental health care ().

Table 1. Nursing Staff Characteristics (n = 47).

In our sample, data were missing for two nurses; each of them was present in one shift during our study period. We could not assess the physical stature of four nurses, because these participants worked at the ward for a very short period of time.

Outcome data

We recorded 23 seclusions, from which we excluded two events because the patients were secluded while staying at another unit of the psychiatric department. Thirteen patients from our sample were secluded (1–3 times) during the study period (27.1%).

Patients who were secluded more often were admitted after an aggressive incident (p =.010) or admitted for the first time to a psychiatric hospital (p =.002). Patients who were secluded also had (surprisingly) significantly higher scores in the Global Assessment of Functioning compared to the patients who were not secluded during their admission (p =.004) (). To adjust for potential confounding due to these imbalances, we corrected the association of the possible predictors and seclusion with the propensity score (an aggregated variable of patients' characteristics). Secluded patients (median =.01310; IQR =.0157) and non-secluded patients (median =.00079; IQR =.0059) differed significantly in their propensity scores (U = 61.07; p <.001).

Table 2. Patient Characteristics (n = 48).

Main results

A higher (although not significant) proportion of female nurses present at the ward increased the odds of a patient being secluded, OR (95% CI) = 5.27 (0.98–28.49). Furthermore, a larger mean physical stature of the shifts' nursing team reduced the odds of seclusion, OR = 0.21 (0.06–0.72). This suggests that the presence of female nurses was associated with higher chance of seclusion of patients, while the presence of nurses with large physical stature was associated with significantly lower chance of seclusion during their shift. These were also the only variables with a univariate p value ≤.20 as predictor for seclusion ().

Table 3. Results of Univariate Regression Analysis.

Male and female nurses differed significantly in age (U = 351.00; p =.008), i.e. male nurses were significantly older than female nurses. To assess whether this confounded the relation between the proportion of female nurses and seclusion, we added the mean age of the nursing staff present in the shift to the regression model with the proportion of female nurses and the propensity score as independent variables and found a small increase of the odds ratio (OR) for female nurses, ORadjusted = 5.48 (0.95–29.62). We concluded that age did not confound this relation according to the rule of thumb that a factor is a confounder when the adjusted effect estimate differs at least 10% from the unadjusted effect (Bliss, Weinberg, Webster, & Vieira, Citation2012)).

Male and female nurses also differed significantly in physical stature (U = 282.50; p =.026). Male nurses had significantly larger physical statures then female nurses. To assess whether this difference in physical stature biased the relation between the proportion of female nurses and seclusion, we added the mean physical stature of the shifts' nursing team to the regression model with proportion of female nurses and the propensity score as independent variables. The decrease of the OR for the proportion of female nurses, ORadjusted = 2.71 (0.44–16.71), suggested that the mean physical stature did confound the relation between proportion of female nurses and seclusion as this differed more than 10% from the unadjusted effect estimates. In the model with the proportion of female nurses and the propensity score as independent variables, we found a large (although at a trend level) effect for the mean physical stature of the shifts' nursing team, ORadjusted = 0.27 (0.07–1.04).

Discussion

Key results

We found a substantial (although at a trend level) association between seclusion and gender and a substantial and significant association between physical stature and seclusion. Physical stature, controlled for gender, may be an important characteristic of nurses predicting seclusion. The effect of nurses' gender is in line with the findings of Vollema et al. (Citation2012) but not in accordance to the findings of Janssen et al. (Citation2007) and Bowers et al. (Citation2009). We found no significant association between nurses' age and seclusion (in line with Nijman et al. (Citation1994)) and for the nurses' experience in mental health care, but contrary to Janssen et al. (Citation2007). We did not find previous studies on the effect of nurses' physical stature on seclusion. Because of the lack of previous evidence on this matter, we consider this the most important new finding of this study.

We found no significant effect of patient-staff ratio on seclusion though we hypothesized that patient-staff ratio would be significantly related to seclusion risk, in accordance to Tunde-Ayinmode and Little (Citation2004) and Morrison and Lehane (Citation1995). However, the fact that we found no effect on patient-staff ratio may be due to the lack of variance in patient-staff ratio in our sample, or due to the small sample size.

A previous study showed that feelings of unsafety among nurses on the ward measured retrospectively were related to seclusion (Vollema et al., Citation2012). However, to measure this prospectively may make nurses more aware of their feelings of feeling unsafety that may influence the probability of seclusion. Obviously, the occurrence of an aggressive incident influences feelings of unsafety of nurses. By introducing feelings of safety as a possible risk factor for the occurrence of seclusion, we may also influence feelings of unsafety and could therefore bias the association. For this reason, we did not include this factor in our prospective study. Nevertheless, hazardous behaviour is the primary criterion for seclusion. This will affect the feelings of safety of the nurse, and we do recognize its importance on the use of seclusion and other coercive measures.

Strengths and limitations

Previous studies on this matter collected data retrospectively (Janssen et al., Citation2007; Nijman et al., Citation1994; Vollema et al., Citation2012), used a cross-sectional design (Bowers et al., Citation2010) or primarily addressed patient-staff ratios (Morrison & Lehane, Citation1995; Tunde-Ayinmode & Little, Citation2004). One of the strengths of our study is that we used a rigorous, census-based, prospective design to collect data. Moreover, data collection took place on a highly detailed level; we collected data on a level of shift, so we could confirm that the analysed nurses were present at the time the event took place. We also analysed all patient charts for events, instead of only analysing the events reported by nurses.

However, the findings of our study should be interpreted in the light of the following limitations. The first and main limitation is that we performed this study with a relatively small sample size, so the statistical power is limited. Therefore, despite the fact that we found large effects, replication is needed. The second major limitation is that we performed this study in a single hospital, restricting the generalizability of our results, although stature and gender may not be very context sensitive. Finally, logistic regression analysis assumes that the nurses within the team were independent data sources, which was probably not the case. Nurses within a team will influence each other when working together in a shift. In future studies with enough statistical power, multilevel logistic regression analyses must be considered.

Generalisability

Our study was performed at a closed admission ward in an academic hospital. Because this admission ward has an obligation to accept involuntary admissions from Amsterdam and surroundings, we propose that our findings are generalizable to closed admission wards of non-academic clinics as well. Legislations of psychiatric admissions in the Netherlands are identical for academic and non-academic hospitals.

Interpretation

We found substantial effect sizes for proportion of female nurses (OR = 5.27) and large mean physical stature of the shifts' nursing team (OR = 0.21) on seclusion. Physical stature seems to be a more robust factor in the multiple regression model suggesting that the main part of the association between the proportion of female nurses and seclusion is mediated by physical stature. Because of the small sample size, we are cautious with the interpretation of these findings. Therefore, in future research, the influence of stature and factors associated with stature as well as unit characteristics like patient-staff ratio should be evaluated in studies with a larger sample size.

Creating a safe environment in psychiatric admission wards is an important challenge of professionals worldwide. Several initiatives for reducing coercion and for improving quality of care have started in the recent years, e.g., the High Intensive Care model in the Netherlands (Mierlo van, Bovenberg, Voskes, & Mulder, Citation2013) and Safewards internationally (Bowers, Citation2014; Bowers et al., Citation2014). Both initiatives emphasize the importance of the interaction between nurses and patients.

If our result that the sex and stature of nurses is related to seclusion is replicated in a larger study, this may have practical implications. We propose that raising awareness of the influence of nurses on (the reduction of) coercive measures needs further exploration. Aggression and violence both have a possible interactional component, and research and innovation should not focus on patients alone. The composition of nursing teams can be influenced by policy makers and may be a factor of interest when taking the next step in further reducing coercive measures in mental health care. When our main results are replicated in an independent study, we should consider adaptions in nursing team composition. This may contribute to the goal of diminishing seclusion as a coercive measure in mental health care as much as possible. Seclusion and other coercive measures in mental health care are a threat to patients' safety and should be used with great caution. Article 5, section 1 in the European Convention for the Protection of Human Rights and Fundamental Freedoms declares that no person should be deprived of its liberty. As section 1e states, in case of severe psychiatric disorders, lawful seclusion is sometimes necessary. It does not alter the fact that national and international standards in using coercion in mental health care should be focussed on preventing coercion by all means possible. By gaining more knowledge concerning risk factors for coercion and seclusion, we aim to contribute to the international goal of banning seclusion from mental health facilities.

Disclosure of interest

No conflict of interest has been declared by the author(s).

Acknowledgments

The authors thank all nurses of the psychiatric department of the AMC for cooperating in this study, especially Sascha da Silva Curiel for assisting in the data collection. They also thank Lindy Boyette, PhD (University of Amsterdam), for critical reading of the manuscript.

Funding

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors. This study was funded by the Department of Psychiatry of the Academic Medical Centre in Amsterdam and the Faculty of Health of the Amsterdam University of Applied Sciences.

References

  • Abdul Rahman, H., Jarrar, M. K., & Don, M. S. (2015). Nurse level of education, quality of care and patient safety in the medical and surgical wards in Malaysian Private Hospitals: A cross-sectional study. Global Journal of Health Science, 7(6), 331–337. doi:10.5539/gjhs.v7n6p331
  • Bak, J., & Aggernaes, H. (2012). Coercion within Danish psychiatry compared with 10 other European countries. Nordic Journal of Psychiatry, 66(5), 297–302. doi:10.3109/08039488.2011.632645
  • Bliss, R., Weinberg, J., Webster, T., & Vieira, V. (2012). Determining the probability distribution and evaluating sensitivity and false positive rate of a confounder detection method applied to logistic regression. Journal of Biometrics & Biostatistics, 3(4), 142. doi:10.4172/2155–6180.1000142
  • Bowers, L. (2014). Safewards: a new model of conflict and containment on psychiatric wards. Journal of Psychiatric and Mental Health Nursing, 21(6), 499–508. doi:10.1111/jpm.12129
  • Bowers, L., Alexander, J., Bilgin, H., Botha, M., Dack, C., James, K., … Stewart, D. (2014). Safewards: the empirical basis of the model and a critical appraisal. Journal of Psychiatric and Mental Health Nursing, 21(4), 354–364. doi:10.1111/jpm.12085
  • Bowers, L., Allan, T., Simpson, A., Jones, J., Van Der Merwe, M., & Jeffery, D. (2009). Identifying key factors associated with aggression on acute inpatient psychiatric wards. Issues in Mental Health Nursing, 30(4), 260–271. doi:10.1080/01612840802710829
  • Bowers, L., Van Der Merwe, M., Nijman, H., Hamilton, B., Noorthorn, E., Stewart, D., & Muir-Cochrane, E. (2010). The practice of seclusion and time-out on English acute psychiatric wards: The City-128 Study. Archives of Psychiatric Nursing, 24(4), 275–286. doi:10.1016/j.apnu.2009.09.003
  • Busch, A. B., & Shore, M. F. (2000). Seclusion and restraint: A review of recent literature. Harvard Review of Psychiatry, 8(5), 261–270.
  • Fisher, W. A. (1994). Restraint and seclusion: A review of the literature. American Journal of Psychiatry, 151(11), 1584–1591.
  • Frueh, B. C., Knapp, R. G., Cusack, K. J., Grubaugh, A. L., Sauvageot, J. A., Cousins, V. C., … Hiers, T. G. (2005). Patients' reports of traumatic or harmful experiences within the psychiatric setting. Psychiatric Services, 56(9), 1123–1133. doi:10.1176/appi.ps.56.9.1123
  • GGZ-Nederland. (2004). De krachten gebundeld: ambities van de GGZ. Amersfoort: GGZ Nederland.
  • Happell, B., Dares, G., Russell, A., Cokell, S., Platania-Phung, C., & Gaskin, C. J. (2012). The relationships between attitudes toward seclusion and levels of burnout, staff satisfaction, and therapeutic optimism in a district health service. Issues in Mental Health Nursing, 33(5), 329–336. doi:10.3109/01612840.2011.644028
  • Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression, second edition (2 ed.). New York: John Wiley & Sons, Inc.
  • Husum, T. L., Bjorngaard, J. H., Finset, A., & Ruud, T. (2010). A cross-sectional prospective study of seclusion, restraint and involuntary medication in acute psychiatric wards: patient, staff and ward characteristics. BMC Health Services Research, 10, 89. doi:10.1186/1472-6963-10-89
  • IGZ. (2011). Terugdringen separeren stagneert, normen vereist rondom insluiting psychiatrische patiënten. Uitkomsten inspectieonderzoek naar de preventie van separeren 2008–2011. Retrieved from http://www.rijksoverheid.nl/documenten-en-publicaties/rapporten/2011/12/08/terugdringen-separeren-stagneert-normen-vereist-rondom-insluiting-psychiatrische-patienten.html
  • Janssen, W. A. (2012). Argus: assessment and use of data in evaluating coercive measures in Dutch psychiatry. PhD thesis, Vrije Universiteit, Amsterdam.
  • Janssen, W. A., Noorthoorn, E., Linge, R., & Lendemeijer, B. (2007). The influence of staffing levels on the use of seclusion. International Journal of Law and Psychiatry, 30(2), 118–126. doi:10.1016/j.ijlp.2006.04.005
  • Janssen, W. A., Noorthoorn, E., Sande, R. V. d., Nijman, H. L. I., Smit, A., Hoogendoorn, A., … Widdershoven, G. A. M. (2014). Zes jaar Argus. Vrijheidsbeperkende interventies in de GGz in 2012 en ontwikkeling ten opzichte van voorgaande jaren. Retrieved from Amersfoort.
  • Janssen, W. A., Noorthoorn, E. O., Vries, W. J. d., G. J. M. H., Nijman, H. L. I., Smit, A., … Widdershoven, G. A. M. (2009). Separaties in psychiatrische ziekenhuizen 2002–2008: Nederland internationaal vergeleken. Maandblad Geestelijke Gezondheidszorg, 64(6), 457–469.
  • Kuosmanen, L., Makkonen, P., Lehtila, H., & Salminen, H. (2015). Seclusion experienced by mental health professionals. Journal of Psychiatric and Mental Health Nursing, 22(5), 333–336. doi:10.1111/jpm.12224
  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
  • Larue, C., Dumais, A., Ahern, E., Bernheim, E., & Mailhot, M. P. (2009). Factors influencing decisions on seclusion and restraint. Journal of Psychiatric and Mental Health Nursing, 16(5), 440–446. doi:10.1111/j.1365-2850.2009.01396.x
  • Mierlo van, T., Bovenberg, F., Voskes, Y., & Mulder, C. L. (2013). Werkboek HIC. High en intensive care in de psychiatrie. Utrecht: Uitgeverij de Tijdstroom.
  • Moran, A., Cocoman, A., Scott, P. A., Matthews, A., Staniuliene, V., & Valimaki, M. (2009). Restraint and seclusion: a distressing treatment option? Journal of Psychiatric and Mental Health Nursing, 16(7), 599–605. doi:10.1111/j.1365-2850.2009.01419.x
  • Morrison, P., & Lehane, M. (1995). Staffing levels and seclusion use. Journal of Advanced Nursing, 22(6), 1193–1202.
  • Nijman, H. L. I., Duangto, C., Ravelli, D. P., Merckelbach, H. L. G. J., & Vorel, S. K. (1994). [Staff characteristics and the use of seclusion] Tijdschrift Voor Psychiatrie, 36(2), 130–138.
  • Rubin, D. B. (1997). Estimating causal effects from large data sets using propensity scores. Annals of Internal Medicine, 127(8 Pt 2), 757–763.
  • Sailas, E., & Fenton, M. (2000). Seclusion and restraint for people with serious mental illnesses. The Cochrane Database of Systematic Reviews, (2), Cd001163. doi:10.1002/14651858.cd001163
  • Steinert, T., Noorthoorn, E. O., & Mulder, C. L. (2014). The use of coercive interventions in mental health care in Germany and the Netherlands. A comparison of the developments in two neighboring countries. Frontiers in Public Health, 2, 141. doi:10.3389/fpubh.2014.00141
  • Tunde-Ayinmode, M., & Little, J. (2004). Use of seclusion in a psychiatric acute inpatient unit. Australasian Psychiatry, 12(4), 347–351. doi:10.1111/j.1440-1665.2004.02125.x
  • Van Der Merwe, M., Muir-Cochrane, E., Jones, J., Tziggili, M., & Bowers, L. (2013). Improving seclusion practice: implications of a review of staff and patient views. Journal of Psychiatric and Mental Health Nursing, 20(3), 203–215. doi:10.1111/j.1365-2850.2012.01903.x
  • Vollema, M. G., Hollants, S. J., Severs, C. J., & Hondius, A. J. (2012). [Determinants of seclusion in a psychiatric institution: A naturalistic and exploratory study]. Tijdschrift Voor Psychiatrie, 54(3), 211–221.
  • Vruwink, F. J., Noorthoorn, E. O., Nijman, H. L., Vandernagel, J. E., Hox, J. J., & Mulder, C. L. (2012). Determinants of seclusion after aggression in psychiatric inpatients. Archives of Psychiatric Nursing, 26(4), 307–315. doi:10.1016/j.apnu.2011.10.004