Abstract

Context

Audits conducted on medical records have been traditionally used in hospitals to assess and improve quality of medical care but have yet to be properly integrated and used for suicide prevention purposes. We aimed to (1) revise a quality of care grid and adapt it to an adult population of suicide attempters and (2) identify quality of care deficits in managing adult suicide attempters at the emergency department (ED) in two different Montreal university hospitals.

Methods

An existing checklist for quality of medical and social care in the ED was adapted. A systematic search and data extraction of all suicide attempters in two different Montreal university hospitals were then conducted. All identified individuals who attempted suicide were fully reviewed and quality of care was assessed.

Results

Eleven criteria were kept by the expert focus group in the revised grid that was then used to rate 369 individuals that attempted suicide. Suicide risk assessment was only present in 63% of attempters before discharge. Although family history was documented for 90% of attempters, in only 41% of the cases were interviews conducted with relatives. Most discharged patient lacked proper follow-up considering 11% of their relatives received written information on resources in case of need.

Discussion

Paper records may be used to systematically assess the quality of care for suicide attempters seen in ED. Results reiterate the need for better suicide prevention strategies for these individuals. The checklist proved to be an excellent assessment of best practices or identification of possible improvements.

INTRODUCTION

Suicide is a major public health concern worldwide (Borges et al., Citation2010; WHO, Citation2018). In Quebec alone, it takes the lives of more than a thousand individuals per year and represents almost a third of all suicide deaths in Canada (Levesque, Gagné, Pelletier, & Perron, Citation2018). Even more alarming is the fact that 48.7% of individuals who died by suicide were seen in the Emergency Department (ED) for various reasons including suicide attempts in the year preceding their death (Vasiliadis, Ngamini-Ngui, & Lesage, Citation2015).

Suicide attempts are known to be a major risk factor of suicide death (Steele, Thrower, Noroian, & Saleh, Citation2018). Many suicide attempters present themselves to the ED making it therefore a plausible place to prevent reenactment of suicidal behavior and the startup point for secondary prevention (Larkin & Beautrais, Citation2010). Yet, there are no “gold standards” in the management of suicidal patients. A myriad of recommendations, referred to as guidelines, do exist but with no obligation of a follow-up by the medical team (CRESP, Citation2015; Knesper, Citation2010; Lane, Hébert, Bazinet, & Gagné, Citation2015; NICE, Citation2004). The application of these recommendations is left entirely to the clinician’s judgment toward the situation at hand. This allows for inconsistencies not only between hospital facilities but also between wards and clinicians as well.

There are documented gaps in services for suicide attempters, all jeopardizing patients’ survival (Renaud et al., Citation2014; Vasiliadis et al., Citation2015). Audits of suicide cases conducted in two Canadian provinces (Fortin et al., Citation2019; Lesage et al., Citation2008) and systematically in the UK through the National Confidential Enquiry on Suicides, have shown important deficits in coordination of medical and social care involving the ED for patients in crisis (While et al., Citation2012). Amongst these identified deficits, mental health and substance use disorders seem not to be addressed in ED settings leaving patients and relatives to return to their environment that led to the attempt in the first place without appropriate support (Lesage et al., Citation2008). To avoid the return of suicidal behavior, it is necessary to systematically identify these service gaps and develop appropriate measures to address them. The recommendations from the clinical audits of the UK National Confidential Enquiry on Suicide, the New Brunswick provincial audit, and the Montreal audits all point toward improving standard procedures in the ED for suicide attempters by developing and applying standards-based audits for the ED with regards to suicide attempts.

To our knowledge, there is no other specific standards-based checklist to assess quality of care for adult suicide attempters that could be performed from medical records. There is, however, a grid that was developed for adolescent attempters on quality of medical and social care in the ED by France’s Agence nationale d’accréditation et d’évaluation en santé (ANAES). This grid was further tested in Quebec by Renaud, Lesage, and Boivin (Citation2004) with a sample of adolescents. Results of the use of the ANAES grid with adolescents from Quebec were very similar to results found in France. Following this adolescent audit process in Quebec, Renaud et al. (Citation2004) strongly recommended extending the use of this grid to other contexts and populations. For this reason, the current study aims to (1) revise and adapt a quality of care grid to an adult population of suicide attempters in the context of Montreal university hospitals and (2) identify quality of care deficits in two different Montreal university hospitals.

MATERIALS AND METHODS

The study procedure included a total of three steps: (1) Review and adaptation of the quality of care grid, (2) Systematic search and data extraction, which were conducted concurrently and (3) Identification of quality of care deficits in participating hospitals.

Review and Adaptation of the Quality of Care Grid

The first part of this study consisted of reviewing and adapting a quality of care grid to an adult population of suicide attempters in the context of Montreal university hospitals. As previously mentioned, the grid developed in France by the ANAES (Citation1998) was adapted to the Quebec context by Renaud et al. (Citation2004).

For the current study, Renaud et al.’s (Citation2004) grid criteria were reviewed by an expert focus group composed of six psychiatrists, four nurses and two epidemiologists. The backgrounds of the clinicians were either clinical, managerial and/or academic. Discussions included practice conditions and habits of trade, inclusion of worldwide recommendations and guidelines, and legal restraint concerning adult rights about disclosure to relatives. Each criterion was assessed with consideration to professional experiences as well as recommendations issued from different countries. Consensus was reached on wording of each item. Guidelines from the United States of America (AASSPRC) (Knesper, Citation2010), United Kingdom (NICE) (NICE, Citation2004), New Zealand (CRESP, Citation2015) and Quebec (Lane, Archambault, Collins-Poulette, & Camirand, Citation2010) served as the basis of discussion.

During the data extraction, the raters held monthly meetings with researchers. Each meeting between raters focused on three items of the grid and further discussions were oriented toward items of prior meetings in which raters would encounter difficulties or had questions regarding item ratings. Seven review sessions were needed to ensure applicability and feasibility in retrieving this information in a medical chart, either by manuscript or electronically. The review sessions were held at one-month intervals giving raters a sufficient time to learn and debrief on the new directives between each session. In the presence of discrepancies, they would be questioned on their reasoning behind their decisions during the monthly meeting. Their inputs were noted in order to be added to following discussions. Also, a vignette describing each litigious point was created to inform future training efforts for similar purposes. A total of five vignettes were produced. Finally, an instruction booklet was written through an iterative process. The booklet includes the list of all the criteria, a brief definition of each of them, where and how they are usually written in a medical chart in Quebec’s both official languages, and, finally how to rate the findings. Ratings varied between 0 (absent), 1 (present but not well documented) and 2 (present without any doubt). The vignettes deriving from the litigious cases were inserted at the end of the booklet to serve as reference and practice exercises. The booklet remained open for any addition of newly encountered litigious case throughout the study.

Out of the 16 original items, 5 were dropped. These dropped items included criteria present or absent “de facto” in 100% of Canadian ED practices selected for our study; or collected in all cases to assess a third one, and part of the important “not applicable” situation in the Renaud et al. (Citation2004) study, and could not be recovered. Also, some items would never appear in a medical chart (“interview taking place in a suitable room”) or involved knowledge and judgment of the environment (“Admission took place in a suitable ward/department”). The final 11 items of the quality of care grid can be found in .

TABLE 1. Final quality of care grid adapted for an adult population and quality of care assessment of 369 consecutive suicide attempters in 2 Montreal university hospitals, January 2009–April 2010.

Systematic Search, Data Extraction and Coding Manual Development

The second part of this study consisted of a systematic search and data extraction of all suicide attempters in two different Montreal university hospitals. All individuals who presented themselves to the hospital as a potential suicide attempt between January 2009 and April 2010 were identified by hospital medical records and ED triage file. The date range chosen for the charts to be reviewed respected the timeframe of the ethics approval and included a full calendar year to account for seasonality. In total, 369 individuals who attempted suicide were identified. Four raters who were three physician research assistants trained in medical records extraction and one psychiatric nurse, the same raters from Rahme et al.’s (Citation2016) study, were responsible for this part of the study. The independent raters extracted socio-demographic and clinical variables for the 369 identified individuals that attempted suicide. These 369 individuals were identified from a total of 5746 reviewed charts. The details of this process is thoroughly described in Rahme et al. (Citation2016).

Identification of Quality of Care Deficits in Participating Hospitals

The third part of this study consisted of identifying quality of care deficits in the participating hospitals. As mentioned previously, quality of care was assessed for 369 individuals who presented themselves to the emergency department for a potential suicide attempt between January 2009 and April 2010. Descriptive statistics using standard deviations (SD) and proportions as appropriate were conducted by an independent statistical analyst. Rates of the identified quality of care deficits were calculated. Ethics approval from the Ethics Boards of the study hospitals and permission from the Director of Professional Services (DPS) were obtained for the triage assessment and chart review. Patient informed consent is not required for retrospective chart reviews and was not sought.

RESULTS

The final version of the “quality of care management for suicide attempters” grid includes a total of 11 criteria. 369 suicide attempts were identified and fully reviewed. Socio-demographic and clinical characteristics are presented in . Results from the “quality of care management for suicide attempters” grid are presented in . First, of the 369 individuals who attempted suicide, half were below 37 years of age and 47% were males. Poisoning (54%) followed by injury (laceration, collision, jump, fire, firearms) (22%) were responsible for most attempts. Among attempters, 70% were born in Canada, 46% were unemployed, 52% were single, 39% did not finish their high school, 36% had children and 36% lived alone. Most (74%) had a mental disorder diagnosis in their case notes (46% depression).

TABLE 2. Socio-demographic and clinical characteristics of 369 consecutive suicide attempters in 2 Montreal university hospitals, January 2009–April 2010.

Second, the descriptive statistic of each criterion is indicated in the “Total” column of . Quality was found in the systematic evaluation and coordination of inpatient care by mental health professionals (items 1–11). Results show that suicide risk was only assessed in 63% of all individuals who attempted suicide (item 3). Also, interviews with relatives were only conducted in 41% of the cases (item 4). However, family history was documented in the medical files (item 5) of 90% of the cases. The deficits were mostly found in the coordination of outpatient appointment. More precisely, items 8 and 9 show that only 20% of patients and 11% of relatives received written contact information of resources reachable 24/7 in case of emergency, according to the case records. Also, less than half (47%) of suicide attempters seen left with a planned appointment noted in the medical record with a psychiatrist or a psychologist (item 10). In addition, for 43% of suicide attempters, a professional was informed about their attendance to their next planned appointment, according to the medical records.

DISCUSSION

The current study aimed to review and adapt a quality of care grid to an adult population of suicide attempters in the context of Montreal hospitals and to identify quality of care deficits in two different Montreal university hospitals. The newly revised grid included 11 criteria that were selected by an expert focus group. This new version of the grid was then applied to 369 individuals who attempted suicide for quality of care assessment (158 treated in the ED following ED visit). Results of this study helped identify many deficits in the quality of care of suicide attempters in the ED of the study hospitals. First, suicide risk assessment was only documented in 63% of individuals who attempted suicide (criteria 3), and only 52% of the ED cases. These results were much lower than what was identified in Renaud et al.’s (Citation2004) study with 97.5% of adolescents being assessed in a Children’s university hospital. This difference may result from differences between adult and pediatric care. Second, interviews with relatives were conducted in only 41% of the cases (criteria 4) which was less than the 50% proportion found from the ANAES in adults and the 100% proportion found by Renaud et al. (Citation2004) in adolescents admitted to hospital for suicide attempt where their parents would be present most of the time. This difference may be attributed to the fact that parents of children and adolescents must be contacted and implicated if their children are at-risk of danger to themselves. However, for adults, this raises concern for relatives and reflects the confusion in regard to the patient’s right to confidentiality and the level of information that can be provided to close relatives. This being said, even if the individual’s loved ones are present, health professional might be less inclined to interview them if the individual is against sharing any information with them. However, to conduct a thorough and complete suicide risk assessment, it is strongly recommended that loved ones be implicated as well. Finally, the hospitalization of more than half of the patients as well as a potential lack of ED service coordination and continuity of services can possibly explain why only 20% of the patients and 11% of the patients’ relatives received written contact information for available resources in case of need (criteria 8 and 9). These results are similar to previous audits where only 20% of patients received this information in France and are lower than the 41% found among adolescents in Renaud et al.’s (Citation2004) Quebec audit. As for the low percent of relatives that received contact information in our study, this criterion was adapted for the new version of the grid that we created and was not assessed in previous studies. This information might be verbal and clinicians may have failed to document it in their files, but would still indicate a low priority attached to these suicide prevention actions, whilst others, like contacting a discharge outpatient clinician was better recorded and completed. This illustrates a clear need for better service coordination and continuity with patients and their relatives.

The current study does present some limitations and strengths. First, we assessed all patients who presented to the ED whether or not they were subsequently admitted to hospital. This does cause some limitations as to the deficits in quality of care identified in the case notes but may inflate some criteria completion. For example, some patients were eventually hospitalized, giving more time for criteria to be enacted, like family interviews. Second of all, there is the possibility of missing data in this study; however, this missing information only accounts for less than 5% of all important variables. Also, although extractors followed a rigorous process to extract data for analysis from all multidisciplinary notes, interviews with staff and patients would have allowed a better understanding of each criterion and if they are recorded in the medical files. It would have been interesting to know how criteria were interpreted and how they were assessed in each hospital considering it was assumed by extractors that criteria not documented in file was not assessed. Certain tasks may therefore have been performed without being documented in the person’s file. Also, although extractors participated in monthly discussions during the data collection, it is also possible that they did not all identify criteria the same way. However, deficits identified in this study do coincide with larger and more exhaustive studies (While et al., Citation2012). Further research should focus on exploring these aspects in a more in-depth way and validation studies should also be conducted. At the time of the study, our expert group was less aware of our recent audits of suicide cases, echoing previous audits in the Canadian context (Lesage et al., Citation2008) that substance-related disorders (SRD) were associated with half the suicide cases, were associated with half the suicide cases, were not in contact with specialist addictions services and there was a lack of liaison between ED, specialist mental health and specialist SRD (Fortin et al., Citation2019). Furthermore, one of the hospitals included in the study did not have an intervention unit for addictions which explains why this original item was dropped. We would therefore suggest a new item stating “a systematic evaluation of presence of SRD was conducted, reported, and if positive, a liaison staff from specialist SRD conducted evaluation in the ED or hospital setting before discharge.”

As for strengths, this study had access to individuals that attempted suicide that are difficult to capture otherwise. Individuals that attempted suicide identified by only nurses triage notes were included. Similar findings showed that more than half of attempted suicide presentations remained “silent” (went undetected) if nurses’ notes were ignored (Daneau, Citation2016; Rahme et al., Citation2016). Another strength is that our study can be reproduced in all Quebec’s hospital and probably any Canadian hospital since the medical records systems respond to provincial and even Canadian accreditation standards. It can be tested in US and European countries, certainly France where the original grid captured similar deficits than our Canadian study. Although improvements in the criteria and wording of the grid are still necessary, this newly revised quality of care grid for an adult population of suicide attempters represents a simple, as well as time and cost-effective method to assess quality of care without having to conduct an extensive and thorough audit process. Other studies in Canada and in the UK have also demonstrated that improving quality of care after recommendations following audits of medical care contributes to a reduction in suicide rates (While et al., Citation2012). The newly revised quality of care grid therefore provides a promising avenue for suicide prevention in the ED.

Further research into the validity of the grid could associate specific criteria with suicidal death. The introduction of a systematic national suicide prevention protocol for all patients that present themselves to the ED, as suggested by previous audits, containing the 11 elements of the grid, in addition to a new item on Substance Related Disorders systematic evaluation and reference, might be a solution to better improve quality of care for adult suicide attempters (Lesage et al., Citation2008; Lesage & Fortin, Citation2018; NICE, Citation2004; While et al., Citation2012).

ACKNOWLEDGMENTS

Jessica Rassy received a postdoctoral grant from the Quebec Network on Nursing Intervention Research (RRISIQ) and the project from the Réseau Québécois sur le suicide, les troubles de l’humeur et les troubles associés (RQSHA).

DISCLOSURE STATEMENT

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Notes on contributors

Jessica Rassy

Jessica Rassy, Université de Sherbrooke, Longueuil, Quebec, Canada; Institut universitaire en santé mentale de Montréal and Research Centre, Quebec, Canada; Université de Montréal, Montréal, Quebec, Canada.

Diane Daneau

Diane Daneau, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada.

Caroline Larue

Caroline Larue, Institut universitaire en santé mentale de Montréal and Research Centre, Quebec, Canada; Université de Montréal, Montréal, Quebec, Canada.

Elham Rahme

Elham Rahme, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada.

Nancy Low

Nancy Low, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada.

Suzanne Lamarre

Suzanne Lamarre, St-Mary’s Hospital, Montreal

Gustavo Turecki

Gustavo Turecki, Douglas Mental Health Institute and Research Centre, Montreal, Quebec, Canada.

Jean-Pierre Bonin

Jean-Pierre Bonin, Institut universitaire en santé mentale de Montréal and Research Centre, Quebec, Canada.

Helene Racine

Helene Racine, Douglas Mental Health Institute and Research Centre, Montreal, Quebec, Canada.

Suzanne Morin

Suzanne Morin, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada.

Kaberi Dasgupta

Kaberi Dasgupta, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada.

Johanne Renaud

Johanne Renaud, Douglas Mental Health Institute and Research Centre, Montreal, Quebec, Canada; McGill Group for Suicide Studies, Montreal, Quebec, Canada.

Alain Lesage

Alain Lesage, Institut universitaire en santé mentale de Montréal and Research Centre, Quebec, Canada

REFERENCES