900
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Anxiety, depression, and uncertainty appraisal and factors affecting uncertainty risk and opportunity appraisal of health care workers in Korea during the COVID-19 outbreak

Uncertainty risk and opportunity appraisal

, ORCID Icon &
Article: 2182306 | Received 13 Mar 2022, Accepted 08 Feb 2023, Published online: 24 Feb 2023

ABSTRACT

Background

Due to the prolonged period of COVID-19, the uncertainty related to COVID-19 is bound to increase for healthcare workers (HCWs) in tertiary medical institutions as much as for the HCWs in dedicated hospitals.

Purpose

To assess anxiety, depression, and uncertainty appraisal, and to determine the factors affecting uncertainty risk and opportunity appraisal experienced by HCWs at the forefront of COVID-19 treatment.

Method

This was a descriptive, cross-sectional study. The participants were HCWs at a tertiary medical center in Seoul. HCWs included medical (doctors, nurses) and non-medical (nutritionists, pathologists, radiologists, office workers, etc.) personnel. Self-reported structured questionnaires (patient health questionnaire, generalized anxiety disorder scale, and uncertainty appraisal) were obtained. Finally, responses from 1337 people were used to evaluate factors affecting uncertainty risk and opportunity appraisal using a quantile regression analysis.

Results

The average ages of medical and non-medical HCWs were 31.69 ± 7.87 and 38.66 ± 11.42 years, and the proportion of females was high. The rates of moderate to severe depression (23.23%) and anxiety (6.83%) were higher in medical HCWs. The uncertainty risk score was higher than the uncertainty opportunity score for all the HCWs. Factors that increased uncertainty opportunity were a decrease in depression in medical HCWs and a decrease in anxiety in non-medical HCWs. Increase in age was directly proportional to uncertainty opportunity in both groups.

Conclusion

There is a need to devise a strategy to reduce uncertainty among HCWs who inevitably face various infectious diseases that appear in the near future. In particular, since there are various types of non-medical as well as medical HCWs in medical institutions who can prepare an intervention plan that comprehensively considers the characteristics of each occupation and the distribution of risks and opportunities of uncertainty will be able to improve the quality of life of HCWs and further promote the health of the people.

Introduction

In November 2019, the coronavirus disease (COVID-19) was first reported in Wuhan, China. COVID-19 has since become a global health emergency in the form of a global pandemic (World Health Organization, Citation2020). In the early days of COVID-19, the number of infected people was overwhelmingly high because of overseas inflows, but now sporadic community-based infections continue (Korea Disease Control and Prevention Agency, Citation2021). As COVID-19 continues, it is a reality that not only health care workers (HCWs) in dedicated hospitals who focus on treating patients infected with COVID-19, but other types of HCWs are also likely to come into contact with COVID-19 patients. In particular, tertiary medical institutions in Seoul are conducting tests at COVID-19 screening clinics, and because of the nature of these institutions, they have no choice but to treat COVID-19 patients at any time in outpatient and emergency rooms. In the United States, Italy, China, Spain, and France, the COVID-19 infection rate among HCWs caring for COVID-19 patients is reported to range from approximately 15%−20% (Ali et al., Citation2020a; Ali et al., Citation2020b). Therefore, unlike HCWs in dedicated hospitals that focus on treating patients infected with COVID-19, the uncertainty of when HCWs in tertiary medical institutions may see COVID-19 patients is further increased. Uncertainty, introduced by Mishel, is a variable that affects recovery from disease and is defined as a cognitive state that can be created by disease-related events that are experienced for the first time, unpredictable symptoms, treatment effects that are not guaranteed to be recoverable, and lack of information about the disease processes (Mishel & Braden, Citation1988). Uncertainty is evaluated in various forms because it is considered an important factor not only for patients with chronic diseases (Kang, Citation2009; Kim & Hong, Citation2018) but also for parents and families who manage chronic diseases together (Arias-Rojas et al., Citation2019; Connolly et al., Citation2021; Yoo, Citation2007). COVID-19 contains all the characteristics of uncertainty suggested by Mishel, and HCWs at the forefront of patient care can be considered representative groups involved in direct patient care, similar to the parents and family members of patients with chronic diseases. The appraisal of uncertainty is a cognitive thinking process that provides meaning to uncertainty risk or opportunity. If uncertainty is evaluated as a risk to an individual, it will lead to negative results; on the contrary, if it is evaluated as an opportunity, it can lead to the establishment of a new outlook on life because the ability to cope with diseases is correspondingly improved. Uncertainty is inevitably influenced by various physical and psychological factors. Due to COVID-19, HCWs work long hours in stressful work environments and complain of fatigue and isolation (Ali et al., Citation2020b).

In HCWs, the anxiety rate was 30.5% (Adibi et al., Citation2021) and the depression rate was 31.1% (Marvaldi et al., Citation2021). The rates of sleep disorder and insomnia were 44.0% (Marvaldi et al., Citation2021) and 36.36% (Sahebi et al., Citation2021), respectively.

Since HCWs include both medical (doctors and nurses) and non-medical (assistants, nutritionists, and radiologists) HCWs, a comprehensive understanding of them is required. Moreover, the goals of disease prevention, treatment, and health promotion of patients can be achieved only when various HCWs cooperate. However, previous studies have mainly focused on medical HCWs (Buselli et al., Citation2020; Domínguez-Salas et al., Citation2021). Therefore, this study investigated various physical and psychological factors that can affect uncertainty risk and opportunity appraisal according to the degree of distribution of uncertainty for both medical and non-medical HCWs. Thus, we collected basic data for the development of intervention programs that can reduce uncertainty risks and enhance uncertainty opportunities by considering professional and personal characteristics of various HCWs.

Methods

Study participants

The participants were HCWs involved in the treatment and management of COVID-19 patients in Korea. at a tertiary medical center. Medical HCWs include doctors and nurses, and non-medical HCWs include assistants and transfer agents, nutritionists, clinical pathologists, radiologists, physical therapists, office workers, and computer administrators. It is estimated that the hospital has approximately 2,000 direct and indirectly employed staff, out of which, 1500 questionnaires were distributed to departments that obtained cooperation. Among them, 1384 questionnaires were collected (92.3% response rate), 47 people who did not properly respond to the questionnaire were excluded, and data from 1337 people were finally analyzed.

Study design

This cross-sectional study was designed to assess anxiety, depression, and uncertainty appraisal, and to determine the factors affecting uncertainty risk and opportunity appraisal experienced by HCWs at the forefront of COVID-19 treatment.

Data collection and research ethics

The data collection period for this study was from October to November 2020. Before proceeding with the study, data collection was performed with the approval of the institutional review board (IRB 7001355-202010-HR-406) of Konkuk University.

The purpose of the questionnaire was explained to HCWs using an online bulletin board, and participants were encouraged to participate in the questionnaire. Afterward, a self-reported structured questionnaire and written consent forms were distributed to each department, and cooperation from each department was obtained. The investigator finally collected the questionnaires and consent forms from each department.

Measurements

General characteristics

The general characteristics of the subjects, such as age, sex, occupation, marital status, and working hours per day, were investigated.

Physical health

The physical health of the participants, such as exercise, drinking, smoking, subjective health status (SHS), status of daily living scores (SDLS), and physical burden was investigated. Regular exercise (more than three times a week, to the point of sweating for at least 30 min), whether they drank alcohol regularly, or had smoked more than five packs of cigarettes (100 cigarettes) in their life so far (smoker, past smoker, non-smoker) was also investigated. The SHS uses a five-point Likert scale, with a score of 1 being ‘very good’ and 5 being ‘very bad,’ with a higher score indicating a negative perception of SHS. SDLS is divided into 10-point intervals ranging from 0 to 100, with a higher score indicating that daily living is not impaired compared to the pre-COVID-19 outbreak. Physical burden uses a five-point Likert scale, with a score of 1 being ‘not at all difficult’ and 5 being ‘very difficult,’ with higher scores indicating a greater physical burden.

Psychological health

The psychological health of the subjects, such as psychological burden, depression, anxiety, and uncertainty, was investigated. For psychological burden, a five-point Likert scale was used, with a score of 1 being ‘not at all difficult’ and 5 being ‘very difficult,’ with higher scores indicating a greater psychological burden. To measure the degree of depression, a nine-item patient health questionnaire scale (Kocalevent et al., Citation2013) was used. A translation and a back-translation method were used, and approved by its author (Park et al., Citation2010). Subjects were asked how often they experienced by each of the depressive symptoms over the last two weeks. The scores were 0 (not at all), 1 (several days), 2 (more than half the days), and 3 (nearly every day). The cutoff score of this tool is 10 points, and no/minimal depression is 0–4 points, mild depression is 5–9 points, moderate depression is 10–14 points, and severe depression is 15–27 points. For criterion validity, sensitivity and specificity were .88, and Cronbach’s α reliability was .86-.89. The test-retest reliability was .84 and the area under the curve was .95 (Kroenke et al., Citation2001).

To measure the degree of anxiety, a seven-item generalized anxiety disorder scale (Löwe et al., Citation2008) was used. A translation and a back-translation method were used, and approved by its author (Lee et al., Citation2022). Subjects were asked how often they experienced by each of the seven anxiety symptoms during the last two weeks. Scores of 0 (not at all), 1 (several days), 2 (more than half the days), and 3 (nearly every day) were assigned. The cutoff score of this tool was 7 points: no/minimal anxiety, 0–4 points; mild anxiety, 5–9 points; moderate anxiety, 10–14 points; and severe anxiety, 15–21 points. In criterion validity, sensitivity was .89, specificity was .82, and the area under the curve was .91 (Spitzer et al., Citation2006). The Cronbach’s alpha for internal consistency was. 89 for the public (Löwe et al., Citation2008). The tool developed for uncertainty appraisal (Mishel & Sorenson, Citation1991) was used. A translation and a back-translation method were used, and approved by its author (Cha & Kim, Citation2012). Using uncertainty appraisal, we investigated how individuals felt about the ongoing COVID-19 pandemic. The uncertainty appraisal scale is divided into uncertainty risk and uncertainty opportunity. The eight items for uncertainty risk included anger, worry, sadness, anxiety, disappointment, fear, guilt, and boredom. The seven items for uncertainty opportunity included feeling good, confidence, satisfaction, hope, anticipation, euphoria, and relief. The scores were 0 (not at all), 1 (hardly not), 2 (a few), 3 (somewhat), 4 (a lot), and 5 (very much); it uses a six-point Likert scale. Uncertainty risk is a total of 0–40 points, and uncertainty opportunity is a total of 0–35 points. In the study by Mishel and Sorenson, reliability for uncertainty risk’s Cronbach's alpha was .87 and uncertainty opportunity’s Cronbach's alpha was .82 (Mishel & Sorenson, Citation1991). Both uncertainty risk and opportunity in the study by Cha and Kim had Cronbach’s alpha of .88 (Cha & Kim, Citation2012).

Data analysis

The collected data were analyzed using the R statistical program (R Foundation for Statistical Computing, Vienna, Austria). Descriptive statistics on general characteristics and physical and psychological health were displayed as means and standard deviations, or frequencies and percentages. In this study, uncertainty risk and opportunity were evaluated using quantile regression analysis, rather than classical regression analysis. Unlike classical regression analysis, which estimates determinants based on the conditional mean of the dependent variable, quantile regression analysis can be used when the determinants of the dependent variable for each quantile differ based on the conditional distribution of the dependent variable (Park et al., Citation2018). In other words, quantile regression analysis is a method for estimating the relationship between an explanatory variable and a dependent variable by obtaining the conditional quantile of the dependent variable. Therefore, when the least-squares method is used, if normality and homoscedasticity are violated, it can be controlled. Furthermore, compared to the least-squares method, it is a very useful statistical method in that it can estimate various distributions of the response variable to the explanatory variable. For missing values, the multiple imputation method was applied on the premise of random missing values ⁣⁣for the questionnaire content. The multiple imputation method is an analysis method that creates several values that are ⁣⁣estimated to be real values ⁣⁣using existing data while preserving the uncertainty of missing values (Sterne et al., Citation2009). This method can use complete data without discarding missing values and can use uncertainty information about the substituted values. Additionally, compared with the single imputation method, the multiple imputation method has the advantage of increasing the efficiency of estimation by repeating random substitutions based on the data distribution and then summing them. In this study, the repletion of the algorithm was 10 times.

Results

General characteristics

In the general characteristics (), the average ages of medical and non-medical HCWs were 31.69 ± 7.87 and 38.66 ± 11.42 years, respectively. The proportion of females was higher among both medical and non-medical HCWs. Non-medical HCWs had a higher percentage of married people (53.01%), while medical HCWs had a higher percentage of others (67.85%). The daily working hours of medical and non-medical HCWs were 9.17 ± 2.92, and 8.84 ± 3.60 h, respectively.

Table 1. Characteristics of subjects.

Physical health

Regarding physical health (), the ratio of not exercising regularly was higher than that of exercising regularly in both groups, as was the ratio of non-smokers. In the case of drinking, the drinking rate was > 50% in both groups. Regarding SHS, the proportion of respondents who answered that their SHS was ‘bad’ or ‘very bad’ was 13.91% for medical HCWs, and 9.27% for non-medical HCWs. The percentage of SDLS less than 50 was higher (48.59%) among medical HCWs than among non-medical HCWs (38.37%). Regarding physical burden, the proportion of respondents who answered ‘difficult’ or ‘very difficult’ was 39.02% for non-medical HCWs and 66.27% for medical HCWs.

Psychological health

Regarding psychological health (), 36.26% of non-medical HCWs answered that their psychological burden was ‘difficult’ or ‘very difficult’, compared to 74.81% of medical HCWs. The average scores for depression and anxiety were 6.90 ± 4.92 and 3.32 ± 3.92 points for medical HCWs, and 4.81 ± 4.31 and 2.46 ± 3.33 points for non-medical HCWs, respectively. The rates of moderate to severe depression and anxiety were 23.23% and 6.83% for medical HCWs and 12.68% and 4.39% for non-medical HCWs, respectively. The uncertainty risk and opportunity scores of medical HCW were 16.16 ± 7.04 and 9.31 ± 6.41 points, and 14.63 ± 7.53 and 11.43 ± 7.17 points for non-medical HCWs, respectively.

Factors affecting uncertainty risk and opportunity appraisal

Factors affecting uncertainty risk appraisal are shown in and . Increases in depression and anxiety scores and physical and psychological burden among medical HCWs were found to increase the uncertainty risk. Among non-medical HCWs, increased anxiety scores and age and decreased SDLS were found to increase the uncertainty risk.

Figure 1. Factors affecting the uncertainty risk appraisal.

Photograph of medical healthcare workers’ uncertainty risk appraisal factors (depression, anxiety, physical burden, and psychological burden), of non-medical healthcare workers’ uncertainty risk appraisal factors (anxiety, age, and status of daily living score).
Figure 1. Factors affecting the uncertainty risk appraisal.

Table 2. Uncertainty risk appraisal of medical and non-medical HCWs.

Factors affecting uncertainty opportunity appraisal are shown in and . Among medical HCWs, increasing age, having a spouse, and increasing SDLS were found to improve uncertainty opportunities. The depression score was high among medical HCWs with a low uncertainty opportunity score and low with a high uncertainty opportunity score. Among non-medical HCWs, increasing age was found to improve uncertainty opportunities. The anxiety score was high among non-medical HCWs with a low uncertainty opportunity score and low with a high uncertainty opportunity score.

Figure 2. Factors affecting the uncertainty opportunity appraisal.

Photograph of medical healthcare workers’ uncertainty opportunity appraisal factors (depression, age, marital status, and status of daily living score), of non-medical healthcare workers’ uncertainty opportunity appraisal factors (anxiety and age).
Figure 2. Factors affecting the uncertainty opportunity appraisal.

Table 3. Uncertainty opportunity appraisal of medical and non-medical HCWs.

Discussion

This study investigated the factors affecting uncertainty risk and opportunity for both medical HCWs and non-medical HCWs, with different influencing factors for both.

This study found that the uncertainty risk score was higher than the uncertainty opportunity scores for all HCWs; in particular, the uncertainty risk score of medical HCWs was higher than that of non-medical HCWs. In the case of patients with cancer, coronary artery disease, and heart failure, the uncertainty opportunity score was higher than the uncertainty risk score. Although there were differences by disease, the uncertainty risk scores ranged from 8.3–20.5, and the uncertainty opportunity scores range from 10.3–24.2 points (Cha & Kim, Citation2012; Lee, Citation2009; Lee, Citation2010; Lee & Kang, Citation2020). HCWs had a higher uncertainty risk but lower uncertainty opportunity than patients with chronic diseases. In this study, factors that increased uncertainty risk increased depression and anxiety among medical HCWs and increased anxiety among non-medical HCWs. Conversely, factors that increased uncertainty opportunity were a decrease in depression among medical HCWs and a decrease in anxiety among non-medical HCWs. To reduce uncertainty risk and increase uncertainty opportunity, there is a need for psychological intervention methods that can reduce anxiety and depression in both medical and non-medical HCWs. According to a previous systematic review (Salari et al., Citation2020), the rates of anxiety and depression among hospital staff (excluding doctors or nurses) during the COVID-19 pandemic were 27% and 20.6%, respectively. Furthermore, the incidence rates of anxiety and depression were 19.8% and 40.4% for doctors, and 22.8% and 28% for nurses, respectively. Doctors and nurses had a higher rate of depression than anxiety, while other hospital staff members had higher anxiety scores. In this study, the rate of moderate to severe depression was nearly twice as high in medical HCWs than in non-medical HCWs, which was consistent with the results of previous studies. However, the rate of moderate to severe anxiety was higher in medical HCWs than in non-medical HCWs, which was contradictory to the results of previous studies. Nevertheless, anxiety was an important factor that increased uncertainty risk among non-medical HCWs in this study. According to previous research, the reasons for the anxiety of non-medical HCWs were low access to official psychological support and lack of direct medical information about the onset of infectious diseases (Tan et al., Citation2020). Previous studies have suggested various interventions to reduce anxiety and depression; in particular, relaxation training (Teixeira et al., Citation2005), cognitive–behavioral therapy, and interpersonal therapies have been suggested as psychological interventions (Fava, Citation2003; Raes et al., Citation2009). Because medical professionals are a group with a stronger sense of responsibility and calling than anyone else, what is important to them is colleagues who can empathize with and encourage them. In particular, the protection of patients’ personal information is an important issue for HCWs; therefore, the activation of online and offline communities within medical institutions for HCWs should be considered. Through this, HCWs in medical institutions could have the opportunity to share their opinions and empathize with and encourage each other. Medical HCWs face the suffering and death of patients in their field (Shay, Citation2014). However, in the context of COVID-19, many HCWs reported experiencing moral injuries (Walton et al., Citation2020). Before the COVID-19 pandemic, family, friends, and religious people could participate in a patient’s death process, and a funeral was a time to share their grief and accept death. However, during the COVID-19 pandemic, it has become impossible to carry out all of these processes. Consequently, HCWs face various ethical dilemmas. Therefore, it is necessary to form small focus or leader-centered groups to share and discuss the moral injury experiences of HCWs and regularly exchange opinions and information with each other.

The findings of this study revealed that the factors that increased uncertainty risk were increased physical burden for medical HCWs and decreased SDLS for non-medical HCWs. This suggests that not only psychological interventions but also physical interventions are necessary to lower uncertainty risk and increase uncertainty opportunity. Previous studies have reported that the psychological burden experienced by medical HCWs can be expressed by a variety of physical symptoms (Chew et al., Citation2020). The proportion of HCWs participating in regular exercise was quite low, and the rate of drinking was 50% for HCWs in this study. Therefore, a physical intervention method for HCWs is necessary; in particular, an intervention method with fewer time and space restrictions should be considered. Time and frequency of exercise and stretching could be specified; for example, performing exercises using a hand grip or stretching band in the work schedule of HCWs. Balanced nutrition is the most important factor in maintaining physical health. However, it is not easy to secure mealtime, and even if time allows it, HCWs often have to eat a lunch box or instant food in a hurry. In particular, time and physical restrictions because of wearing level D protective clothing per the COVID-19 quarantine guidelines and the shortage of manpower because of the increase in the COVID-19 infection rates among fellow HCWs exacerbates this situation. Accordingly, increasing the extra pay for HCWs may be considered. As the work of HCWs because of the COVID-19 pandemic has been overburdened for a long time, we expect positive results from discussions by the government about an increase in extra pay for HCWs.

An increase in age increased uncertainty opportunity in both medical and non-medical HCWs in this study. An increase in age in the medical field implies that they have various work experiences and effective communication skills. Therefore, it is necessary to establish a medical work environment in which HCWs with various experiences can continue working. In reality, most non-medical HCWs are contract or temporary workers. To guarantee employment stability and increase work efficiency of medical institutions, it may be possible to consider a method of providing additional points to those who have experience in managing infectious diseases when evaluating their work ability for reemployment. Furthermore, it is necessary to allow HCWs to share diverse knowledge and experiences through mentor-mentee programs with senior groups. Consequently, the senior group will be recognized for their worth and more satisfaction with their lives, and many HCWs who experience new infectious diseases will be able to work with the confidence that they have a good human support system.

This study differs from others in that it not only considered potential risks in the medical field by taking an interest in uncertainty risk but also took an interest in the uncertainty opportunities for the growth potential of HCWs. Nevertheless, this study has some limitations and based on these, suggestions are made. First, it is necessary to be careful in generalizing the results of the study because information on HCWs from only one medical institution was collected. In particular, most medical HCWs were nurses, and the proportion of women among both medical and non-medical HCWs was relatively high. Therefore, it is necessary to further expand research institutions and subjects in consideration of the size and region of medical institutions and the gender and occupation of HCWs in the future.

The results of this study suggest that there is a need to devise a strategy to reduce uncertainty among HCWs who inevitably face various infectious diseases that are expected to appear in the near future. Because there are various types of non-medical and medical HCWs, preparing an intervention plan that comprehensively considers the characteristics of each occupation and the distribution of risks and opportunities of uncertainty will help improve the quality of life of HCWs and further promote health of the people.

Conclusion

This study is meaningful in that it investigated factors affecting uncertainty risks and opportunities for medical and non-medical HCWs working during the COVID-19 pandemic. Medical HCWs who spent a long time in direct contact with patients had a higher uncertainty risk than non-medical HCWs but a relatively low uncertainty opportunity. Among medical HCWs, it was found that an increase in depression and anxiety and an increase in physical and mental burdens raised uncertainty risk. Among non-medical HCWs, an increase in anxiety score and age, as well as a decrease in the SDLS, were found to increase the uncertainty risk. Among medical HCWs, decreased depression, increased age, having a spouse, and increased SDLS were found to improve uncertainty opportunity. Among non-medical HCWs, a decrease in anxiety and an increase in age were found to improve uncertainty opportunity. These results underscore the importance of thoroughly preparing differentiated intervention strategies for various HCWs to successfully perform their roles in the medical field for the treatment of COVID-19.

Author contributions

Conceptualization, S.Y.A, and J.S.O.; methodology, H.K.; software, J.S.O.; validation, S.Y.A.; formal analysis, S.Y.A. and J.S.O.; investigation, H.K.; resources, H.K.; data curation, J.S.O.; writing – original draft preparation, J.S.O and S.Y.A.; writing – review and editing, J.S.O. and S.Y.A.; visualization, J.S.O. and S.Y.A.; supervision, H.K. All authors have read and agreed to the published version of the manuscript.

Ethics approval

This study received ethical approval from the Research Ethics Board at the Konkuk University (IRB No. 7001355-202010-HR-406).

Informed consent statement

Informed consent was obtained from all subjects involved in the study.

Institutional review board statement

The study was conducted in accordance with the Declaration of Helsinki and was approved by an Institutional Review Board/ Ethics committee. See details under Methods.

Data availability of statement

All the data and methods of statistical analysis were included in the manuscript.

Acknowledgments

The authors would like to thank the members of Konkuk University hospital who faithfully responded to the questionnaire.

Disclosure statement

No potential conflict of interest was reported by the author(s).

References

  • Adibi, A., Golitaleb, M., Farrahi-Ashtiani, I., Pirani, D., Yousefi, K., Jamshidbeigi, Y., & Sahebi, A. (2021). The prevalence of generalized anxiety disorder among health care workers during the COVID-19 pandemic: A systematic review and meta-analysis. Frontiers in Psychiatry, 12, 658846. https://doi.org/10.3389/fpsyt.2021.658846
  • Ali, S., Noreen, S., & Farooq, I. (2020a). COVID-19 and healthcare workers in Pakistan: Are we losing this fight? Journal of Medical Sciences, 28(2), 186–188. https://jmedsci.com/index.php/Jmedsci/article/view/892
  • Ali, S., Noreen, S., Farooq, I., Bugshan, A., & Vohra, F. (2020b). Risk assessment of healthcare workers at the frontline against COVID-19. Pakistan Journal of Medical Sciences, 36(COVID19-S4), S99–S103. https://doi.org/10.12669/pjms.36.COVID19-S4.2790
  • Arias-Rojas, M., Carreño-Moreno, S., & Posada-López, C. (2019). Incerteza dos cuidadores familiares na doença de pacientes sob cuidados paliativos e fatores associados. Revista Latino-Americana de Enfermagem, 27(e3200), 1–8. https://doi.org/10.1590/1518-8345.3185.3200
  • Buselli, R., Corsi, M., Baldanzi, S., Chiumiento, M., Del Lupo, E., Dell'Oste, V., Bertelloni, C. A., Massimetti, G., Dell'Osso, L., Cristaudo, A., & Carmassi, C. (2020). Professional quality of life and mental health outcomes among health care workers exposed to Sars-Cov-2 (COVID-19). International Journal of Environmental Research and Public Health, 17(17), 6180. https://doi.org/10.3390/ijerph17176180
  • Cha, K., & Kim, K. (2012). Impact of uncertainty on resilience in cancer patients. Asian Oncology Nursing, 12(2), 139–146. https://doi.org/10.5388/aon.2012.12.2.139
  • Chew, N. W., Lee, G. K., Tan, B. Y., Jing, M., Goh, Y., Ngiam, N. J., Yeo, L. L., Ahmad, A., Khan, F. A., Shanmugam, G. N., & Sharma, A. K. (2020). A multinational, multicentre study on the psychological outcomes and associated physical symptoms amongst healthcare workers during COVID-19 outbreak. Brain, Behavior, and Immunity, 88, 559–565. https://doi.org/10.1016/j.bbi.2020.04.049
  • Connolly, T., Coats, H., DeSanto, K., & Jones, J. (2021). The experience of uncertainty for patients, families and healthcare providers in post-stroke palliative and end-of-life care: A qualitative meta-synthesis. Age and Ageing, 50(2), 534–545. https://doi.org/10.1093/ageing/afaa229
  • Domínguez-Salas, S., Gómez-Salgado, J., Guillén-Gestoso, C., Romero-Martín, M., Ortega-Moreno, M., & Ruiz-Frutos, C. (2021). Health care workers’ protection and psychological safety during the COVID-19 pandemic in Spain. Journal of Nursing Management, 29(7), 1924–1933. https://doi.org/10.1111/jonm.13331
  • Fava, M. (2003). Diagnosis and definition of treatment-resistant depression. Biological Psychiatry, 53(8), 649–659. https://doi.org/10.1016/S0006-3223(03)00231-2
  • Kang, Y. (2009). Role of health locus of control between uncertainty and uncertainty appraisal among patients with atrial fibrillation. Western Journal of Nursing Research, 31(2), 187–200. https://doi.org/10.1177/0193945908326063
  • Kim, E. M., & Hong, S. (2018). Impact of uncertainty on the anxiety of hospitalized pregnant women diagnosed with preterm labor: Focusing on mediating effect of uncertainty appraisal and coping style. Journal of Korean Academy of Nursing, 48(4), 485–496. https://doi.org/10.4040/jkan.2018.48.4.485
  • Kocalevent, R.-D., Hinz, A., & Brähler, E. (2013). Standardization of the depression screener patient health questionnaire (PHQ-9) in the general population. General Hospital Psychiatry, 35(5), 551–555. https://doi.org/10.1016/j.genhosppsych.2013.04.006
  • Korea Disease Control and Prevention Agency. (2021, Dec 30). Coronavirus real time domestic statistics. Retrieved Feb 15, 2022, from http://ncov.mohw.go.kr.
  • Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
  • Lee, I. (2010). Uncertainty, appraisal and quality of life in patients with breast cancer across treatment phases. Journal of Jeju Halla University, 33, 83–94. http://www.riss.kr/link?id=A82692681.
  • Lee, M. (2009). Uncertainty, appraisal of uncertainty and health-related quality of life in recovering clients discharged from hospital after CABG. Health & Nursing, 21(1), 49–63. UCI: I410-ECN-0102-2012-690-000228687
  • Lee, M., & Kang, Y. (2020). The relationships among symptom experience, uncertainty, appraisal of uncertainty and self-care behavior in patients with heart failure. Health & Nursing, 32(1), 9–20. https://doi.org/10.29402/HN32.1.2
  • Lee, S. H., Shin, C., Kim, H., Jeon, S. W., Yoon, H. K., Ko, Y. H., Pae, C. U., & Han, C. (2022). Validation of the Korean version of the generalized anxiety disorder 7 self-rating scale. Asia-Pacific Psychiatry, 14(1), e12421. https://doi.org/10.1111/appy.12421
  • Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008). Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical Care, 46(3), 266–274. https://doi.org/10.1097/MLR.0b013e318160d093
  • Marvaldi, M., Mallet, J., Dubertret, C., Moro, M. R., & Guessoum, S. B. (2021) Anxiety, depression, trauma-related, and sleep disorders among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Neuroscience & Biobehavioral Reviews, 126, 252–264. https://doi.org/10.1016/j.neubiorev.2021.03.024
  • Mishel, M. H., & Braden, C. J. (1988). Finding meaning: Antecedents of uncertainty in illness. Nursing Research, 37(2), 98–103. https://doi.org/10.1097/00006199-198803000-00009
  • Mishel, M. H., & Sorenson, D. S. (1991). Uncertainty in gynecological cancer: A test of the mediating functions of mastery and coping. Nursing Research, 40(3), 167–171. https://doi.org/10.1097/00006199-199105000-00010
  • Park, J., Lee, J. H., Park, C. G., & Lee, Y. (2018). Factors influencing death anxiety of nursing students. Journal of the Korean Data And Information Science Sociaty, 29(5), 1227–1242. https://doi.org/10.7465/jkdi.2018.29.5.1227
  • Park, S.-J., Choi, H.-R., Choi, J.-H., Kim, K.-W., & Hong, J.-P. (2010). Reliability and validity of the Korean version of the Patient Health Questionnaire-9 (PHQ-9). Anxiety and Mood, 6(2), 119–124. UCI:G704-SER000010590.2010.6.2.006
  • Raes, F., Williams, J. M. G., & Hermans, D. (2009). Reducing cognitive vulnerability to depression: A preliminary investigation of MEmory Specificity Training (MEST) in inpatients with depressive symptomatology. Journal of Behavior Therapy and Experimental Psychiatry, 40(1), 24–38. https://doi.org/10.1016/j.jbtep.2008.03.001
  • Sahebi, A., Abdi, K., Moayedi, S., Torres, M., & Golitaleb, M. (2021). The prevalence of insomnia among health care workers amid the COVID-19 pandemic: An umbrella review of meta-analyses. Journal of Psychosomatic Research, 149, 110597. https://doi.org/10.1016/j.jpsychores.2021.110597
  • Salari, N., Khazaie, H., Hosseinian-Far, A., Khaledi-Paveh, B., Kazeminia, M., Mohammadi, M., Shohaimi, S., Daneshkhah, A., & Eskandari, S. (2020). The prevalence of stress, anxiety and depression within front-line healthcare workers caring for COVID-19 patients: A systematic review and meta-regression. Human Resources for Health, 18(1), 1–14. https://doi.org/10.1186/s12960-020-00544-1
  • Shay, J. (2014). Moral injury. Psychoanalytic Psychology, 31(2), 182–191. https://doi.org/10.1037/a0036090
  • Spitzer, R., Kroenke, K., & Williams, J. (2006). Generalized anxiety disorder 7-item (GAD-7) scale. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
  • Sterne, J. A., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009). Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. Bmj, 338(jun29 1), b2393–b2393. https://doi.org/10.1136/bmj.b2393
  • Tan, B. Y., Chew, N. W., Lee, G. K., Jing, M., Goh, Y., Yeo, L. L., Zhang, K., Chin, H. K., Ahmad, A., Khan, F. A., & Shanmugam, G. N. (2020). Psychological impact of the COVID-19 pandemic on health care workers in Singapore. Annals of Internal Medicine, 173(4), 317–320. https://doi.org/10.7326/M20-1083
  • Teixeira, J., Martin, D., Prendiville, O., & Glover, V. (2005). The effects of acute relaxation on indices of anxiety during pregnancy. Journal of Psychosomatic Obstetrics & Gynecology, 26(4), 271–276. https://doi.org/10.1080/01674820500139922
  • Walton, M., Murray, E., & Christian, M. D. (2020). Mental health care for medical staff and affiliated healthcare workers during the COVID-19 pandemic. European Heart Journal: Acute Cardiovascular Care, 9(3), 241–247. https://doi.org/10.1177/2048872620922795
  • World Health Organization. (2020, Aug 1). Statement on the fourth meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of coronavirus disease (COVID-19). World Health Organization. https://www.who.int/news/item/01-08-2020-statement-on-the-fourth-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-outbreak-of-coronavirus-disease-(covid-19)
  • Yoo, K. H. (2007). A correlational study on uncertainty, mastery and appraisal of uncertainty in hospitalized children's mothers. Journal of Korean Academy of Nursing, 37(4), 594–602. https://doi.org/10.4040/jkan.2007.37.4.594