0
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Research ethics education needs assessment in Serbian medical researchers

, , , , , , & show all

ABSTRACT

The lack of formal education in research ethics is a significant issue for the ethical conduct of research in Serbia. We conducted a cross-sectional survey on a sample of researchers and ethics committee members in Serbia to evaluate their self-assessed competence and educational needs in research ethics. Results indicated that previous ethics education had a significant effect on respondents’ perception of their own competence in addressing issues like informed consent, authorship, and publishing. Respondents expressed a high motivation for further research ethics education. Moreover, the study revealed that researchers with different specializations and different research experience have different educational needs.

INTRODUCTION

During the past several decades, the ethical conduct of research has become a pressing concern for scientists, funding agencies, politicians, and society as a whole (Shamoo & Resnik, Citation2015). Cases of scientific misconduct covered by the press and increasing interdependence of scientific institutions, industry, and business may jeopardize societal trust in science and scientists. These developments may also give rise to conspiracy theories related to clinical and public health recommendations (Goldenberg, Citation2023). Today we see distrust reflected in responses to pandemic safety measures, vaccinations, genetic testing, and climate change, among others. To address this concern, scientific research oversight agencies have focused increasingly on educating investigators and those charged with institutional research oversight, namely, members of research ethics committees (REC) or institutional review boards (IRBs) (Antes et al., Citation2009). Some funding agencies (e.g. National Institutes of Health) now require ethics training for all scientists applying for funding (Dalton, Citation2000). Biomedical science is an object of particular scrutiny, given its potential direct impact on health and the frequent involvement of human participants.

For these reasons, ethical review of research protocols has become a widely accepted requirement for initiating human and animal research. To adequately perform research review, however, members of RECs need highly developed understanding of the critical issues in the ethical conduct of research, and competencies in assessing studies involving humans or animals in particular. Yet, in many countries, one of the main obstacles to the RECs’ good performance is lack of training in research ethics (Tusino & Furfaro, Citation2022). Although each health institution in Serbia is mandated to establish a REC, members are not obligated to receive formal research ethics education (Republic of Serbia, Citation2019). Even though ethics committee members need deep understanding of ethical issues in clinical research, few reviewers have formal research ethics training. This lack of formal research ethics education is a significant limitation on ethical review in Serbia and other low- and middle-income countries (LMICs) (Abass, Citation2017). The need for educated REC members becomes especially important in the contemporary research context, particularly with rapidly developing technologies involving innovative study designs, biobanks, immunotherapies, artificial intelligence studies, genomics, “big data” and the like.

Some research ethics education is provided to Serbian biomedical researchers as continuing medical education, as courses within graduate training and as elective clinical research short courses. The training is not uniform, and the level and scope of courses can be minimal. At the same time, evidence suggests that formal ethics education for health care professionals can improve their confidence in addressing ethical problems (Sulmasy et al., Citation1993). Furthermore, competence in ethics is being recognized as a valuable element in medical education (Carrese et al., Citation2015; Savulescu et al., Citation1999). Ethics competence, consisting of knowledge, skills, and attitudes necessary for resolving ethical dilemmas, is typically considered part of professional competence (Robichaux, Citation2016) because it enables healthcare professionals to make complex decisions and justify them (Koskenvuori et al., Citation2019). In this way, ethics training helps to protect patient rights and promote quality care. It also assuages moral distress by providing clinicians and researchers with tools for navigating the moral dilemmas that they inevitably encounter in their professional activities (Rushton et al., Citation2016).

Recently in Serbia, several initiatives to establish formal research ethics training programs were launched. One such initiative is the NIH/Fogarty International Center project to establish a Master’s Program in Research Ethics at the Faculty of Medicine of the University of Belgrade. As the faculty for that program worked on developing its curriculum, we recognized the importance of learning about the needs of our potential students. We therefore undertook a study to assess the educational needs of Serbian biomedical researchers to inform shaping the curriculum. We also used the opportunity to identify novel research ethics issues that arise in the context of research in Serbia. We designed a study with a sample of Serbian biomedical researchers and REC members to elicit information about their previous education in research ethics, their self-assessed competence in research ethics, the issues that they wanted to learn more, and their motivation and preferences for research ethics education.

MATERIALS AND METHODS

Study design and sampling

Cross-sectional research was conducted from February 14 to March 25, 2022.

Physician-researchers employed as either full-time or part-time in public healthcare institutions in three Serbian cities, Belgrade, Kragujevac, and Novi Sad, were recruited via e-mail using institutional mailing lists. The research was conducted in Serbian, and we used the Survey Monkey platform to disseminate the online questionnaire, collect the data, and save the responses in a database.

Physician-researchers from all specialty areas, departments, and levels of experience were eligible to participate. The introductory section of the questionnaire provided participants with a brief description of the study and explained that all responses would be anonymous and treated as confidential. The participants were also informed that their participation was voluntary and that they had the right to skip any questions they chose not to answer and to withdraw from the study at any point.

Instruments

The original comprehensive questionnaire instrument developed for the purpose of this study was based on a qualitative study aiming to identify the most frequent and relevant ethical issues arising in the context of research in Serbia and to explore Serbian medical researchers’ and ethics committees’ perspectives on ethical dilemmas. The qualitative study included six interviews with REC members and three focus groups with clinical researchers. Categories of ethical dilemmas obtained by qualitative content analysis were the basis for the key constructs in this survey.

The instrument included the following sections:

Research Ethics Competence-General Self-assessment (REC-GS) is a short questionnaire measuring general confidence in the application of research ethics knowledge. It consists of five, 5-point Likert scale items (ranging from 1 “strongly disagree” to 5 “strongly agree”). The principal component analysis revealed one component accounting for 59% of the variance, with all item loadings higher than 0.60. The Cronbach’s alpha for the five items was 0.82. The total score was calculated by summing the responses and dividing the sum with the number of items (five). The total score ranged from 1 to 5, with higher scores denoting higher self-assessed general research ethics competence.

Research Ethics Competence-Specific Domains Self-assessment (REC-SDS) is a questionnaire measuring confidence regarding satisfactory application of the research ethics knowledge within specific domains. It consists of twelve, 5-point Likert scale items (ranging from 1 “strongly disagree” to 5 “strongly agree”), asking respondents to determine how confident they feel in relying on their theoretical knowledge of research ethics when solving the presented ethical problems. The Image Factoring analysis with Oblimin rotation revealed two factors accounting for 67% of the variance. The Cronbach’s alpha for the twelve items was 0.92. The total score was calculated by summing up the responses and dividing the sum with the number of items (twelve). The total score ranged from 1 to 5, with higher scores denoting higher self-assessed domain-specific research ethics competence.

Research Ethics Learning Motivation Scale (RELMS) is a short questionnaire measuring motivation for future education in research ethics. It consists of six, 5-point Likert scale items (ranging from 1 “strongly disagree” to 5 “strongly agree”). The principal component analysis revealed one component accounting for 63% of the variance, and Cronbach’s alpha was 0.87. The total score was calculated by summing up the responses to all items. For the purpose of calculating the total score, the responses on item 6 were reversely coded.

Ethical Issues Frequency Scale (EIFS) is a scale measuring the prevalence of specific ethical issues in previously performed research. It consists of twelve, 5-point Likert scale items (ranging from 1 “never” to 5 “always”) considering the ethical issues that are common for research practise. The principal component analysis with Oblimin rotation revealed two factors accounting for 69% of the variance. The Cronbach’s alpha for the twelve items was 0.94.

A check-list with research ethics topics was used to assess whether the respondents felt the need for further research ethics education. It consisted of a 12-item list of ethical issues. Participants were asked to indicate the topics for additional education.

Previous research experience was assessed by a single item measure, asking participants to provide the number of studies in which they had been actively involved, followed up by a question asking to mark the role they occupied in the studies, with four options provided (1) principal investigator, 2) research coordinator, 3) research associate, and 4) other (to add)

Prior experience in research ethics review and oversight was evaluated using indicators such as: 1) service on IRB measured by the question “Have you ever served as a member of an IRB?” with the binary (Yes/No) response

Previous research ethics education was assessed by the question “Have you had any education in research ethics?” with the binary (Yes/No) response, and the follow-up question for those who answered “Yes:” “What was the duration of the education,” with three possible options: 1) short course, 2) one semester, and 3) several semesters

Socio-demographic characteristic included six items: gender, age, education level, work status, work place, and specialty.

Statistical analysis

Descriptive statistics were used to detail the sample characteristics and to summarize the variables. Internal consistency of the scale scores was evaluated with Cronbach’s alpha. To examine whether the prior education in research ethics had significant effects on general self-assessed competence and self-assessed competence within specific domains, a multivariate analysis of variance (MANOVA) with age as a covariate was conducted. In addition, a multivariate analysis of variance (MANOVA) was performed utilizing individual items of the REC-SDS as dependent variables, with prior education as independent. Bonferroni correction was used to adjust for multiple tests, and p < .025, namely p˂0.004 was considered statistically significant. To explore whether the frequency of ethical issues encountered in research practice was related to a medical specialty, analysis of variance (ANOVA) was conducted. To establish determinants of motivation to participate in research ethics education in the future, linear regressions were employed. In order to determine whether preferences for education in specific domains depend on certain socio-demographic variables and previous scientific experience, we conducted a series of bi-logistic regression analyses. All analyses were performed in Statistical Package for Social Sciences (SPSS) for Windows, version 25 (IBM Corp., Armonk, NY).

Ethical approval

On January 1, 2021, the Program for the Protection of Human Subjects (PPHS) office issued its determination that our study is exempt from human research as defined by Department of Health and Human Services (DHHS) regulations 45 CFR 46.101(b).

RESULTS

Socio-demographic characteristics

A total of 154 respondents, aged 24 to 64, participated in the research: 38.3% males and 61.7% females. All participants had earned an M.D (completed studies of medicine), more than a half of the participants (57.8%) had completed Doctoral studies, and 16.2% held Master’s degrees. The majority (68.8%) had clinical specialization (internal medicine, pediatrics, psychiatry, neurology, surgery, anesthesiology, gynecology), 20.1% had non-clinical specialization (forensic medicine, social medicine, epidemiology, hygiene, occupational medicine, basic science) and 11% were general practitioners. Almost half of them (48.1%) had previously taken a course in research ethics, but only 21.5% attended at least a one-semester course, while 26.6% attended a short course. A quarter of the respondents (25.3%) served as REC members at some point ().

Table 1. Socio-demographic characteristics of participants.

Self-assessed research ethics competence

Biomedical researchers in our sample reported a higher level of self-assessed general competence to deal with research ethics issues in their research activities (M = 3.97 ± 0.67) as compared to self-assessed domain-specific research ethics competence (M = 3.76 ± 0.77). Both average total scores fell in the third quartile of the score range, which could be interpreted as moderately high self-assessed general and domain-specific research ethics competence. Domains in which our respondents felt most competent are responsible conduct of research (authorship and publishing (M = 4.12 ± 0.92), informed consent (M = 4.11 ± 0.91) and confidentiality (M = 4.10 ± 0.98)). They felt least competent to deal with issues of biobanking (M = 3.08 ± 1.25), international research (M = 3.47 ± 1.10), and commercial research (M = 3.55 ± 1.07).

After controlling for age, prior education did have a statistically significant positive effect on the participants’ both self-assessment of general competences (F (2, 148) = 5.655, p < .025, partial η2 = 0.07), and the self-rated competence on specific research ethics issues (F (2, 148) = 8,444, p < .001, partial η2 = 0.07) (). After controlling for age, previous research ethics education did have a statistically significant effect on respondents’ perception of their own competence to resolve dilemmas related to informed consent, vulnerable groups, biobanking, using placebo, and responsible conduct of research (scientific misconduct, authorship, and publishing, conflict of interest) ().

Table 2. MANOVA: the effect of previous education in research ethics on the self-assessment of general competences and self-assessment of domain specific competences self-rating after controlling for age.

Table 3. MANOVA: the effect of previous education in research ethics on the self-rating perception of the specific competences after controlling for age.

Motivation to pursue research ethics education

Overall, the respondents showed a high level of motivation to participate in further research ethics education (Mean = 24.19, SD = 4.92). A high percentage of physicians expressed an intrinsic motivation for studying topics in the field: 61.1% of the respondents indicated that their reasons for participating in (further) research ethics training were to expand upon their knowledge about already familiar topics, 81.2% indicated that it would fulfill their need to constantly improve professionally, and 63% specified that they would find reading the literature and discussing the topics interesting and challenging. The respondents also showed a high degree of extrinsic motivation: 64.3% reported that they would attend research ethics classes because doing so would enable them to participate in the projects requiring knowledge of research ethics. In addition, 72.1% indicated they would like to acquire additional knowledge in research ethics because that could enable them to do a better job in preparing research proposals for ethics review. Only 10.4% of participants stated they would never take additional education in research ethics because it would be useless ().

Table 4. Motivation to attend research ethic education, n (%).

Linear regression revealed that age was the only significant predictor of the motivation to enter the research ethics course, with younger respondents’ being more motivated to participate in such education than older respondents ().

Table 5. Predictors of the participants’ motivation to enter the research ethics course: linear regression.

The frequency of research ethics issues

Research ethics issues most frequently encountered by our respondents are related to responsible conduct of research (authorship and publishing (49%)), informed consent (35.7%), and recruitment of participants (34.4%). The least frequently encountered issues are related to biobanking (20.1%) and justice (20.7%) ().

Table 6. The frequency of encountering ethical issues, n (%).

Analysis of variance showed that there were significant differences in the frequency of some research ethics problems among respondents by specialty (). Post hoc tests revealed that respondents with a clinical specialization reported encountering significantly more problems related to informed consent compared to general physicians (F = 3.116, p < .05). Respondents with clinical specialization also reported facing significantly more research ethics issues related to the use of placebos in research as compared to respondents with non-clinical specialization (F = 4.399, p < .05). The frequency of other ethical issues encountered in research practice did not differ among respondents with different types of specialties.

Table 7. The effects of the type of specialization on encountering different ethical problems: ANOVA.

Preferences for topics within research ethics education

Nearly half of the respondents stated that they would like additional education in ethics issues in research involving vulnerable populations (45.5%), externally sponsored research, (44.2%) international research (41.6%), and recruitment of participants (39%). Approximately one-third of the participants expressed a desire for education in topics, such as informed consent (33.8%), biobanking (35.1%), justice (31.2%), and placebo (37%). Somewhat more than a quarter of respondents (27.3%) expressed interest in the subject of confidentiality. Regarding topics related to responsible conduct of research, half of the respondents (50%) expressed interest in ethical questions related to publication and authorship issues, while somewhat smaller proportions preferred additional education related to scientific misconduct (39%) and conflict of interest (33.1%).

In order to determine whether specific preferences were related to socio-demographic variables (age, specialization), previous research experience (participation in a number of research studies), and prior experience in the research ethics field (service on a REC, previous research ethics education), a series of bi-logistic regression analyses were conducted ( and ). We found that none of these variables significantly affected interest in research ethics education regarding informed consent, vulnerable groups, biobanking, commercial research, recruitment of participant, justice, and responsible conduct of research (scientific misconduct, authorship, and conflict of interest). Still, there were different preferences for the topics such as placebo and confidentiality, depending on the type of specialty (clinical specialization vs. non-clinical specialization vs. general physicians). General physicians were 70% less likely to be interested in education concerning placebo (OR = 0.31, p < .05) and had almost 3 times higher chance of being interested in education concerning confidentiality (OR = 2.89, p < .05), as compared to those with clinical specialization. In addition, the respondents who participated in RECs were 70% less likely to be interested in education concerning international research (OR = 0.27, p < .05).

Table 8. The associations between certain characteristics of participants and their preferences for the future education: bi-logistic regression analysis.

Table 9. The associations between certain characteristics of participants and their preferences for the future education: bi-logistic regression analysis – continuing.

DISCUSSION

This study provides insights into the research ethics education experiences and the educational needs of biomedical researchers in Serbia. As evidenced by studies of several other Fogarty research ethics education programs conducted in countries across Eastern Europe, Central Asia, Africa, the Middle East, and Latin America, one of the main challenges identified in designing curricula was to make it relevant to the local needs and culture of trainees (Matar et al., Citation2014). Several findings of this study are noteworthy, and they have implications for the curriculum development of the Master’s program.

This study demonstrates that nearly half of Serbian biomedical researchers had some kind of research ethics education during their professional life, but only a fifth attended an education lasting one semester or longer. Respondents with prior research ethics education assessed their general research ethics competence as higher, and felt more competent to deal with issues of informed consent, vulnerable groups, biobanking, using placebo, and responsible conduct of research (scientific misconduct, authorship and publishing issues, conflict of interest), than respondents with no prior research ethics education. High confidence in one’s research ethics competence does not necessarily imply objective knowledge or skills. A study of REC members’ knowledge in Croatia showed that, although the majority of REC members were highly confident in their knowledge and competency, the level of actual knowledge was less than satisfactory. Their knowledge, however, was significantly improved after an interventional course (Borovečki et al., Citation2006). These findings imply a need for a more systematic approach to research ethics education, with strictly defined objectives and content, based on the reported needs of Serbian researchers.

Our respondents felt most competent in dealing with issues of responsible conduct of research (authorship and publishing), informed consent, and confidentiality, and least secure in resolving dilemmas related to biobanking, international, and commercial research. Similar findings were observed in a study of the perceptions and experiences of Bolivian health researchers. They felt most knowledgeable in research ethics related to informed consent, while they had the least knowledge in international research ethics (Sullivan et al., Citation2015). These findings are relevant given that most of clinical studies conducted in Serbia are international commercial studies sponsored by multinational pharmaceutical companies and funding institutions from high income countries. There is an increasing trend of conducting clinical studies in Eastern-European countries (Bartoszkiewicz et al., Citation2022; Filipovic, Citation2021). Several reasons explain this phenomenon. LMICs in Eastern Europe have a large pool of patients who are treatment-naïve to the newest therapies. More than 90% of the clinical studies being conducted in Serbia involve innovative therapies. Since participation in clinical studies is often the only way for many patients to access new treatments not covered by insurance, they are eager to take part in these studies (Rankovic & Mijatovic, Citation2016). In addition, an increasing number of studies conducted in Serbia are based on stored biospecimens (European Commission, Citationn.d.). The development of legislation regulating this field in detail is still ongoing. In addition, public awareness on data and biospecimen protection is still quite low, thus making research opportunities less restricted than they might be elsewhere.

Our respondents were highly motivated to pursue education in research ethics, expressing high levels of both intrinsic and extrinsic motivation. Younger researchers are more motivated to engage in research ethics education. High motivation for education in research ethics indicates a good chance for successful recruitment to our research ethics Master’s program.

The ethical dilemmas most frequently encountered by our respondents were related to responsible conduct of research (authorship and publishing), informed consent, and recruitment of participants. Clinical researchers often encountered problems with informed consent and placebo whereas researchers with non-clinical specialization and general physicians rarely did. This finding is not surprising given that clinical researchers are typically involved in research with human participants, and therefore face dilemmas related to informed consent. Ethical issues related to use of placebo are also more prominent in clinical studies. This finding is in line with the results of a national survey of United States internists’ experiences with ethical dilemmas where physicians encounter different types of ethical dilemmas depending on their specialty (DuVal et al., Citation2004). Another finding suggests that general practitioners were less likely to be interested in education regarding placebo than specialist researchers but were more likely to be interested in studying ethical aspects of confidentiality. The issue of data confidentiality is gaining increasing attention, especially in the era of “big data,” so it is not surprising that general practitioners are aware of the issue and interested in additional education.

Respondents who had experience as REC members were less likely to be interested in education regarding ethical aspects of international research, whereas those who had participated in smaller number of studies were more likely to be interested in additional education, especially related to participant recruitment. The largest percentage of respondents are interested in education regarding responsible conduct of research (authorship and publication issues and scientific misconduct), participant recruitment, vulnerable populations, commercial research, and international research. Topics of responsible conduct of research (e.g., authorship, publication issues, scientific misconduct), as well as issues related to human participants (e.g., informed consent, recruitment) are the most frequently encountered issues, and also the preferred subjects for additional education. Similarly, in a study conducted with REC members in Cameroon, Mali, and Tanzania, respondents identified the issue of informed consent among the top five ranked research ethics training priorities (Ateudjieu et al., Citation2010).

In contrast, dilemmas associated with international and commercial trials are issues our respondents feel least competent to address. This evidence from our study should be utilized in guiding future research ethic education to meet the needs of researchers in countries like ours which also conduct international and commercial trials. Also, the low level of confidence among Serbian researchers for addressing ethical issues associated with biobanking is particularly informative. There is an urgent need to provide adequate education for educators of trainees with similar needs to establish and cultivate ethical awareness and confidence in dealing with these ethically complex fields of research.

Strengths and limitations

To our knowledge, this is the first study examining the research ethics education needs of biomedical researchers in Serbia. We noted, however, several limitations of our study. Convenience sampling could have omitted some groups and left us with a sample that was not ideally representative of the population of Serbian researchers. We included biomedical researchers from three large University centers in Serbia, so additional research is needed to engage more representation from public and private hospitals, clinics, and universities, and to involve researchers other than clinicians, who could provide unique perspectives on the problem

The use of an online platform for questionnaire dissemination probably resulted in a lower response rate than an in-person study. This problem has been documented in previous studies (Leece et al., Citation2004; Whitehead, Citation2011). We decided to employ online dissemination because of our time constraints. We needed the information to support our curriculum development, while COVID-19 physical distancing measures made directly approaching participants too difficult. Since we used an open-access link for the questionnaire allowing participants to share the survey freely with their colleagues, it was not applicable to make the estimation of the unique audience reached and calculate the response rate.

Limitations of self-reported inquiring include the possibility of social desirability bias (Fisher & Katz, Citation2000). As the study was based on self-reported data, there may have been some over- and under-reporting of some particular experiences and behaviors. For example, the finding that ethical issues related to authorship and publishing were among the issues respondents felt most competent to deal with, and at the same time were among the topics for which they expressed the highest educational interest suggests the effect of possible social desirability bias in responding to items regarding self-assessed competence.

CONCLUSION

Respondents in our study expressed strong motivation for future education in research ethics. This suggests that comprehensive systematic education in research ethics for biomedical researchers in Serbia is needed. Results of this study indicate that issues related to responsible conduct of research (e.g., authorship, publishing issues, scientific misconduct) and human participant research (e.g., informed consent, recruitment) are those that Serbian biomedical researchers feel most competent to deal with and encounter in their research practice most frequently. Surprisingly, they are also among topics they are most interested in studying further.

Ethical issues related to international and commercial research and biobanking are issues biomedical researchers in Serbia feel least confident to address. They are also among the highly preferred topics for additional education. Researchers with different specialization and research experience have relatively different educational needs, a finding that should be taken into account when tailoring research ethics curricula to a specific learner population.

Supplemental material

Supplement Tables.docx

Download MS Word (15.3 KB)

DISCLOSURE STATEMENT

No potential conflict of interest was reported by the author(s).

SUPPLEMENTARY MATERIAL

Supplemental data for this article can be accessed online at https://doi.org/10.1080/10508422.2024.2382402.

DATA AVAILABILITY STATEMENT

The data that support the findings of this study are available from the corresponding author, [IM], upon reasonable request.

Additional information

Funding

This work was funded by the National Institutes of Health/Fogarty Center under Grant [3R25TW008171-08S1].

REFERENCES

  • Abass, S. (2017). Establishing training programs for research ethics committees. In H. Silverman (Ed.), Research ethics in the Arab region (pp. 349–358). Springer.
  • Antes, A. L., Murphy, S. T., Waples, E. P., Mumford, M. D., Brown, R. P., Connelly, S., & Devenport, L. D. (2009). A meta-analysis of ethics instruction effectiveness in the sciences. Ethics & Behavior, 19(5), 379–402. https://doi.org/10.1080/10508420903035380
  • Ateudjieu, J., Williams, J., Hirtle, M., Baume, C., Ikingura, J., Niaré, A., & Sprumont, D. (2010). Training needs assessment in research ethics evaluation among research ethics committee members in three African countries: Cameroon, Mali and Tanzania. Developing World Bioethics, 10(2), 88–98. https://doi.org/10.1111/j.1471-8847.2009.00266.x
  • Bartoszkiewicz, M., Kufel-Grabowska, J., & Litwiniuk, M. (2022). Number of clinical trials of new therapeutic agents in the European Union countries of central and Eastern Europe, 2000–2019. Polish Annals of Medicine, 29(1), 1. https://doi.org/10.29089/2020.20.00146
  • Borovečki, A., Ten Have, H., & Orešković, S. (2006). Education of ethics committee members: Experiences from Croatia. Journal of Medical Ethics, 32(3), 138–142.
  • Carrese, J. A., Malek, J., Watson, K., Lehmann, L. S., Green, M. J., McCullough, L. B., Geller, G., Braddock, C. H., & Doukas, D. J. (2015). The essential role of medical ethics education in achieving professionalism: The romanell report. Academic Medicine, 90(6), 744–752. https://doi.org/10.1097/ACM.0000000000000715
  • Dalton, R. (2000). NIH cash tied to compulsory training in good behaviour. Nature, 408(6813), 629–630. https://doi.org/10.1038/35047242
  • DuVal, G., Clarridge, B., Gensler, G., & Danis, M. (2004). A national survey of US internists’ experiences with ethical dilemmas and ethics consultation. Journal of General Internal Medicine, 19(3), 251–258. https://doi.org/10.1111/j.1525-1497.2004.21238.x
  • European Commission. (n.d.). CORDIS- EU research results: Serbia takes the lead in rare diseases research. Retrieved July 12, 2023, from https://cordis.europa.eu/article/id/173636-serbia-takes-the-lead-in-rare-diseases-research
  • Filipovic, Z. (2021, September 24). Why hold clinical trials in Eastern Europe? A new perspective on a growing trend. Martifarm. https://martifarm.com/why-hold-clinical-trials-in-eastern-europe-a-new-perspective-on-a-growing-trend/
  • Fisher, R. J., & Katz, J. E. (2000). Social‐desirability bias and the validity of self‐reported values. Psychology & Marketing, 17(2), 105–120. https://doi.org/10.1002/(SICI)1520-6793(200002)17:2<105:AID-MAR3>3.0.CO;2-9
  • Goldenberg, M. J. (2023). Public trust in science. Interdisciplinary Science Reviews, 48(2), 366–378. https://doi.org/10.1080/03080188.2022.2152243
  • Koskenvuori, J., Stolt, M., Suhonen, R., & Leino‐Kilpi, H. (2019). Healthcare professionals’ ethical competence: A scoping review. Nursing Open, 6(1), 5–17. https://doi.org/10.1002/nop2.173
  • Leece, P., Bhandari, M., Sprague, S., Swiontkowski, M. F., Schemitsch, E. H., Tornetta, P., Devereaux, P. J., & Guyatt, G. H. (2004). Internet versus mailed questionnaires: a controlled comparison (2). Journal of Medical Internet Research, 6(4), e39.
  • Matar, A., Garner, S., Millum, J., Sina, B., & Silverman, H. (2014). Curricular aspects of the Fogarty bioethics international training programs. Journal of Empirical Research on Human Research Ethics, 9(2), 12–23. https://doi.org/10.1525/jer.2014.9.2.12
  • Rankovic, D., & Mijatovic, M. (2016). Istraživanje o kliničkim ispitivanjima u Srbiji [Research of clinical studies in Serbia. Srbija u pokretu. http://srbijaupokretu.org/wp-content/uploads/2016/07/Izve%C5%A1taj-Klini%C4%8Dka-ispitivanj-u-Srbji.pdf
  • Republic of Serbia. (2019). Law on Health Care. Official Gazette of the Republic of Serbia, No. 25/2019. https://www.paragraf.rs/propisi/zakon_o_zdravstvenoj_zastiti.html
  • Robichaux, K. (2016). Ethical competence in nursing practice. Competencies, skills, decision making. Springer.
  • Rushton, C. H., Caldwell, M., & Kurtz, M. (2016). Moral distress: A catalyst in building moral resilience. The American journal of nursing, 116(7), 40–49. https://doi.org/10.1097/01.NAJ.0000484933.40476.5b
  • Savulescu, J., Crisp, R., Fulford, K. W., & Hope, T. (1999). Evaluating ethics competence in medical education. Journal of medical ethics, 25(5), 367–374. https://doi.org/10.1136/jme.25.5.367
  • Shamoo, A. E., & Resnik, D. B. (2015). Responsible conduct of research (3rd ed.). Oxford University Press.
  • Sullivan, S., Aalborg, A., Basagoitia, A., Cortes, J., Lanza, O., & Schwind, J. S. (2015). Exploring perceptions and experiences of Bolivian health researchers with research ethics. Journal of Empirical Research on Human Research Ethics, 10(2), 185–195. https://doi.org/10.1177/1556264615576903
  • Sulmasy, D. P., Geller, G., Levine, D. M., & Faden, R. R. (1993). A randomized trial of ethics education for medical house officers. Journal of medical ethics, 19(3), 157–163. https://doi.org/10.1136/jme.19.3.157
  • Tusino, S., & Furfaro, M. (2022). Rethinking the role of Research Ethics Committees in the light of Regulation (EU) No 536/2014 on clinical trials and the COVID‐19 pandemic. British journal of clinical pharmacology, 88(1), 40–46. https://doi.org/10.1111/bcp.14871
  • Whitehead, L. (2011). Methodological issues in Internet-mediated research: a randomized comparison of internet versus mailed questionnaires. Journal of Medical Internet Research, 13(4), e109. https://doi.org/10.2196/jmir.1593