https://orcid.org/0000-0001-7889-5578
ABSTRACT
Background
The concept of neonatal near miss is used to identify neonates who nearly died but survived a life-threatening complication in the first 28 days of life. Neonatal mortality is the tip of the iceberg. Quality improvement through utilization of a validated scale and reduction in adverse neonatal outcome is a priority for achieving sustainable development goals.
Objectives
To develop and assess the content validity of neonatal near-miss scale in the public health hospitals in Amhara Regional State, northwest Ethiopia.
Methods
A literature review was performed prior to the development of the neonatal near-miss assessment scale. An expert panel committee was formed by health facility practitioners and by the members of the academia. Two rounds of meetings were conducted with the expert panel to reach consensus on the face and content validity. The content validity index, Kappa statistics, and the content validity ratio were computed to estimate the content validity scale of neonatal near miss.
Results
In this study, four domains (pragmatic, clinical, management, and lab-investigations) with 32 items were identified. The item-level content validity index ranged from 0.7 to 1. The overall scale content validity (S-CVI) (average) for the domains (pragmatic, clinical, management, and lab-investigations) were 0.98, 0.95, 0.96, and 0.96, respectively. The overall S-CVI (universal) was 0.78 to 1, whereas the overall S-CVI (average) of neonatal near miss assessment scale was found to be 0.96. The content validity ratio and Kappa statistics values ranged from 0.6 to 1 and 0.9 to 1 for the respective domains.
Conclusion
The identified four domains and the respective items were valid enough (content-wise) to be used as identification criteria for neonatal near-miss cases. The scale will contribute to neonatal near-miss identification and also improve the quality of neonatal management care.
Responsible Editor
Maria Emmelin
Background
In 2017, 2.5 million neonates died globally in the first month of life, representing an average of about 7,000 every day. Most of these deaths occurred in the first week of birth. Based on this, consequently 28 million newborns are estimated to die between 2018 and 2030, and 80% of these deaths would occur in Southern Asia and sub-Saharan Africa [Citation1].
However, Ethiopia had outlined a plan to reduce the neonatal mortality rate (NMR from 29 per 1,000 live births in 2015/2016 to 11 per 1,000 live births by 2019/2020 [Citation2], but increased to 30 per 1,000 live births in 2019 [Citation3]. The highest mortality was in Amhara Regional State, which had an NMR of about 47 per 1,000 live births [Citation4].
Neonatal mortality is a significant public health problem in many low-resource countries [Citation5]. However, for every death, there are more than eight newborns that suffer life-threatening complications but survive (near-miss) [Citation6]. The concept of neonatal near-miss is a recent term and used to explain neonates who nearly died but survived from life-threatening complications during the first 28 days of extra-uterine life. It is becoming an increasingly important indicator not only for epidemiologic surveillance but also for assessment of quality of care [Citation7].
Neonatal mortality is the tip of the iceberg, but we also see a higher number of ill survivors than the number of deaths due to a lack of a validated assessment scale [Citation8]. According to a multi-country study carried out by the WHO, ideally, one near-miss case would mirror one death.The only difference could be that the neonate was alive at the time of assessing the vital status [Citation9]. Neonatal near-miss data should be used together with neonatal mortality data as a tool in the assessment of quality of care provision [Citation10,Citation11].
According to a data-based analysis of WHO cross-sectional studies, the concept of neonatal near miss and scale development was useful for shaping improvements in health care and of the health systems towards achieving Millennium Development Goals 4 and 5 [Citation9].
Several scoring tools have been used to assess severe neonatal morbidities, but none of these scoring markers can be used to define near miss neonates [Citation12]. The emerging pragmatic criteria are birth weight under 1,750 g, an APGAR score under 7 after 5 minutes, and gestational age under 33 completed gestation weeks [Citation9,Citation13–17]. The management criteria are phototherapy within 24 hours of life, cardiopulmonary resuscitation, use of vasoactive drugs, anticonvulsants, blood product or surfactant utilization, surgery, or use of steroids for treatment of refractory hypoglycemia, or intubation for 7 days [Citation18–21]. One study used certain clinical criteria [Citation22]. Lab-investigation criteria were not included, but they could be feasible in low-resource countries like Ethiopia. The validated neonatal near-miss assessment scale could be simple to use and easily understandable [Citation9].
Development and validation of neonatal near miss criteria could facilitate the use of a neonatal near miss scale as the measurement of quality of neonatal care and for the evaluation of death reviews [Citation8,Citation10]. Unlike maternal near miss, currently, there is no standard definition of a near miss neonate or a content and face validated neonatal near-miss assessment scale [Citation6,Citation9,Citation13,Citation23]. This makes the development and content validity a challenge before scaling up such activities [Citation6,Citation8,Citation10,Citation12,Citation24,Citation25].
Focusing on near-miss cases allows identification of a sufficient number of cases to study and understanding of health system failures within a short-time period, as compared to neonatal death studies. On top of this, studying neonatal near miss to identify health system failures is more acceptable for health care providers, as it would be a good opportunity to give feedback [Citation23].
Evidence suggest that researching neonatal near-miss cases rather than only neonatal deaths can provide more information on what goes wrong as the sample is larger, the parents are more available to give feedback, and the obstetric and neonatal staff can improve their practice by avoiding blaming each other [Citation12,Citation23,Citation26,Citation27].
The conceptualization and operationalization of a neonatal near-miss scale in the local context of Ethiopia need further information on interventions and performances useful for shaping improvements in neonatal health care and the health systems, with the goal of achieving Sustainable Development Goals [Citation9].
There is limited evidence in Ethiopia describing the process of developing a context-specific neonatal near-miss scale based on face and content validity for large-scale use in Ethiopian neonatal wards [Citation23]. This study aimed to develop and validate, content wise, the context-specific neonatal near-miss assessment scale and was conducted at the University of Gondar, College of Medicine and Health Science, and the University of Gondar Comprehensive Specialized Hospital in Amhara Regional State, northwest Ethiopia.
Methods
Design
In this study, two steps from theoretical background/literature review and experts’ opinions to develop and content validate the neonatal near-miss assessment scale were used. Theoretical background/literature review was performed prior to the development of the neonatal near miss assessment scale. Then, an expert panel committee was formed from members of the academia (pediatrics and neonatal health, clinical midwifery, reproductive health, epidemiology, and biostatistics) and health facility practitioners (neonatal nurses and midwives). Experts participating in this study were informed that their participation was entirely voluntary, and they were free to withdraw at any time. Two rounds of meetings were conducted with the expert panel with the aim of reaching consensus on the face and content validity.
Assessment scale development steps
The absence of a validated identification scale for near-miss cases makes it very difficult to establish the relationship between near-miss cases and neonatal deaths. Contextual validated scale development could allow comparisons between different settings, regardless of local development level and across time [Citation28]. The initial steps of scale development were performed using a three-step approach: identifying the content domain, generating the sample items, and constructing the scale [Citation29].
Domain identification
The content domain of the construct of neonatal near-miss is identified through literature review, content analysis, and expert panel discussions [Citation30]. The literature review helped the researchers identify different research gaps in the foundation of the near-miss neonates and their assessments instrument [Citation7]. Consensus-based standards for selection of health status measurements instrument (COSMIN) checklist was also used [Citation31]. During this preliminary work, the conceptualization of the central concept of items under each domain was emphasized. Pragmatic and management domains were selected from a previous study [Citation25] but with the addition and deletion of more than seven items, certain clinical [Citation22] and lab investigation scales were added from the literature [Citation32] and experts’ suggestion based on their feasibility order in the low resource setting study area. Finally, four domains with 31 items were approved for the identification of near miss neonates’ cases (pragmatic, management, clinical, and laboratory criteria).
Item generations
Items in each domain were presented hierarchically with easier and more feasible items at the top of each domain and less feasible ones at the bottom [Citation33]. The items developed for neonatal near-miss identification were reviewed by an expert panel committee. The panels of experts were selected considering expert knowledge, specific training, or professional experience on the subject matter ().
Table 1. Sociodemographic data of the expert panel on phase one scale from the public health hospital of Amhara Regional State, northwest Ethiopia, 2020
Content validity
Content validity is a precondition for other forms of statistical validity. It assesses the dimensions of the construct intended to be measured and reflects a specific domain of content. It helps the researchers gain invaluable feedback from panel experts [Citation30]. Addressing content validity begins with scale development. An invitation letter was sent via email to nine expert panel members with detailed explanations and the neonatal near-miss assessment scale one week before the first panel meeting. Then, after the expert panels had given their judgments individually, we contacted them through phone call to schedule a face-to-face meeting. The meeting took 2,5 hours. The panel meeting aimed to approve/add/delete the identified four domains by literature review, and to evaluate the items in each domain, as well as to ensure their relevance to assess the construct and neonatal near miss. The items with domains feasibility, representativeness, and applicability in low-resource setting hospitals were also assessed by the panel members during the panel meeting. All the experts who attended the panel meeting had reached a consensus on approving a total of four domains and 32 items with comments (seven items were eliminated, two items relocated to other domains, and order rearrangement was done). After this, a reviewed version was resubmitted to experts for approval through email with either all comments that were raised during the meeting incorporated or not. We received approval from all panel experts. Then, we designed a preliminary version of NNMAS comprising of 32 items grouped into four domains ().
Figure 1. Steps for development and assessment of content validity for a neonatal near miss scale in the context of Ethiopia
To minimize over or under estimation for the quantifications, 10 other independent panels of experts were invited for the second round to assess the necessity, relevancy, and clarity of each selected item in measuring the related domains. This panel was selected based on their expert knowledge in the field, specific training, and professional experience on the subject matter, with consideration of work experience of five or more years ().
Table 2. Sociodemographic data of the expert panel on phase two scale in the public health hospital of Amhara Regional State, northwestern Ethiopia, 2020
This expert panel were also asked to give their professional judgment on the scoring rate by considering the representativeness of individual items, whether the items in each domain adequately measured what they intended to measure and were asked to suggest revisions, additions and/or deletion of items in each construct. They also gave a score for each item based on the completeness, feasibility and time used for application, which was 20 minutes for all items, in each domain. The quantitative viewpoints on the relevance, necessity, clarity, and representativeness were collected to ensure the content validity of the items generated.
Quantification of content validity
Content validity ratio
According to the Lawshe test [Citation34], content validity ratio (CVR) was computed to specify whether an item is necessary for operating a construct or not. The experts were asked to give a score of (1 = not essential, 2 = useful but not essential, and 3 = essential.)
CVR = (Ne – N/2)/(N/2)
Ne-stands for the number of panelists indicating ‘essential’ and N is the total number of panelists. CVR values range between −1(perfect disagreement) and +1(perfect agreement) with CVR values above zero, indicating that over half of panel members agree on an item being essential [Citation35].
Content validity index (CVI)
The CVI was calculated for all individual items (I-CVI) and the overall scale (S-CVI). Experts were asked to rate each scale item in terms of its relevance to the underlying construct. The four points used along the item rating continuum were 1 = not relevant, 2 = somewhat relevant, 3 = quite relevant, and 4 = highly relevant.
Individual items
Content validity index (I-CVI) = (3or4)/N
The number of experts giving a rating of (3 or 4 = 1); N = total number of experts who were involved, and I-CVI was not less than 0.78.
Scale-content validity index (S-CVI)
This can be conceptualized in two ways: S-CVI (universal agreement) and S-CVI (average). The S-CVI (universal agreement) reflects the proportion of items on the scale that achieved a rating of 3 or 4 by all the experts on the panel. This shows the experts’ performance level. S-CVI (average) emphasizes average item quality rather than the average performance of the experts. It is recommended that an S-CVI should be 0.8 at a minimum for reflecting content validity [Citation30].
Kappa statistics coefficient
CVI is extensively used by researchers. However, it does not take into consideration the inflated values that may occur because of the possibility of chance agreement. Thus, computation of the Kappa statistics coefficient ensures a better understanding of content validity, as it removes any random chance agreement. Kappa statistic is a consensus index of inter-rater agreement that supplements CVI to ensure that the agreement among experts is beyond chance. Computation of Kappa statistics require the calculation of the probability of change agreement, that is, Pc = [N/A (N – A)]× 0.5 N, where N = number of experts in the panel, A = number of experts in the panel who agree that the item is relevant. Kappa statistics are then calculated as K = (I-CVI – Pc)/(1 – Pc). Values above 0.74, between 0.60 and 0.74, and between 0.40 and 0.59 are considered to be excellent, good, and fair, respectively [Citation30].
Results
In the current study, a panel of 19 experts was involved in two rounds. It comprised the members of the academia (experts in pediatrics and neonatal health, clinical midwifery, reproductive health, epidemiology, and biostatistics) and health facility practitioners (neonatal nurses and midwives) with more than 5 years of work experience.
Under the essentiality of items quantified by the experts, more than 98% of the items’ content validity ratio was in the range of 0.60 to 1.00. This indicates that the items are necessary (content valid) in order to assess neonatal near-miss cases. In this study, CVR of hematuria was found to be 0.4, which is below 0.5 and therefore considered not necessary (). The I-CVI for all the items in the four domains ranged from 0.70 to 1.00. The S-CVI (average) for pragmatic, management, clinical, and lab-investigation domains of NNMAS was found to be 0.97, 0.95, 0.96, and 0.96, respectively ().
Table 3. CVR for items from each domain with a number of experts who gave a scoring rate for an item in the public health hospital of Amhara Regional State, northwest Ethiopia, 2020
The overall S-CVI (universal) for the 32-items scale ranged between 0.78 and 1.00, which indicated the high content validity of the items for the construct of the neonatal near miss assessment scale. The overall S-CVI (average) of NNMAS was found to be 0.96 (). After quantification, we have produced the final version of the NNMAS scale containing 31 items under four domains. One item (hematuria), with 70% agreement was rejected ().
Table 4. Ratings on NNMAS by 10 experts’ items rated 3 or 4 on a 4-point relevant scale in the public health hospital of Amhara Regional State, northwestern Ethiopia, 2020
Discussion
This study aimed to describe the development and content validity of a context-specific neonatal near miss assessment scale for use in an Ethiopian low-resource setting. Many researchers have used and described various neonatal near-miss tools, and some have been validated [Citation9,Citation25]. No researchers have examined the impact of validated and reliable neonatal near miss tools, and the authors filled this specific gap in this paper. We have taken the first step in providing a contextually valid version of NNMAS that could provide valid, representative, and easily administered criteria for neonatal near-miss cases in low-resource settings in countries like Ethiopia. This can save the lives of neonates and reduce the high burden of neonatal death [Citation8].
Universal access to quality neonatal health services is essential to meet specific sustainable development goals to reduce neonatal and overall child mortality. Data for decision-making are crucial for planning services and monitoring progress [Citation36]. A neonatal near miss scale can be used as a measure of the quality of neonatal care and to evaluate death reviews [Citation10]. Quality of care could be measured using these standards. Thus, it could help to improve the quality of care in the clinical practice [Citation37].
Based on the experts’ suggestions, certain changes in the wording and rearrangement of the order of items and clarifications were made. Except for minor wording modifications, the experts on the panel for face validity did not provide suggestions regarding item deletion or addition. The criteria developed and validated were simple to use, highly related with near miss and death, and could be served as diagnosis and predictor of later mortality [Citation11,Citation20]. The scale needs to be accepted and used by health care providers in neonatal wards. Being familiar with a scale emphasizes the importance of face-to-face introduction. Furthermore, the invitation to health care providers to be involved at the neonatal ward is critical [Citation13]. The usefulness of this tool (scale) was proven in this study of face and content validation of the neonatal near miss assessment scale in this local context and could answer many researchers’ questions, although it must be further validated [Citation6,Citation8–10,Citation23,Citation25]. This study added clinical and simple lab-investigation domains with nearly 20 items that could be implemented in low-resource countries. These results were supported by the face and content validity, which was a qualitative measure required as an important first step in the development of the scale [Citation33]. In the current study, the overall S-CVI (universal) for the 31-item scale ranged between 0.78 and 1.00, and the overall S-CVI (average) of NNMAS was found to be 0.96. This indicated the high content validity of the items for the construction of the neonatal near miss assessment scale.
Limitation of the study
After confirmation of face and content validity, other types of validity and reliability need to be considered in the NNMAS validation process. The main limitation is the relatively advanced quantitative measures on a relatively small sample, despite us having invited 10 other panel experts (six academics, two practitioners, and two methodologists) to avoid unnecessary, potential biases.
The validation process of NNMAS therefore still needs other types of validity and its prospective predictive capability needs further evaluation for full implementation. To produce valid results, the content of a test, survey, or measurement method must cover all relevant parts of the subject. It aims to measure [Citation30]. If some aspects are missing from the measurement, or if irrelevant aspects are included, the validity is threatened [Citation38]. We therefore suggest psychometric testing to provide a solid foundation for tool validation.
Conclusion and clinical implications
Face and content validity are the first developmental phase for full psychometrical validation of NNMAS as this is a unique scale, and all the quantification findings indicated that this validated and reliable tool could be implemented in low-resource countries, to identify neonatal near-miss cases and, potentially, as such, support health care providers with a tool that will support decision-making, which in turn will help reduce the neonatal near miss morbidity and mortality in low-resource settings, not only in Ethiopia. The NNMAS showed face validity with minor rewording following suggestions from experts and holds a promise to identify near-miss neonates. Testing the validity and reliability of the scale with full psychometric properties and testing its comprehensiveness for respondents could be extremely important.
List of abbreviations
APGAR= Appearance, Pulse, Grimace, Activity, and Respiration
COSMIN=Consensus-based Standards for the selection of health status Measurement Instrument; CVI=Content Validity Index; CVR=Content Validity Ratio; I-CVI=Item-Content Validity Index; NNMAS=Neonatal Near miss Assessment Scales; S-CVI=Scale-Content Validity Index; UOG=University of Gondar; WHO=World Health Organization
Ethics and consent
Ethical clearance was obtained from the Institutional Review Board (IRB) of the University of Gondar, and informed consent was obtained from the panel experts involved.
Author contributions
All authors have made substantial contributions to the content and process of this study. MA conceived the idea. KG, YM, HL, and KE conducted the design, development, and validation of the scale. All authors participated in the process of the questionnaire validation. MA wrote the first draft of the manuscript. Review writing and editing were done by all authors. All authors have read and agreed to the final version of the manuscript.
Paper context
In Ethiopia, the neonatal death estimate is only the tip of the iceberg. The concept of neonatal near miss is used to identify why neonates who nearly died survived from a life-threatening complication during the first 28 days of life. This paper adds a validated near miss assessment scale for the Ethiopian context to the topic. This study provides a validated scale that can be used to identify neonatal near-miss cases in Ethiopia.
Acknowledgments
We acknowledged the contributions of all experts who participated in the face and content validations. We appreciated their dedication and time given to judge each item within the domain. The neonatal near-miss assessment scale would not have reached this level without their input and relevant comments.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
References
- UNICEF W, World Bank, UN-DESA Population Division. Levels and trends in child mortality report 2018Estimates developed by the UN inter-agency group for child mortality estimation; 2018; p. 1–9. Available from: https://wwwwhoint/maternal_child_adolescent/documents/levels_trends_child_mortality_2018/en/
- Directorate MaCH, Health FMo. National strategy for newborn and child survival in Ethiopia(2015/16-2019/20); 2015; p. 1–83. Available from: https://wwwhealthynewbornnetworkorg/resource/national-strategy-newborn-child-survival-ethiopia/
- ICF. EPHIEEa. Ethiopia mini demographic andHealth Survey 2019: key Indicators. Rockville (MD): EPHI and ICF; 2019; p. 1–35.
- ICF. CSACEa. Ethiopia Demographic and Health Survey 2016. Addis Ababa (Ethiopia) and Rockville (MD): CSA and ICF; 2016; p. 1–551.
- Ruhanga M. Predictive factors of neonatal mortality in intensive neonatal care unit at Goma Eastern Democratic Republic Of Congo. J Pediatr Neonatal Care. 2019:9.
- Bell AJ, Wynn LV, Bakari A, et al. “We call them miracle babies”: how health care providers understand neonatal near-misses at three teaching hospitals in Ghana. Plos One. 2018;13:e0198169.
- Shroff BD, Ninama NH. A call for eminence obstetrics care by way of “Neonatal Near miss”Events (NNM): a hospital-based case–control study. J Obstetrics Gynecol India. 2018:1–6.
- Manandhar SR, Dsm M, Adhikari D, et al. Neonatal Near Miss Cases of Different Health Facilities. Nepal Paediatr Soc. 2014;34:115–118.
- Pileggi-Castro C, Camelo Jr JS Jr, Perdoná GC, et al. Development of criteria for identifying neonatal near-miss cases: analysis of two WHO multicountry cross-sectional studies. BJOG. 2014;121:110–118.
- Avenant T. Neonatal near miss: a measure of the quality of obstetric care. Best Pract Res Clin Obstetrics Gynaecol. 2009;23:369–374.
- Day LT, Ruysen H, Gordeev VS, et al. “Every Newborn-BIRTH”protocol: observational study validating indicators for coverage and quality of maternal and newborn health care in Bangladesh, Nepal and Tanzania. J Glob Health. 2019;9:010902.
- Santos JP, Pileggi-Castro C, Camelo JS, et al. Neonatal near miss: a systematic review. BMC Pregnancy Childbirth. 2015;15:320.
- Ninama NH, Shroff BD. Will outlining neonatal near miss events make a change? A hospital based case control study. International Journal of Community Medicine and Public Health. 2019;6:5.
- Kale PL, Jorge M, Laurenti R, et al. Pragmatic criteria of the definition of neonatal near miss: a comparative study. Revista de saude publica. 2017;51:111.
- Silva AA, Leite AJ, Lamy ZC, et al. Neonatal near miss in the Birth in Brazil survey. Cad Saude Publica. 2014;30:S1–10.
- Silva G, Rosa K, Saguier E, et al. A populational based study on the prevalence of neonatal near miss in a city located in the South of Brazil: prevalence and associated factors. Rev Bras Saúde Materno Infantil. 2017;17:159–167.
- Carvalho OMC, Xavier ATDO, Gouveia APM, et al. Identificação de casos de near miss neonatal: que critérios são usados no cenário brasileiro – revisão integrativa. Rev Medicina UFC. 2019;59:53–59.
- Morais LR, Patz BC, Campanharo FF, et al. Neonatal near miss among newborns of women with type 1 diabetes mellitus. Obstet Gynecol Int. 2019;2019:8594158.
- De Lima THB, Katz L, Kassar SB, et al. Neonatal near miss determinants at a maternity hospital for high-risk pregnancy in Northeastern Brazil: a prospective study. BMC Pregnancy Childbirth. 2018;18:401.
- Santos JP, Cecatti JG, Serruya SJ, et al. Neonatal Near Miss: the need for a standard definition and appropriate criteria and the rationale for a prospective surveillance system. Clinics (Sao Paulo). 2015;70:820–826.
- Nakimuli A, Mbalinda SN, Nabirye RC, et al. Still births, neonatal deaths and neonatal near miss cases attributable to severe obstetric complications: a prospective cohort study in two referral hospitals in Uganda. BMC Pediatr. 2015;15:44.
- Tekelab T, Chojenta C, Smith R, et al. Incidence and determinants of neonatal near miss in south Ethiopia: a prospective cohort study. BMC Pregnancy Childbirth. 2020;20:354.
- Say L. Neonatal near miss: a potentially useful approach to assess quality of newborn care. J Pediatr (Rio J). 2010;86:1–2.
- Shroff BD, Ninama NH. A call for eminence obstetrics care by way of “Neonatal Near Miss”Events (NNM): a hospital-based case-control study. J Obstet Gynaecol India. 2019;69:50–55.
- Pileggi-Castro C, Souza J, Cecatti J, et al. Neonatal near miss approach in the 2005 WHO Global Survey Brazil. J Pediatr (Rio J). 2010;86:21–26.
- Wick L. Survival and negotiation: narratives of severe (near-miss) neonatal complications of Syrian women in Lebanon. Reprod Health Matters. 2017;25:27–34.
- Ronsmans C, Cresswell JA, Goufodji S, et al. Characteristics of neonatal near miss in hospitals in Benin, Burkina Faso and Morocco in 2012-2013. Trop Med Int Health. 2016;21:535–545.
- Pileggi-Castro C, Camelo JS Jr, Perdon GC, et al. Development of criteria for identifying neonatal near-miss cases: analysis of two WHO multicountry cross-sectional studies. BJOG Int J Obst Gynaecol. 2014;121:110–118.
- Zamanzadeh V, Ghahramanian A, Rassouli M, et al. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4:165–178.
- Shrotryia VK, Dhanda U. Content validity of assessment instrument for employee engagement. SAGE Open. 2019;9:215824401882175.
- Mokkink LB, Prinsen CAC, Bouter LM, et al. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20:105–113.
- Bakari A, Bell AJ, Oppong SA, et al. Neonatal near-misses in Ghana: a prospective, observational, multi-center study. BMC Pediatrics. 2019;19:509.
- Gagnon MP, Attieh R, Dunn S, et al. Development and content validation of a transcultural instrument to assess organizational readiness for knowledge translation in healthcare organizations: the OR4KT. Int J Health Policy Manag. 2018;7:791–797.
- Ikhsanudin SB. Content validity analysis of first semester formative test on biology subject for senior high school. J Phys. 2018;1097:012039.
- Ayre C, Scally AJ. Critical values for Lawshe’s content validity ratio. Meas Eval Couns Dev. 2014;47:79–86.
- Murphy GA, Waters D, Ouma PO, et al. Estimating the need for inpatient neonatal services: an iterative approach employing evidence and expert consensus to guide local policy in Kenya. BMJ Glob Health. 2017;2:e000472.
- Essali A. Clinical Audit= التدقيق السريري. Arab J Psychiatry. 2017;44:1–4.
- MacKenzie S. The dangers of poor construct conceptualization. J Academy Marketing Sci. 2003;31:323–326.
![Supercharge Your Next Research Paper: Research and write your next paper with Jenni AI.]({"type":"image" , "src" : "/sda/112448/MPU-L1SN.png"})