3,233
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Development of a Japanese version of the Self-assessment Scale of Interprofessional Competency (JASSIC)

ORCID Icon &
Pages 599-606 | Received 08 Sep 2020, Accepted 29 Jun 2021, Published online: 06 Aug 2021

ABSTRACT

This study aimed to develop a Japanese version of the Self-assessment Scale of Interprofessional Competency (JASSIC), which consists of six domains: Patient-/Client-/Family-/Community-Centered, Interprofessional Communication, Role Contribution, Facilitation Relationship, Reflection, and Understanding of Others. Validity of JASSIC was confirmed through a four-step process consisting of expert discussion, cognitive debriefing, feasibility, and statistical analysis. Confirmatory factor analysis (CFA) was performed by testing the correlation between the sum scores of JASSIC and the Assessment of Interprofessional Team Collaboration Scale-II(AITCS-II). First, 24 items were created through discussions among physicians, a nurse, a medical educator, and an information sociologist. Second, the items were modified by cognitive debriefing of a physician, nurse, pharmacist, occupational therapist, and social worker. Third, we provided the developed JASSIC for professionals at Hospital X (n = 139) and revised the wording and composition of the items. Finally, CFA among professionals at Hospital Y (n = 153) identified a 6-domain structure (GFI: 0.847, AGFI: 0.782, RMSEA: 0.088). Cronbach’s alpha was 0.92, and the correlation coefficient with AITCS-II was 0.72. Ongoing research into JASSIC will promote effective interprofessional collaborative practice not only in Japan but also other countries which share a similar culture and system.

Introduction

The current pressures on primary healthcare settings globally have revealed the challenges of the super-aging society, multimorbidity and health inequities (Samuelson et al., Citation2012). Such challenges cannot be contained by a single profession and require efficient interprofessional collaborative practice (IPCP). Achieving IPCP in turn requires utilization of seamless interprofessional education (IPE) from undergraduate level to continuous professional development, as presented in a framework for action by the World Health Organization (WHO) (Gilbert et al., Citation2010). Owing to the rigor of the curriculum and the presence of professional silos against IPE, however, healthcare education has failed to overcome dysfunctional healthcare systems (Frenk et al., Citation2010). In particular, while assessment of interprofessional learning is essential for the effective promotion of IPE and IPCP, no international consensus on the assessment of IPE has yet been established (Rogers et al., Citation2017).

In healthcare education, competency-based assessment is promoted as ideal (Gruppen et al., Citation2012). A set of competencies is defined as the ability to integrate that particular set of knowledge, skills, ethics, and attitudes which together characterize the successful practitioner of a profession (Ten Cate, Citation2005). With competency as a goal, learners or practitioners coordinate the learning process, apply the learning to practical situations, and assess performance based on expected levels (Carraccio et al., Citation2002). Interprofessional competencies and capabilities have been advocated in the UK, US, Canada, Australia, and Japan (Brewer & Jones, Citation2013; Brownie et al., Citation2014; Canadian Interprofessional Health Collaborative, Citation2010; Haruta et al., Citation2018; Schmitt et al., Citation2011), but few comprehensive tools for the broad assessment of interprofessional education competencies have yet been developed. Some tools that partially assess knowledge, skills, attitudes, and assessment process are available, including ICAR, the interprofessional collaborator assessment rubric (Curran et al., Citation2011); iTOSCE, the interprofessional team objective structured clinical examination (Curran et al., Citation2009; Simmons et al., Citation2011); and iTOFT, the interprofessional teamwork observation and feedback tool (Morgan et al., Citation2015; Thistlethwaite et al., Citation2016). In Japan, evaluation tools for IPE developed through linguistic and validation studies include RIPLS, the Readiness for Interprofessional Learning Scale (Oishi et al., Citation2017; Tamura et al., Citation2012); IPFS, the Inter Professional Facilitation Scale (Haruta et al., Citation2017); and AITCS, the Assessment of Interprofessional Team Collaboration Scale (Yamamoto & Haruta, Citation2019). However, none of these was developed based on interprofessional competencies in Japan. Interprofessional competency-based assessment can allow the comprehensive reflection of one’s own competency, as well as analysis of not only the differences in each profession but also the situation in each facility and local community. This can provide insights to aid the development of IPE curricula and/or community healthcare systems.

Against this background, this study aimed to develop a Japanese version of the Self-assessment Scale of Interprofessional Competency (JASSIC) as a tool for individual professionals to assess interprofessional competencies.

Methods

Development of the self-assessment scale was conducted in four steps, namely (1) expert discussion, (2) cognitive debriefing, (3) feasibility, and (4) statistical analysis. The development and validity process of JASSIC is illustrated in .

Figure 1. Flow chart of the development and validity process.

Figure 1. Flow chart of the development and validity process.

Based on the interprofessional competency framework in Japan (Haruta et al., Citation2018), two authors (JH and RG) developed the items of JASSIC Ver. 1 as a prototype to measure interprofessional competencies. The Interprofessional Competency Framework in Japan includes two core domains (Patient-/Client-/Family-/Community-Centered and Interprofessional Communication) and four peripheral domains (Role Contribution, Facilitation Relationship, Reflection, and Understanding of Others) (Haruta et al., Citation2018). JH is the first author of a thesis aimed at promoting the development of Interprofessional Competency in Japan.

Expert discussion

Multi-professional experts who were involved in the project to develop an Interprofessional Competency Framework in Japan and who had a good understanding of the framework were asked to contribute to this study. Based on the subjective opinions of five experts, a consensus method was considered appropriate for development of the scale. Each expert evaluated JASSIC Ver. 1 by completing an e-mail survey based on a 4-point Likert scale from June to July 2019. A 4-point scale was adopted based on Lynn’s determination (Lynn, Citation1986) and the quantification of content validity: 1 = very valid; 2 = mostly valid; 3 = not quite valid; and 4 = not valid (Polit & Beck, Citation2006). Full consensus was defined as 78% or more of the responders giving a rating of 1 or 2, in accordance with a previous study (Morita et al., Citation2015). Additionally, we conducted web meetings using Skype TM to seek each expert’s views and asked each expert to suggest different wording or to propose other items. Once an expert consensus was reached, JASSIC Ver. 2 was created in August 2019 by adding items with the scoring reversed.

Cognitive debriefing

The cognitive debriefing was implemented through interviews using Zoom by one author (RG) with five health professions, including a physician, nurse, pharmacist, occupational therapist, and social worker, who worked in different healthcare facilities. The goal was to check their understanding of all items and explanations in JASSIC Ver. 2. The understandability, misinterpretability, and acceptability were then evaluated, and JASSIC ver.3 was created following further adjustment in September 2019.

Feasibility

Feasibility was evaluated by reviewing the proportion of missing values per item. For the face validity of Ver. 3, we confirmed whether the respondents were able to make interpretive decisions for each item. We analyzed individual attribute data that could indicate implicit bias in healthcare settings, such as positive evaluation in the positions of professionals (Fitzgerald, Citation2014; Fitzgerald & Hurst, Citation2017), and performed inter-item correlation (Cohen & Swerdlik, Citation2005). For content validity, free-text responses were grouped into positive and negative comments with categories relating to utility, comprehension, and embarrassment based on specific guiding questions.

This validity process was implemented via research collaborators through the distribution of JASSIC Ver. 3. to all healthcare professionals in Hospital X, a community hospital, by the head of nursing. Study participants who did not consent to participate in the study or who did not answer every item were excluded. The self-assessment scale was collected in November 2019, and the results were used to develop JASSIC Ver. 4.

Statistical analysis

The purpose of the analyses was to evaluate the structural validity, internal consistency, and hypothesis testing for construct validity of JASSIC Ver. 3 and Ver. 4. The items of JASSIC Ver. 3 were revised or erased based on the correlation matrix for correlation coefficients under 0.3 (Tabachnick & Fidell, Citation2014). JASSIC Ver. 4. was distributed to all healthcare professionals in Hospital Y, a community hospital, from January to February 2020 by the hospital administration. For descriptive statistical analysis, scores for JASSIC Ver. 4 were summarized as mean, standard deviation, and percentage of floor and ceiling scores after excluding missing values. Through this process, floor/ceiling effects greater than 50% were eliminated. For structural validity, exploratory factor analysis (EFA) was used due to insufficient analysis of the structure of JASSIC Ver. 4. In EFA, Promax rotation was performed in conjunction with the maximum likelihood method (Taherdoost et al., Citation2014). Factor selection was based on the Scree test (Cattell, Citation1966) and Kaiser Eigen values >1.0 (Kaiser, Citation1960) as a reference. In this process, we estimated the number of factor loadings, and eliminated any items exhibiting factor loadings inferior to 0.4 for several dimensions (Maskey et al., Citation2018). Based on the JASSIC final version with the remaining items, confirmatory factor analysis (CFA) was implemented to explore structural validity using Structural Equation Modeling (SEM)(Simon et al., Citation2010). The fit of the models to the data was determined by exploring the goodness-of-fit index (GFI), adjusted GFI (AGFI) and the root-mean-square error of approximation (RMSEA) on the hypothesis that the factor structure matches the six domains of the interprofessional competency framework in Japan (West et al., Citation1995). Internal consistency in JASSEC final version was assessed using Cronbach’s alpha (Nunnally & Bernstein, Citation1994). Since no other Japanese tools for self-assessment of interprofessional competency are available, hypotheses testing for construct validity were checked by comparison with another measurement instrument (convergent validity) and between subgroups (known-group validity)(Davidson, Citation2014). For convergent validity, the correlation between the total score of the Assessment of Interprofessional Team Collaboration Scale-II (AITCS-II)(Orchard et al., Citation2018), whose Japanese version was validated in a similar way to the present questionnaire (Yamamoto & Haruta, Citation2019), and the total score of JASSIC final version was examined using Pearson’s correlation coefficient. For known-group validity, the total scores for JASSIC final version between nurses and non-nurses were analyzed with an unpaired t-test based on a previous study in Japan, which showed that the AITCS score for nurses is higher than that for other professionals (Haruta et al., Citation2019). Analyses were performed using IBM SPSS software (version 26) and Amos 25 Graphics. This study was approved by the Ethics Committee of the Faculty of Medicine of the University of Tsukuba (No. 1418). All participants were volunteers who had checked a box on the questionnaire indicating their intention to participate.

Results

Expert discussion

JH and RG created JASSIC Ver. 1 with 26 items, consisting of 5 items for each of the core domains of Patient-/Client-/Family-/Community-Centered and Interprofessional Communication, and 4 items for each of the peripheral domains of Role Contribution, Facilitation Relationship, Reflection, and Understanding of Others. Five experts, consisting of a male family physician with a 16-year career, a female family physician with a 16-year career, a female nurse with a 19-year career, a medical educator with a 10-year career, and an information sociologist with a 11-year career, all of whom were involved in the development of interprofessional competency in Japan, evaluated JASSIC Ver. 1 using the sheet to check the 4-point scale and describe the free text of each item via e-mail. The experts initially failed to reach full consensus for all items. By checking all items in two web meetings and three e-mail interactions, a 24-item JASSIC Ver 2. was created, which included four reverse scoring items.

Cognitive debriefing

The five health professionals who performed the cognitive debriefing, namely a physician, nurse, pharmacist, occupational therapist, and social worker, are characterized in . Each professional underwent a debriefing that took between 20 and 35 minutes. The authors discussed the findings of the debriefing and determined that three items should be revised using different wordings, and that one item should be rearranged to make it easier to answer. The resulting document was considered JASSIC Ver. 3.

Table 1. Attributes of the five healthcare professionals involved in cognitive debriefing from June to August 2019.

Feasibility

JASSIC Ver. 3 was distributed to 149 healthcare professionals at Hospital X. Of these 6 did not provide consent and 4 were excluded due to missing values, leaving the data of 139 participants for analysis. Baseline characteristics of the participants in Hospital X are shown in . For face and content validity, we found that participants might misinterpret the reverse scoring items, given that three of four reverse scoring items (No.15, 19, 20) had inter-item correlations of 0.3 or less for more than half of responses, in absolute values. (Supplemental material.1)

Table 2. Attributes of healthcare professional participants using JASSIC Ver. 3 in Hospital X in November 2019 and JASSIC Ver 4. in Hospital Y from January to February, 2020.

Statistical analysis

First, the data of JASSIC Ver. 3 were analyzed. Excluding the four reverse items, the inter-item Spearman’s rank correlations were all significant and ranged from 0.29 to 0.71 (r > 0.2, p < .05). Further, Pearson’s correlation coefficient between the total score of JASSIC Ver. 3 and AITCS-II was 0.67 (p < .001). Based on these findings, the authors developed JASSIC Ver. 4, which changed the reverse items to regular ones because three of the reversed items of Ver. 3 scored 0.3 or less on the correlation matrix for correlation coefficients.

Second, JASSIC Ver. 4 was distributed to 165 healthcare professionals at Hospital Y, of whom 8 did not provide consent and 4 were excluded due to missing values, leaving 153 participants for analysis. Baseline characteristics of the participants in Hospital Y are shown in . No floor and ceiling effect was seen. In EFA with six fixed factors based on the domains of interprofessional competency in Japan, six items were excluded, since factor loadings were less than 0.4 for several dimensions. The Kaiser-Meyer-Olkin (KMO) value was 0.875 and Bartlett’s test for sphericity was significant (χ2 = 2144.543, df =153, p < .001). EFA fixed 6 factors showed a cumulative contribution rate of 82.3%, while the individual contribution rates in the order of interprofessional competency in Japan were 44%, 3.6%, 7.7%, 6.6%, 3.7%, and 16%, respectively. Factor loadings after rotation are shown in . JASSIC final version was created following this process. Mean and standard deviation of the total score of JASSIC final version were 62.8 ± 9.9 (full 90) in . All items of JASSIC final version exhibited an inter-item correlation ranging from 0.17 to 0.82, except for 0.15 (correlation between item 11 and item 23) (Supplemental material. 2), and also showed significant correlation by Spearman’s correlation coefficient (p < .05). CFA of JASSIC final version indicated a 6-domain structure, with 0.847 for GFI, 0.782 for AGFI, and 0.088 for RMSEA (90% confidence interval [CI]: 0.073–0.102) (). Cronbach’s alpha was 0.92 for all items, and 0.95, 0.88,0.87,0.84,0.90, and 0.81 for each order factor (). Pearson’s correlation coefficient between the total score of AITCS-II and JASSIC final version was 0.69 (p < .001). For known-group validation using JASSIC final version, the mean and standard deviation of the total scores of 98 nurses and 55 non-nurses were 64.9 ± 9.6 and 59.3 ± 9.6, respectively, which were significantly different (p = .001).

Table 3. Exploratory factor analysis of JASSIC final version* with 18 items in Hospital Y from January to February 2020.

Figure 2. Confirmatory factor analysis of JASSIC final version with 18 items in Hospital Y from January to February 2020.

Figure 2. Confirmatory factor analysis of JASSIC final version with 18 items in Hospital Y from January to February 2020.

Discussion

We developed a Japanese version of the Self-assessment Scale of Interprofessional Competency (JASSIC) in a robust process which involved four steps. The JASSIC is a tool to assess one’s own interprofessional competencies according to the interprofessional competency framework in Japan. This assessment tool provides a visualization of the current situation for each profession and organization and can facilitate reflection, particularly in the primary care setting, in which IPCP is required.

Since the interprofessional competency framework consists of six domains (Haruta et al., Citation2018), it was hypothesized that JASSIC would be constituted into six factors based on the competencies. However, in psychological statistics, the reversed items affected the participants’ perceptions (Baumgartner & Steenkamp, Citation2001). The inclusion of reversed items may eliminate the acquiescence bias (Watson, Citation1992). However, it was reported that inclusion of reversed items may cause confusion among the respondents (Sonderen et al., Citation2013) and distort the factor structure (Savalei & Falk, Citation2014; Zhang et al., Citation2016). In this study, we had to exclude the reversed items because they were either weakly correlated with the other items or had low factor loading. This suggests that an assessment consisting of non-reversed items provides a more robust factor structure for healthcare professions.

In the EFA of JASSIC Ver.4, two factors did not meet Kaiser Eigen values >1.0 (Kaiser, Citation1960). However, in general, Kaiser criteria overestimate the correct number of factors by 66% (Linn, Citation1968) and tend to substantially overestimate and/or underestimate the number of factors (Zwick & Velicer, Citation1986). Some studies have mentioned that Kaiser criteria are among the least accurate methods for selection of factor retention (Ledesma & Valero-Mora, Citation2007; Velicer & Jackson, Citation1990). Thus, instead of strictly adhering to the Kaiser criteria, the factors were theoretically selected by interprofessional competency domains.

The JASSIC final version was validated using psychometric evaluation methods (Gärtner et al., Citation2018). A missing data rate of 4.8% suggests that the feasibility of the scale is acceptable. Generally, while the cutoff values for acceptability were taken to be GFI, AGFI > 0.90, GFI and AGFI values in this study were 0.88 and 0.78, respectively. This might have been affected by the sample size, on which GFI and AGFI are known to depend (Mulaik et al., Citation1989). The RMSEA value of 0.088 in this sample is close to acceptable (Fabrigar et al., Citation1999). Internal consistency across the 18 items in JASSIC final version was assessed using Cronbach’s alpha, with an alpha of ≥ 0.70 indicating adequate reliability. Regarding hypothesis testing for construct validity, the correlation coefficient between the total score of AITCS-II and JASSIC final Ver. was ≥0.50, which supports convergent validity. Known-group validity demonstrated the expected difference among relationships between nurses and non-nurses (Haruta et al., Citation2019). Overall, these validated steps warrant the value of JASSIC final version as a self-assessment tool.

There are three strengths in this study. First, we developed a competency-based assessment tool structured into six domains. A factor structure divided into six domains is robust, as it allows for comparisons on a domain-by-domain basis. Second, JASSIC may be continuously utilized from the student to professional level by clarifying milestones in this process, given that interprofessional competency in Japan develops seamlessly from undergraduate level to continuous professional development. Third, JASSIC is based on an interprofessional competency framework developed in Japan. IPE and IPCP are influenced by culture and systems. These findings are also meaningful for other countries in Asia, where IPE and IPCP are developing rapidly, and which have relatively similar cultures to Japan. Moreover, JASSIC allows comparison of differences in interprofessional competencies among other countries, which can provide insights into the development process of competency-based assessment tools.

Several limitations of our study also warrant mention. The composition of items included no revised items. Since the JASSIC is an interprofessional competencies assessment tool with self-report measures, it may include acquiescence and social desirability. As other limitations, small sample size for CFA and how the goodness-of-fit values were barely adequate hence a further study with a larger sample would be needed. However, while it is important that this assessment tool have valid contents and a robust structure, we expect it will encourage leaners and practitioners to reflect on their progress by making them aware of learning points in each domain. The study participants were all healthcare professionals in community hospitals; future research should be applied to other facilities.

Allowing for these limitations, the results are significant because few relatively robust interprofessional competency-based assessment tools have been reported internationally. In addition, we believe that the JASSIC – developed under the concept of competency-based education – can be applied in principle not only to other institutions and communities, but also to learners and practitioners. It is expected that self-assessment by each profession, especially in the field of primary care, where effective IPCP is required, will encourage reflection by individuals, organizations, and communities, and thereby build better IPCP in the field. Future investigation into correlations among patient outcomes and JASSIC and national surveys using JASSIC will be of interest. Additionally, JASSIC might be helpful for other Asian countries which can be identified as within the Confucian Asia cluster, which includes Japan (Gupta et al., Citation2002). Further, we believe that it will be internationally meaningful to describe how JASSIC can be used in the primary care setting.

Conclusion

We developed and validated a Japanese version of the Self-assessment Scale of Interprofessional Competency (JASSIC). JASSIC research will promote the development of effective IPE and IPCP not only in Japan but also other Asian countries.

Declaration of interests

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article

Ethical approval

Ethics Committee of the Faculty of Medicine, University of Tsukuba (No. 1418).

Supplemental material

Supplemental Material

Download Zip (43.9 KB)

Acknowledgments

The authors thank Dr. Youhei Mori, Dr. Ai Oishi, Dr. Kazue Yoshida, Dr. Michiko Goto, and Dr. Kenji Yoshimi for their expert discussion, and Dr. Yu Yamamoto, Mr. Ryohei Gokan, Ms. Yuka Shindo, Mr. Tomotsugu Yamakawa, and Ms. Kaori Naganuma for cognitive debriefing. We are very grateful to the professional healthcare participants of Kamisu-Saiseikai Hospital and Takahagi Kyodo Hospital.

Data availability statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical considerations

Supplementary materials

Supplemental data for this article can be accessed on the publisher’s website.

Additional information

Funding

This study was supported by the Interprofessional Collaboration and Community-based Integrated Care Committee of the Japan Primary Care Association. This work was supported by JSPS KAKENHI Grant-in-Aid for Young Scientists (B) Grant Number JP19K19377.

References

  • Baumgartner, H., & Steenkamp, J.-B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38(2), 143–156. https://doi.org/10.1509/jmkr.38.2.143.18840
  • Brewer, M. L., & Jones, S. (2013). An interprofessional practice capability framework focusing on safe, high-quality, client-centred health service. Journal of Allied Health, 42(2), e45–9.
  • Brownie, S., Thomas, J., McAllister, L., & Groves, M. (2014). Australian health reforms: Enhancing interprofessional practice and competency within the health workforce. Journal of Interprofessional Care, 28(3), 252–253. https://doi.org/10.3109/13561820.2014.881790
  • Canadian Interprofessional Health Collaborative. (2010). A national interprofessional competency framework. Health San Francisco. 1-32. http://ipcontherun.ca/wp-content/uploads/2014/06/National-Framework.pdf .
  • Carraccio, C., Wolfsthal, S. D., Englander, R., Ferentz, K., & Martin, C. (2002). Shifting paradigms: From Flexner to competencies. Academic Medicine : Journal of the Association of American Medical Colleges, 77(5), 361–367. https://doi.org/10.1097/00001888-200205000-00003
  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102_10
  • Cohen, R. J., & Swerdlik, M. E. (2005). Psychological testing and assessment: An introduction to tests and measurement (6th ed.). McGraw-Hill.
  • Curran, V., Casimiro, L., Banfield, V., Hall, P., Lackie, K., Simmons, B., Tremblay, M., Wagner, S. J., & Oandasan, I. (2009). Research for Interprofessional Competency-Based Evaluation (RICE). Journal of Interprofessional Care, 23(3), 297–300. https://doi.org/10.1080/13561820802432398
  • Curran, V., Hollett, A., Casimiro, L. M., Mccarthy, P., Banfield, V., Hall, P., Lackie, K., Oandasan, I., Simmons, B., & Wagner, S. (2011). Development and validation of the interprofessional collaborator assessment rubric (ICAR). Journal of Interprofessional Care, 25(5), 339–344. https://doi.org/10.3109/13561820.2011.589542
  • Davidson, M. (2014). Known-groups validity. In Encyclopedia of quality of life and well-being research. 3481–3482. Dordrecht:Springer Netherlands. https://doi.org/10.1007/978-94-007-0753-5_1581
  • Fabrigar, L. R., MacCallum, R. C., Wegener, D. T., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
  • Fitzgerald, C. (2014). A neglected aspect of conscience: Awareness of implicit attitudes. Bioethics, 28(1), 24–32. https://doi.org/10.1111/bioe.12058
  • Fitzgerald, C., & Hurst, S. (2017). Implicit bias in healthcare professionals: A systematic review. BMC Medical Ethics, 18(1), 19. https://doi.org/10.1186/s12910-017-0179-8
  • Frenk, J., Chen, L., Bhutta, Z. A., Cohen, J., Crisp, N., Evans, T., Fineberg, H., Garcia, P., Ke, Y., Kelley, P., Kistnasamy, B., Meleis, A., Naylor, D., Pablos-Mendez, A., Reddy, S., Scrimshaw, S., Sepulveda, J., Serwadda, D., & Zurayk, H. (2010). Health professionals for a new century: Transforming education to strengthen health systems in an interdependent world. The Lancet, 376(9756), 1923–1958. https://doi.org/10.1016/S0140-6736(10)61854-5
  • Gärtner, F. R., Bomhof-Roordink, H., Smith, I. P., Scholl, I., Stiggelbout, A. M., & Pieterse, A. H. (2018). The quality of instruments to assess the process of shared decision making: A systematic review. Plos One, 13(2), e0191747. https://doi.org/10.1371/journal.pone.0191747
  • Gilbert, J. H. V., Yan, J., & Hoffman, S. J. (2010). A WHO report: Framework for action on interprofessional education and collaborative practice. Journal Of Allied Health, 39, 196–197. http://apps.who.int/iris/bitstream/handle/10665/70185/WHO_HRH_HPN_10.3_eng.pdf?sequence=1
  • Gruppen, L. D., Mangrulkar, R. S., & Kolars, J. C. (2012). The promise of competency-based education in the health professions for improving global health. Human Resources for Health, 10(1), 1-7. https://doi.org/10.1186/1478-4491-10-43
  • Gupta, V., Hanges, P. J., Dorfman, P., Gupta, V., Hanges, P. J., & Dorfman, P. (2002). Cultural clusters: Methodology and findings. Journal of World Business, 37(1), 11–15. https://doi.org/10.1016/S1090-9516(01)00070-0
  • Haruta, J., Breugelmans, R., & Nishigori, H. (2017). Translation and cultural adaptation of the Japanese version of the interprofessional facilitation scale. Journal of Interprofessional Care, 32(3), 321-328.
  • Haruta, J., Ozone, S., & Goto, R. (2019). Factors for self-assessment score of interprofessional team collaboration in community hospitals in Japan. Family Medicine and Community Health, 19(7), 4. https://doi.org/10.1136/fmch-2019-000202
  • Haruta, J., Yoshida, K., Goto, M., Yoshimoto, H., Ichikawa, S., Mori, Y., Yoshimi, K., & Otsuka, M. (2018). Development of an interprofessional competency framework for collaborative practice in Japan. Journal of Interprofessional Care, 32(4), 436–443. https://doi.org/10.1080/13561820.2018.1426559
  • Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. http://audibmw.info/pdf/retain/4.pdf
  • Ledesma, R. D., & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research and Evaluation, 12(1), 2. http://audibmw.info/pdf/retain/4.pdf
  • Linn, R. L. (1968). A monte carlo approach to the number of factors problem. Psychometrika, 33(1), 37–71. https://doi.org/10.1007/BF02289675
  • Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385. https://doi.org/10.1097/00006199-198611000-00017
  • Maskey, R., Fei, J., & Nguyen, H. O. (2018). Use of exploratory factor analysis in maritime research. Asian Journal of Shipping and Logistics, 34(2), 91–111. https://doi.org/10.1016/j.ajsl.2018.06.006
  • Morgan, S., Pullon, S., & McKinlay, E. (2015). Observation of interprofessional collaborative practice in primary care teams: An integrative literature review. International Journal of Nursing Studies, 52(7), 1217–1230. https://doi.org/10.1016/j.ijnurstu.2015.03.008
  • Morita, T., Oyama, Y., Cheng, S. Y., Suh, S. Y., Koh, S. J., Kim, H. S., Chiu, T. Y., Hwang, S. J., Shirado, A., & Tsuneto, S. (2015). Palliative care physicians’ attitudes toward patient autonomy and a good death in East Asian countries. Journal of Pain and Symptom Management, 50(2), 190–199.e1. https://doi.org/10.1016/j.jpainsymman.2015.02.020
  • Mulaik, S. A., James, L. R., Van Alstine, J., Bennett, N., Lind, S., & Stilwell, C. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105(3), 430–445. https://doi.org/10.1037/0033-2909.105.3.430
  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (Third ed.). Mcgraw-Hill. https://doi.org/10.1016/34567890
  • Oishi, A., Haruta, J., Yoshimi, K., Goto, M., Yoshida, K., & Yoshimoto, H. (2017). Cross-cultural adaptation of the professional version of the Readiness for Interprofessional Learning Scale (RIPLS) in Japanese. Journal of Interprofessional Care, 31(1), 1. https://doi.org/10.1080/13561820.2016.1248814
  • Orchard, C., Pederson, L. L., Read, E., Mahler, C., & Laschinger, H. (2018). Assessment of Interprofessional Team Collaboration Scale (AITCS). Journal of Continuing Education in the Health Professions, 38(1), 11–18. https://doi.org/10.1097/CEH.0000000000000193
  • Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
  • Rogers, G. D., Thistlethwaite, J. E., Anderson, E. S., Abrandt Dahlgren, M., Grymonpre, R. E., Moran, M., & Samarasekera, D. D. (2017). International consensus statement on the assessment of interprofessional learning outcomes. Medical Teacher, 39(4), 347–359. https://doi.org/10.1080/0142159X.2017.1270441save
  • Samuelson, M., Tedeschi, P., Aarendonk, D., De La Cuesta, C., & Groenewegen, P. (2012). Improving interprofessional collaboration in primary care: Position paper of the european forum for primary care. Quality in Primary Care, 20, 303–312. https://primarycare.imedpub.com/improving-interprofessional-collaboration-in-primary-care-position-paper-of-the-european-forum-for-primary-care.php?aid=280
  • Savalei, V., & Falk, C. F. (2014). Recovering substantive factor loadings in the presence of acquiescence bias: A comparison of three approaches. Multivariate Behavioral Research, 49(5), 407–424. https://doi.org/10.1080/00273171.2014.931800
  • Schmitt, M., Blue, A., Aschenbrener, C. A., & Viggiano, T. R. (2011). Core competencies for interprofessional collaborative practice. Academic Medicine, 86(11), 1351. https://doi.org/10.1097/ACM.0b013e3182308e39
  • Simmons, B., Egan-Lee, E., Wagner, S. J., Esdaile, M., Baker, L., & Reeves, S. (2011). Assessment of interprofessional learning: The design of an interprofessional objective structured clinical examination (iOSCE) approach. Journal of Interprofessional Care, 25(1), 73–74. https://doi.org/10.3109/13561820.2010.483746
  • Simon, D., Kriston, L., Loh, A., Spies, C., Scheibler, F., Wills, C., & Härter, M. (2010). Confirmatory factor analysis and recommendations for improvement of the Autonomy-Preference-Index (API). Health Expectations, 13(3), 234–243. doi: 10.1111/j.1369-7625.2009.00584.x
  • Sonderen, E., van, Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: let’s learn from cows in the rain. Plos One, 8(7), e68967. https://doi.org/10.1371/journal.pone.0068967
  • Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics: Pearson new international edition. (Peason (ed.); Pearson ne).
  • Taherdoost, H., Sahibuddin, S., & Jalaliyoon, N. (2014). Exploratory factor analysis; Concepts and theory. Jerzy Balicki. In Mathematics and computers in science and engineering series (Vol. 27, pp. 375–382). https://hal.archives-ouvertes.fr/hal-02557344
  • Tamura, Y., Seki, K., Usami, M., Taku, S., Bontje, P., Ando, H., Taru, C., & Ishikawa, Y. (2012). Cultural adaptation and validating a Japanese version of the readiness for interprofessional learning scale (RIPLS). Journal of Interprofessional Care, 26(1), 55–63. https://doi.org/10.3109/13561820.2011.595848
  • Ten Cate, O. (2005). Entrustability of professional activities and competency-based training. Medical Education, 39(12), 1176–1177. https://doi.org/10.1111/j.1365-2929.2005.02341.x
  • Thistlethwaite, J., Dallest, K., Moran, M., Dunston, R., Roberts, C., Eley, D., Bogossian, F., Forman, D., Bainbridge, L., Drynan, D., & Fyfe, S. (2016). Introducing the individual Teamwork Observation and Feedback Tool (iTOFT): Development and description of a new interprofessional teamwork measure. Journal of Interprofessional Care, 30(4), 526–528. https://doi.org/10.3109/13561820.2016.1169262
  • Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some further observations. Multivariate Behavioral Research, 25(1), 97–114. https://doi.org/10.1207/s15327906mbr2501_12
  • Watson, D. (1992). Correcting for acquiescent response bias in the absence of a balanced scale. Sociological Methods & Research, 21(1), 52–88. https://doi.org/10.1177/0049124192021001003
  • West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation modeling: Concepts, issues and applications. SAGE Publications.
  • Yamamoto, Y., & Haruta, J. (2019). Translation and cross-cultural adaptation of the Japanese version of the assessment of interprofessional team collaboration scale-II (J-AITCS-II). MedEdPublish, 8(3), 46. https://doi.org/10.15694/mep.2019.000195.1
  • Zhang, X., Noor, R., & Savalei, V. (2016). Examining the effect of reverse worded items on the factor structure of the need for cognition scale. Plos one, 11(6). https://doi.org/10.1371/journal.pone.0157795
  • Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442. https://doi.org/10.1037/0033-2909.99.3.432