3,575
Views
2
CrossRef citations to date
0
Altmetric
Research Article

ICT Self-efficacy scale: the correlations with the age of first access to the internet, the age at first ownership of a personal computer (PC), and a smartphone

, , &
Article: 2151068 | Received 02 Sep 2022, Accepted 20 Nov 2022, Published online: 28 Nov 2022

ABSTRACT

Background

Because of the wide use of information and communication technologies (ICT) in healthcare, medical students’ knowledge and skills of modern ICT have been considered essential for their successful learning and future careers. According to Bandura’s self-efficacy, enhancing ICT self-efficacy, which might be affected by technology experience, could be a pathway to improving ICT literacy and competence, which should be one focus of medical educationalists. However, there is a lack of suitable measurements of medical students’ self-efficacy and a clear understanding of its relationship with technology experience.

Materials and methods

We conducted a literature review and direct consultation with an expert panel to identify potential items for the ICT self-efficacy scale. Based on the data collected in a survey of 486 first-year medical students in China, the exploratory factor analysis (EFA) was employed to confirm the structure of the final version. Furthermore, we used linear regressions to quantify the association between ICT self-efficacy and technology experience measured by the age of first access to the Internet, the age at first ownership of a personal computer (PC) or a laptop, and that of a smartphone.

Results

The EFA results derived 15 items of four factors, with 67.02% of the total variance explained: Privacy and Safety, Differencing, Communication, and Learning and Application. The Cronbach’s alphas for the four subscales and the overall scale ranged from 0.78 to 0.89. Regression results demonstrated a significant association of ICT self-efficacy with age at first ownership of a personal computer (PC) and the mediation role of the general self-efficacy in the ICT self-efficacy’s association with the age at first ownership of a personal smartphone.

Conclusion

The ICT scale developed is a reliable and valid task-specific measure to assess ICT Self-Efficacy for medical students. In addition, enhancing students’ technology experience might improve their ICT self-efficacy.

Introduction

As information and communications technology (ICT) has grown exponentially, more and more ICT is utilized in various healthcare fields, such as electronic medical records, telemedicine, and decision support tools for healthcare professionals [Citation1,Citation2]. These successful ICT applications improved access to health services, quality and safety of care, continuity of health services, and economic efficiency [Citation3,Citation4]. Therefore, the competence to use ICT efficiently and independently has been considered a critical prerequisite for successfully integrating medical students into the community of health professionals [Citation5–7]. Furthermore, vast amounts of accumulating evidence reveal that trainees and educators utilized ICT to cope with the challenges caused by the pandemic, such as education delivery [Citation8,Citation9], upholding equity, diversity, and inclusion (EDI), medical students on the frontline [Citation10], testing and evaluation [Citation11], confirming the demanding requirement of medical students’ knowledge and skills of modern ICT.

Considering that ICT evolution speeds up so rapidly, rather than specific skills which are outdated very soon, it might be effective and efficient to cultivate medical students’ ICT self-efficacy. According to Bandura’s definition [Citation12], self-efficacy is the belief that a person can execute courses of action required to deal with prospective situations. Furthermore, researchers proved that the self-efficacy of specific domains might significantly predict behavior change and performance in the corresponding domains [Citation13]. Therefore, enhancing medical students’ ICT self-efficacy might improve their ICT competence and academic performance, then competence in healthcare delivery in the digital age, which should be a key focus of contemporary medical schools.

As research suggested, besides formal education in schools, medical students can also acquire and improve their ICT self-efficacy in informal learning at home or in other out-of-school situations [Citation14,Citation15]. Furthermore, as access to ICT technology, including the Internet, personal computers, and smartphones, became quite common in many countries [Citation16], current medical students probably started to use digital technology at very young ages [Citation17]. It is self-evidenced that the new generation of medical students is much better than their elderly peers in ICT self-efficacy on average, providing convenience to the analysis of how the use of ICT at an early age affects the development of ICT self-efficacy in one’s later life. However, research in this field is far from enough, partially because of the lack of applicable measures of ICT-related self-efficacy. Although a small number of scales, for example, Musharraf and her colleagues’ ICT Self-Efficacy scale, had been developed and validated [Citation18], some failed to include typical and fundamental technological applications for students’ online survival in the digital age.

In this study, we would like to develop and validate a task-specific measure of ICT self-efficacy tailored to assess the relationship between medical students’ ICT self-efficacy and when they started using ICT. Items were drafted by considering the implications of Bandura’s self-efficacy theory and ICT skills that current university students apply when achieving their daily tasks. The study’s second objective is to examine the relationship between the first ages medical students’ access to the Internet, possession of their personal computer (PC) and smartphones, and their ICT self-efficacy in their first year of university.

Materials and methods

Item pool and content validity

A three-step process was employed to ensure that the specific set of items measuring ICT self-efficacy should be a subset of appropriate items [Citation19]:

  1. Based on a literature search of existing questionnaires, we identified relevant domains of ICT self-efficacy and created an initial battery of items.

  2. After consulting with an expert panel of medical education, we established a conceptual framework of ICT self-efficacy with relevant domains. Furthermore, we refined the initial battery of survey items to reflect this underlying construct.

  3. We reviewed the wording of items to ensure the appropriateness of the content, language level, type and form, and sequence to finalize an item pool for ICT self-efficacy inclusive of 24 items.

Each item was scored from 0 to 4 points on a Likert-type scale, with the highest score indicating greater self-efficacy (1 = Strongly disagree, 2 = Disagree, 3 = Agree, and 4 = Strongly agree) (See ).

Table 1. Item pool and structure of ICT Self-efficacy Scale.

Survey and data collection

A cluster random sampling technique was employed. Among the first-year students enrolled in clinical medicine programs of China Medical University in 2021, we randomly selected 26 out of 48 classes. And 650 students from these classes were asked to participate in the survey voluntarily between 1 September 2021, and 30 September 2021. The online survey was constructed and administered using a Wenjuanxing e-questionnaire platform (Wenjuanxing Tech Co. Ltd, Changsha, China) [Citation20], widely used in China. The further exclusion of questionnaires with too many missing values led to an effective response rate of 74.77% (486/650), which is acceptable.

The questionnaire consisted of three parts and included 41 questions. Part I (7 questions) was to collect information on age, gender, the age of first access to the Internet, the age at first ownership of a personal smartphone, whether possessing a smartphone now, the age at first ownership of a personal computer (PC) or a laptop, and whether possessing a computer or laptop now. Part II consisted of the 24 items from the ICT self-efficacy item pool. The final part is the 10-item General Self-Efficacy Scale (GSE) to assess students’ beliefs about coping with difficult life situations.

Statistical analysis

All statistical analysis was carried out using Stata 14 (Stata- Corp 2015, Stata Statistical Software, Release 14, Stata- Corp, LLP, College Station, Texas, USA). The continuous variables were expressed as Mean ± SD, while categorical data were presented as frequency and percentage. A p-value of <0.05 was considered statistically significant.

Reliability

We calculated Cronbach’s alpha to test the interitem reliability of the scale. A value of 0.70 or higher was considered acceptable [Citation21].

Construct validity

Before scale validation, we carried out the Kaiser-Meyer-Olkin (KMO) test to verify the sampling adequacy for the factor analysis and Bartlett’s test of sphericity to indicate sufficient correlations between items.

The construct validity was assessed using principal component analysis (PCA) with an Oblimax rotation technique. We also employed the Promax rotation technique to test whether the possible correlations among factors significantly changed the structure. The number of factors was determined based on the number of eigenvalues above one and the scree plot. Factor loadings equal to or greater than 0.5 were considered appropriate.

Multiple linear regression

Multiple linear regression analyses were performed to evaluate the possible relationships between ICT self-efficacy and its influencing factors, such as age, gender, and access to the Internet and smartphone. In addition, the potential mediation effect of general self-efficacy in the relationship between ICT self-efficacy and ICT experience was investigated by using the Sobel test [Citation22].

Ethics approval

Ethics approval was obtained from the Medical Research Ethics Committee of China Medical University before the commencement of the study.

Results

Participant characteristics

A total of 486 first-year medical students participated in the study. Of all participants, the mean age was 18.16 years (SD = 0.75);45.47% were male (Panel A, ). Averagely, participants got access to the Internet for the first time at age 9.33 (SD = 2.62) and possessed their first smartphones at age 14.40 (SD = 2.76). Only one student did not have a smartphone. The male students were significantly earlier to access the Internet than females; however, they almost possessed their smartphones at the same age. In terms of general self-efficacy, the average score is 28.08 (SD = 6.52), and female medical students have lower scores than males (26.97 vs. 29.41, P < 0.001).

Table 2. Summary statistics of the samples.

Scale validation

The value of Kaiser–Meyer–Olkin is 0.88, indicating the sampling adequacy for factor analysis. Bartlett’s Test of Sphericity (χ2=3305.57, p < 0.001) provides additional evidence of the factorability of the data.

The factor loadings by PCA showed that Items 7, 8, 9, 13, 15, and 21 had large positive loadings ≥0.40 on more than two factors; Item 20 seemed irrelevant to any factor; Item 4 and 6 had disproportional low loading compared with the items of the same factor. Additionally, an apparent floor effect for Item 4 was found, with only 1.65% of Chinese medical students feeling it difficult to set the password or PIN on their cellphones.

Dropping all those items above, a rerun of PCA confirmed a structure with four underlying domains (or factors): Privacy and Safety, Differencing, Communication, and Learning and Application, which is consistent with the suggested structure of the expert panel. The domains, Privacy and Security, and Communication are about perceived capabilities for personal control and basic behaviors on the Internet. Differencing refers to the belief in one’s capacity for information evaluation. The final domain, Learning and Application, indicates one’s perceived capabilities of learning and applying what has been learned to solve problems.

The eigenvalues equal 5.89, 1.80, 1.29, and 1.08 for the four factors. The factors explained 39.29%, 11.97%, 8.59%, and 7.17% of items’ variance, respectively, and 67.02% cumulatively. Factor loadings for the 4-Factor model ranged from 0.57 to 0.89 (). For the final version scale of 15 items, Cronbach’s alpha was 0.89, confirming that a large proportion of the scale’s total variance was attributed to a common source. The Cronbach coefficient alpha for each factor varied from 0.78 to 0.84, indicating the reliability within each domain.

Table 3. Factor analysis of ICT Self-Efficacy Scale (N = 486).

The results confirmed that the ICT Self-Efficacy Scale consisted of four conceptually and statistically validated components. Panel B of presents descriptive statistics of ICT self-efficacy, whose average was 42.24 and standard deviation was 9.27. The scores of female students were significantly lower than those of males (41.25 vs. 43.43, P = 0.01). This gender difference mainly stemmed from domain Differencing (8.27 vs. 9.04, P < 0.001) and Communication (11.02 vs. 11.74, P = 0.013).

The associations of ICT self-efficacy with ICT experience

The ICT self-efficacy of medical students was robustly associated with the age of medical students at first to access the Internet and the first ages of ownership of smartphones and computers. The results of the multiple linear regression adjusted for age and gender show that one year later access to the Internet, ownership of a smartphone, and a PC or laptop were associated with a significant decrease in ICT self-efficacy valued at 0.52 (SE = 0.16), 0.62 (SE = 0.15) and 0.87 (SE = 0.18) respectively (Col.1–3 in ). When all these three variables were introduced into the regression simultaneously, all estimated effects decreased; however, still significant (Col.4 in ).

Table 4. Linear regression analysis results to examine the associations between ICT experiences and ICT self-efficacy, and the mediating role of general self-efficacy.

Bandura’s self-efficacy theory indicates that general self-efficacy might be correlated with ICT experience and ICT self-efficacy simultaneously, which could lead to a mediation role of general self-efficacy. Col. 5 of presented that general self-efficacy was significantly negatively associated with the age at first smartphone ownership among Chinese medical students. However, earlier Internet access or a PC or laptop could not significantly enhance general self-efficacy. After controlling for general self-efficacy, the regression results in Col. 6 demonstrated that general self-efficacy was significantly associated with ICT self-efficacy. Only the age at first ownership of a personal computer (PC) remained to correlate to ICT self-efficacy significantly. Therefore, we might conclude that when the general self-efficacy mediated the association between the age at first ownership of a personal computer or laptop and the ICT self-efficacy, the first computer or notebook ownership might still be directly associated with the ICT self-efficacy. The integration of Col. 5 and 6 of is the Sobel test (see ).

Figure 1. Mediation analysis of General self-efficacy on the association between ICT experience and ICT self-efficacy. (Standard errors in parentheses; *** p < 0.01, ** p < 0.05, * p < 0.1).

Figure 1. Mediation analysis of General self-efficacy on the association between ICT experience and ICT self-efficacy. (Standard errors in parentheses; *** p < 0.01, ** p < 0.05, * p < 0.1).

In addition, by introducing the same controls as Col. 6 of , the possible enhancement effect of possessing a computer or notebook was estimated for each domain of ICT self-efficacy (See ). The results indicate that this estimated enhancement effect was robustly observed for all domains and particularly significant for Privacy and Safety, and Learning and Application: −0.18 (SE = 0.07) and −0.20 (SE = 0.05), respectively.

Table 5. Linear regression analysis results to examine the associations between ICT experiences and each domain of ICT self-efficacy.

Discussion

The key findings of the present study are as follows: 1) The ICT self-efficacy scale contained four domains: Privacy and Safety, Differencing, Communication, and Learning and Application, which was a valid tool for Chinese medical students. 2) the ICT experience measured by the first age of accessing the Internet, the age at first ownership of a personal computer or a laptop, and the age at first ownership of a smartphone was significantly associated with ICT self-efficacy in Chinese medical students. 3) The general self-efficacy significantly mediated the estimated effect of age at first ownership of a personal smartphone on ICT self-efficacy. 4) The age at first ownership of a PC or laptop was associated with each domain of ICT self-efficacy, particularly significantly with Privacy and Safety, and Learning and Application.

Bandura defined self-efficacy as people’s judgments of their capabilities [Citation23] to organize and execute courses of action required to attain designated types of performances, which guided the scale development in this study. Since individuals’ efficacy judgments vary with specific goals, self-efficacy should be domain- and task-specific. As a result, to assess self-efficacy, educational research often asks participants to rate the strength of their belief in their ability to execute the requisite activities [Citation24]. However, if researchers fail to measure self-efficacy correctly due to their misunderstanding of the construct, the assessments usually have poor predictive power [Citation25]. Thus, in this study, we firstly invited a panel of experts in medical education to clarify the construct of ICT self-efficacy, resulting in a 4-domain structure of ICT self-efficacy. Then, by considering the current ICT development situation in ICT-developed countries like China [Citation26,Citation27], we specified the tasks for each domain and finalized the items. Therefore, the construct of the ICT self-efficacy scale could be practicable in other countries or regions; however, the items may need to be revised according to regional economic and social situations, such as the prevalence of PCs and smartphones and the construction of telecommunications networks.

The regression analysis in this study focused on the relationship between the age when medical students access the Internet, possessing a smartphone or a PC or a laptop, and their ICT self-efficacy. Following the previous findings in the literature, these relationships are expected to be negative, i.e., the earlier one accesses the Internet, ownership of a smartphone or a computer, the higher level of ICT self-efficacy [Citation28,Citation29]. These hypotheses are confirmed in almost all the regressions, even when controlling for student gender, age, and general self-efficacy. Compared with the work of Hatlevik and his colleagues, which achieved a similar result, this study used a nuanced marker for experience with technology (i.e., three variables of first ages) [Citation29]. When introducing all these three variables simultaneously into the regression, the estimated effect of the age at first ownership of a personal computer (PC) or a laptop was the most significant; however, those of Internet and smartphone were only marginally significant.

So, when considering the possible correlations among the different technology experiences, computer usage might be the most effective way to enhance one’s ICT self-efficacy. And in addition, considering the well-observed correlation between ICT self-efficacy and skills, it could be also effective in cultivating one’s ICT skills [Citation15,Citation30].

As Sherer et al. stated, one’s past experiences with success and failure in various situations could result in expectations that one carries into new situations [Citation31]. In this way, the experience of specific tasks could enhance general self-efficacy; meanwhile, general self-efficacy might also improve the efficacies of certain domains or tasks reversely. Therefore, general self-efficacy could work as a mediator of technology experience. The mediation effect analysis in this study verifies this hypothesis. The results demonstrate that among Chinese medical students, general self-efficacy behaved quite differently in its mediation effect on the relationships between the three types of technology experience and ICT self-efficacy:

  1. When taking general self-efficacy as the mediator, the age of first access to the Internet had no direct or indirect effect on ICT self-efficacy, consistent with the marginal significance of the estimated overall effect.

  2. Although the smartphone experience seemed to have no direct effect on ICT self-efficacy, general self-efficacy worked as an essential mediator in this relation resulting in a significant indirect effect.

  3. The estimated direct effect of the computer possesses on ICT self-efficacy was very significant, and there was no mediation effect of general self-efficacy.

Further analysis of the association between technology experiences and the domains of ICT self-efficacy might explain the findings above. The estimated direct effect of the age of first access to the Internet is marginally significant for Differencing only. In fact, for current medical students in China who were born in a digital world, the experience of surfing the Internet is pervasive because of the prevalence of network devices and PCs. However, when facing massive information from the Internet, they always need to distinguish valuable information from junk information, which develops their capacity for information differencing and improves their belief on such capacity constantly. Furthermore, for current medical students, PCs and smartphones are not only tools for communication and entertainment but also learning; thus, both PC and smartphone experiences directly affect students’ beliefs on Learning and Application. Considering the broader use of PCs in problem-solving, it is not surprising that the estimated effect of PC experience was more significant than those of Internet surfing or smartphone usage.

A limitation of this study is that a cross-sectional observational cohort from one medical university was utilized for initial validation and subsequent regression analysis. Since the validation is in a single institute setting, bias may increase along with limitations of generalizability. The future study might focus on the generalization pattern of this scale by implementing multi-institute surveys. Furthermore, although we controlled for age and gender, the information on students’ socioeconomic backgrounds was not collected and so was not introduced into regressions. However, such background information is vital for understanding variations in students’ ICT self-efficacy because it may explain digital inequity and the digital divide. Thus, we suggest future studies on ICT self-efficacy or technology experience collect such information. In addition, this study will hopefully motivate further research on the development of the ICT self-efficacy scale regarding the relationship between personal characteristics, background contextual variables, and ICT self-efficacy.

In conclusion, we have developed and validated a novel tool to assess ICT self-efficacy. Furthermore, we propose that individuals’ technology experiences, including internet access, and the utilization of PCs and smartphones, are significant predictors of their ICT self-efficacy. Therefore, to help medical students follow the trends of educational reforms driven by ICT development trends, schools and families should provide opportunities to enhance students’ technology experience and ICT self-efficacy.

Acknowledgments

The authors wish to thank all participants who completed the questionnaire and are much more indebted to Prof. Zhe Zhao for helping with implementing this survey.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The data supporting this study’s findings are available from the corresponding author, ND, upon reasonable request.

Additional information

Funding

This work is funded by The Medical Education Grant of China Medical University YDJK2020007,YDJK2021036 YDJK2020007 & YDJK2021036.

References

  • Ekeland AG, Bowes A, Flottorp SA. Effectiveness of telemedicine: a systematic review of reviews. Int J Med Inform. 2010;79(11):736–8.
  • Zonneveld M, Patomella A-H, Asaba E, et al. The use of information and communication technology in healthcare to improve participation in everyday life: a scoping review. Disabil Rehabil. 2020;42(23):3416–3423.
  • Wang SH. Web-Based medical service: technology attractiveness, medical creditability, information source, and behavior intention. J Med Internet Res. 2017;19(8):e285.
  • Gagnon M-P, Légaré F, Labrecque M, et al. Interventions for promoting information and communication technologies adoption in healthcare professionals. Cochrane Database Syst Rev. 2009;21(1):Cd006093.
  • Milic NM, Ilic N, Stanisavljevic DM, et al. Bridging the gap between informatics and medicine upon medical school entry: implementing a course on the applicative use of ICT. PloS one. 2018;13(4):e0194194.
  • Rodríguez-Ríos A, Espinoza-Téllez G, Martínez-Ezquerro JD, et al. Information and communication technology, mobile devices, and medical education. J Med Syst. 2020;44(4):90.
  • Valcke M, Wever BD. Information and communication technologies in higher education: evidence-based practices in medical education. Med Teach. 2006;28(1):40–48.
  • Goh P-S, Sandars J. A vision of the use of technology in medical education after the COVID-19 pandemic. MedEdPublish. 2020;9(1):49.
  • Sandars J, Correia R, Dankbaar M, et al. Twelve tips for rapidly migrating to online learning during the COVID-19 pandemic. MedEdPublish. 2020;9(1):82.
  • Kalet AL, Jotterand F, Muntz M, et al. Hearing the call of duty: what we must do to allow medical students to respond to the COVID-19 pandemic. World Mycotoxin J. 2020;119(1):6–7.
  • Prigoff J, Hunter M, Nowygrod R. Medical Student Assessment in the Time of COVID-19. J Surg Educ. 2021;78(2):370–374.
  • Bandura A. Self-efficacy: the exercise of control (New York: W. H Freeman and Co.). 1997.
  • Bandura A. Self-Efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191–215.
  • Tømte C, Hatlevik OE , et al. Gender-differences in Self-efficacy ICT related to various ICT-user profiles in Finland and Norway. How do self-efficacy, gender and ICT-user profiles relate to findings from PISA 2006, Computers & Education. 2011;57(1):1416–1424 .
  • Hatlevik OE, Throndsen I, Loi M, et al. Students’ ICT self-efficacy and computer and information literacy: determinants and relationships. Comput Educ. 2018 (MAR.);118:107–119.
  • OECD. PISA 2015 Results (Volume III): Students' Well-Being, PISA. Paris: OECD Publishing; 2017.
  • Chaudron S, Gioia RD, Gemo M. Young children (0-8) and digital technology, a qualitative study across Europe. Luxembourg: Publications Office of the European Union; 2018.
  • Musharraf S, Bauman S, Anis-Ul-Haque M, et al. Development and validation of ICT self-efficacy scale: exploring the relationship with cyberbullying and victimization. Int J Environ Res Public Health. 2018;15(12):2867.
  • DeVellis RF. Scale development: theory and applications. 2nd ed. Sage: Thousand Oaks; 2003.
  • Wenjuanxing. Accessed 1 9 2022. Available from: https://www.wjx.cn/
  • Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
  • Leonardelli GJ. Calculation for the Sobel test: an interactive calculation tool for mediation tests. Ener Cons Tech. 2003;15(9):1103–1109.
  • Bandura A. Social foundations of thought and action: a social cognitive theory. J Appl Psychol. 1986;12(1):169.
  • Bandura A. Guide for constructing self-efficacy scales (Revised). Self-efficacy Beliefs of Adolescents. 2006;5:307–337.
  • Pajares F. Self-efficacy beliefs in academic settings. Rev Educ Res. 1996;66(4):543–578.
  • Niebel T. ICT and economic growth - Comparing developing, emerging and developed countries. World Dev. 2018;104:197–211.
  • Wang D, Zhou T, Lan F, et al. ICT and socio-economic development: evidence from a spatial panel data analysis in China. Telecommun Policy. 2021;45(7):102173.
  • Kennewell S, Morgan A. Factors influencing learning through play in ICT settings. Comput Educ. 2006;46(3):265–279.
  • Juhaňák L, Zounek J, Záleská K, et al. The relationship between the age at first computer use and students’ perceived competence and autonomy in ICT usage: a mediation analysis. Comput Educ. 2019;141:103614.
  • Rohatgi A, Scherer R, Hatlevik OE. The role of ICT self-efficacy for students’ ICT use and their achievement in a computer and information literacy test. Comput Educ. 2016;102:103–116.
  • Sherer M, Maddux JE, Mercandante B, et al. The Self-Efficacy Scale: construction and validation. Psychol Rep. 1982;51(2):663–671.