0
Views
0
CrossRef citations to date
0
Altmetric
ORIGINAL RESEARCH

Trust: How It Affects the Use of Telemedicine in Improving Access to Assistive Technology to Enhance Healthcare Services

ORCID Icon, , &
Pages 1859-1873 | Received 17 Mar 2024, Accepted 16 Jul 2024, Published online: 23 Jul 2024

Abstract

Background

Modern telemedicine (TM) technologies play a crucial role in enhancing access to Assistive Technology in healthcare services. However, the full benefits of this technology will not be realized unless it is widely accepted among service users (patients). This study aimed to investigate the impact of patient trust and perceived risk on the acceptance of TM for Assistive Technology in healthcare.

Materials and Methods

A comprehensive survey instrument was developed and refined through expert feedback and a pilot study, leading to data collection from 917 participants. The theoretical framework guiding this research was based on the Trust factors in TM, which helped in conceptualizing the factors influencing patient acceptance of TM.

Results

The study revealed a significant gap in patient trust in TM and highlighted the multifaceted nature of perceived risk, emphasizing the need to consider individual risk factors separately. Results also indicated that trust in technological reliability and the perceived effectiveness of TM were critical factors influencing its adoption. The findings underscore the importance of building trust among service users and promoting the reliability of TM for achieving desirable medical outcomes.

Conclusion

In conclusion, to facilitate widespread acceptance of TM for Assistive Technology, a multi-faceted approach involving healthcare providers, organizations, and governments is essential to address patient concerns, enhance trust, and promote the benefits of this technology.

Introduction

In recent decades, a number of factors, such as ageing national populations and rising costs, have combined with increasingly limited resources to make adequate healthcare provision difficult to achieve without the introduction of new, more efficient, healthcare solutions.Citation1,Citation2 However, advances in digital technology can play a key role in addressing this challenge. One example of how digital technology can enhance healthcare provision is in the area of telemedicine (TM),Citation3,Citation4 a growing technology which has the potential to enable high-quality, high-efficiency and convenient healthcare provision over wide areas.Citation2 While TM has applications in several health-related fields, it has particularly high potential for improving access to assistive technology. Defined as the implementation of information and communication technologies (ICTs) to deliver healthcare services, TM is already proving to be a valuable tool for improving access to assistive technology, especially in countries which have a high proportion of citizens.Citation5

However, despite its recognized potential, and increasing use in improving access to assistive technology, TM has not yet achieved mass adoption.Citation4,Citation6 A full understanding of the reasons for this will play a key role in driving acceptance forward. However, this requires further research. While previous studies in technology acceptance has provided some significant insights, such as the relationship between perceived benefits and technology adoption,Citation6 the healthcare context has some key differences from the general technology environment. In particular, Intention to Use (ITU) in a healthcare context depends not only on utilitarian factors such as perceived usefulness and perceived benefits, but also on a range of psychological factors, such trust and risk.Citation7,Citation8

In the general world of health provision, the role of trust and perceived risk has been shown, by various studies, to be important in the acceptance of technological processes and interventions e.g.Citation9,Citation10 Other research has also shown that these factors (trust and risk) are multidimensional. The effect of trust, for example, on ITU, can be broken down to a number of sub-factors, such as trust in medical practitioners or trust in online information e.g.Citation11,Citation12 In a similar way, risk can also be considered to be multidimensional.Citation13,Citation14 The risk of compromised private information has been found to be of particular significance as a barrier to technology acceptance.Citation7,Citation8

Despite these valuable advances in understanding technology acceptance in the general healthcare context, however, the acceptance of TM remains a unique situation. The reason for this is that, with TM, the patient is not only required to accept technology, but to accept a shift in the patient-practitioner relationship.Citation15,Citation16 With TM, the patient-practitioner relationship is re-framed in a digital context, which separates the issue of acceptance from the overarching healthcare context.

It should be noted that there have been a number of studies on the role of trust and risk in TM acceptance. However, these studies have generally treated both factors (risk and trust) as single, holistic constructs, as opposed to multi-part, constructs e.g.Citation17,Citation18 Further, these studies have rarely factored-in the issue of trust and its effects. While some research has found that the perceived risk to personal privacy can (negatively) affect trust,Citation19 the extent to which the replacement of personal interaction (patient-practitioner) with a technological process can create further negative consequences remains unclear.Citation20 To drive acceptance of TM, particularly as assistive technology, it is important to understand the effects of multiple patient concerns, including the fear that TM will not deliver a satisfactory medical outcome, concerns about (mis)use of personal data, anxieties about wasting time and psychological stress.Citation13,Citation14 Considered collectively, these issues mean that there is a significant gap in two main aspects of TM research with respect to assistive technology: (1) patient trust in TM, and (2) how various risk factors interact to affect TM adoption.

Another factor which can affect the relationship between perceived trust and perceived risk, and therefore the readiness to adopt TM, is the service user’s background and personal context.Citation20,Citation21 Although some previous studies have specified a service user’s illness/symptom, none have attempted to account for the effect of aspects of their background or social/educational context, such as (ie gender, nationalities and language). Any dependency of the relationship between the various trust and risk factors on the service user’s native language is currently unexplored. It is important to understand any such dependency more fully, if TM is to be more effectively used to facilitate access to assistive technology. These considerations lead to the research question (RQ):

RQ1: How do perceived trust and risk factors affect the intention to use TM for accessing assistive technology among service users?

The paper is organized in a structured manner. Section 2 offers a thorough review related to the development of the theoretical framework and hypotheses. Subsequently, an outline of the research methodology is presented in Section 3, followed by the presentation of results in Section 4, and an in-depth discussion in Section 5. Finally, the study’s conclusions are summarized in Section 6, highlighting the significant findings and limitations and future research.

Theoretical Framework and Hypothesis Development

Trust Factors in TM

Although trust is a widely-applied concept across many disciplines, it lacks a universally agreed definition for academic and research purposes.Citation22,Citation23 In the overall technology field, the concept is generally accepted as referring to a subject’s belief that a specific trust factor has the ability to deliver a desired outcome.Citation22,Citation23 In the TM field, and specifically in the context of improving access to assistive technology, there are three trust factors: medical practitioner, technological reliability and therapeutic solutions.Citation24

Medical Practitioner

The focus of the current study is the provision of access to assistive technology solutions via TM. This process usually begins with an initial consultation with a medical practitioner, which is then transitioned to a TM setting. Trust in the practitioner reflects the service user’s belief that the professional concerned has the desire and the competence to act in the service user’s best interests.Citation25,Citation26 As the relationship between the practitioner and the service user is key to gaining the service user’s confidence in the TM process, trust in the practitioner is critical to ITU.Citation15 The service user’s trust in the practitioner’s competence and readiness to act their best interest can help minimize or eliminate doubts concerning the use of impersonal solutions, and increase the willingness to use TM. This is consistent with other studies that have found a positive association between trust in practitioner and ITU in a TM context.Citation27,Citation28 The study therefore proposes:

Hypothesis 1: Trust in medical practitioner is positively related to ITU.

Technological Reliability

For the purposes of this study, the term “technological reliability” denotes the specific form of technology used to facilitate interaction between the service user (patient) and the service provider (medical institution). This could be, for example, an online video platform, or voice messaging. In alignment with the practitioner trust factor, trust in Technological Reliability is defined as the belief (by the service user) that the technology solution deployed can be relied upon to provide a therapeutic solution (in this case, assistive technology) appropriate to the service user’s needs.Citation29,Citation30 Functionality defines the capability of the TM platform to fulfil its purpose of providing medical care to patients. A service user’s impression of a TM solution, has a strong influence on ITU. This impression is formed by a variety of factors, such as image stability and sound quality.Citation29,Citation30 A favorable impression plays an important role in building trust in the service user, which, in turn, affects ITU e.g.Citation27,Citation28 Therefore, strong patients’ beliefs that a technology will accomplish functionally and reliably through a healthcare provision rise the likelihood of patients’ willingness to use TM. The study therefore proposes:

Hypothesis 2: Trust in technological reliability is positively related to ITU.

Therapeutic Solutions

The third trust factor, “Therapeutic Solution”, is the ultimate objective of the TM process. Trust in the therapeutic solution derives from the service user’s belief in its efficacy and appropriateness, together with trust in the other factors.Citation16 The associations between these trust factors will be discussed in terms of the trust framework, as described by Stewart.Citation31 Trust in therapeutic solutions is critical to ITU in a TM context. This is because the Therapeutic Solution represents the service user’s medical goal, and is therefore the basic rationale for using TM.Citation16,Citation28 The logic of this argument implies that a belief in the efficacy and appropriateness will result in positivity towards TM and, consequently, a positive ITU toward the TM strategy. The study therefore proposes:

Hypothesis 3: Trust in therapeutic solutions is positively related to ITU.

Factors of Perceived Risk in TM

The perception of risk is a fundamental and critical component of ITU, and therefore represents a major barrier to adoption.Citation19 In the context of healthcare, risk can be considered to consist of two basic aspects: (a) level of uncertainty, and (b) perceived severity of consequence.Citation13,Citation14 It is natural in any context that most individuals will modulate behaviors according to perceived risk, but this is particularly true in the healthcare environment, where such risks can significantly, and negatively, affect present and future health.Citation27,Citation28 The research model of this study proposes that there are four different risk factors which affect ITU (medical outcomes, personal privacy, time requirement, stress), and the following section looks in more detail at the definition of each factor, how they negatively affect ITU.

Medical Outcomes

In the context of this study, medical outcomes risk refers to the perceived likelihood that the TM process will fail to deliver the desired health benefits to the service user.Citation32,Citation33 As the TM process is inherently more impersonal than orthodox processes,Citation27,Citation28 its use can cause service user concerns that diagnosis and subsequent therapies (application of assistive technology) will not be either appropriate or effective.Citation34–38 This is a key issue, as most individuals place high importance on physical and mental health, so the consequences of therapeutic failure would be perceived as severe.Citation16 As people tend to reduce risks with severe consequences through the use of avoidance behavior,Citation32 they are likely to have low ITU. This negative relationship between medical outcome risk and ITU, in a TM context, is supported by research,Citation27,Citation28 and it has also been shown, by several studies, to be valid in other digital health contexts e.g.Citation32,Citation37,Citation38 This study therefore proposes:

Hypothesis 4: Medical outcome risk is negatively related to ITU.

Personal Privacy

It is inherent to any healthcare provision process that the service user shares their personal, and often sensitive, information with medical practitioners.Citation27,Citation28,Citation39 This exposes the service user to the risk of compromised privacy.Citation27,Citation28,Citation39 This (loss of control of private and sensitive information) can occur in a number of ways, ranging from errors or carelessness to data leaks and hacking.Citation14 While the level of risk associated with personal privacy varies with the specifics of the situation,Citation8 it is always viewed as a serious issue in a medical context.Citation7 However, in a TM context, the perception of risk is exacerbated further, as service users often feel uncomfortable in sharing sensitive information through the mechanism of an impersonal (TM) platform.Citation27,Citation28,Citation39 Much of the concern in service users stems from the often-severe consequences of information abuse, which can range from social stigma to loss of employment.Citation34,Citation35 These concerns significantly affect the service user’s readiness to engage with TM,Citation27,Citation28,Citation39 a finding which is reflected in research related to other health provision contexts e.g.Citation9,Citation11,Citation12 This study therefore proposes:

Hypothesis 5: Personal privacy risk is negatively related to ITU.

Time Requirement

In both principle and practice, the use of TM is a time-efficient process for most service users.Citation29,Citation30 Many, however, do not (initially) perceive TM in this way, and have concerns that they may need to spend significant time in familiarizing themselves with the TM platform, or that the TM process merely adds complexity and administration requirements to the conventional process of consultation with a medical practitioner.Citation11,Citation13,Citation14 This apprehension is rooted in the belief that one must overcome a learning curve to become adept at navigating TM systems. Additionally, there is a concern that TM could introduce additional layers of complexity and administrative tasks, potentially complicating what would otherwise be a straightforward consultation with a healthcare professional. As such, while TM is designed to enhance efficiency, its initial perception is marred by the misconception that its integration into routine medical practice might be more time-consuming than beneficial. This study therefore proposes:

Hypothesis 6: Time requirement risk is negatively related to ITU.

Stress

Another important risk factor is stress,Citation13 which is defined, for the purposes of this paper, as the extent to which a service user experiences emotional anxiety or stress, when engaging with TM.Citation9,Citation12,Citation13 This stress can manifest in various forms; users may experience frustration if they find the TM platform’s interface non-intuitive or challenging to navigate. Such technological barriers can lead to a sense of helplessness, especially when faced with the need for immediate medical assistance or guidance. Furthermore, the impersonal nature of interacting with technology, as opposed to the human warmth felt during face-to-face interactions with medical practitioners, can intensify a patient’s perception that their unique health concerns are not being fully understood or addressed. For those with limited digital literacy or no prior exposure to such technology, the transition to TM can be particularly daunting, potentially exacerbating their stress levels.Citation9,Citation12,Citation13 The apprehension about engaging with a seemingly cold and detached system, coupled with the anxiety of learning new technology, underscores stress as a significant risk factor in the patient’s acceptance and effective use of TM services. This study therefore proposes:

Hypothesis 7: Stress risk is negatively related to ITU.

Relation Between ITU and Usage Behavior

There are several models in the literature which explore the factors that influence ITU in technology, such as the now established models described by DavisCitation40 and Venkatesh et al.Citation41 Other research, specific to TM, has shown that these models are relevant in the context of TM, and that they (the established models of DavisCitation40 and Venkatesh et al,Citation41) identify the critical factors in ITU. The association between ITU and TM usage behavior has also been the subject of significant research, though these studies have been mainly from the healthcare practitioner perspective and have rarely considered the service user perspective.Citation42,Citation43 The relationship between ITU and usage behavior is an important consideration. Research across a variety of technology fields and contexts have established that there is a positive association between ITU and behavior – ie that those who demonstrate an ITU a technology is more likely to actually use that technologyCitation40,Citation41 – and this positive association has also been shown to hold true in the arena of healthcare.Citation44,Citation45 As these findings align well with the generally accepted intention- behavior frameworks of technology acceptance,Citation40,Citation41 this study proposes that a service user has a greater likelihood of engaging with TM if they express a positive ITU. This study therefore proposes:

Hypothesis 8: ITU is positively associated with usage behavior.

Conceptual Framework

As a result of the theoretical background described above, we hypothesized how perceived risk factors—namely, medical outcomes (H4), personal privacy (H5), time requirement (H6), and stress (H7)—negatively influence the ITU a technology. Conversely, trust factors—such as trust in medical practitioner (H1), trust in technological reliability (H2), and trust in therapeutic solutions (H3)—are posited to exert a positive influence. ITU is posited as a central determinant of use behavior, which is the ultimate outcome of interest. Hypothesis H8 suggests that a stronger ITU will lead to higher actual usage, a relationship that we aim to test empirically using structural equation modelling to understand the concurrent influences of these factors on user behavior.

Research Method

Development of the Survey Instrument

To collect data for this research, we meticulously developed a survey instrument, incorporating elements from questionnaires that have previously demonstrated validity e.g.Citation23,Citation24,Citation41,Citation46,Citation47 This approach was chosen to ensure that the survey was accurately aligned with the specific goals of our study. The survey was structured into three distinct sections: (1) An introduction outlining the study’s objectives and the eligibility criteria for participants, specifically targeting individuals with experience in MT, (2) The collection of data on various metrics associated with our research constructs, with responses measured on a five-point Likert scale, and (3) The acquisition of demographic information from respondents. The-metrics utilized in the questionnaire are detailed in , providing a comprehensive overview of the constructs under investigation.

Table 1 The Constructs, Together with Their Respective Questionnaire Items and Related Factor Loadings

To ensure the content validity of the survey items, each was subjected to an independent review by the researchers involved in the study.Citation48–50 This rigorous process involved detailed discussions on each construct and its associated items, leading to a consensus that ensured the survey’s items were both relevant and representative of the constructs being measured. Furthermore, an initial assessment with 43 experts in the field resulted in 39 valuable responses. The insights gained from this feedback led to several refinements in the questionnaire, including:

  • The rephrasing of certain items to enhance clarity and understanding.

  • The strategic reordering of items to ensure a logical flow and coherence in the survey’s structure.

  • The addition of explicit instructions for participants on the intricacies of completing the questionnaire accurately.

Following the refinement of the English version of the survey, it underwent a translation process into Arabic by a bilingual researcher proficient in both English and Arabic. This was to ensure inclusivity and accessibility for a broader participant base. The back-translation method was employed to validate the accuracy of the translation, a crucial step that underscores the importance of linguistic precision in cross-cultural research.Citation51

A pilot study involving a subset of 45 participants from the intended sample population of Saudi residents was then conducted. This preliminary phase was instrumental in testing the survey for clarity, logical sequencing of items, and the elimination of any ambiguous wording.Citation52 Based on the outcomes of this pilot study, minor adjustments were made to further refine the survey items.

The enhanced version of the survey, enriched by the feedback from the pilot study and the comprehensive evaluation by the research team, was subsequently employed to collect data for the main study. This iterative process of development and refinement ensures that the survey instrument is both robust and sensitive to the nuances of the research objectives, thereby facilitating the collection of high-quality data.

In adopting this meticulous approach, we aimed not only to uphold the academic rigor of our methodology but also to ensure that our instrument was accessible and inclusive, reflecting a commitment to ethical research practices.

Sampling

To collect data, we employed an online survey methodology. This approach was selected due to its broad geographical reach, higher response rates compared-to-traditional methods, cost-effectiveness, and flexibility. Online platforms offer the advantage of easily accommodating larger sample sizes, making them ideal for our study’s needs.Citation53,Citation54

During the six-month data collection period, we distributed 1200 surveys across a diverse demographic, including various age groups, genders, nationalities, and languages. The questionnaires were distributed through digital survey tools (Google Form), leveraging Email lists, social media platforms, and online community forums. This facilitated our outreach and data collection efforts. We utilized these diverse channels to reach a broad spectrum of participants, aiming for inclusivity and comprehensive representation. Of the received 981 responses, 917 met our eligibility criteria, such as adherence to submission deadlines and completion of all questions, ensuring the integrity and completeness of our dataset. Additionally, all eligible participants were required to have prior experience with telemedicine to provide informed perspectives. provides a detailed demographic breakdown of the 917 participants deemed eligible for analysis.

Table 2 An Outline of the Demographic Features of the Participants

To ensure a comprehensive representation, we meticulously screened respondents based on predefined criteria, aiming to minimize selection bias and enhance the study’s validity.Citation53–55 The screening process was designed to reflect the diverse perspectives and experiences relevant to our research questions.

Our sample size was determined through power analysis, indicating a minimum requirement of 377 participants for statistically meaningful outcomes.Citation56,Citation57 With 917 valid responses, our study far exceeded this threshold, suggesting a robust sample that enhances the reliability and generalizability of our findings. The power analysis, grounded in statistical theory, confirms that our sample is adequately representative of the larger population, allowing for confident extrapolation of our results.

In conducting this online survey, we encountered and addressed several challenges, including ensuring participant engagement and mitigating the risk of incomplete responses. Strategies such as follow-up reminders and user-friendly survey design were implemented to maximize response rates and data quality.

Nonresponse Bias

To evaluate the risk of non-response bias, we adhered to the methodologies recommended by Armstrong and Overton.Citation55 By presupposing that the characteristics of the final participants closely mirror those of the individuals who did not respond, we conducted a comparison between the first and last quartiles of survey participants to check for any bias due to nonresponse. The application of the t-test revealed no significant differences between these two groups for the main variables of our study (p > 0.05). Additionally, a chi-squared testCitation55,Citation58 was used to compare the gender and age demographics of the two groups, which also indicated no significant differences (p > 0.05). Consequently, it appears that non-response bias does not pose a significant issue for this investigation.

Method of Analysis

The present study utilizes Partial Least Squares Structural Equation Modeling (PLS-SEM) for its analytical framework, motivated by multiple considerations. Primarily, PLS-SEM is acknowledged for its proficiency in facilitating theory development, a fact supported by numerous authoritative references.Citation59–61 Furthermore, PLS-SEM is preferred for analyzing complex structural models that include many constructs and/or intricate relationships among those constructs. Another key reason for selecting PLS-SEM is its suitability for studies with smaller sample sizes, making it a more appropriate choice than Covariance-Based Structural Equation Modeling (CB-SEM) under such circumstances.

Ethics

All participants on this study were informed, via the early invitation and the survey’s web-site, that the study fulfilled with all applicable ethical standards, as approved by the Research Ethics Committee of King Saud University (KSU-HE-12-242). The information emphasized that all data collection and handling would ensure complete anonymity to safeguard privacy, informed participants about their right to opt out at any point, and highlighted that there were no correct or incorrect responses. Additionally, it was underscored that participants would not receive any direct benefits or incentives for taking part.

Results

Testing the Measurement Model

In the present study, we employed Factor Analysis (FA) to reveal underlying factors encapsulated by a series of variables or items, as recommended by.Citation58,Citation62 Beyond identifying these hidden dimensions, our analysis extended to evaluating the model’s fit, and verifying both convergent and discriminant validity to ensure comprehensive assessment. Factor Analysis was chosen due to its robust capacity for uncovering latent constructs that underpin observable variables,Citation62,Citation63 critical for our research’s objectives.

To determine the suitability of our sample for FA, we first employed the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy, obtaining a value of 0.832. This value significantly exceeds the commonly recommended threshold of 0.7,Citation64,Citation65 suggesting our sample size is adequately large and relevant for the analysis. Subsequent application of Bartlett’s test of sphericity further supported our methodology; it tested the null hypothesis that the variables are uncorrelated (that the correlation matrix is an identity matrix) and yielded a significant outcome (P-value < 0.05), showing that the variables share sufficient common variance for FA.Citation58,Citation64 These preliminary tests—the KMO measure and Bartlett’s test—collectively affirm the applicability of FA to our dataset, underpinning the robustness of our approach.

In terms of model fit, the derived indices align with the acceptable standards set forth by Hair et alCitation61 and Hu and Bentler,Citation66 as evidenced in showcasing the structural model’s fit. This adherence to recognized benchmarks underscores the robustness of our analytical approach, confirming the validity of our model and the accuracy of our factor analysis. This ensures our findings rest on a solid foundation, reinforcing their reliability and relevance to the underlying constructs of interest.

Table 3 The Model Fit Indices

As illustrated in , the factor loadings assigned to individual item were significant, extending from 0.786 to 0.941. This range of values highlights the strength of the association between items and their respective factors, underscoring the convergent validity of our analysis. It confirms that each item properly measured its corresponding factor, reinforcing the credibility of our findings. This evidence of convergent validity is essential, as it assures that the constructs identified are indeed reflected by the variables measured, further solidifying the integrity and applicability of our Factor Analysis results.

To assess the internal consistency of our constructs, we applied Cronbach’s Alpha (CA), with findings presented in showing CA values for each construct in the range of 0.81 to 0.87. Additionally, Composite Reliability (CR) metrics ranged from 0.75 to 0.84, exceeding the advised benchmark of 0.70. These outcomes demonstrate a high degree of internal consistency across constructs, reflecting precise measurement of the targeted latent constructs.Citation59,Citation61

Table 4 Results of Correlations, CR, CA and AVE

Moreover, a test for discriminant validity was conducted to ensure there were clear distinctions between constructs and their measurements, as per the guidelines by Hair et alCitation59,Citation61 This test involves comparing the square root of the Average Variance Extracted (AVE) for each construct against its association coefficients, with the requirement that the square root of the AVE must surpass an association value of 0.50. According to the results displayed in , our study successfully fulfills these critical conditions, highlighting the adequacy of discriminant validity.

Lastly, the study addressed the issue of multi-collinearity, which occurs when independent variables exhibit a high degree of correlation among themselves. We examined together the Variance Inflation Factor (VIF) and tolerance values to assess this concern. Findings indicated that the VIF value remained below 3, and the tolerance value was higher than 2, aligning with the recommendations of Hair et alCitation59,Citation67 This adherence to established norms mitigates the impact of multi-collinearity, ensuring the integrity of our analysis.

Considering these comprehensive assessments, the measurement model stands validated and reliable, demonstrating strong model fit, convergent validity, discriminant validity, and controlled multi-collinearity. These results collectively affirm the robustness of our model, validating it as both accurate and dependable for capturing the nuances of the latent constructs under study.

Analysis of Common Method Variance and Bias

Common Method Variance (CMV) is a potential source of methodical error that can occur when collecting data from a single basis. To address this concern in our study, we applied Harman’s single factor test to check for CMV, which yielded no evidence of its presence. Additionally, we examined Common Method Bias (CMB), a specific type of CMV that might arise with the use of uniform response scales. For detecting CMB, we utilized the common latent factor method, which also showed no indication of bias. Thus, we can confidently assert that the results of the present study are not compromised by either CMV or CMB, reinforcing the credibility and accuracy of the present findings.

Findings of the Research Hypotheses

The study employed Structural Equation Modeling (SEM) to assess the measurement model’s psychometric properties and to test the research hypotheses. SEM, a robust statistical method, was utilized to explore the relationships among various constructs. The results demonstrated that different trust factors (trust in Practitioners, trust in technological reliability, trust it therapeutic solutions) positively ITU, while perceived risks (medical outcomes, personal privacy, time requirement, stress) were found to negatively influence this intention, explaining 63.7% of the variance observed. This evidence supported hypotheses H1 through H7. Moreover, ITU is positively associated with usage behavior, explaining 50.9% of the variance observed.

The significance of these relationships was confirmed by significant t-values and elucidated through standardized path coefficients listed in , indicating the strength of each relationship. In summary, the SEM findings robustly validate the theoretical model proposed in our research, highlighting the factors TM.

Table 5 The Path Coefficients and t-Test Value for the Full Sample

Discussion

In this study, we aimed to explore the influence of trust and risk on the adoption of TM as a means of accessing assistive technology. Our comprehensive analysis revealed key factors that significantly impact individuals’ willingness to embrace TM for healthcare delivery and assistive technology access. These findings underscore the critical roles that trust in TM technology, along with the perceived risks associated with its use, play in adoption decisions.

Specifically, we identified that trust (trust in Practitioners, trust in technological reliability, trust in therapeutic solutions) positively influences users’ intentions to adopt TM technology. Trust emerges as a cornerstone, fostering confidence among users in the TM platforms’ capability to deliver safe, secure, and effective healthcare solutions.Citation22,Citation23 Conversely, perceived risks (medical outcomes, personal privacy, time requirement, stress), negatively influences users’ intentions to adopt TM technology. These apprehensions highlight the need for stringent measures to safeguard user data and ensure the reliability and quality of TM services.

The present research contributes to the limited body of knowledge on the adoption of TM from the perspectives of trust and risk. While prior studies have extensively explored various facets of TM adoption,Citation27,Citation28 the nuanced impact of trust and risk factors has received relatively less attention. This oversight is particularly noteworthy given the expanding role of TM in modern healthcare ecosystems, where it promises to enhance accessibility, convenience, and efficiency in accessing healthcare services and assistive technology.

By delineating the influence of trust and risk on TM adoption, the present study provides valuable insights for healthcare providers, policymakers, and technology developers. Addressing these factors effectively can lead to higher adoption/acceptance rates among potential TM users, paving the way for a more inclusive and accessible healthcare system. Ensuring robust security measures, transparent practices, and reliable TM solutions will be key to mitigating risks and building trust among users,Citation27,Citation28 thereby facilitating the broader adoption of TM as a vital component of healthcare delivery. Additionally, the issue of equity in the use of TM and sustainability must be introduced. The use of TM is still fragmented globally and within each country. Future research should investigate how to ensure equitable access to TM services across different populations and regions. Furthermore, exploring sustainable models for TM integration into healthcare systems is crucial.

The study also addresses the gap between ITU and actual usage behaviour, highlighting the complexities of translating positive attitudes towards TM into consistent use. This gap underscores the need for improved communication about TM’s benefits and the availability of assistive technology services, as well as strategies to maintain user engagement over time.

In sum, this study enriches the discourse on TM adoption by emphasizing the critical roles and dissection of trust and risk into subdimensions, as well as the complex interplay between intention and behavior. These insights not only contribute to theoretical advancements in understanding TM adoption, but also offer practical guidance for healthcare providers, policymakers, and technologists aiming to expand the reach and efficacy of TM services (details about contribute below). Future research should also explore how cultural, socioeconomic, and geographical factors influence trust and perceived risks in TM. This will provide a more comprehensive understanding of the barriers and facilitators to TM adoption, contributing to the development of tailored strategies to enhance TM uptake.

Theoretical Implications

This paper creates implications for research into technology adoption in a number of ways. One of these is emphasizing the importance of treating the concept of trust as a multidimensional entity, especially when exploring the willingness of service users to engage with TM. While there are some studies which have taken this approach, such as those by Cao et alCitation36 and Yang et al,Citation28 most studies have defined trust as mono-dimensional.Citation34,Citation35 However, the limited number of studies which have taken the multidimensional approach have found – as has the current study – that trust in technological reliability has a greater impact on the TM adoption mechanism than trust in medical practitioners. This study therefore contributes to the literature by adding to the evidence for this effect. Our findings also add validity to the idea that trust should be considered multidimensional, by showing that each individual trust factor has a different, but significant, impact on ITU.

A similar argument applies to the construct of risk. This study shows that risk should also be treated as consisting of several subdimensions. Although some studies have recognized that risk consists of multiple factors e.gCitation27,Citation28 none of these studies have examined the separate, independent impact of each factor, and have, instead, treated the effect or risk in a holistic manner. Failure to analyze the impact of individual risk factors, on the other hand, can lead to ambiguity and misleading conclusions.

Another way in which this study contributes to future research on TM adoption is by demonstrating a significant ITU-Behavior gap among service users. While research outside of the specific TM field has shown that ITU does not necessarily translate into actual usage behaviors,Citation1,Citation30,Citation68 this finding has usually been ignored within the field of TM research, which has tended to concentrate its efforts on the causative factors for ITU only e.g.Citation31,Citation36 While ITU-focused studies are useful, they do not take account of the fact that other, external, factors could affect usage behavior. The current study shows clearly that, in the TM environment, usage behavior may not follow from ITU.

Practical Implications

Several practical implications result from the findings of this study. One of these is that, if TM is to be widely embraced, it is critical to develop trust in technological reliability among service users, as this can play a major role in forming trust in therapeutic solutions and ITU. Developing this trust will require a multi-pronged approach by individual healthcare providers, as well as governments, to inform and educate the public as the many proven benefits of the technology.

Another practical implication of the study’s findings is that service users need to be convinced that the use of TM will provide effective medical outcomes, in terms of access to assistive technology. Again, this will require the promotion of TM, by individual practitioners, organizations and governments, as an effective and reliable route to desirable medical outcomes.

Lastly, service users must believe that the use of TM poses no risk to the desired medical outcome. This can be achieved as part of the promotional strategies designed to increase trust, as described above. Additionally, the need of recognize and address the specific risk concerns of different user groups by tailoring communication strategies can help ensure that risk mitigation messages are culturally sensitive, thereby enhancing their effectiveness. Moreover, establish robust feedback mechanisms that allow users to report issues, express concerns about TM services, and suggest improvements. This not only aids in continuously enhancing the safety and reliability of TM services but also demonstrates a commitment to user-centric care, further reducing perceived risks.

Conclusions

The study’s exploration into the adoption of TM elucidates the critical role of multidimensional constructs of trust and perceived risk, underscoring a nuanced understanding necessary for enhancing TM’s integration into assistive technology landscapes. By diverging from traditional analyses that conceptualize trust and risk as singular dimensions, this research offers a fresh perspective, revealing the complex interplay of factors influencing TM adoption.

A notable contribution of this research lies in its counterintuitive discovery that trust in technological reliability is more predictive of trust in therapeutic solutions than the traditionally relied-upon trust in medical practitioners. This insight invites healthcare providers and policymakers to reconsider the emphasis placed on technological aspects of TM solutions, advocating for a balanced approach that fosters both technological and practitioner trust to enhance patient receptivity.

Furthermore, the differentiation of perceived risk into distinct dimensions and their varied impacts on TM adoption emphasizes the necessity for a comprehensive risk management strategy. Particularly, the singular significance of medical outcome risks on usage intention highlights a pivotal area for developers and policymakers to address in promoting TM adoption.

The strengths of this study are manifold. It offers a novel perspective by dissecting trust and risk into multidimensional constructs, providing a richer understanding of their roles in TM adoption. The unexpected finding regarding the importance of technological trust over practitioner trust further contributes to the discourse, suggesting new focal points for enhancing TM acceptance.

The identified disparity between the ITU of TM and actual usage behaviour unveils a critical research gap, suggesting that factors beyond those measured may influence TM adoption. Future studies are encouraged to delve deeper into psychological, technological, and environmental determinants that bridge this gap, offering a more holistic view of TM adoption dynamics.

Limitations and Future Research

It is important to note that the present research has some limitations. One of these is the study’s use of different groups as the basis for comparing the impact of cultural/social factors on the impact of trust and risk on ITU and usage behavior. Although this approach facilitated useful insights, the results cannot be generalized to all socio-cultural factors. Also, the study did not consider the extent to which external, or other, factors, such as the urgency of required therapy, could affect the trust and risk. This could be usefully included in future research.

A second limitation includes the study geographic and demographic scope; the majority of survey participants (75%) were under 49 years old, and thus likely to be digital users with high to very high educational levels. Therefore, the survey did not reach segments of the population with lower educational levels or older populations, who may have a lower level of digitalization but a greater need for care through telemedicine and assistive technology. Future research should expand to diverse populations and settings. Further research should expand to diverse populations and settings. Investigating the underexplored facets of trust and risk, alongside innovative methodologies, could uncover pivotal insights, paving the way for tailored interventions that accelerate TM’s widespread acceptance and utilization. This refined understanding and strategic recommendations offer a pathway for harnessing TM’s full potential, advocating for a multifaceted approach to fostering widespread adoption and ensuring TM’s role as a cornerstone in the future of healthcare delivery.

Thirdly, while the study found a gap between ITU and usage behavior, this gap was not based on independently verified behaviors, which were self-declared by the participant. Although these self-declared behaviors were likely to be accurate in general terms, there was no independent evidence for this assumption. This could be addressed by future (longitudinal) studies. Lastly, this research was focused on a Saudi Arabian context. However, the TM acceptance process may vary with culture, so our findings may not apply to other countries. Future research could examine the extent to which the trust-risk relationships, and their impact on ITU, are a function of cultural context.

Ethics Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board (Human and Social Researches) of King Saud University – No. KSU-18-242.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Disclosure

The authors report no conflicts of interest in this work.

Acknowledgments

The authors extend their appreciation to Researchers Supporting Project number (RSP2024R233) at King Saud University, Riyadh, Saudi Arabia.

Data Sharing Statement

Data are not shared due to privacy and ethical restrictions.

Additional information

Funding

This research was funded by the Researchers Supporting Project number (RSP2024R233), King Saud University, Riyadh, Saudi Arabia.

References

  • Adamkiewicz D, Atri L, Berman L, et al. Implementation of a telemedicine student clinical experience. Telemed E-Health. 2023;29(3):432–441. doi:10.1089/tmj.2022.0127
  • Wang X, Zhang Z, Zhang J. The introduction of telemedicine service: with or without reimbursement? J Ind Manage Optim. 2024;20(3):1177–1202. doi:10.3934/jimo.2023120
  • Verma H, Hasegawa D, Tepper DL, Burger AP, Weissman MA. Patient satisfaction with telehealth at an academic medical center primary care clinic. Telemed E-Health. 2023. doi:10.1089/tmj.2023.0158
  • O’Shea AMJ, Mulligan K, Carlson P, et al. Healthcare utilization differences among primary care patients using telemedicine in the veterans health administration: a retrospective cohort study. J Gen Intern Med. 2024;39:109–117. doi:10.1007/s11606-023-08472-1
  • Ghosh R, Healy A, Prabhune A, Mallavaram A, Raju S, Chockalingam N. Provision of rehabilitation and assistive technology services in a low resource setting during the COVID-19 pandemic and introduction of telehealth: service users’ and providers. Perspect Assist Technol. 2022;1–7. doi:10.1080/10400435.2022.2095582
  • Harst L, Lantzsch H, Scheibe M. Theories Predicting End-User Acceptance of Telemedicine Use: systematic Review. J Med Internet Res. 2019;21(5):e13117. doi:10.2196/13117
  • Strycharz J, Segijn CM. Ethical Side-Effect of Dataveillance in Advertising: impact of Data Collection, Trust, Privacy Concerns and Regulatory Differences on Chilling Effects. J Bus Res. 2024;173:114490. doi:10.1016/j.jbusres.2023.114490
  • Knight T, Yuan X, Bennett Gayle D. Illuminating privacy and security concerns in older adults’ technology adoption. Work Aging Retir. 2024;10(1):57–60. doi:10.1093/workar/waac032
  • Alzahrani AI, Al-Samarraie H, Eldenfria A, Dodoo JE, Zhou X, Alalwan N. COVID-19 and people’s continued trust in EHealth systems: a new perspective. Behaviour Inf Technol. 2023;42(9):1294–1310. doi:10.1080/0144929X.2022.2071168
  • Arfi WB, Nasr IB, Kondrateva G, Hikkerova L. The role of trust in intention to use the IoT in EHealth: application of the Modified UTAUT in a consumer context. Technol Forecast Soc Change. 2021;167:120688. doi:10.1016/j.techfore.2021.120688
  • Tian K, Hao L, Xuan W, Phongsatha T, Hao R, Wei W. The impact of perceived value and affection on Chinese residents’ continuous use intention of mobile health science information: an empirical study. Front Public Health. 2023;11. doi:10.3389/fpubh.2023.1034231
  • Zhang X, Yan X, Cao X, Sun Y, Chen H, She J. The role of perceived e-health literacy in users’ continuance intention to use mobile healthcare applications: an exploratory empirical study in China. Inf Technol Dev. 2018;24(2):198–223. doi:10.1080/02681102.2017.1283286
  • Sahoo AK, Dash A, Nayak P. Perceived risk and benefits of E-Health consultation and their influence on user’s intention to use. J Sci Technol Policy Manage. 2023. doi:10.1108/JSTPM-10-2022-0174
  • Featherman MS, Pavlou PA. Predicting E-services adoption: a perceived risk facets perspective. Int J Hum Comput Stud. 2003;59(4):451–474. doi:10.1016/S1071-5819(03)00111-3
  • Li Y, James L, McKibben J. Trust between Physicians and Patients in the E-Health Era. Technol Soc. 2016;46:28–34. doi:10.1016/j.techsoc.2016.02.004
  • Lu J, Bai J, Zhao H, Zhang X. The effect of “offline-to-online” trust transfer on the utilization of online medical consultation among Chinese rural residents: experimental study. J Med Internet Res. 2023;25:e43430. doi:10.2196/43430
  • Jabeen F, Hamid Z, Akhunzada A, Abdul W, Ghouzali S. Trust and reputation management in healthcare systems: taxonomy, requirements and open issues. IEEE Access. 2018;6:17246–17263. doi:10.1109/ACCESS.2018.2810337
  • Liu PL, Jiang S. Patient-centered communication mediates the relationship between health information acquisition and patient trust in physicians: a five-year comparison in China. Health Commun. 2021;36(2):207–216. doi:10.1080/10410236.2019.1673948
  • Gong Z, Han Z, Li X, Yu C, Reinhardt JD. Factors influencing the adoption of online health consultation services: the role of subjective norm, trust, perceived benefit, and offline habit. Front Public Health. 2019;7:7. doi:10.3389/fpubh.2019.00286
  • Liu J, Marriott K, Dwyer T, Tack G. Increasing user trust in optimisation through feedback and interaction. ACM Trans Comput Hum Interact. 2022;29(5):1–34. doi:10.1145/3503461
  • Lee MKO, Turban E. A trust model for consumer internet shopping. Int J Electron Commer. 2001;6(1):75–91. doi:10.1080/10864415.2001.11044227
  • Asan O, Bayrak AE, Choudhury A. Artificial intelligence and human trust in healthcare: focus on clinicians. J Med Internet Res. 2020;22(6):e15154. doi:10.2196/15154
  • Mcknight DH, Carter M, Thatcher JB, Clay PF. Trust in a specific technology. ACM Trans Manag Inf Syst. 2011;2(2):1–25. doi:10.1145/1985347.1985353
  • Velsen van L, Tabak M, Hermens H. Measuring patient trust in telemedicine services: development of a survey instrument and its validation for an anticoagulation web-service. Int J Med Inform. 2017;97:52–58. doi:10.1016/j.ijmedinf.2016.09.009
  • Anderson LA, Dedrick RF. Development of the trust in physician scale: a measure to assess interpersonal trust in patient-physician relationships. Psychol Rep. 1990;67(3_suppl):1091–1100. doi:10.2466/pr0.1990.67.3f.1091
  • Luo Y, Liu Y, Chen H, et al. How about trust in physician-patient relationship? A concept analysis of physicians. Perspectives Patient Educ Couns. 2023;112:107709. doi:10.1016/j.pec.2023.107709
  • Zhang J, Luximon Y, Li Q. Seeking medical advice in mobile applications: how social cue design and privacy concerns influence trust and behavioral intention in impersonal patient–physician interactions. Comput Human Behav. 2022;130:107178. doi:10.1016/j.chb.2021.107178
  • Yang M, Jiang J, Kiang M, Yuan F. Re-examining the impact of multidimensional trust on patients’ online medical consultation service continuance decision. Inform Syst Front. 2022;24(3):983–1007. doi:10.1007/s10796-021-10117-9
  • Koonin LM, Hoots B, Tsang CA, et al. Trends in the Use of Telehealth During the Emergence of the COVID-19 Pandemic — United States, January–March 2020. MMWR Morb Mortal Wkly Rep. 2020;69(43):1595–1599. doi:10.15585/mmwr.mm6943a3
  • Almathami HKY, Win KT, Vlahu-Gjorgievska E. Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients’ homes: systematic literature review. J Med Internet Res. 2020;22(2):e16407. doi:10.2196/16407
  • Stewart KJ. Trust transfer on the world wide web. Organ Sci. 2003;14(1):5–17. doi:10.1287/orsc.14.1.5.12810
  • Kuen L, Schürmann F, Westmattelmann D, Hartwig S, Tzafrir S, Schewe G. Trust transfer effects and associated risks in telemedicine adoption. Electronic Markets. 2023;33(1):35. doi:10.1007/s12525-023-00657-0
  • Pizam A, Ozturk AB, Hacikara A, et al. The role of perceived risk and information security on customers’ acceptance of service robots in the hotel industry. Int J Hosp Manag. 2024;117:103641. doi:10.1016/j.ijhm.2023.103641
  • Liu K, Tao D. The roles of trust, personalization, loss of privacy, and anthropomorphism in public acceptance of smart healthcare services. Comput Human Behav. 2022;127:107026. doi:10.1016/j.chb.2021.107026
  • Kamal SA, Shafiq M, Kakria P. Investigating acceptance of telemedicine services through an extended technology acceptance model (TAM). Technol Soc. 2020;60:101212. doi:10.1016/j.techsoc.2019.101212
  • Cao Y, Zhang J, Ma L, Qin X, Li J. Examining user’s initial trust building in mobile online health community adopting. Int J Environ Res Public Health. 2020;17(11):3945. doi:10.3390/ijerph17113945
  • Ramírez-García C, Ramón-Jerónimo MÁ, García-álvarez de Perea J, Vélez-Elorza ML. Risk sources and the effectiveness of the control system in the franchisor’s risk perception management. Ind Marketing Manage. 2024;117:202–219. doi:10.1016/j.indmarman.2023.12.024
  • Roozee E, Kim D, Sohns A, de Vries JR, Temby OF, Hickey GM. Managing inter-organizational trust and risk perceptions in transboundary fisheries governance networks. Mar Policy. 2024;159:105927. doi:10.1016/j.marpol.2023.105927
  • Guo X, Zhang X, Sun Y. The privacy–personalization paradox in mHealth services acceptance of different age groups. Electron Commer Res Appl. 2016;16:55–65. doi:10.1016/j.elerap.2015.11.001
  • Davis FDPU. Perceived ease of use, and user acceptance of. MIS Quarterly. 1989;13(3):319–340. doi:10.2307/249008
  • Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Quarterly. 2003;27(3):425–478. doi:10.2307/30036540
  • AlQudah AA, Al-Emran M, Shaalan K. Technology acceptance in healthcare: a systematic review. Appl Sci. 2021;11(22):10537. doi:10.3390/app112210537
  • Nadal C, Sas C, Doherty G. Technology acceptance in mobile health: scoping review of definitions, models, and measurement. J Med Internet Res. 2020;22(7):e17256. doi:10.2196/17256
  • Gu D, Khan S, Khan IU, et al. Assessing the adoption of E-health technology in a developing country: an extension of the UTAUT Model. Sage Open. 2021;11(3):215824402110275. doi:10.1177/21582440211027565
  • Kissi J, Quansah DKK, Nutakor JA, Dankyi AB, Adu-Gyamfi Y. Telehealth during COVID-19 Pandemic Era: a Systematic Review. AIMS Med Sci. 2022;9(1):81–97. doi:10.3934/medsci.2022008
  • Oldeweme A, Märtins J, Westmattelmann D, Schewe G. The role of transparency, trust, and social influence on uncertainty reduction in times of pandemics: empirical study on the adoption of COVID-19 tracing apps. J Med Internet Res. 2021;23(2):e25893. doi:10.2196/25893
  • Rauschnabel PA, He J, Ro YK. Antecedents to the adoption of augmented reality smart glasses: a closer look at privacy risks. J Bus Res. 2018;92:374–384. doi:10.1016/j.jbusres.2018.08.008
  • Gillham B. Developing a Questionnaire. London: Continuum; 2000.
  • Denscombe M. Web-based questionnaires and the mode effect. Soc Sci Comput Rev. 2006;24(2):246–254. doi:10.1177/0894439305284522
  • Bernard RM, Brauer A, Abrami PC, Surkes M. The development of a questionnaire for predicting online learning achievement. Distance Educ. 2004;25(1):31–47. doi:10.1080/0158791042000212440
  • Kitchin R, Moore-Cherry N. Fragmented governance, the urban data ecosystem and smart city-regions: the case of metropolitan Boston. Reg Stud. 2020;1–11. doi:10.1080/00343404.2020.1735627
  • Creswell JW, Clark VLP. Designing and Conducting Mixed Methods Research. London: SAGE; 2011.
  • DeVaus D. Surveys in Social Research. London: Routledge; 2002.
  • Aday LA, Cornelius LJ. Designing and conducting health surveys: a comprehensive guide. Jossey Bass A. 2006;2006:1.
  • Armstrong JS, Overton TS. Estimating nonresponse bias in mail surveys. J Market Res. 1977;14(3):396–402. doi:10.1177/002224377701400320
  • Ma WWK, Clark Thk online course acceptance: A paired sample experiment. In TechEd Ontario International Conference & Exposition; Ontario, Canada, 2003; pp 1–14.
  • Calculator. Sample size calculator. Available from: http://www.calculator.net/sample-size-calculator.html. Accessed July 18, 2024.
  • Field AP. 2013. Discovering Statistics Using IBM SPSS Statistics: And Sex and Drugs and Rock “N”. Los Angeles: Sage, Roll.
  • Hair JF, Ringle CM, Sarstedt M. PLS-SEM: indeed a Silver Bullet. J Marketing Theory Pract. 2011;19(2):139–152. doi:10.2753/MTP1069-6679190202
  • Rigdon EE, Sarstedt M, Ringle CM. On comparing results from CB-SEM and PLS-SEM: five perspectives and five recommendations. Marketing ZFP. 2017;39(3):4–16. doi:10.15358/0344-1369-2017-3-4
  • Hair JF, Howard MC, Nitzl C. Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. J Bus Res. 2020;109:101–110. doi:10.1016/j.jbusres.2019.11.069
  • Comrey AL, Lee HB. A First Course in Factor Analysis. NJ, Hillsdale: Erlbaum; 1992.
  • Tinsley HE, Tinsley DJ. Uses of factor analysis in counseling psychology research. J Couns Psychol. 1987;34(4):414–424. doi:10.1037//0022-0167.34.4.414
  • Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31–36. doi:10.1007/BF02291575
  • Adya M, Kaiser KM. Early determinants of women in the IT workforce: a model of girls’ career choices. Inform Tech People. 2005;18(3):230–259. doi:10.1108/09593840510615860
  • Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equation Model. 1999;6(1):1–55. doi:10.1080/10705519909540118
  • Jr. JFH, Matthews LM, Matthews RL, Sarstedt M. PLS-SEM or CB-SEM: updated guidelines on which method to use. Int J Multivar Data Anal. 2017;1(2):107. doi:10.1504/IJMDA.2017.087624
  • Valikodath NG, Leveque TK, Wang SY, et al. Patient attitudes toward telemedicine for diabetic retinopathy. Telemed E-Health. 2017;23(3):205–212. doi:10.1089/tmj.2016.0108