Published on in Vol 9, No 1 (2021): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/25435, first published .
Using an Extended Technology Acceptance Model to Understand the Factors Influencing Telehealth Utilization After Flattening the COVID-19 Curve in South Korea: Cross-sectional Survey Study

Using an Extended Technology Acceptance Model to Understand the Factors Influencing Telehealth Utilization After Flattening the COVID-19 Curve in South Korea: Cross-sectional Survey Study

Using an Extended Technology Acceptance Model to Understand the Factors Influencing Telehealth Utilization After Flattening the COVID-19 Curve in South Korea: Cross-sectional Survey Study

Original Paper

1So-Ahn Public Health Center, Jeon-ra-nam-do, Republic of Korea

2Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea

3Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea

*these authors contributed equally

Corresponding Author:

Seongwon Lee, PhD

Department of Biomedical Informatics

Ajou University School of Medicine

164, World cup-ro, Yeongtong-gu

Suwon, 16499

Republic of Korea

Phone: 82 31 219 4471

Email: seongwon.lee.16@gmail.com


Background: Although telehealth is considered a key component in combating the worldwide crisis caused by COVID-19, the factors that influence its acceptance by the general population after the flattening of the COVID-19 curve remain unclear.

Objective: We aimed to identify factors affecting telehealth acceptance, including anxiety related to COVID-19, after the initial rapid spread of the disease in South Korea.

Methods: We proposed an extended technology acceptance model (TAM) and performed a cross-sectional survey of individuals aged ≥30 years. In total, 471 usable responses were collected. Confirmatory factor analysis was used to examine the validity of measurements, and the partial least squares (PLS) method was used to investigate factors influencing telehealth acceptance and the impacts of COVID-19.

Results: PLS analysis showed that increased accessibility, enhanced care, and ease of telehealth use had positive effects on its perceived usefulness (P=.002, P<.001, and P<.001, respectively). Furthermore, perceived usefulness, ease, and privacy/discomfort significantly impacted the acceptance of telehealth (P<.001, P<.001, and P<.001, respectively). However, anxiety toward COVID-19 was not associated with telehealth acceptance (P=.112), and this insignificant relationship was consistent in the cluster (n=216, 46%) of respondents with chronic diseases (P=.185).

Conclusions: Increased accessibility, enhanced care, usefulness, ease of use, and privacy/discomfort are decisive variables affecting telehealth acceptance in the Korean general population, whereas anxiety about COVID-19 is not. This study may lead to a tailored promotion of telehealth after the pandemic subsides.

JMIR Med Inform 2021;9(1):e25435

doi:10.2196/25435

Keywords



Background

The COVID-19 pandemic, caused by SARS-CoV-2 infection, has changed the world in various ways. Due to the highly contagious nature of this novel virus and shortages in personal protective equipment, health care centers have become high-risk transmission areas, and health care workers are at high risk for contracting COVID-19 [1]. In China where the first COVID-19 outbreak was documented, a significant proportion of cases were due to hospital-related transmission [2]. Accordingly, many studies reported that visits to health care centers had been dramatically decreased during the initial phase of the pandemic [3,4]. As a result, telehealth has gained unprecedented attention in the world as a protective measure against COVID-19 [5].

As a country situated close to China, South Korea was soon affected with its own outbreak. The first patient with a confirmed COVID-19 diagnosis entered the country on January 19, 2020 [6]. The outbreak was augmented by a religious gathering in Daegu, a city in southeastern South Korea [7]. The number of confirmed cases dramatically increased and reached a count of 909 cases daily on February 29, which was the highest number of cases reported by far in South Korea [8]. Meanwhile, rapid nationwide screening for COVID-19 was conducted alongside social distancing, mask use, and temporary implementation of telehealth. From February 24 to April 12, a total of 103,998 telehealth appointments were conducted in South Korea (2167 appointments per day on average) [9]. As of early June, the average number of daily incident cases was 55 in South Korea during an entire week, which represents a remarkable decrease from the previous average number of daily cases of 445 between February 25 and March 10 (15 days).

Kidholm et al [10] defined telehealth as “the delivery of health care services through the use of information and communication technologies in a situation where the actors are at different locations.” Rho et al [11] stated that telehealth is “the interchange of health information using telecommunications technology by geographically disconnected providers and patients with the intention to evaluate, diagnose, treat, or educate the patient.” In this study, we defined telehealth as health care services for diagnosis, treatment, or counseling delivered via telecommunication technologies by medical professionals at remote locations.

Although there is little doubt about the considerable benefit of telehealth in terms of managing the crisis caused by COVID-19 [12], the long-term prospect of telehealth remains largely unclear. However, there are conflicting opinions on the continuation of telehealth use after COVID-19. Some argue that telehealth may be abandoned after the COVID-19 curve is flattened [13,14]. Meanwhile, in Israel, the increase in the use of phone visits in pediatric clinics was sustained after lockdown restrictions were lifted [14]. Therefore, we attempted to predict trends in health care service use after COVID-19 by investigating the impact of the disease on the acceptance of telehealth.

In this study, we aimed to identify factors affecting the acceptance of telehealth by performing a survey of the Korean general population. Furthermore, we investigated whether anxiety related to COVID-19 had any significant impact on telehealth acceptance.

Research Model

According to the technology acceptance model (TAM), usefulness and easiness are the two major factors involved in user adoption of a technology [15]. TAM has been widely used to evaluate user acceptance of general technologies but is limited by little explanatory power for specific system purposes [16]. Therefore, to evaluate the acceptance of telehealth, we extended TAM with predicted benefits and concerns for telehealth.

Hirani et al [17] studied user beliefs on telehealth acceptance and presented the following constructs regarding its precedents and consequences: (1) enhanced care, (2) increased accessibility, (3) privacy and discomfort, (4) care personnel concerns, (5) kit as substitution, and (6) satisfaction. Enhanced care and increased accessibility are benefits that telehealth may provide to patients, whereas privacy and discomfort, as well as care personnel concerns, are obstacles that may hinder telehealth acceptance. Kit as substitution refers to one’s beliefs about how telehealth may be an alternative to regular care, and satisfaction is the gratification experienced as a result of the telehealth system and service. Among them, we selected three precedent variables, namely increased accessibility, enhanced care, and privacy and discomfort, since this study aimed to explore the factors influencing the acceptance of the telehealth system itself. The care personnel concerns construct was excluded as a variable because it indicates concerns about the capabilities of the health care provider and does not pertain to the telehealth system.

In addition, to study the impact of COVID-19 on telehealth acceptance, we included the construct of anxiety related to COVID-19 in the research model (Figure 1).

Figure 1. Research model. TAM: technology acceptance model.
View this figure

Development of Hypotheses

Telehealth Usefulness

Increased accessibility is a key element for the success of health care services. Accessibility is the belief pertaining to how a health care system has facilitated the receipt of care from health care providers [17]. Access to health care is the interplay between the characteristics of persons, and social and physical environments, and the characteristics of health systems, institutions, and providers, and it plays a central role in the performance of a health care system [16]. Facilitating access to health care increases the opportunity to obtain appropriate care services in situations where it is needed, and enhances the utilization of such services in terms of service availability and relevance, as well as physical and financial accessibility [18].

With telehealth, patients do not need to travel to the hospital and wait to see their physician [19]. Moreover, telehealth makes it possible for disabled patients and patients with other barriers to care, such as those who are housebound or live in rural areas, to access services [20]. The accessibility of telehealth will increase the usefulness of telehealth and thus we hypothesized:

H1. Increased accessibility has a positive impact on the perceived usefulness of telehealth.

Enhanced care is defined as one’s beliefs on how telehealth can improve the care that patients receive from their health care professional [17]. Telehealth makes it easier for patients to consult health care professionals and increases the possibility of seamless health care and early detection of diseases [17]. It may improve the efficiency of health care in terms of convenience in follow-up while maintaining clinical effectiveness with less cost for both patients and clinicians compared with traditional visits [21]. Telehealth was also found to be effective in certain fields, including psychological interventions [22] and home monitoring of respiratory conditions [23], and for chronic diseases including diabetes, heart disease, and chronic obstructive pulmonary diseases [24,25]. This enhanced health care system will increase people’s perceptions of the usefulness of telehealth; thus, we hypothesized the following:

H2. Enhanced care has a positive impact on the perceived usefulness of telehealth.

TAM asserts that user perception regarding the usefulness of a technology is influenced by its ease of use. Perceived ease of use refers to the extent to which a person believes that using the system will be free of effort [15]. The easier the system is to use, the more useful it can be [26]. For telehealth, the ease of use will also increase the perceived usefulness of it, and thus we hypothesized:

H3. Perceived ease of use has a positive impact on the perceived usefulness of telehealth.
Attitude Toward Telehealth

TAM stipulates that perceived usefulness and perceived ease of use are factors associated with people’s attitude toward a system [15]. The attitude toward telehealth is defined by positive or negative feelings related to using a telehealth service [27]. According to the theory of reasoned action, people’s beliefs such as perceived usefulness and perceived ease of use shapes an attitude, which, in turn, influences a behavior [28]. Many studies have demonstrated that when people perceive a technology as useful, the likelihood of accepting it increases [29,30]. Evidence also shows that when a technology is easy to use, the attitude toward it improves [31]. We anticipated that the perceived usefulness and the perceived ease of use of telehealth would improve people’s attitude toward it. We developed the following two hypotheses:

H4. Perceived usefulness has a positive impact on attitude toward telehealth.
H5. Perceived ease of use has a positive impact on attitude toward telehealth.

Privacy and discomfort are major concerns that hinder telehealth adoption [16]. This construct can be defined as concerns about the impact of telehealth on the safety of personal and health information [17]. Generally, telehealth involves the digital collection, use, disclosure, and communication of health information over a network between health care providers and patients [32]. Health information is highly confidential, so people may experience concerns about privacy intrusions and loss of control over information [19,33,34]. To realize the potential of telehealth, trust between health care providers and patients without privacy concerns is required. The greater the concern regarding privacy and discomfort related to the use of telehealth, the worse the attitude toward telehealth, and thus we hypothesized:

H6. Privacy and discomfort have a negative impact on attitude toward telehealth.

The COVID-19 pandemic may provide an increased incentive for telehealth use [5]. People have been subjected to a number of public policies such as regional lockdowns, quarantine at home, physical distancing, and restricted travel [35,36]. They are concerned about hospital visits because of the probability of contracting COVID-19 in this setting, which can lead to serious complications, especially for patients with chronic diseases.

In a study on the adoption of Google Meet for education, students’ perceived fear of COVID-19 significantly affected the intention to attend the class via Google Meet [37]. This finding is relevant to our paper in that it supports the idea that psychological factors can affect the behavior of users.

A recent study investigating panic during the COVID-19 pandemic in the Philippines using the Health Anxiety Inventory reported that levels of avoidance behavior and symptoms of hypochondriasis differed between residents inside and outside Metro Manila [38]; this implies that anxieties about contracting COVID-19 may alter the behavior of the public.

Additionally, a study from China reported that approximately one-third of the survey participants reported having moderate to severe anxiety, with 84.7% of respondents spending most of their time at home and 75.2% worrying about their family members being exposed to COVID-19 [39]. Therefore, people who are anxious about COVID-19 will be more positive about accepting non–face-to-face health care services. Thus, we hypothesized:

H7. Anxiety related to COVID-19 has a positive impact on attitude toward telehealth.
Intention to Use Telehealth

The intention to use telehealth is defined by the extent to which a population intends to use telehealth [11]. According to TAM, the intention to use a technology is influenced by one’s attitude toward it [16]; this intention predicts the actual usage behavior [31]. A positive attitude, including high favorability, and satisfaction of a technology results increase one’s intention to use it; hence, a positive attitude toward telehealth increases the intention to use it. Therefore, we hypothesized:

H8. Attitude toward telehealth has a positive impact on the intention to use telehealth.

Measurement Instruments

To ensure the validity of the measures, all measurement items for each variable in the model were developed based on previous studies. We modified them to measure the perceptions and attitudes toward telehealth. A questionnaire originally developed in English was translated into Korean and was repeatedly examined to ensure that the items and expressions in both versions were consistent.

The questionnaire consisted of three parts. The first part pertained to perceptions and beliefs regarding telehealth, including the TAM variables. The second part included questions on anxiety level in relation to COVID-19, and the last part included questions on respondents’ sociodemographic information (eg, gender, age group, education level, monthly income), hospital usage patterns (eg, frequency of hospital visits), and their health status (eg, comorbidities).

Variables related to beliefs about telehealth, increased accessibility, enhanced care, and privacy and discomfort were measured using the Service User Technology Acceptability Questionnaire by Hirani et al [17]. Four items were used to measure each respondent’s increased accessibility to telehealth, and 5 items were used for enhanced care. For privacy and discomfort, there were initially 4 items, but one was removed during the reliability test, resulting in 3 items.

The TAM variables of perceived usefulness of, perceived ease of use of, and intention to use telehealth were developed from measurement items published by Venkatesh and Davis [26]. Perceived ease of use was measured with 4 measurement items, and 2 items were used to measure intention to use telehealth. For perceived usefulness, 4 items were used, but one was removed during the reliability test, and the remaining 3 items were used for analysis. Attitude toward telehealth was measured by 4 questions, which were developed from Davis [15].

Anxiety about COVID-19 was measured using items published by Roy et al [40]. They developed 18 items to measure people’s feelings of anxiety toward COVID-19 based on a 5-point Likert scale (1=never, 2=rarely, 3=sometimes, 4=often, 5=always). We sorted these items in the order of the highest number of answers of “often” or “always,” and selected 6 items for which over 80% of respondents had answered as “often” or “always.” During the reliability test, 3 items were removed, and a total of 3 items were included for analysis. The detailed items of each construct are listed in Table 1; each item was measured by a 5-point Likert scale.

Table 1. Measurement items of constructsa.
Construct and itemMeasurementsReference
Increased accessibility (AC)Hirani et al [17]

ac1Telehealth increases my access to health care.

ac2Telehealth helps me to improve my health.

ac3Telehealth saves me time in that I do not have to visit my GPb clinic.

ac4Telehealth has made it easier to get in touch with health care professionals.
Enhanced care (EC)Hirani et al [17]

ec1Telehealth makes me actively involved in my health.

ec2Telehealth allows the people looking after me to better monitor me and my condition.

ec3Telehealth can be recommended to people with a similar condition to mine.

ec4Telehealth can certainly be a good addition to regular health care.

ec5Telehealth allows me to be less concerned about my health care.
Perceived ease of use (PE)Venkatesh and Davis [26]

pe1My interaction with telehealth is clear and understandable.

pe2Interacting with telehealth does not require a lot of mental effort.

pe3I find telehealth to be easy to use.

pe4I find it easy to get the telehealth system to do what I want it to do.
Perceived usefulness (PU)Venkatesh and Davis [26]

pu2Using telehealth in my job increases my productivity of health care.

pu3Using telehealth enhances the effectiveness of my health care.

pu4I find telehealth to be useful to my health care.
Privacy and discomfort (PD)Hirani et al 17]

pd1Telehealth makes me feel uncomfortable physically or emotionally.

pd2The telehealth service I received invades my privacy.

pd3The telehealth service I received interferes with my everyday routine.
COVID-19–related anxiety (CA)Roy et al [40]

ca2Since last week, how often have you avoided partying?

ca3Since last week, how often have you avoided social contact?

ca4Since last week, how often have you avoided large meetings and gatherings?
Attitude (AT)Davis [15]

at1Using telehealth is a good idea.

at2Using telehealth is a wise idea.

at3I like using telehealth.

at4Using telehealth makes me feel good.
Intention to use (UI)Venkatesh and Davis [26]

ui1Assuming I have access to telehealth, I intend to use it.

ui2Given that I have access to telehealth, I predict that I would use it.

aItems for each variable, except anxiety about COVID-19, were measured on a 5-point Likert scale (1=totally disagree to 5=totally agree). Items for anxiety about COVID-19 were also measured on a 5-point Likert scale but using the following designations: 1=never, 2=rarely, 3=sometimes, 4=often, and 5=always.

bGP: general practitioner.

Data Collection

Data were collected through a cross-sectional survey. We used a mobile survey company, OpenSurvey, to recruit participants and collect questionnaire data. Using OpenSurvey’s panel and smartphone app, data could be collected nationwide. We included only individuals aged ≥30 years. To reduce confounding effects, stratified sampling was used for 4 age groups: 30-39, 40-49, 50-59, and ≥60 years. The survey was conducted on July 3, 2020, when the average number of daily confirmed cases of COVID-19 was approximately 50 per week (June 29 to July 5) after the initial rapid spread of COVID-19 in South Korea. The questionnaire was distributed to a panel that met the study criteria, and 500 responses were collected. In order to encourage participation, USD 0.84 (KRW 1000) was paid to each questionnaire respondent.

This study was approved by the Ethics Committee of Ajou University (AJIRB-SBR-SUR-20-227), South Korea.

Data Analysis

The partial least squares (PLS) method, based on structural equation modeling, was used to validate the research model. First, we evaluated the validity and internal consistency of research constructs with measurement analysis: factor loading, the average variance extracted (AVE), and Cronbach alpha. Second, we performed PLS analysis to validate our hypotheses. SmartPLS 3.0 (SmartPLS GmbH) was used as a statistical analytic software.


Demographic Characteristics

The total number of collected questionnaires was 500. Of these, 29 were excluded since the respondents provided the same answer to all questionnaire items. Data from 471 respondents were included for analysis. Table 2 shows the respondents’ demographic information. A total of 232 (49.26%) respondents were male, and respondents were almost equally distributed across the age groups. Many respondents had received an education equivalent to a bachelor’s degree (n=300, 63.69%). The most commonly reported income in our study population was $2000-$3000 (n=112, 23.78%) and $3000-$4000 (n=96, 20.38%). Only 16 (3.40%) participants had used telehealth during the past year. Some respondents had major chronic diseases, such as hypertension (n=70, 14.86%), diabetes (n=31, 6.58%), and heart disease (n=28, 5.94%), and 193 (40.98%) participants reported that they had visited the hospital 3-6 times a year.

Table 2. Demographics of respondents (N=471).
CharacteristicParticipant, n (%)
Gender

Male232 (49.26)

Female239 (50.74)
Age group (years)

30-39119 (25.27)

40-49115 (24.42)

50-59116 (24.63)

60-69121 (25.69)
Education

High school education or lower10 (2.12)

High school graduate112 (23.78)

Bachelor’s degree300 (63.69)

Master’s degree or other49 (10.4)
Income per month

<$100053 (11.25)

$1000-$200073 (15.50)

$2000-$3000112 (23.78)

$3000-$400096 (20.38)

$4000-$500064 (13.59)

>$500073 (15.50)
Telehealth experience

No455 (96.60)

Yes16 (3.40)
Number of hospital visits per year

<3179 (38.00)

3-6193 (40.98)

7-1278 (16.56)

≥1321 (4.46)
Chronic disease

Hypertension70 (14.86)

Diabetes31 (6.58)

Cancer10 (2.12)

Stroke4 (0.85)

Heart disease28 (5.94)

Depression20 (4.25)

Asthma17 (3.61)

Other36 (7.64)

Measurement Model

We used reflective measurement modeling for all 8 latent variables, in which indicators are influenced by the variables not composing them [41]. First, the reliability and convergent validity of the measurement model was evaluated by confirmatory factor analysis. As a result of factor loading, the items with a loading value not exceeding 0.7 were excluded from the analysis [42]. Those items were 1 for privacy and discomfort and 3 for anxiety about COVID-19. The internal consistency of the constructs was examined by a Cronbach alpha coefficient greater than .7, which is an accepted cut-off [43,44]. The AVEs of all the constructs were well above 0.50, and the convergent validity of the measurement items was validated [45]. Table 3 shows the results of the factor loadings, composite reliability, AVE, and Cronbach alpha.

Table 3. Factor loadings and reliability.
Construct and itemMean (SD)LoadingsComposite reliabilityAverage variance extractedCronbach alpha
Increased accessibility (AC)
0.8950.680.842

ac13.979 (0.860)0.877



ac23.798 (0.863)0.860



ac34.244 (0.765)0.779



ac43.989 (0.886)0.779


Enhanced care (EC)
0.9190.695.890

ec13.786 (0.891)0.823



ec23.272 (0.995)0.779



ec33.626 (0.885)0.864



ec43.885 (0.855)0.875



ec53.673 (0.911)0.825


Perceived ease of use (PE)
0.8910.673.838

pe13.325 (0.917)0.815



pe23.316 (0.972)0.742



pe33.505 (0.913)0.875



pe43.667 (0.907)0.842


Perceived usefulness (PU)
0.9130.779.858

pu23.735 (0.858)0.878



pu33.463 (0.919)0.871



pu43.756 (0.914)0.897


Privacy and discomfort (PD)
0.9080.767.848

pd12.204 (0.890)0.852



pd22.293 (0.936)0.879



pd32.055 (0.881)0.897


Anxiety about COVID-19 (CA)
0.8670.684.769

ca22.291 (1.363)0.814



ca33.123 (1.235)0.822



ca42.713 (1.635)0.845


Attitude (AT)
0.9330.778.904

at13.662 (0.942)0.857



at23.675 (0.919)0.928



at33.739 (0.912)0.928



at43.187 (0.862)0.810


Intention to use (UI)
0.9790.959.958

ui13.805 (1.002)0.979



ui23.798 (0.978)0.980


Next, discriminant validity was verified using the Fornell–Larcker [43], cross-loading, and heterotrait-monotrait (HTMT) criteria [46]. For the Fornell–Larcker criterion, the square root of the AVE for a construct must be higher than the cross-construct correlation values. During the validation of the criterion, 1 item for perceived usefulness was excluded. Table 4 presents the correlation matrix and square root of the AVE, which shows that the Fornell–Larcker criterion was fulfilled. The cross-loading criterion was also satisfied, in which the loading value of the items on the corresponding constructs exceeded those on the other constructs. Lastly, we tested the HTMT criterion for our reflective constructs. According to Henseler et al [46], when testing the null hypothesis (H0: HTMT≥1) against the opposite hypothesis (H1: HTMT<1), if a CI contains the value 1, it indicates a lack of discriminant validity. The HTMT results for this study show that the HTMT CI does not include 1; thus, discriminant validity was established (Multimedia Appendix 1).

Table 4. Correlation matrix and square root of the average variance extracted. Values in italics are the square root of the AVE for the corresponding constructs.
ConstructsACaECbPEcPUdPDeCAfATgUIh
AC0.825






EC0.7850.834





PE0.6600.7130.820




PU0.7190.8250.6980.882



PD–0.525–0.440–0.423–0.3980.876


CA0.1220.1500.0690.1440.0030.827

AT0.7110.7310.6630.727–0.4640.1340.882
UI0.7240.6840.6360.654–0.5180.0830.8020.980

aAC: increased accessibility.

bEC: enhanced care.

cPE: perceived ease of use.

dPU: perceived usefulness.

ePD: privacy and discomfort.

fCA: anxiety about COVID-19.

gAT: attitude toward telehealth.

hUI: intention to use telehealth.

Hypothesis Testing

The structural model was developed to identify the relationships among the constructs. First, we assessed the model fit using the standardized root mean square residual (SRMR) [46] and root mean square (RMStheta). The SRMR value for this study was 0.061, which is less than the cut-off value of 0.08, and showed an acceptable model fit [47]. The RMStheta value was 0.145, which was slightly above the recommended threshold [48], but its exact acceptable threshold values have not been determined [49].

To test our hypotheses, we executed the PLS with a 500-times sampling bootstrap and evaluated the relationship between variables using path coefficient (β) and t statistics. The PLS results for the hypotheses are shown in Figure 2 and Table 5. The results show that all hypotheses, except H7, were supported. Increased accessibility and enhanced care were revealed to have a positive impact on the perceived usefulness of telehealth (H1: t=3.074, P<.01; H2: t=12.479, P<.001). Moreover, the perceived ease of use of telehealth had a positive impact on the perceived usefulness of it (t=5.049, P<.001); thus, H3 was supported. Both the perceived usefulness and the perceived ease of use of telehealth demonstrated the positive influence of attitude toward telehealth, so H4 (t=11.555, P<.001) and H5 (t=5.748, P<.001) were also supported. Privacy and discomfort about telehealth had a significantly negative influence on attitude toward telehealth (H6: t=4.746, P<.001). Meanwhile, anxiety toward COVID-19 had no significant effect on attitude toward telehealth (t=1.591, P>.05), and thus H7 was rejected. Lastly, attitude toward telehealth had a significantly positive influence on the intention to use telehealth (t=34.846, P<.001), supporting H8. The R2 value of the dependent variable of the intention to use telehealth was 0.643 (adjusted R2=0.642). This implies that 64.3% of the intention to use telehealth was elucidated by 4 precedent variables: perceived usefulness, perceived ease of use, privacy and discomfort, and anxiety.

Figure 2. Partial least squares results and R2 values (N=471). ***P<.001; **P<.01; *P<.05.
View this figure
Table 5. Hypothesis analysis results.
HypothesisPathβt valueP valueComments
H1ACa → PUb0.1353.074.002Supported
H2ECc → PU0.57912.479<.001Supported
H3PEd → PU0.1965.049<.001Supported
H4PU → ATe0.47311.555<.001Supported
H5PE → AT0.2595.748<.001Supported
H6PDf → AT–0.1664.746<.001Supported
H7CAg → AT0.0491.591.11Not supported
H8AT → UIi0.80234.846<.001Supported

aAC: increased accessibility.

bPU: perceived usefulness.

cEC: enhanced care.

dPE: perceived ease of use.

eAT: attitude toward telehealth.

fPD: privacy and discomfort.

gCA: anxiety about COVID-19.

hUI: intention to use telehealth.

Additionally, we classified participants into 2 clusters—(1) participants with chronic disease and (2) participants without chronic disease—and executed PLS analysis for each cluster. The results, shown in Multimedia Appendix 2, revealed that there was one significant difference between the clusters: among participants with chronic disease, no significant effect of increased accessibility on perceived usefulness was observed (t=0.142, P>.10). In both clusters, anxiety about COVID-19 was not significantly associated with attitude toward telehealth.


Principal Findings

In this nationwide survey targeting the Korean general population, we identified factors affecting the acceptance of telehealth. Using the extended TAM, we confirmed that not only perceived usefulness and ease of use, but also increased accessibility and enhanced care, which are the characteristics of telehealth, have a positive effect on attitude toward telehealth. Privacy and discomfort were a hindrance to telehealth, and this issue calls for improvement. Unexpectedly, anxiety about COVID-19 had no significant effect on attitude toward telehealth. The neutral association between anxiety about COVID-19 and telehealth acceptance was consistent in populations with and without chronic diseases.

This study confirmed that findings from previous studies can be applied to South Korea in the pandemic context. TAM can be successfully applied to studying telehealth acceptance in the overall population. Many studies have investigated telehealth acceptance based on TAM in multiple countries such as Taiwan [50] and China [19,51], and perceived usefulness and ease of use were validated as positive factors for telehealth acceptance. The enhanced accessibility of telehealth geographically, economically, and socially are benefits of telehealth [17,52]. Along with increased accessibility, enhanced care also has significant effects on the usefulness of telehealth, which is consistent with the results of previous studies [53,54]. In terms of privacy concerns, this study confirmed the findings of previous research, which showed that such concerns negatively correlated with the intention to adopt telehealth [51].

To our knowledge, this is the first study to analyze empirically the effects of COVID-19 on telehealth acceptance. Undoubtedly, the unprecedented nature of the pandemic has induced substantial enthusiasm for telehealth worldwide [55]. Of note, no significant relationship was found between anxiety about COVID-19 and telehealth acceptance. This insignificant impact may be attributed to when the survey was conducted (July 3, 2020). At that time, the number of COVID-19 cases had decreased and remained at less than 100 from April 2 to July 25, 2020 [8]. This decline in cases may have alleviated feelings of COVID-19–related anxiety.

Moreover, our findings may indicate the possibility of telehealth use even after the pandemic. A survey targeting physician engagement with patients and telehealth experiences showed that one-fifth of clinicians expected to use telehealth more after the COVID-19 pandemic is terminated compared to before the pandemic [56]. In South Korea, about 262,000 telehealth appointments were conducted from February 24 to May 10 (3403 appointments and 142 COVID-19 cases per day on average) and about 511,000 telehealth appointments were conducted from May 10 to September 20 (3871 appointments and 97 COVID-19 cases per day on average) [57-59]. Although telehealth was allowed temporarily due to COVID-19 in South Korea, it appears that interest in and the need for telehealth have already increased. This study offers indispensable information for policymakers and health care providers on implementing appropriate telehealth services.

Since patients with chronic diseases are more susceptible to fatal outcomes due to COVID-19 than those without chronic diseases [60], we assumed that patients with chronic diseases would prefer telehealth due to anxiety about COVID-19. Our finding suggests that patients with chronic diseases may continue to use telehealth after the pandemic era due to other reasons, including enhanced care and perceived ease of use. Interestingly, the relationship between increased accessibility and perceived usefulness was also not evident in this population. It contradicted with previous findings, which demonstrated that one of the key elements of telehealth for patients with chronic diseases is increased accessibility [20,61]. Our results may be driven by the universal availability of health care use in South Korea. Kim et al [62] surveyed unmet health care needs such as economic hardship, scheduling conflict, and long waiting times among the Korean elderly, and 17.4% (economic accessibility, 9.2%; service acceptability, 6.5%; and scheduling conflict, 1.7%) of respondents answered that unmet needs exist, which is a lower percentage than those in other developed countries, including Greece (26.3%) and Canada (scheduling conflict, 54.9%; service acceptability, 42.8%; and economic accessibility, 12.7%). It may imply that telehealth is required not only for filling the gaps in the current medical supply system but also for further development in patient care.

This study also provides some guidance for telehealth service providers. First, telehealth providers should elaborate the service model to promote accessibility and health care quality. A better health care service could involve preemptive treatment before the deterioration of health [63], and consultation with general physicians after normal clinic hours [64] could be considered. Second, technology developers should couple basic technologies with a convenient user interface. Telehealth-related technologies such as data integration with electronic medical records, data connection from multiple sources [65], and biophysiological data measuring/monitoring tools should be improved [66]. Moreover, an approachable user interface should be developed to encourage patients with digital literacy to accept telehealth [67]. Third, privacy concerns and feelings of discomfort are obstacles to be overcome in telehealth. Telehealth providers should establish a privacy and security protocol corresponding to HIPAA (Health Insurance Portability and Accountability Act) or HITEC (Health Information Technology for Economic and Clinical Health) for storing, transmitting, and utilizing data to provide a private and secure telehealth service [68].

Limitations

This study has several limitations. First, while factors associated with telehealth acceptance were included in this study, the actual behavior of adopting telehealth was not analyzed. The indirect construct of intention to use telehealth was used as a surrogate variable. Second, although the number of telehealth insurance claims were higher for those aged >30 years [69], exclusion of those in the 20-29 years age group is also a limitation of our study; this meant that users who are potentially more technologically skillful and have a greater tendency toward telehealth were omitted. Third, this study was based on cross-sectional data collected from individual surveys. Longitudinal field studies in the context of actual telehealth should be performed in the future. Fourth, we used COVID-19 anxiety measurements from a previous study that were not rigorously validated; in addition, the measures simply investigated people’s cognition and emotions related to COVID-19. It is not easy to reference well-validated measurements for anxiety in the context of a new pandemic, but it is significant that this study provides an early examination of the impact of COVID-19 on telehealth acceptance. Fifth, this study did not consider other factors that may influence telehealth acceptance. Individual, organizational, social, and legal factors such as policy, social norms, and trust in telehealth should be considered for the successful implementation of the telehealth system [70]. Lastly, because this study only included the South Korean population, it may not be generalized to other countries, which have different medical systems.

Conclusions

Based on our extended version of TAM, this study revealed the key factors influencing user intentions and attitudes toward telehealth services in the Korean general population. Our results indicate that accessibility, enhanced care, usefulness, ease of use, and privacy and discomfort are variables affecting user intentions and attitudes in this population, while anxiety about COVID-19 did not have significant impact. This study may aid technology developers and health care decision makers to better understand the behavioral characteristics of the Korean population and lead to the tailored promotion of telehealth services after the pandemic subsides.

Acknowledgments

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea, funded by the Ministry of Education (NRF-2020R1I1A1A01072208), and a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI16C0992).

Authors' Contributions

All authors contributed to the conception, design, analysis, and interpretation of data for this work. All authors contributed in drafting, revising, and approving the final version of the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Heterotrait-monotrait (HTMT) credential interval.

DOCX File , 26 KB

Multimedia Appendix 2

Path analysis results for patients with and without chronic disease.

DOCX File , 18 KB

  1. Ranney ML, Griffeth V, Jha AK. Critical Supply Shortages — The Need for Ventilators and Personal Protective Equipment during the Covid-19 Pandemic. N Engl J Med 2020 Apr 30;382(18):e41. [CrossRef]
  2. Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA 2020 Mar 17;323(11):1061-1069 [FREE Full text] [CrossRef] [Medline]
  3. Baum A, Schwartz MD. Admissions to Veterans Affairs Hospitals for Emergency Conditions During the COVID-19 Pandemic. JAMA 2020 Jul 07;324(1):96-99 [FREE Full text] [CrossRef] [Medline]
  4. Hartnett KP, Kite-Powell A, DeVies J, Coletta MA, Boehmer TK, Adjemian J, National Syndromic Surveillance Program Community of Practice. Impact of the COVID-19 Pandemic on Emergency Department Visits - United States, January 1, 2019-May 30, 2020. MMWR Morb Mortal Wkly Rep 2020 Jun 12;69(23):699-704 [FREE Full text] [CrossRef] [Medline]
  5. Shachar C, Engel J, Elwyn G. Implications for Telehealth in a Postpandemic Future: Regulatory and Privacy Issues. JAMA 2020 Jun 16;323(23):2375-2376. [CrossRef] [Medline]
  6. Kim J, Choe P, Oh Y, Oh K, Kim J, Park SJ, et al. The First Case of 2019 Novel Coronavirus Pneumonia Imported into Korea from Wuhan, China: Implication for Infection Prevention and Control Measures. J Korean Med Sci 2020 Feb 10;35(5):e61 [FREE Full text] [CrossRef] [Medline]
  7. Her M. How Is COVID-19 Affecting South Korea? What Is Our Current Strategy? Disaster Med Public Health Prep 2020 Oct 03;14(5):684-686 [FREE Full text] [CrossRef] [Medline]
  8. Ae-ran K. Is the increase in corona 19 confirmation slowing, which increased by up to 900 people a day? [Korean]. Yonhap News. 2020 Mar 5.   URL: https://www.yna.co.kr/view/AKR20200305126100017 [accessed 2020-12-20]
  9. Kim DY. About 100,000 non-face-to-face treatments at 3,072 medical institutions Korean. akomnews.com. 2020 Apr 21.   URL: http://www.akomnews.com/bbs/board.php?bo_table=news&wr_id=39090 [accessed 2020-10-19]
  10. Kidholm K, Ekeland AG, Jensen LK, Rasmussen J, Pedersen CD, Bowes A, et al. A model for assessment of telemedicine applications: mast. Int J Technol Assess Health Care 2012 Jan;28(1):44-51. [CrossRef] [Medline]
  11. Rho MJ, Kim HS, Chung K, Choi IY. Factors influencing the acceptance of telemedicine for diabetes management. Cluster Comput 2014 Mar 12;18(1):321-331. [CrossRef]
  12. Mann DM, Chen J, Chunara R, Testa PA, Nov O. COVID-19 transforms health care through telemedicine: Evidence from the field. J Am Med Inform Assoc 2020 Jul 01;27(7):1132-1135 [FREE Full text] [CrossRef] [Medline]
  13. Vartabedian B. Telemedicine hype cycle and the future of remote care. 33 Charts. 2020 Jun 30.   URL: https://33charts.com/telemedicine-hype-cycle [accessed 2020-10-15]
  14. Grossman Z, Chodick G, Reingold SM, Chapnick G, Ashkenazi S. The future of telemedicine visits after COVID-19: perceptions of primary care pediatricians. Isr J Health Policy Res 2020 Oct 20;9(1):53 [FREE Full text] [CrossRef] [Medline]
  15. Davis FD. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 1989 Sep;13(3):319. [CrossRef]
  16. Jansen-Kosterink S, Dekker-van Weering M, van Velsen L. Patient acceptance of a telemedicine service for rehabilitation care: A focus group study. Int J Med Inform 2019 May;125:22-29. [CrossRef] [Medline]
  17. Hirani SP, Rixon L, Beynon M, Cartwright M, Cleanthous S, Selva A, et al. Quantifying beliefs regarding telehealth: Development of the Whole Systems Demonstrator Service User Technology Acceptability Questionnaire. J Telemed Telecare 2017 May;23(4):460-469. [CrossRef] [Medline]
  18. Gulliford M, Figueroa-Munoz J, Morgan M, Hughes D, Gibson B, Beech R, et al. What does 'access to health care' mean? J Health Serv Res Policy 2002 Jul;7(3):186-188. [CrossRef] [Medline]
  19. Zhou M, Zhao L, Kong N, Campy KS, Qu S, Wang S. Factors influencing behavior intentions to telehealth by Chinese elderly: An extended TAM model. Int J Med Inform 2019 Jun;126:118-127. [CrossRef] [Medline]
  20. Edwards L, Thomas C, Gregory A, Yardley L, O'Cathain A, Montgomery AA, et al. Are people with chronic diseases interested in using telehealth? A cross-sectional postal survey. J Med Internet Res 2014 May 08;16(5):e123 [FREE Full text] [CrossRef] [Medline]
  21. Donelan K, Barreto E, Sossong S, Michael C, Estrada J, Cohen AB, et al. Patient and clinician experiences with telehealth for patient follow-up care. Am J Manag Care 2019 Jan;25(1):40-44 [FREE Full text] [Medline]
  22. Barak A, Hen L, Boniel-Nissim M, Shapira N. A Comprehensive Review and a Meta-Analysis of the Effectiveness of Internet-Based Psychotherapeutic Interventions. Journal of Technology in Human Services 2008 Jul 03;26(2-4):109-160. [CrossRef]
  23. Jaana M, Paré G, Sicotte C. Home telemonitoring for respiratory conditions: a systematic review. Am J Manag Care 2009 May;15(5):313-320 [FREE Full text] [Medline]
  24. Esmatjes E, Jansà M, Roca D, Pérez-Ferre N, del Valle L, Martínez-Hervás S, Telemed-Diabetes Group. The efficiency of telemedicine to optimize metabolic control in patients with type 1 diabetes mellitus: Telemed study. Diabetes Technol Ther 2014 Jul;16(7):435-441. [CrossRef] [Medline]
  25. Polisena J, Coyle D, Coyle K, McGill S. Home telehealth for chronic disease management: a systematic review and an analysis of economic evaluations. Int J Technol Assess Health Care 2009 Jul;25(3):339-349. [CrossRef] [Medline]
  26. Venkatesh V, Davis FD. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science 2000 Feb;46(2):186-204. [CrossRef]
  27. Kohnke A, Cole ML, Bush R. Incorporating UTAUT Predictors for Understanding Home Care Patients' and Clinician's Acceptance of Healthcare Telemedicine Equipment. Journal of Technology Management & Innovation 2014 Jul;9(2):29-41. [CrossRef]
  28. Chang MK. Predicting Unethical Behavior: A Comparison of the Theory of Reasoned Action and the Theory of Planned Behavior. Journal of Business Ethics 1998;17(16):1825-1834. [CrossRef]
  29. Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010 Feb;43(1):159-172 [FREE Full text] [CrossRef] [Medline]
  30. Jimison HB, Sher PP. Consumer health informatics: Health information technology for consumers. J Am Soc Inf Sci 1995 Dec;46(10):783-790. [CrossRef]
  31. Or CKL, Karsh B, Severtson DJ, Burke LJ, Brown RL, Brennan PF. Factors affecting home care patients' acceptance of a web-based interactive self-management technology. J Am Med Inform Assoc 2011 Jan;18(1):51-59 [FREE Full text] [CrossRef] [Medline]
  32. Hall JL, McGraw D. For telehealth to succeed, privacy and security risks must be identified and addressed. Health Aff (Millwood) 2014 Feb;33(2):216-221. [CrossRef] [Medline]
  33. Hale TM, Kvedar JC. Privacy and Security Concerns in Telehealth. Virtual Mentor 2014 Dec 01;16(12):981-985 [FREE Full text] [CrossRef] [Medline]
  34. He D, Naveed M, Gunter CA, Nahrstedt K. Security Concerns in Android mHealth Apps. AMIA Annu Symp Proc 2014;2014:645-654 [FREE Full text] [Medline]
  35. Polizzi C, Lynn S, Perry A. Stress and coping in the time of COVID-19: Pathways to resilience and recovery. Clinical Neuropsychiatry: Journal of Treatment Evaluation 2020;17(2):59-62. [CrossRef]
  36. Gostin LO, Wiley LF. Governmental Public Health Powers During the COVID-19 Pandemic: Stay-at-home Orders, Business Closures, and Travel Restrictions. JAMA 2020 Jun 02;323(21):2137-2138. [CrossRef] [Medline]
  37. Al-Maroof RS, Salloum SA, Hassanien AE, Shaalan K. Fear from COVID-19 and technology adoption: the impact of Google Meet during Coronavirus pandemic. Interactive Learning Environments 2020 Oct 14:1-16. [CrossRef]
  38. Nicomedes CJC, Avila RMA. An analysis on the panic during COVID-19 pandemic through an online form. J Affect Disord 2020 Nov 01;276:14-22 [FREE Full text] [CrossRef] [Medline]
  39. Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int J Environ Res Public Health 2020 Mar 06;17(5) [FREE Full text] [CrossRef] [Medline]
  40. Roy D, Tripathy S, Kar SK, Sharma N, Verma SK, Kaushal V. Study of knowledge, attitude, anxiety & perceived mental healthcare need in Indian population during COVID-19 pandemic. Asian J Psychiatr 2020 Jun;51:102083 [FREE Full text] [CrossRef] [Medline]
  41. Bollen. Evaluating Effect, Composite, and Causal Indicators in Structural Equation Models. MIS Quarterly 2011;35(2):359. [CrossRef]
  42. Chin WW. Commentary: Issues and Opinion on Structural Equation Modeling. MIS Quarterly 1998;22(1):vii-xvi.
  43. Fornell C, Larcker DF. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research 1981 Feb;18(1):39. [CrossRef]
  44. Gefen D, Straub D, Boudreau M. Structural Equation Modeling and Regression: Guidelines for Research Practice. CAIS 2000;4. [CrossRef]
  45. Hair JF, Ringle CM, Sarstedt M. Partial Least Squares Structural Equation Modeling: Rigorous Applications, Better Results and Higher Acceptance. Long Range Planning 2013 Feb;46(1-2):1-12. [CrossRef]
  46. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. of the Acad. Mark. Sci 2014 Aug 22;43(1):115-135. [CrossRef]
  47. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 1999 Jan;6(1):1-55. [CrossRef]
  48. Hair Jr JF, Hult GTM, Ringle C, Sarstedt M. A Primer on Partial Least Squares Structural Equation Modeling (2nd ed). Thousand Oaks, CA: SAGE Publications; 2016.
  49. Henseler J, Hubona G, Ray PA. Using PLS path modeling in new technology research: updated guidelines. Industr Mngmnt & Data Systems 2016 Feb;116(1):2-20 [FREE Full text] [CrossRef]
  50. Tsai J, Cheng M, Tsai H, Hung S, Chen Y. Acceptance and resistance of telehealth: The perspective of dual-factor concepts in technology adoption. International Journal of Information Management 2019 Dec;49:34-44. [CrossRef]
  51. Deng Z, Hong Z, Ren C, Zhang W, Xiang F. What Predicts Patients' Adoption Intention Toward mHealth Services in China: Empirical Study. JMIR Mhealth Uhealth 2018 Aug 29;6(8):e172 [FREE Full text] [CrossRef] [Medline]
  52. Bashshur RL. Telemedicine effects: Cost, quality, and access. J Med Syst 1995 Apr;19(2):81-91. [CrossRef]
  53. Antypas K, Wangberg SC. An Internet- and mobile-based tailored intervention to enhance maintenance of physical activity after cardiac rehabilitation: short-term results of a randomized controlled trial. J Med Internet Res 2014 Mar 11;16(3):e77 [FREE Full text] [CrossRef] [Medline]
  54. Nomura A, Tanigawa T, Muto T, Oga T, Fukushima Y, Kiyosue A, et al. Clinical Efficacy of Telemedicine Compared to Face-to-Face Clinic Visits for Smoking Cessation: Multicenter Open-Label Randomized Controlled Noninferiority Trial. J Med Internet Res 2019 Apr 26;21(4):e13520 [FREE Full text] [CrossRef] [Medline]
  55. . Impact of COVID-19 on Telehealth. Am Health Drug Benefits 2020 Jun;13(3):125-126 [FREE Full text] [Medline]
  56. COVID-19 HCP sentiment surveys, part 1: physician engagement with patients and remote/telehealth experiences. Sermo. 2020.   URL: https://www.sermo.com/hcp-sentiment-study-series/ [accessed 2020-12-15]
  57. COVID-19 dashboard. CoronaBoard. 2020.   URL: https://coronaboard.kr/en/ [accessed 2020-12-15]
  58. Hong-jin K. 770,000 non-face-to-face treatments, half of internal medicine [Korean]. HIT News. 2020 Oct 29.   URL: http://www.hitnews.co.kr/news/articleView.html?idxno=30626 [accessed 2020-12-20]
  59. Paradigm shift in non-face-to-face care [Korean]. MediPost. 2020 Jul 6.   URL: http://www.bosa.co.kr/news/articleView.html?idxno=2129938 [accessed 2020-12-20]
  60. Coronavirus disease 2019 (COVID-19): People with certain medical conditions. Centers for Disease Control and Prevention. 2020.   URL: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/people-with-medical-conditions.html [accessed 2020-12-15]
  61. Holman H, Lorig K. Patient self-management: a key to effectiveness and efficiency in care of chronic disease. Public Health Rep 2004;119(3):239-243 [FREE Full text] [CrossRef] [Medline]
  62. Kim Y, Lee J, Moon Y, Kim KJ, Lee K, Choi J, et al. Unmet healthcare needs of elderly people in Korea. BMC Geriatr 2018 Apr 20;18(1):98 [FREE Full text] [CrossRef] [Medline]
  63. Mohktar MS, Redmond SJ, Antoniades NC, Rochford PD, Pretto JJ, Basilakis J, et al. Predicting the risk of exacerbation in patients with chronic obstructive pulmonary disease using home telehealth measurement data. Artif Intell Med 2015 Jan;63(1):51-59. [CrossRef] [Medline]
  64. Tuckson RV, Edmunds M, Hodgkins ML. Telehealth. N Engl J Med 2017 Oct 19;377(16):1585-1592. [CrossRef] [Medline]
  65. Ackerman MJ, Filart R, Burgess LP, Lee I, Poropatich RK. Developing next-generation telehealth tools and technologies: patients, systems, and data perspectives. Telemed J E Health 2010;16(1):93-95 [FREE Full text] [CrossRef] [Medline]
  66. Gokalp H, Clarke M. Monitoring activities of daily living of the elderly and the potential for its use in telecare and telehealth: a review. Telemed J E Health 2013 Dec;19(12):910-923. [CrossRef] [Medline]
  67. Blandford A, Wesson J, Amalberti R, AlHazme R, Allwihan R. Opportunities and challenges for telehealth within, and beyond, a pandemic. Lancet Glob Health 2020 Nov;8(11):e1364-e1365 [FREE Full text] [CrossRef] [Medline]
  68. Watzlaf VJM, Dealmeida DR, Zhou L, Hartman LM. Protocol for a Systematic Review of Telehealth Privacy and Security Research to Identify Best Practices. Int J Telerehabil 2015 Nov;7(2):15-22 [FREE Full text] [CrossRef] [Medline]
  69. FH® Healthcare Indicators and FH® Medical Price Index: An Annual View of Place of Service Trends and Medical Pricing. FAIR Health. 2019 Apr.   URL: https:/​/s3.​amazonaws.com/​media2.fairhealth.org/​whitepaper/​asset/​FH%20Healthcare%20Indicators%20and%20FH%20Medical%20Price%20Index%202019%20-%20A%20FAIR%20Health%20White%20Paper.​pdf [accessed 2020-12-15]
  70. Gagnon M, Duplantie J, Fortin J, Landry R. Implementing telehealth to support medical practice in rural/remote regions: what are the conditions for success? Implement Sci 2006 Aug 24;1:18 [FREE Full text] [CrossRef] [Medline]


AVE: average variance extracted
HIPAA: Health Insurance Portability and Accountability Act
HITEC: Health Information Technology for Economic and Clinical Health
HTMT: heterotrait-monotrait
PLS: partial least squares
RMS: root mean square
SRMR: standardized root mean square residual
TAM: technology acceptance model


Edited by G Eysenbach; submitted 02.11.20; peer-reviewed by S Ghaddar, M Mueller; comments to author 23.11.20; revised version received 22.12.20; accepted 24.12.20; published 08.01.21

Copyright

©Min Ho An, Seng Chan You, Rae Woong Park, Seongwon Lee. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 08.01.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.