Published on in Vol 9, No 11 (2021): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/32180, first published .
Health Professionals’ Perspectives on Electronic Medical Record Infusion and Individual Performance: Model Development and Questionnaire Survey Study

Health Professionals’ Perspectives on Electronic Medical Record Infusion and Individual Performance: Model Development and Questionnaire Survey Study

Health Professionals’ Perspectives on Electronic Medical Record Infusion and Individual Performance: Model Development and Questionnaire Survey Study

Authors of this article:

Rai-Fu Chen1 Author Orcid Image ;   Ju-Ling Hsiao2 Author Orcid Image

Original Paper

1Department of Information Management, Chia-Nan University of Pharmacy and Science, Tainan City, Taiwan

2Department of Pharmacy, Chia-Nan University of Pharmacy and Science, Tainan City, Taiwan

*all authors contributed equally

Corresponding Author:

Ju-Ling Hsiao, PhD

Department of Pharmacy

Chia-Nan University of Pharmacy and Science

Number 60, Sec 1, Erren Road

Rende District

Tainan City, 71710

Taiwan

Phone: 886 6 2664911 ext 5106

Email: mayo5012@gmail.com


Background: Electronic medical records (EMRs) are integrated information sources generated by health care professionals (HCPs) from various health care information systems. EMRs play crucial roles in improving the quality of care and medical decision-making and in facilitating cross-hospital health information exchange. Although many hospitals have invested considerable resources and efforts to develop EMRs for several years, the factors affecting the long-term success of EMRs, particularly in the EMR infusion stage, remain unclear.

Objective: The aim of this study was to investigate the effects of technology, user, and task characteristics on EMR infusion to determine the factors that largely affect EMR infusion. In addition, we examined the effect of EMR infusion on individual HCP performance.

Methods: A questionnaire survey was used to collect data from HCPs with >6 months experience in using EMRs in a Taiwanese teaching hospital. A total of 316 questionnaires were distributed and 211 complete copies were returned, yielding a valid response rate of 66.8%. The collected data were further analyzed using WarpPLS 5.0.

Results: EMR infusion (R2=0.771) was mainly affected by user habits (β=.411), portability (β=.217), personal innovativeness (β=.198), technostress (β=.169), and time criticality (β=.168), and individual performance (R2=0.541) was affected by EMR infusion (β=.735). This finding indicated that user (habit, personal innovativeness, and technostress), technology (portability), and task (mobility and time criticality) characteristics have major effects on EMR infusion. Furthermore, the results indicated that EMR infusion positively affects individual performance.

Conclusions: The factors identified in this study can extend information systems infusion theory and provide useful insights for the further improvement of EMR development in hospitals and by the government, specifically in its infusion stage. In addition, the developed instrument can be used as an assessment tool to identify the key factors for EMR infusion, and to evaluate the extent of EMR infusion and the individual performance of hospitals that have implemented EMR systems. Moreover, the results can help governments to understand the urgent needs of hospitals in implementing EMR systems, provide sufficient resources and support to improve the incentives of EMR development, and develop adequate EMR policies for the meaningful use of electronic health records among hospitals and clinics.

JMIR Med Inform 2021;9(11):e32180

doi:10.2196/32180

Keywords



Background

Electronic medical records (EMRs), as an important health information technology (HIT), have been developed to solve problems arising from the use of paper medical records, including the difficulty in searching for information, incompleteness of information, illegibility of handwriting, difficulty in management and storage, and inaccessibility [1]. EMRs are computerized medical information systems that collect, store, and display patient information generated by health care professionals (HCPs) from various health care information systems, including hospital information systems (HISs), picture archiving and communication systems, laboratory information systems, radiology information systems, and others [2]. EMR systems can be regarded as both electronic health record (EHR) systems and clinical information systems to provide clinical (including patient history and clinical notes, prescription management and patient demographics, and patient care management), communicational (visualization of results, communication with other institutions, and electronic transfers), and administrative (appointments scheduling and distance access, and billing and data security) functionalities [3]. Therefore, EMRs play a crucial role in improving the care quality, continuity, safety, efficiency, and decision-making in health care, and facilitate the cross-hospital exchange of health information [1,2,4-9].

Prior studies found positive correlations between information technology (IT)/information system (IS) utilization and individual and organizational performance [10-12]. With the wide-ranging use of HITs in the health care industry, understanding the usage behavior of HCPs is an important research topic for further HIT development. Underutilization of a system is often a major problem contributing to lack of complete infusion or integration of the implemented IS into employees’ daily work or organizational processes after it is introduced [13,14]. Underutilization of a system has been considered as one of the key causes for a system not meeting the initial expectations in increasing productivity and yielding reasonable returns [15-17]. IS infusion, the final stage of the IS development process in Cooper and Zmud’s [18] IS implementation model, is defined as using the system to its full potential in an extended, integrative, and emergent way. Organizations can fully leverage their investments in IS infusion because users voluntarily go beyond standardized system usage and exploit the system’s full potential to improve their task performance [19,20]. Despite being recognized as critical to the long-term success of an IS, particularly for full realization of its potential [19], relatively little attention has focused on how infusion occurs [3,14,21-23]. In addition, some studies argued that most IS infusion studies have mainly focused on technological aspects at an organizational level rather than an individual level [22-24]. This is a problem as the results obtained from such studies cannot offer useful suggestions and improvements to major system users for further explorative, integrative, and future use, and may further cause negative effects in individual and organizational performance derived from use of the IT/IS.

Although EMRs can provide clinical and operational benefits, EMR adoption is lagging because of user resistance and other barriers [2]. Most EMR-related studies have mainly focused on issues that arise in the early stage of EMR development, particularly for investigating the factors or barriers affecting EMR adoption or acceptance [2,9,25-32]. Trudel et al [33] found that an increase in EMR adoption does not lead to physicians’ progress in using EMR systems during EMR assimilation, which are the routinization and infusion stages mentioned by Cooper and Zmud [18]. Raymond et al [34] called for a deeper understanding of the factors leading to greater performance outcomes from EMR systems after extended EMR use. Moreover, Bhattacherjee [35] confirmed that the long-term success of an IT/IS depends on its continued use rather than its first use, and the influencing factors toward the use of an IT/IS may vary in various IT/IS implementation stages. Ng and Kim [36] argued that IS infusion requires the authentic motivation of users, which is not the case for IS adoption and continuance, and they indicated a lack of understanding about the authentic motivations leading to infusion in the existing literature. Due to the paucity of HIT infusion studies [21,22], the factors (motivations) concerning EMR infusion in the context in which EMR systems are being integrated in clinical settings and incorporated in routine practice should be evaluated. Identification and understanding of the key determinants and consequents of EMR infusion will be helpful to minimize the gaps between IT practitioners and HCPs in EMR design and implementation, and enable further improvements to meet organizational expectations.

Numbeo [37] reported that the health care system of Taiwan ranks first among 93 countries. The successful implementation of HIS and EMRs with full integration of various ITs/ISs in health care institutes is considered the key to the early success of cross-hospital exchange of EMRs in Taiwan. For example, during the COVID-19 pandemic, authorized HCPs in Taiwanese clinics or hospitals can request patient medical records within 3 months and check patients’ travel history, occupation, contact history, and cluster history using the patient’s health insurance card information to help reduce the infection risk to HCPs and to enable electronic transfer, if necessary, for providing better patient care. Although many Taiwanese hospitals have invested substantial resources and efforts to develop EMRs, with long-term government support for eHealth and EMR development since 2009, factors that affect the long-term success of EMR infusion and performance remain unclear. This situation calls for further research from a practical perspective to provide significant insights for EMR development, particularly in the EMR infusion stage, and the results may further provide contributions to HIT development.

Moreover, the initial success of EMR adoption and acceptance does not ensure its long-term success in terms of its incorporation into the daily operating procedures of hospitals in the technology infusion stage. Therefore, the purpose of this study was to understand the determinants and consequences (performance impacts) of EMR infusion at the individual level. The research questions addressed in this study were: (1) What are the salient factors (motivations) of technology, task, and user influencing EMR infusion by HCPs? (2) How do these factors (motivations) influence EMR infusion and performance?

Prior Related Studies

IT Infusion and Performance

ITs and ISs have the potential to substantially improve the operational effectiveness and efficiency of an organization if used appropriately. IT implementation is a dynamic IT adaption process in organizations with various stages, including initiation, adoption, adaptation, acceptance, routinization, and infusion, as identified by Cooper and Zmud [18] based on a technological diffusion approach. This general IT implementation model has been widely accepted and used in the IS discipline by various users and contexts for exploring the key factors influencing different implementation stages of specific systems. The IT postadoption stages, including IT acceptance, routinization, and infusion as defined by Cooper and Zmud [18], are often the main focus of such research because they are highly relevant to actual IT usage and organizations can observe the realized benefits obtained through IT usage [15,36].

Saga and Zmud [20] investigated the nature and determinants of IT acceptance, routinization, and infusion, and they identified key variables and determinants related to various IT postadoption stages. They found that standardized use, use perceived as “normal,” and administration infrastructure development are key characteristics of IT/IS routinization, whereas extended use, integrative use, and emergent use of IT/IS can be represented as the measurement variables for IT/IS infusion. For the IT implementation stages, IT assimilation and IT infusion are two relevant and similar concepts but with slight differences in nature and the applied theories. Armstrong and Sambamurthy [38] defined IT/IS assimilation as “the success achieved by firms in utilizing the capabilities of IT/IS to enhance their business performance.” IT/IS assimilation can bring significant business value if IT/IS becomes a routinized element of value-chain activities and business strategies in a firm [18,38]. They further argued that IT assimilation “focuses more on the extent of which IT has been infused into specific business activities” and “how effectively IT is enabling the conduct of those activities relative to rivals.” Thus, IT/IS assimilation can be viewed as a broader and integrative stage across IT/IS routinization and infusion stages [18].

Some well-known theoretical models have been proposed and validated for IT/IS postadoption stages, including technology adoption [17,39,40], IS continuance [35], and IS infusion [41,42]. Technology acceptance models (TAMs) are widely used for IT/IS evaluation in the technology adoption stage [17,39,40], whereas IS continuance models are used for evaluation in the IS routinization stage [35]. Ng and Kim [36] argued that most IS research has placed substantial attention on initial system adoption and continuance; however, only few IS infusion studies have been performed to date, which have produced mixed and inconclusive results due to the lack of consideration of the authentic motivation of users in IS infusion. Tennant et al [23] argued that existing implemented systems are often underutilized or not used effectively. They suggested focusing on a deeper level of usage (ie, the infusion stage) that can enhance work tasks and performance. Tennant et al [23] summarized the definitions of infusion used by researchers into two main types: (1) use of IT in a more comprehensive and integrated manner to support the higher-level aspects of organizational work, resulting in the use of IT at its full potential [18]; and (2) the extent to which the full potential of innovation has been embedded in an organization’s (or individual’s) work system [43].

Ng and Kim [36] investigated the relationships between user empowerment, which is regarded as the authentic motivation derived from psychological empowerment theory, and IS infusion. They also examined the moderating effect of habit between user empowerment dimensions and IS infusion types. The results showed that user empowerment dimensions have significant effects on the IS infusion types. In addition, the moderating role of habit between motivations of user empowerment and IS infusion (extended use and integrative use) was confirmed. O’Connor et al [22] and Tennant et al [23] argued that the majority of infusion studies have largely focused on technological aspects at an organizational level rather than an individual level. This may lead to difficulty in the extent to which the full potential of IT/IS can be embedded in an organization’s or individual’s work system. Tennant et al [23] proposed a conceptual research model based on concepts derived from the system usage perspective reported by Burton-Jones and Straub [44] and the task-technology fit (TTF) perspective described by Goodhue and Thompson [10] to examine IS infusion and performance. According to the research model, factors related to the characteristics of the system, individual or user, and task are the antecedents of IS infusion, which may subsequently affect an individual’s performance. Although the IS infusion model proposed by Tennant et al [23] provided a starting point to understand the nature of IS infusion and its effects on consequences, the model should be further validated in various contexts.

Performance evaluation is a key surrogate measure for IS success within the IS discipline in the postimplementation stage [10-12]. Goodhue and Thompson [10] proposed a TTF model by integrating the perspectives of fit and utilization focus to explore the antecedents (task, technology, and individual factors) of TTF, and the relationship between TTF, utilization, and individual performance. They reported that IT/IS can positively affect individual performance if the technology is used (utilization) and is a good fit for the supported task. Some studies have adopted the TTF model to investigate task, technology, and individual fit, and to explore their effects on individual performance [45,46]. By contrast, other studies have examined IT/IS models by incorporating the TTF construct across various contexts (user groups, technologies, and tasks) [47-49]. For example, Hsaio and Chen [45] examined the TTF of mobile nursing ISs for nursing performance on the basis of the TTF model. Dishaw and Strong [48] integrated two IT utilization models (TTF and TAM, as an extension of the TAM with the TTF construct) and found that the integrated model had more explanatory power than each individual model (TTF or TAM) and facilitated a more favorable understanding of IT utilization.

The TTF model has been considered as the core of investigating IS infusion and its effect on individual performance [21-23]. In a study based on the TTF perspective, Tennant et al [23] indicated that future studies related to IS infusion should incorporate the elements of user, task, and system, because IS infusion involves the use of technologies that assist individuals in performing their tasks. Hsaio and Chen [50] and O’Connor et al [21,22] proposed research models by incorporating user, task, and system characteristics as the determinants to investigate mobile health (mHealth) continuance and infusion based on the TTF perspective. In addition, Goodhue and Thompson [10] indicated that the feedback mechanism of performance may affect subsequent TTF, utilization, and performance. For the long-term evaluation of an IS, the fit among the task, technology, and individual should be evaluated, and the IS should be continuously used for supporting the tasks. Thus, this process of IS infusion may affect individual performance.

EMR-Related Studies

HIMSS Analytics defined an EMR as “an application environment composed of the clinical data repository, clinical decision support, controlled medical vocabulary, order entry, computerized provider order entry, pharmacy, and clinical documentation applications.” Moreover, the environment contains patients’ EMRs across inpatient and outpatient services, and is used by HCPs to document, monitor, and manage health care delivery within a health care organization [2]. Boonstra and Broekhuis [2] mentioned that EMRs are computerized medical information systems that collect, store, and display patient information. Yamamoto and Khan [9] indicated that the perceived advantages of EMRs include:

optimizing the documentation of patient encounters, improving the communication of information among physicians, improving access to patient medical information, reducing errors, optimizing billing, improving reimbursement for services, forming a data repository for research and quality improvement, and reducing the use of papers.

Furthermore, EMRs designed to document patient care information and enable data sharing among clinicians [29,51] can disrupt work practices, thus causing a significant decrease in productivity with their initial use [52,53].

EMR systems are viewed as both EHR systems and clinical information systems in hospital settings to provide clinical, communicational, and administrative functionalities [3]. Among the investigated three functionalities, Raymond et al [3] found that clinical functionalities can explain why certain primary care physicians make more extended use of EHRs than others because clinical functionalities can better support or fit their main medical tasks. The core components of an EHR are administrative functions, computerized physician order entry, lab systems, radiology systems, pharmacy systems, and clinical documentation [54]. Raymond et al [3] indicated that EHR systems have been slowly adopted by health care providers in the United States due to the challenges of costly software packages, system security, patient confidentiality, and unknown future government regulations.

Although the appropriate use of EMRs can improve quality, continuity, safety, and efficiency in health care, they have not been widely adopted in health care institutions as expected because of resistance among HCPs [2]. To understand the key barriers to the use of EMRs, Boonstra and Broekhuis [2] performed a comprehensive systematic review of studies related to the use of EMRs among physicians in the early stage of EMR development in health care institutions. They identified the following 8 key barriers affecting physicians’ acceptance of EMR implementation: organizational, process change, financial, technical, time, psychological, social, and legal barriers. O’Donnell et al [55] investigated primary care physicians’ attitudes toward EMR adoption and proposed a clinical adoption framework to understand the disparate performance among health care institutions in EMR implementation. Some studies have explored EMR adoption based on technological evaluation theories, namely the theory of planned behavior and the unified theory of acceptance and use of technology (UTAUT) [56-58]. Ahmed et al [56] investigated predicators of intention to use EMR based on the expanded UTAUT model (UTAUT2). They identified performance expectancy, effort expectancy, social influence, facilitating conditions, and computer literacy as key predicators of intention to use EMRs by health care providers; however, hedonic motivation and habit had no significant effect on intention to use EMRs. In addition, Sayyah Gilani et al [59] performed a study on EMR continuance intention of HCPs based on technology continuance theory. They found that EMR continuance was influenced by attitude and satisfaction. Attitude is mainly influenced by perceived ease of use, perceived usefulness, and satisfaction, whereas satisfaction is influenced by perceived usefulness and confirmation. In turn, perceived usefulness is affected by perceived ease of use and confirmation.

However, previous studies have argued that the scope of these theories is limited because they do not address the causes related to the adoption process, specifically for the postimplementation stage [28,57,60]. In addition, Trudel et al [33] reported the presence of the ceiling effect on EMR assimilation based on their observation that the growth of EMR adoption does not lead to physicians’ progress in using EMR systems. Raymond et al [34] called for a deeper understanding of the factors leading to greater performance outcomes from EMR systems after extended EMR use. Goh et al [61] proposed a dynamic process model based on adaptive structuration theory for improving understanding of the interplay between HIT and patterns of clinical work embodied in daily routines. O’Connor et al [21] investigated the determinants (factors adapted from technology, user, and task) of individual infusion of mHealth technologies and their subsequent outcomes. In their conceptual model, technology, user, and task were considered key enablers of successful mHealth infusion, and mHealth infusion led to improvements in preventative care, greater decision-making, and reduced medical errors. O’Connor et al [22] further proposed an mHealth infusion model to investigate the effects of the characteristics of technology (availability, maturity, and portability), individuals (habits, self-efficacy, and technology trust), and tasks (time criticality, interdependence, and mobility) on the integrative and exploratory use of mHealth infusion by HCPs and the relationship between mHealth infusion and performance.

Bhattacherjee [35] indicated that the long-term success of an IS depends on its continued use in the postimplementation stage, and proposed the expectation confirmation model (ECM) to understand IS continuance by examining the relationships among confirmation, perceived usefulness, satisfaction, and IS continuance. In addition, the author indicated that the key factors determined for IS acceptance are not necessarily crucial in the IS postimplementation or infusion stage. This finding implied that factors affecting ISs may exert different effects on different IS implementation stages. Hsaio and Chen [50] investigated the determinants of HCPs’ perspectives on mHealth continuance and performance based on the ECM proposed by Bhattacherjee [35] and the mHealth infusion model proposed by O’Connor et al [22]. They found that mHealth continuance is mainly affected by perceived usefulness, technology maturity, individual habits, task mobility, and user satisfaction, whereas individual performance is substantially affected by mHealth continuance.

The aforementioned findings provide the theoretical basis for this study in terms of understanding the effects of the antecedents of EMR infusion (task, technology, and individual characteristic) on the exploratory, integrative, and future (emergent) use of EMRs, and the subsequent effects on individual performance.


Research Model

On the basis of the results reported by Hsaio and Chen [50] and O’Connor et al [22] regarding mHealth infusion, and those by Goodhue and Thompson [10] regarding the TTF model, we constructed an EMR infusion model to investigate the effects of technology, user, and task characteristics on EMR infusion by HCPs and their subsequent effects on individual performance. In addition, some variables mentioned by Hsaio and Chen [50] and O’Connor et al [22] were included to accommodate the EMR utilization and health care context in Taiwan. In this study, we excluded self-efficacy and technology trust from the user characteristics reported by O’Connor et al [22] because self-efficacy was reported to be a nonsignificant factor affecting HCPs’ IT acceptance [62,63]. EMRs have been developed, used (not mandatorily), and incorporated into daily procedures in Taiwanese hospitals for several years; thus, technology trust was not considered in this model. In addition, personal innovativeness of IT and technostress were added as variables in the research model. Rai et al [64] indicated that personal innovativeness positively and significantly affected mHealth usage intention and assimilation. Technostress is an emergent problem derived from the pervasive use of technologies, which may significantly affect individual productivity and daily life [65]. We considered that EMR use in its infusion stage may be affected by technostress exerting an effect on EMR infusion and individual performance. However, the effects of personal innovativeness and technostress on EMR infusion and performance should be empirically validated. Thus, the research model (Figure 1) involved nine EMR infusion antecedents: accessibility, maturity, portability (technology), time criticality, interdependence, mobility (task), EMR infusion, and individual performance (the outcomes of EMR infusion). The measurement, operational definition, and number of items for the variables investigated in this study are summarized in Table 1.

The technology characteristics examined in this study included accessibility (availability), maturity, and portability; these factors determine the functionality or usability of an EMR. The task characteristics examined in this study included time criticality, interdependence, and mobility. The user characteristics examined in this study included personal innovativeness in IT, technostress, and habit. These characteristics represent individual traits and perceptions toward the use of IT.

Figure 1. Research model. EMR: electronic medical record. H: hypothesis.
View this figure
Table 1. Measurement and operational definitions of variables.
ConstructOperational definitionReferencesNumber of items
Technology characteristics

AccessibilityThe ability of accessing EMRa information when requiredGebauer et al [66], Liang et al [67]3

MaturityThe existence of a level of EMR quality that is perceived as satisfactory and the perceived need for system improvement by the userO’Connor et al [22], Liang et al [67]5

PortabilityThe degree of ease associated with transporting the EMRO’Connor et al [22], Gebauer et al [66]3
Task characteristics

Time criticalityThe urgency when accessing information through the EMRO’Connor et al [22], Liang et al [67]3

InterdependenceThe degree to which completing tasks using the EMR requires interaction with other peopleHsiao and Chen [45], Gebauer et al [66]3

MobilityThe extent to which a task is being performed in different locations using the EMRGebauer et al [66], Liang et al [67]3
User characteristics

Personal innovativenessWillingness to try out any new technologyAgarwal and Prasad [68], Thatcher and Perrewe [69]4

TechnostressA problem of adaptation resulting from the health care professional’s inability to cope with EMR use in a healthy mannerRagu-Nathan et al [70], Tu et al [71]5

HabitThe extent to which an individual tends to use the EMR automaticallyLimayem et al [72], Venkatesh et al [73]3

EMR infusionThe extent of EMR infusion related to the exploratory, integrative, and future use of EMRO’Connor et al [22], Tennant et al [23]9

Individual performanceThe extent to which EMR use (continuance) can improve the health care professional’s efficiency, effectiveness, and quality of medical activitiesJunglas et al [74]8

aEMR: electronic medical record.

EMR infusion is the extent of the exploratory, integrative, and future use of the EMR. Individual performance is defined as the improvement in HCPs’ efficiency, effectiveness, and quality of medical activities through EMR continuance (use). O’Connor et al [22] and Tennant et al [23] reported that IT assimilation and infusion are two types of uses that are beyond routine use and refer to a deeper level of usage that enhances work tasks and performance. Technology, task, and user characteristics are considered key antecedents that affect IS infusion or continuance [22,23,50] and the extent of IS infusion can affect individual performance. However, not all technology, task, and user characteristics examined by Hsaio and Chen [50] were reported to be significant antecedents, implying that the factors affecting IS infusion may vary among different technology, task, and user groups. Thus, the antecedents of EMR infusion should be empirically examined and tested for long-term EMR system evaluation. We proposed four research hypotheses with nine subhypotheses, which are summarized in Textbox 1.

Research hypotheses and subhypotheses.

H1: The technology characteristics of health care professionals (HCPs) significantly affect electronic medical record (EMR) infusion

  • H1a: The accessibility of an EMR significantly affects EMR infusion
  • H1b: The maturity of an EMR significantly affects EMR infusion
  • H1c: The portability of an EMR significantly affects EMR infusion

H2: The task characteristics of HCPs significantly affect EMR infusion

  • H2a: Task time criticality significantly affects EMR infusion
  • H2b: Task interdependence significantly affects EMR infusion
  • H2c: Task mobility significantly affects EMR infusion

H3: The user characteristics of HCPs significantly affect EMR infusion

  • H3a: Personal innovativeness in information technology significantly affects EMR infusion
  • H3b: Technostress significantly affects EMR infusion
  • H3c: Individual habit significantly affects EMR infusion

H4: EMR infusion significantly affects individual performance

Textbox 1. Research hypotheses and subhypotheses.

Instrument and Respondents

The respondents were HCPs (doctors and nurses) who worked at different departments in the case hospital, and we elaborated rigorous instrument design processes to minimize the potential risks of common method bias derived from a single-respondent questionnaire-based survey as reported by Podsakoff et al [75]. In the first stage, we established 50 preliminary measurement items by referencing the literature and validated the instrument to ensure its appropriateness for the purpose of this study. Individual performance was measured using 8 items adapted from the study of Junglas et al [74]. EMR infusion was assessed with 9 items adapted from the studies of O’Connor et al [22] and Tennant et al [23]. Technology characteristics, namely accessibility, maturity, and portability, were measured using 11 items adapted from studies conducted by Gebauer et al [66], Liang et al [67], and O’Connor et al [22]. Task characteristics, namely time criticality, interdependence, and mobility, were measured using 9 items adapted from Gebauer et al [66], Hsiao and Chen [45], Liang et al [67], and O’Connor et al [22]. User characteristics, namely personal innovativeness, technostress, and habit, were measured using 12 items adapted from Agarwal and Prasad [68], Limayem et al [72], Ragu-Nathan et al [70], Thatcher and Perrewe [69], Tu et al [71], and Venkatesh et al [73].

The second stage of the questionnaire design focused on the evaluation and selection of the measurement items. To evaluate the content validity of the questionnaire, the content validity index (CVI) was calculated, and a threshold value of >0.80 was recommended [76]. Two experts on EMRs and one health informatics professional were invited to examine the content validity of the instrument. One item in habit was excluded because its value was <0.80, and the average CVI of the questionnaire was 0.98. Ultimately, a final research questionnaire consisting of 49 items was developed, and each item of the questionnaire was scored on a 5-point Likert scale (1 for strongly disagree and 5 for strongly agree). The detailed description of the research instrument can be found in Multimedia Appendix 1. The questionnaire consisted of two major parts. The first part focused on the demographic data of respondents, namely age, sex, educational level, and experience using the EMR in the hospital. The second part included measurement items related to the antecedents of EMR, EMR infusion, and individual performance.

To ensure that the data collected were in line with the research objectives, only HCPs with >6 months experience using the EMR in the case hospital were included as participants in this study. A total of 120 doctors and 500 nurses from hospitals in southern Taiwan were recruited. The case hospital has been using EMRs since 2009 to improve their quality of care, continuity, safety, efficiency, and medical decision-making. In addition, the case hospital obtained the EMR accreditation issued by the Ministry of Health and Welfare of Taiwan. This certification indicates that the core EMR functionality can provide the services of cross-hospital health information exchange and EHRs with the support of the existing IT and IS infrastructure.

Model Evaluation

Measurement Model

The collected data were further analyzed using WarpPLS 5.0 [77], with the partial-least squares (PLS) approach to perform extensive, scalable, and flexible casual modeling [78]. Chin [79] suggested using the PLS technique to analyze measurement and structural models. Several common model data fit and quality indices are recommended for WarpPLS because of their advantages compared with other variance-based structural equation modeling (SEM) methods, including the average path coefficient (APC), average R2 (ARS), average adjusted R2 (AARS), average block variance inflation factor (AVIF), average full collinearity variance inflation factor (AFVIF), Tenenhaus goodness of fit (GoF), and R2 contribution ratio (RSCR) [77]. Kock [77] indicated that the addition of latent variables into a model can increase the ARS value but reduce the APC value; however, both ARS and APC can increase concurrently only when the addition of variance can improve the predictive and explanatory qualities of the overall model. The AARS is used to correct inappropriate increases in R2 coefficients when predictors cannot adequately improve the explanatory value of each latent variable [77]. Both AVIF and AFVIF are often used to evaluate the collinearity of a model if new latent variables are added. Kock [80] mentioned that if all variance inflation factors resulting from a full collinearity test are equal to or lower than 3.3, the model can be considered free of common method bias for PLS-SEM. The GoF is an index used to evaluate the explanatory power of a model, and RSCR is used to examine the degree to which a model is free from negative R2 effects [77].

Structural Model

WarpPLS 5.0 with the bootstrap resampling method was used to analyze the structural model, which was mainly evaluated using the path coefficient (β) and R2 value. Path coefficients represent the strength and direction of the relationship between variables, and they are meaningful to research if they achieve a statistically significant level. R2 values indicate the total variance of dependent variables explained by influencing variables, demonstrating the predictive power of the investigated model.

Ethical Considerations

To address potential ethical concerns, our study protocol and informed consent forms were reviewed and approved by the institutional review board (IRB) of St. Martin De Porres Hospital in Taiwan before the distribution and collection of surveys. After receiving approval from the IRB of the target hospital (IRB-15B-021), we obtained voluntary and verbal consent from the study participants. The requirement to document consent was waived. The responses of HCPs were anonymous and unidentified.


Demographic Data and Descriptive Statistics

The questionnaire was administered to collect data from HCPs who worked at the case hospital at the time of the survey and had at least 6 months of experience in using EMRs. A total of 316 questionnaires were distributed and 211 complete copies were returned, resulting in a valid response rate of 66.8%. Voluntary participation might explain the relatively high response rate. According to the collected demographic data (Table 2), most of the respondents were aged <40 years, were women, and had a bachelor’s or higher degree. Furthermore, over 70% of the respondents worked in the nursing department and the remaining respondents worked in the medical department. In addition, 93.4% (203/211) of the respondents had >1 year of experience in using EMRs, indicating the representativeness of the participants. Among the investigated demographic variables, experience in using the EMR and respondents’ department were found to be significantly related to EMR infusion and performance responses based on analysis of variance. This is reasonable because doctors are heavy EMR users, and users with abundant experience in using EMRs tend to have more positive attitudes toward exploratory, integrative, and future EMR use, and a better performance evaluation.

Table 2. Demographic characteristics of the respondents (N=211).
CharacteristicRespondents, n (%)
Age (years)

<3073 (34.6)

31-4091 (43.1)

41-5031 (14.7)

51-6011 (5.2)

> 605 (2.4)
Gender

Male52 (24.7)

Female159 (75.3)
Education level

Junior college29 (13.8)

Bachelor169 (80.1)

Master (or higher)13 (6.1)
Experience in hospital (years)

<18 (3.8)

1-342 (19.9)

3-656 (26.6)

6-936 (17.0)

>969 (32.7)
Experience in using EMRsa(years)

<114 (6.6)

1-3102 (48.4)

3-560 (28.4)

>535 (16.6)
Department

Nursing150 (71.1)

Medical61 (28.9)

aEMR: electronic medical record.

Table 3 shows the descriptive statistics of responses to the original questionnaire, including 49 items of the 11 investigated constructs used in this study. Among the constructs, the mean scores were the highest for time criticality, followed by performance, interdependence, portability, habit, technostress, mobility, accessibility, EMR infusion, maturity, and personal innovativeness in IT. Time criticality, performance, and interdependence were the top three variables and had mean scores greater than 4.0, whereas personal innovativeness in IT had the lowest mean score of the investigated variables. This implied that participating HCPs have a more positive evaluation toward EMR use for supporting their task characteristics (time criticality and interdependence); however, they do not demonstrate excellent personal innovativeness in IT. We further evaluated the item appropriateness and consistency of the measured constructs among domain experts. In total, 42 items were used for further PLS-SEM analysis and 7 items were excluded.

Table 3. Descriptive statistics of constructs and their respective items.
ConstructScore, mean (SD)Range
ACCa3.85 (0.65)1-5

ACC13.94 (0.55)2-5

ACC23.83 (0.66)2-5

ACC33.77 (0.73)1-5
PORb3.96(.64)2-5

POR1c4.10 (0.68)2-5

POR23.88 (0.64)2-5

POR33.91 (0.61)2-5
MATd3.78 (0.67)1-5

MAT13.68 (0.71)2-5

MAT23.64 (0.76)1-5

MAT33.85 (0.60)2-5

MAT4c3.88 (0.61)2-5

MAT53.85 (0.60)2-5
TCe4.05 (0.62)1-5

TC1c3.89 (0.66)1-5

TC24.08 (0.60)2-5

TC34.18 (0.61)2-5
INTf4.02 (0.65)2-5

INT14.09 (0.65)2-5

INT24.02 (0.64)2-5

INT33.96 (0.67)2-5
MOBg3.89 (0.66)1-5

MOB13.91 (0.71)1-5

MOB23.93 (0.60)2-5

MOB33.83 (0.68)2-5
PIh3.60 (0.72)1-5

PI13.48 (0.70)1-5

PI13.43 (0.75)1-5

PI3c3.72 (0.73)2-5

PI4c3.76 (0.70)2-5
TSi3.90 (0.67)2-5

TS13.90 (0.71)2-5

TS23.90 (0.61)2-5

TS34.10 (0.64)2-5

TS44.15 (0.62)2-5

TS5c3.47 (0.78)2-5
HABj3.96 (0.57)3-5

HAB14.02 (0.56)3-5

HAB23.93 (0.57)3-5

HAB33.93 (0.59)3-5
INFk3.82 (0.64)1-5

INF1 (EUl1)3.71 (0.69)2-5

INF2 (EU23.62 (0.71)2-5

INF3 (EU3)3.64 (0.66)2-5

INF4 (IUm1)3.97 (0.60)2-5

INF5 (IU2)3.91 (0.60)3-5

INF6 (IU3)3.96 (0.58)3-5

INF7 (FUn1)3.97 (0.65)2-5

INF8 (FU2)4.00 (0.61)2-5

INF9 (FU3)c3.59 (0.67)1-5
PERo4.05 (0.58)2-5

PER14.20 (0.59)3-5

PER24.15 (0.55)3-5

PER34.02 (0.56)3-5

PER44.00 (0.57)3-5

PER54.00 (0.53)3-5

PER64.06 (0.56)3-5

PER74.03 (0.61)3-5

PER8c3.94 (0.63)2-5

aACC: accessibility.

bPOR: portability.

cExcluded from further analysis.

dMAT: maturity.

eTC: time criticality.

fINT: interdependence.

gMOB: mobility.

hPI: personal innovativeness in information technology.

iTS: technostress.

jHAB: habit.

kINF: electronic medical record infusion.

lEU: exploratory use.

mIU: integrative use.

nFU: future use.

oPER: performance.

Measurement Model

As shown in Table 4, the results demonstrated that all of the model data fit and quality indices met the criteria suggested by Kock [77]. All of the APC, ARS, and AARS values exceeded the recommended values, thereby indicating a highly satisfactory fit. The AVIF and AFVIF values indicated the absence of the collinearly problem in the model, demonstrating that the model can be considered free of common method bias as suggested by Kock [80]. The GoF value also exceeded the suggested value, indicating a satisfactory fit, and the RSCR value indicated an excellent fit. These findings validated the data fit and quality indices of the EMR infusion model.

Table 4. Model fit and quality indices.
Fit indicesValueCriteriaResult
Average path coefficient0.193 (P<.001)P<.05Fit
Average R20.529 (P<.001)P<.05Fit
Average adjusted R20.521 (P<.001)P<.05Fit
Average block VIFa1.954Acceptable if ≤5, ideally ≤ 3.3Fit
Average full collinearity VIF2.324Acceptable if ≤5, ideally ≤3.3Fit
Tenenhaus GoFb0.618Small, ≥0.1; medium, ≥0.25; large, ≥0.36Fit
R2 contribution ratio1.000Acceptable if ≥0.9, ideally=1Fit

aVIF: variance inflation factor.

bGoF: goodness of fit.

We further evaluated the reliability and validity (convergent and discriminant validity) of the instrument as suggested by previous studies [79,81,82]. Hair et al [82] suggested evaluating the reliability and internal consistency of each construct as reflective indicators by performing principal component analysis. They recommended a cut-off value of >.70 for Cronbach α and composite reliability (CR). Furthermore, Fornell and Larcker [81] indicated that the value of average variance extracted (AVE) should exceed 0.5, and each square correlation should have adequate convergent and discriminant validity. As shown in Table 5, the Cronbach α (>.798), CR (>0.734), and AVE (>0.604) values of all constructs exceeded the recommended cut-off values, indicating satisfactory reliability and convergent validity. One criterion for adequate discriminant validity is that the square root of the AVE for each construct should exceed the correlation coefficient between the construct and other constructs in the research model [79]. All square roots of AVE values in this study (diagonals in Table 5) were higher than the correlation coefficients (off-diagonals in Table 5), indicating satisfactory discriminant validity. These findings demonstrated the adequate reliability, convergent validity, and discriminant validity of the model.

Table 5. Correlations among variables, and the reliability and validity of the research model.
VariablesCorrelationsaAVEb (>0.5)CRc (>0.7)Cronbach α (>.7)

ACCdPOReMATfTCgINThMBiTSjPIkHBlINFmPERn


ACC0.7920.6860.6430.5820.5810.5010.3820.5980.4120.5500.4560.6280.761.830
POR0.6860.8300.7150.5380.4140.3740.4390.4810.6190.6630.5760.6890.753.822
MAT0.6430.7150.7870.5460.4800.3210.3700.3750.4490.5380.4600.6190.801.870
TC0.5820.5380.5460.8990.6530.5760.4820.2940.4300.5180.4980.8080.871.855
INT0.5810.4140.4800.6530.8560.6580.4290.3360.3090.5170.4470.7320.857.881
MB0.5010.3740.3210.5760.6580.8310.5370.4430.2950.5700.3210.6910.823.868
TS0.3820.4390.3700.4820.4290.5370.8050.3530.5310.6350.4530.8120.875.866
PI0.5980.4810.3750.2940.3360.4430.3530.9010.3180.4990.3140.6480.827.798
HB0.4120.6190.4490.4300.3090.2950.5310.3180.8650.6750.7040.7490.899.925
INF0.5500.6630.5380.5180.5170.5700.6350.4990.6750.7770.8030.6040.734.801
PER0.4560.5760.4600.4980.4470.3210.4530.3140.7040.6620.8030.6450.892.931

aThe values in the diagonal are square roots of the AVE and the off-diagonal elements are the correlation coefficients (r) among constructs.

bAVE: average variance extracted.

cCR: composite reliability.

dACC: accessibility.

ePOR: portability.

fMAT: maturity.

gTC: time criticality.

hINT: interdependence.

iMOB: mobility.

jPI: personal innovativeness in information technology.

kTS: technostress.

lHAB: habit.

mINF: electronic medical record infusion.

nPER: performance.

Structural Model

As shown in Figure 2, among the four major hypotheses (including nine subhypotheses) of this study, those related to technology characteristics (only H1c was positively supported) and task characteristics (only H2a and H2c were positively supported) were partially supported. However, all of the subhypotheses (H3a, H3b, and H3c) related to user characteristics were significantly supported. The results revealed that EMR infusion was mainly affected by portability among technology characteristics; time criticality and mobility among task characteristics; and personal innovation, technostress, and habit among user characteristics. Habit (H3a), portability (H1c), personal innovativeness (H3a), technostress (H3b), time criticality (H2a), and mobility (H2c) were identified as key factors affecting EMR infusion according to their relative effects on EMR infusion by ranking. In addition, individual performance was significantly affected by EMR infusion (H4). We further examined the direct effects, indirect effects, and total effects of the research variables, specifically for the mediation analysis of technology, task, and user characteristics (through infusion) on performance. As shown in Table 6, technostress, habit, personal innovativeness in IT, and mobility had significant mediating (indirect) effects through infusion on EMR performance.

Figure 2. Results of model validity.
View this figure
Table 6. Direct, indirect, and total effects (β values) of research variables.
VariableTSaHABbINTcTCdMOBeMATfPORgACChPIiINFj
INF (direct effect).169 (P=.005) .411 (P<.001).141.031.145.059.217.047.110N/Ak
PERl

Direct effectN/AN/AN/AN/AN/AN/AN/AN/AN/A.735 (P<.001)

Indirect effect.124 (P=.03).302 (P=.001).104 (P=.04)–.023.106 (P=.04).043.159–.034.081N/A

Total effect.124 (P=.005).302 (P=.001).104.023.106.043.159.034.081.735 (P<.001)

aTS: time criticality.

bHAB: habit.

cINT: interdependence.

dTC: time criticality.

eMOB: mobility.

fMAT: maturity.

gPOR: portability.

hACC: accessibility.

iPI: personal innovativeness in information technology.

jINF: electronic medical record infusion.

kN/A: not applicable.

lPER: performance.


Principal Findings

The results revealed that EMR infusion (R2=0.771) was mainly affected by user habits (β=.411), portability (β=.217), personal innovativeness (β=.198), technostress (β=.169), and time criticality (β=.168), whereas individual performance (R2=0.541) was affected by EMR infusion (β=.735). This finding indicated that user (habit, personal innovativeness, and technostress), technology (portability), and task (mobility and time criticality) characteristics have major influences on EMR infusion. Furthermore, the results indicated that EMR infusion positively affected individual performance. Consistent with the findings of previous IS infusion and TTF studies [10,21-23,50], EMR infusion was found to be affected by technology, task, and user (individual) characteristics. However, not all investigated technology, task, and user characteristics were found to be significant for EMR infusion. The results of this study revealed that among technology characteristics, only portability (β=.217) affected EMR infusion; however, the effects of accessibility and maturity on EMR infusion were not as expected. Portability is the degree of ease associated with transporting EMRs [22,66]. This finding is in accordance with the result reported by O’Connor et al [22] but is not consistent with that reported by Hsaio and Chen [50] for mHealth infusion. EMRs are computerized medical information systems that collect, store, and display patient information [2]; thus, they can be easily transported to HCPs to fulfill their needs. This finding may explain why portability was found to be a significant factor affecting EMR infusion.

O’Connor et al [22] reported that task characteristics, namely time criticality, interdependence, and mobility, were considered to be salient factors affecting mHealth infusion; however, Hsaio and Chen [50] found that mobility was the only significant factor affecting mHealth continuance. We found that among task characteristics, time criticality (β=.168) and mobility (β=.143) affected EMR infusion. The tasks of HCPs are complex and time-critical, and require mobility, specifically for providing services in inpatient and emergency departments. Real-time and accurate information obtained from an EMR is critical to increase efficiency and effectiveness in patient care duties [45]. These findings explain why time criticality and mobility were significant factors affecting EMR infusion. Consistent with the results of Hsaio and Chen [45,50], interdependence was found to be insignificant for EMR infusion.

This study found that user characteristics, namely personal innovativeness (β=.198), technostress (β=.217), and habit (β=.411), significantly affect EMR infusion. All three user characteristics exerted significantly stronger effects compared with those of technology and task characteristics on EMR infusion. This finding implied that user characteristics are the key antecedents of EMR infusion. The individual habit of EMR use showed a consistent result with the findings of O’Connor et al [22] and Hsaio and Chen [50]; however, personal innovativeness was not observed to be a significant factor in the context of mHealth [50]. Previous studies have reported that habit can affect future behavior if technology use becomes a habit as routine behavior [83,84], which is consistent with the findings of this study. The result of personal innovativeness in this study is also in accordance with that reported by Rai et al [64], who confirmed that personal innovativeness positively and significantly affected IS usage intention and assimilation. Consistent with the results reported by La Torre et al [65], we found that technostress significantly affected EMR infusion and individual productivity.

In this study, EMR infusion referred to the extent of EMR infusion related to the exploratory, integrative, and future use of EMRs, whereas individual performance was defined as the improvement in HCPs’ efficiency, effectiveness, and quality of medical activities through EMR continuance (use). Previous studies have indicated that IT assimilation and infusion are two types of use that are beyond routine use, and refer to a deeper level of usage that enhances work tasks and performance [22,23]. Consistent with findings of previous studies [22,23,50], this study indicated that EMR infusion significantly affected its outcomes (individual performance). We also found that technostress, habit, personal innovativeness in IT, and mobility have significant mediating (indirect) effects through EMR infusion on EMR performance. This implied that technostress, habit, and personal innovativeness in IT have both positive and significant direct effects on EMR infusion and indirect effects on EMR performance. Moreover, mobility was found to only have positive and significant indirect effects on EMR performance. Therefore, we should pay more attention to these significant factors of EMR infusion and performance.

We performed an additional analysis to determine HCPs’ performance based on EMR use. As shown in Table 3 (PER1-PER8), the top three items were as follows in descending order: PER1 (“EMR use accelerates information exchange with other members of the health care team”; score=4.20), PER2 (“EMR use reduces information retrieval time in clinical care practice”; score=4.15), and PER6 (“EMR use can make me more efficient at patient care”; score=4.06). Of all the items investigated, most respondents only provided a high and positive evaluation toward EMR performance, and only the mean value of the item “EMR use facilitates estimating and managing the costs of patient care” did not exceed 4 (mean 3.94, SD 0.63), indicating that this item had a slightly lower value than the other items. The results confirmed that EMR use can improve HCPs’ performance (mean 4.05, SD 0.58) related to efficiency, effectiveness, and quality of medical activities.

Contributions to Medical Informatics Theory

Previous studies have suggested investigating the IS infusion chain, including the antecedents of IS infusion and the outcomes of IS infusion at the individual level with broader considerations, to examine the extent to which the full potential of ITs and ISs has been embedded in an organization’s or individual’s work system [22,23]. This study attempted to determine the reasons underlying the ceiling effect in EMR assimilation observed by Trudel et al [33]. From the theoretical perspective of TTF, the results of this study are in accordance with those reported by Goodhue and Thompson [10], who indicated that IT/IS can positively affect individual performance if the technology has been used continuously (utilization) and is a good fit for the supported task (TTF) in the EMR context. For the long-term evaluation of an IS, the fit among task, technology, and individual should be evaluated for the IS, and the IS should be continuously used for supporting the tasks. Thus, the IS infusion process can substantially affect individual performance. The appropriate, integrative, and exploratory use of EMRs in the infusion stage can significantly improve quality of care, continuity, safety, efficiency, and medical decision-making, and facilitate the exchange of cross-hospital health information and EHRs [1,2,4-9].

This is one of the few studies to specifically focus on EMR infusion by considering technology, task, and user aspects, and to examine EMR infusion effects on individual performance. The results of this study can be helpful for extending IS infusion research and identifying critical factors affecting EMR assimilation and infusion where EMRs have been deeply incorporated into the daily operating procedures of hospitals. In addition, EMR design and implementation should meet HCP task needs, particularly for time critically and mobility, and technology needs, specifically for EMR portability. Moreover, future studies can extend the results of this study by incorporating different behavioral theories and factors as the antecedents of IS infusion, and investigating their effects on IS infusion and individual performance. We found that accessibility (availability) and maturity among technology characteristics and interdependence among task characteristics were insignificant factors for EMR infusion. Therefore, additional studies should be performed to validate the factors investigated in the research model because their effects on IS infusion may vary depending on technology, task, and user groups. In addition, inspired by Kim et al [85] on what clinical information is valuable to doctors toward using a mobile EMR, we suggest that further studies pay attention to investigating the critical clinical information and functionalities of EMRs used by different HCPs in EMR infusion and to what extent they can effectively support their tasks with long-term technology use.

Contributions to Medical Informatics Practice

The key factors identified in this study provide useful insights for the further improvement of EMR development in hospitals and the government, specifically for the infusion stage. In addition, the developed instrument can be used as an assessment tool for identifying the key considerations of EMR infusion, and for evaluating the extent of the EMR infusion and individual performance of hospitals that have implemented EMR systems. The results can help the government to understand the urgent needs of hospitals in implementing EMRs, provide sufficient resources and support for improving the incentives of EMR development, and develop adequate EMR policies for the widespread use of health information exchanges and EHRs. Future studies should focus attention on these characteristics, specifically user characteristics (personal innovativeness, technostress, and habit) and task characteristics (time critical and mobility), to further facilitate EMR infusion. Our findings indicate that the routine use of EMRs by HCPs in their daily workflow processes can reduce their technostress related to the use of EMRs and increase their perceived personal innovativeness, thus promoting EMR infusion.

Limitations

This study has several limitations. First, we collected samples from a regional teaching hospital in Taiwan, restricting the generalization of the findings to other medical institutions. Second, the data were derived from questionnaires provided to participants with more than 6 months experience in using EMRs. Respondents answered questions based on their perceptions, experiences, and understanding. Thus, the data collected may not be adequately objective. However, due to the nature of this study (exploratory research), the quality of the collected data is acceptable. Furthermore, this study was based on a sample of voluntary participants. This type of recruitment is not considered to have negatively affected the results because this approach is commonly used in the field.

Acknowledgments

The authors sincerely extend their gratitude and recognition to the Ministry of Science and Technology of Taiwan (MOST109-2410-H-041-001) and Chia-Nan University of Pharmacy and Science of Taiwan (CN10417) for funding this study.

Authors' Contributions

All authors participated sufficiently in the work to take public responsibility for appropriate portions of the content. RFC and JLH were responsible for study conception and design. JLH performed data acquisition. RFC and JLH performed analysis and interpretation of data. RFC and JLH drafted the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Questionnaire for EMR infusion and performance.

DOCX File , 17 KB

  1. Ayatollahi H, Bath PA, Goodacre S. Paper-based versus computer-based records in the emergency department: staff preferences, expectations, and concerns. Health Informatics J 2009 Sep;15(3):199-211 [FREE Full text] [CrossRef] [Medline]
  2. Boonstra A, Broekhuis M. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res 2010 Aug 06;10:231 [FREE Full text] [CrossRef] [Medline]
  3. Raymond L, Paré G, Marchand M. Extended use of electronic health records by primary care physicians: Does the electronic health record artefact matter? Health Informatics J 2017 Apr 01;25(1):146045821770424482 [FREE Full text] [CrossRef] [Medline]
  4. Angst CM, Devaraj S, D'Arcy J. Dual role of IT-assisted communication in patient care: a validated structure-process-outcome framework. J Manag Inf Syst 2014 Dec 08;29(2):257-292. [CrossRef]
  5. Garets D, Davis M. Electronic Medical Records vs Electronic Health Records: Yes, There Is a Difference. A HIMSS Analytics White paper. Teh and Associates.   URL: https://www.tehandassociates.com/wp-content/uploads/2017/03/WP_EMR_EHR.pdf [accessed 2021-07-17]
  6. Klar R. Selected impressions on the beginning of the electronic medical record and patient information. Methods Inf Med 2004;43(5):537-542. [Medline]
  7. The introduction of EMR promotion in Taiwan. Ministry of Health and Welfare. 2015.   URL: https://emr.mohw.gov.tw/emr/introduction.aspx [accessed 2021-07-17]
  8. Wen H, Chang W, Hsu M, Ho C, Chu C. An assessment of the interoperability of electronic health record exchanges among hospitals and clinics in Taiwan. JMIR Med Inform 2019 Mar 28;7(1):e12630 [FREE Full text] [CrossRef] [Medline]
  9. Yamamoto LG, Khan ANGA. Challenges of electronic medical record implementation in the emergency department. Pediatr Emerg Care 2006 Mar;22(3):184-91; quiz 192. [CrossRef] [Medline]
  10. Goodhue D, Thompson R. Task-technology fit and individual performance. MIS Quart 1995 Jun;19(2):213-236. [CrossRef]
  11. DeLone WH, McLean ER. Information systems success: the quest for the dependent variable. Inf Syst Res 1992 Mar;3(1):60-95. [CrossRef]
  12. DeLone WH, McLean ER. The DeLone and McLean Model of information systems success: a ten-year update. J Manag Inf Syst 2014 Dec 23;19(4):9-30. [CrossRef]
  13. Aral S, Brynjolfsson E, Van AM. Information, technology,information worker productivity: Task-level evidence. 2006 Presented at: ICIS2006 Proceedings; 2006; Milwaukee, WI p. 285-306. [CrossRef]
  14. Kim H, Gupta S. A user empowerment approach to information systems infusion. IEEE Trans Eng Manage 2014 Nov;61(4):656-668. [CrossRef]
  15. Jasperson J, Carter PE, Zmud RW. A comprehensive conceptualization of post-adoptive behaviors associated with information technology enabled work systems. MIS Quart 2005;29(3):525. [CrossRef]
  16. Marcolin BL, Compeau DR, Munro MC, Huff SL. Assessing user competence: conceptualization and measurement. Inf Syst Res 2000 Mar;11(1):37-60. [CrossRef]
  17. Venkatesh V, Morris M, Davis G, Davis F. User acceptance of information technology: toward a unified view. MIS Quart 2003;27(3):425-478. [CrossRef]
  18. Cooper RB, Zmud RW. Information technology implementation research: a technological diffusion approach. Manag Sci 1990 Feb;36(2):123-139. [CrossRef]
  19. Hsieh P, Rai A, Xu S. Extracting business value from IT: a sensemaking perspective of post-adoptive use. Manag Sci 2011 Nov;57(11):2018-2039. [CrossRef]
  20. Saga V, Zmud R. The nature determinants of IT acceptance, routinization and infusion. In: Levine L, editor. Diffusion, transfer and implementation of information technology. Amsterdam: Elsevier; 1994:67-86.
  21. O'Connor Y, O’Rahailligh PJ, O’Donoghue J. Individual infusion of m-health technologies: Determinants and outcomes. 2012 Presented at: 20th European Conference on Information Systems; 2012; Barcelona, Spain p. 64.
  22. O'Connor Y, O'Reilly P, O'Donoghue J. M-health infusion by healthcare practitioners in the national health services (NHS). Health Policy Technol 2013 Mar;2(1):26-35. [CrossRef]
  23. Tennant V, Mills A, Chin W. Investigating information system infusion at the individual level: re-conceptualisation and operationalization. 2011 Jul 7 Presented at: 15th Pacific Asia Conference on Information Systems; 2011; Brisbane, Australia   URL: https://aisel.aisnet.org/pacis2011/189
  24. Hassandoust F, Techatassanasoontorn AA, Tan FB. Factors influencing the infusion of information systems: a literature review. Pacif Asia J Assoc Inf Syst 2016;8(1):1-32. [CrossRef]
  25. Davidson E, Heslinga D. Bridging the IT adoption gap for small physician practices: an action research study on electronic health records. Inf Syst Manag 2006 Dec 22;24(1):15-28. [CrossRef]
  26. DesRoches CM, Campbell EG, Rao SR, Donelan K, Ferris TG, Jha A, et al. Electronic health records in ambulatory care--a national survey of physicians. N Engl J Med 2008 Jul 03;359(1):50-60. [CrossRef] [Medline]
  27. Jung SY, Hwang H, Lee K, Lee H, Kim E, Kim M, et al. Barriers and facilitators to implementation of medication decision support systems in electronic medical records: mixed methods approach based on structural equation modeling and qualitative analysis. JMIR Med Inform 2020 Jul 22;8(7):e18758 [FREE Full text] [CrossRef] [Medline]
  28. Kim S, Lee K, Hwang H, Yoo S. Analysis of the factors influencing healthcare professionals' adoption of mobile electronic medical record (EMR) using the unified theory of acceptance and use of technology (UTAUT) in a tertiary hospital. BMC Med Inform Decis Mak 2016 Jan 30;16:12 [FREE Full text] [CrossRef] [Medline]
  29. B. Meinert D. Resistance to Electronic Medical Records (EMRs): A Barrier to Improved Quality of Care. Issues Informing Sci Inf Technol 2005;2:494-504. [CrossRef]
  30. Miller RH, Sim I. Physicians' use of electronic medical records: barriers and solutions. Health Aff (Millwood) 2004;23(2):116-126. [CrossRef] [Medline]
  31. Mohd H, Mohamad S. Acceptance model of electronic medical record. J Adv Inf Manag Stud 2005 Jun;2(1):75-92.
  32. Randeree E. Exploring physician adoption of EMRs: a multi-case analysis. J Med Syst 2007 Dec;31(6):489-496. [CrossRef] [Medline]
  33. Trudel M, Marsan J, Paré G, Raymond L, Ortiz de Guinea A, Maillet É, et al. Ceiling effect in EMR system assimilation: a multiple case study in primary care family practices. BMC Med Inform Decis Mak 2017 Apr 20;17(1):46 [FREE Full text] [CrossRef] [Medline]
  34. Raymond L, Paré G, Ortiz de Guinea A, Poba-Nzaou P, Trudel M, Marsan J, et al. Improving performance in medical practices through the extended use of electronic medical record systems: a survey of Canadian family physicians. BMC Med Inform Decis Mak 2015 Apr 14;15:27 [FREE Full text] [CrossRef] [Medline]
  35. Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Quart 2001 Sep;25(3):351-370. [CrossRef]
  36. Ng E, Kim H. Investigating information systems infusion and the moderating role of habit: A user empowerment perspective. 2009 Presented at: ICIS 2009 Proceedings; 2009; Phoenix, AZ   URL: https://aisel.aisnet.org/icis2009/137
  37. Health Care Index by Country 2020. Numbeo. 2020.   URL: https://www.numbeo.com/health-care/rankings_by_country.jsp?title=2020&displayColumn=0 [accessed 2021-07-17]
  38. Armstrong CP, Sambamurthy V. Information technology assimilation in firms: the influence of senior leadership and IT infrastructures. Inf Syst Res 1999 Dec;10(4):304-327. [CrossRef]
  39. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quart 1989 Sep;13(3):319-340. [CrossRef]
  40. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci 2000 Feb;46(2):186-204. [CrossRef]
  41. Jones E, Sundaram S, Chin W. Factors leading to sales force automation use: a longitudinal analysis. J Pers Sell Sales Manag 2002;XXII(3):145-156. [CrossRef]
  42. Wang W, Hsieh P. Beyond routine: Symbolic adoption, extended use, and emergent use of complex information systems in the mandatory organizational context. 2006 Presented at: ICIS 2006; 2006; Milwaukee, WI   URL: http://aisel.aisnet.org/icis2006/48
  43. Zmud RW, Apple LE. Measuring technology incorporation/infusion. J Product Innov Manag 1992 Jun;9(2):148-155. [CrossRef]
  44. Burton-Jones A, Straub DW. Reconceptualizing system usage: an approach and empirical test. Inf Syst Res 2006 Sep;17(3):228-246. [CrossRef]
  45. Hsiao J, Chen R. An investigation on task-technology fit of mobile nursing information systems for nursing performance. Comput Inform Nurs 2012 May;30(5):265-273. [CrossRef] [Medline]
  46. Lin TC. Mobile nursing information system utilization: the task-technology fit perspective. Comput Inform Nurs 2014 Mar;32(3):129-137. [CrossRef] [Medline]
  47. Abbas SK, Hassan HA, Asif J, Ahmed B, Hassan F, Haider SS. Integration of TTF, UTAUT, and ITM for mobile banking adoption. Int J Manag Sci Eng Manag 2018;4(5):375-379. [CrossRef]
  48. Dishaw MT, Strong DM. Extending the technology acceptance model with task–technology fit constructs. Inf Manag 1999 Jul;36(1):9-21. [CrossRef]
  49. Shih Y, Chen C. The study of behavioral intention for mobile commerce: via integrated model of TAM and TTF. Qual Quant 2011 Aug 30;47(2):1009-1020. [CrossRef]
  50. Hsiao JL, Chen RF. Understanding determinants of health care professionals' perspectives on mobile health continuance and performance. JMIR Med Inform 2019 Mar 18;7(1):e12350 [FREE Full text] [CrossRef] [Medline]
  51. Lim SY, Jarvenpaa SL, Lanham HJ. Barriers to interorganizational knowledge transfer in post-hospital care transitions: review and directions for information systems research. J Manag Inf Syst 2015 Dec 16;32(3):48-74. [CrossRef]
  52. Kellermann AL, Jones SS. What it will take to achieve the as-yet-unfulfilled promises of health information technology. Health Aff (Millwood) 2013 Jan;32(1):63-68. [CrossRef] [Medline]
  53. Mennemeyer ST, Menachemi N, Rahurkar S, Ford EW. Impact of the HITECH Act on physicians' adoption of electronic health records. J Am Med Inform Assoc 2016 Mar;23(2):375-379 [FREE Full text] [CrossRef] [Medline]
  54. Seymour T, Frantsvog D, Graeber T. Electronic health records (EHR). Am J Health Sci 2012 Jul 13;3(3):201-210. [CrossRef]
  55. O'Donnell A, Kaner E, Shaw C, Haighton C. Primary care physicians' attitudes to the adoption of electronic medical records: a systematic review and evidence synthesis using the clinical adoption framework. BMC Med Inform Decis Mak 2018 Nov 13;18(1):101 [FREE Full text] [CrossRef] [Medline]
  56. Ahmed MH, Bogale AD, Tilahun B, Kalayou MH, Klein J, Mengiste SA, et al. Intention to use electronic medical record and its predictors among health care providers at referral hospitals, north-West Ethiopia, 2019: using unified theory of acceptance and use technology 2(UTAUT2) model. BMC Med Inform Decis Mak 2020 Sep 03;20(1):207 [FREE Full text] [CrossRef] [Medline]
  57. Duncan T. An examination of physician resistance related to electronic medical records adoption. Thesis Doctor of Business Administration. Walden Dissertations and Doctoral Studies. 2015.   URL: http://scholarworks.waldenu.edu/dissertations/1257/ [accessed 2021-07-17]
  58. Seeman E, Gibson, S. S. Predicting acceptance of electronic medical records: Is the technology acceptance model enough? SAM Adv Manag J 2009;74(4):21.
  59. Sayyah Gilani M, Iranmanesh M, Nikbin D, Zailani S. EMR continuance usage intention of healthcare professionals. Inform Health Soc Care 2017 Mar;42(2):153-165. [CrossRef] [Medline]
  60. Duncan T, Rahim E. Challenges in healthcare post-EMR adoption. 2018 May Presented at: 13th Midwest United States Association for Information Systems; 2018; Missouri, USA   URL: https://aisel.aisnet.org/mwais2018/9
  61. Goh JM, Gao G, Agarwal R. Evolving work routines: adaptive routinization of information technology in healthcare. Inf Syst Res 2011 Sep;22(3):565-585. [CrossRef]
  62. Chen RF, Hsiao JL. An investigation on physicians' acceptance of hospital information systems: a case study. Int J Med Inform 2012 Dec;81(12):810-820. [CrossRef] [Medline]
  63. Hsiao JL, Chang HC, Chen RF. A study of factors affecting acceptance of hospital information systems: a nursing perspective. J Nurs Res 2011 Jun;19(2):150-160. [CrossRef] [Medline]
  64. Rai A, Chen L, Pye J, Baird A. Understanding determinants of consumer mobile health usage intentions, assimilation, and channel preferences. J Med Internet Res 2013 Aug 02;15(8):e149 [FREE Full text] [CrossRef] [Medline]
  65. La Torre G, De Leonardis V, Chiappetta M. Technostress: how does it affect the productivity and life of an individual? Results of an observational study. Public Health 2020 Dec;189:60-65. [CrossRef] [Medline]
  66. Gebauer J, Shaw MJ, Gribbins ML. Task-technology fit for mobile information systems. J Inf Technol 2010 Sep 01;25(3):259-272. [CrossRef]
  67. Liang TP, Huang CW, Yeh YH, Lin B. Adoption of mobile technology in business: a fit‐viability model. Industr Mngmnt Data Systems 2007 Oct 02;107(8):1154-1169. [CrossRef]
  68. Agarwal R, Prasad J. A conceptual and operational definition of personal innovativeness in the domain of information technology. Inf Syst Res 1998 Jun;9(2):204-215. [CrossRef]
  69. Thatcher JB, Perrewe PL. An empirical examination of individual traits as antecedents to computer anxiety and computer self-efficacy. MIS Quart 2002 Dec;26(4):381-396. [CrossRef]
  70. Ragu-Nathan TS, Tarafdar M, Ragu-Nathan BS, Tu Q. The consequences of technostress for end users in organizations: conceptual development and empirical validation. Inf Syst Res 2008 Dec;19(4):417-433. [CrossRef]
  71. Tu Q, Wang K, Shu Q. Computer-related technostress in China. Commun ACM 2005 Apr;48(4):77-81. [CrossRef]
  72. Limayem M, Hirt SG, Cheung CM. How habit limits the predictive power of intention: the case of information systems continuance. MIS Quart 2007;31(4):705-737. [CrossRef]
  73. Venkatesh V, Thong JY, Xu X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Quart 2012;36(1):157-178. [CrossRef]
  74. Junglas I, Abraham C, Ives B. Mobile technology at the frontlines of patient care: Understanding fit and human drives in utilization decisions and performance. Decis Support Syst 2009 Feb;46(3):634-647. [CrossRef]
  75. Podsakoff PM, MacKenzie SB, Lee J, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 2003 Oct;88(5):879-903. [CrossRef] [Medline]
  76. Petrick JF. Development of a multi-dimensional scale for measuring the perceived value of a service. J Leisure Res 2017 Dec 13;34(2):119-134. [CrossRef]
  77. Kock N. WarpPLS 5.0 user manual. ScriptWarp Systems. 2015.   URL: http://cits.tamiu.edu/WarpPLS/UserManual_v_5_0.pdf [accessed 2021-07-17]
  78. Lowry PB, Gaskin J. Partial least squares (PLS) structural equation modeling (SEM) for building and testing behavioral causal theory: when to choose it and how to use it. IEEE Trans Profess Commun 2014 Jun;57(2):123-146. [CrossRef]
  79. Chin WW. Bootstrap cross-validation indices for PLS path model assessment. In: Esposito V, Chin WW, Henseler J, Wang H, editors. Handbook of partial least squares concepts, methods and applications. Berlin, Germany: Springer Nature; 2010:83-97.
  80. Kock N. Common method bias in PLS-SEM: a full collinearity assessment approach. Int J e-Collab 2015;11(4):1-10. [CrossRef]
  81. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Market Res 1981 Feb;18(1):39-50. [CrossRef]
  82. Hair Jr J, Sarstedt M, Hopkins L, Kuppelwieser VG. Partial least squares structural equation modeling (PLS-SEM): an emerging tool in business research. Eur Bus Rev 2014 Mar 04;26(2):106-121. [CrossRef]
  83. Gefen D. TAM or just plain habit: a look at experienced online shoppers. J Organ End User Comp 2003;15(3):1-13. [CrossRef]
  84. Ouellette JA, Wood W. Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior. Psychol Bull 1998 Jul;124(1):54-74. [CrossRef]
  85. Kim J, Lee Y, Lim S, Kim JH, Lee B, Lee J. What clinical information is valuable to doctors using mobile electronic medical records and when? J Med Internet Res 2017 Oct 18;19(10):e340 [FREE Full text] [CrossRef] [Medline]


AARS: average adjusted R2
AFVIF: average full collinearity variance inflation factor
APC: average path coefficient
ARS: average R2
AVE: average variance extracted
AVIF: average block variance inflation factor
CR: composite reliability
CVI: content validity index
ECM: expectation confirmation model
EHR: electronic health record
EMR: electronic medical record
GoF: Tenenhaus Goodness of Fit
HCP: health care professional
HIS: health information system
HIT: health information technology
IRB: institutional review board
IS: information system
IT: information technology
mHealth: mobile health
PLS: partial least squares
RSCR: R2 contribution ratio
SEM: structural equation model
TAM: technology acceptance model
TTF: task-technology fit
UTAUT: unified theory of acceptance and use of technology


Edited by G Eysenbach; submitted 18.07.21; peer-reviewed by L Raymond; comments to author 10.08.21; revised version received 07.10.21; accepted 17.10.21; published 30.11.21

Copyright

©Rai-Fu Chen, Ju-Ling Hsiao. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 30.11.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.