This paper is in the following e-collection/theme issue:

Reviews in Medical Informatics (93) Organizational Issues (154) Policy (56) Quality Improvement (253) Design and Usability of Clinical Software and EHRs (268) Electronic Health Records (1053) mHealth in a Clinical Setting (615) Physician and Healthcare Worker Burnout (109) Occupational Health and Ergonomics/Prevention at the Workplace (238)

Published on in Vol 12 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54811, first published .
Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis

Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis

Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis

Authors of this article:

Yuxuan Wu1 Author Orcid Image ;   Mingyue Wu2 Author Orcid Image ;   Changyu Wang3 Author Orcid Image ;   Jie Lin4 Author Orcid Image ;   Jialin Liu1, 2 Author Orcid Image ;   Siru Liu5 Author Orcid Image
Article Authors Cited by (1) Tweetations (2) Metrics

    Review

    1Department of Medical Informatics, West China Hospital, Sichuan University, Chengdu, China

    2Information Center, West China Hospital, Sichuan University, Chengdu, China

    3West China College of Stomatology, Sichuan University, Chengdu, China

    4Department of Oral Implantology, West China Hospital of Stomatology, Sichuan University, Chengdu, China

    5Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States

    *these authors contributed equally

    Corresponding Author:

    Jialin Liu, MD

    Information Center

    West China Hospital

    Sichuan University

    37 Guoxue Road

    Chengdu, 610041

    China

    Phone: 86 28 85422306

    Fax:86 28 85582944

    Email: Dljl8@163.com


    Background: Burnout among health care professionals is a significant concern, with detrimental effects on health care service quality and patient outcomes. The use of the electronic health record (EHR) system has been identified as a significant contributor to burnout among health care professionals.

    Objective: This systematic review and meta-analysis aims to assess the prevalence of burnout among health care professionals associated with the use of the EHR system, thereby providing evidence to improve health information systems and develop strategies to measure and mitigate burnout.

    Methods: We conducted a comprehensive search of the PubMed, Embase, and Web of Science databases for English-language peer-reviewed articles published between January 1, 2009, and December 31, 2022. Two independent reviewers applied inclusion and exclusion criteria, and study quality was assessed using the Joanna Briggs Institute checklist and the Newcastle-Ottawa Scale. Meta-analyses were performed using R (version 4.1.3; R Foundation for Statistical Computing), with EndNote X7 (Clarivate) for reference management.

    Results: The review included 32 cross-sectional studies and 5 case-control studies with a total of 66,556 participants, mainly physicians and registered nurses. The pooled prevalence of burnout among health care professionals in cross-sectional studies was 40.4% (95% CI 37.5%-43.2%). Case-control studies indicated a higher likelihood of burnout among health care professionals who spent more time on EHR-related tasks outside work (odds ratio 2.43, 95% CI 2.31-2.57).

    Conclusions: The findings highlight the association between the increased use of the EHR system and burnout among health care professionals. Potential solutions include optimizing EHR systems, implementing automated dictation or note-taking, employing scribes to reduce documentation burden, and leveraging artificial intelligence to enhance EHR system efficiency and reduce the risk of burnout.

    Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42021281173; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021281173

    JMIR Med Inform 2024;12:e54811

    doi:10.2196/54811

    Keywords

    clinical decision support system; electronic health record; electronic medical record; health information technology; alert fatigue; burnout; health care professionals; health care service; EHR; systematic review; meta-analysis; health information system; clinician burnout; health informatics 


    The integration of electronic health record (EHR) into health care systems marks the beginning of a new era in medical information management, with significant potential benefits for patient care, clinical decision-making, and administrative efficiency [1,2]. EHR systems are central to the modern health care infrastructure [3]. Along with these benefits, however, the widespread adoption of EHR systems has raised concerns about the well-being of health care professionals [4,5]. Unintended consequences, such as burnout among health care professionals, technology-related errors, and increased safety risks, have been associated with EHR use [4,6,7]. In addition, a notable part of the problems with EHR systems in the United States is the need to provide additional documentation for insurance companies [8].

    Within the realm of EHR use, burnout among health care professionals, characterized by emotional exhaustion, depersonalization, and a diminished sense of personal accomplishment, has emerged as a critical concern [9,10]. Burnout among health care professionals has become a pressing public health concern [11-13]. Some studies have reported an average burnout prevalence of 44% [2], with rates exceeding 80% in some specific settings and departments [4,5] such as primary care and emergency departments. This pervasive problem affects not only health care professionals but also patients, with negative consequences such as reduced quality of care and increased medical errors and psychological problems [14-17]. The estimated annual cost of burnout among health care professionals due to medical negligence and staff turnover exceeds US $4 billion [18].

    The phenomenon of burnout among health care professionals goes beyond individual distress and has significant implications for patient safety, quality of care, and overall health system performance [14,15,19]. Understanding the prevalence and underlying factors of EHR-related burnout among health care professionals is critical to developing effective interventions and policy adaptations. These interventions are essential to mitigate this burden and ensure the long-term sustainability of EHR implementation in health care [19,20]. The increase in EHR-related burnout among health care professionals reflects a multifaceted interplay of factors, including increased documentation requirements, cumbersome user interfaces, and the rapid pace of technological development [9,16,18].

    This systematic review and meta-analysis aims to provide a comprehensive assessment of the existing literature on EHR-related provider burnout. It seeks to capture the full extent of burnout, identify its causes, and provide evidence-based support and recommendations to alleviate this pervasive problem. In addition, we hypothesize that specific features of EHR systems, such as user interface design or increased documentation requirements, may contribute to provider burnout. We hope that this work will serve as a guide for health care organizations, policy makers, and EHR developers in developing interventions and technological improvements that prioritize the well-being of health care professionals. In doing so, we can promote a sustainable and resilient health care system while harnessing the potential benefits of EHR systems to improve patient care.


    Study Guidelines

    We focused on studies that directly measured burnout, as it is often considered in existing research to be a distinct emotional state, separate from depression or anxiety. This systematic review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines [21] and was registered with PROSPERO (CRD42021281173). Details of the guidelines and registration can be found in Multimedia Appendices 1 and 2, respectively.

    Definitions

    Our definitions of burnout were based on the Maslach Burnout Inventory-Human Services Survey instrument (MBI-HSS) [13,22], which characterizes burnout with high emotional exhaustion as a score ≥27, high depersonalization as >10, and low personal accomplishment as <33. Across the included studies, burnout was defined inconsistently, with definitions ranging from any one of the 3 items to all 3 items. In cases where the same study examined multiple definitions of burnout, we used the most common definition (high emotional exhaustion, high depersonalization, and low personal accomplishment) for the meta-analysis. For alternative definitions, such as those from the Stanford Physician Wellness Survey [23] or mini-Z [24], only outcomes explicitly described as burnout were documented. We categorized studies according to the measurement tool and definition of burnout.

    Search Strategy

    We systematically searched PubMed, Embase, and Web of Science to identify relevant peer-reviewed English language studies published between January 1, 2009, and December 31, 2022. We used several search terms to capture EHR systems, including “electronic health record” and its abbreviation “EHR,” as well as “electronic medical record (EMR)” and “computerized physician order entry (CPOE).” To capture the phenomenon of burnout, we used terms such as “burnout,” “alert fatigue,” and “exhaustion.” In defining our study participants, we considered a spectrum of health care professionals, including “doctor,” “clinician,” “physician,” “surgeon,” “medical staff,” and “health care provider.” On June 30, 2023, the researchers conducted a literature search in databases such as PubMed, Embase, and Web of Science, following the previously established search strategy. No papers were found that met the inclusion criteria for this review.

    The terms were combined using Boolean logic and then filtered by publication date and language (English). A full description of the search strategy can be found in Multimedia Appendix 3. In addition, we carefully examined the references of each article and manually added 5 relevant references to our review list. Duplicate studies were systematically excluded from consideration.

    Inclusion and Exclusion Criteria

    Figure 1 shows the search and selection process. We applied strict inclusion and exclusion criteria to identify original and observational studies relevant to our research objectives. We included studies that examined general EHR use or specific supporting systems such as computerized physician order entry. We focused on studies that directly assessed burnout among health care professionals and individual psychological responses to EHR systems. Our review included the following types of research: cohort studies, case-control studies, and cross-sectional studies. EHR-related burnout was assessed using validated tools such as the MBI-HSS, the mini-Z, or other similar measures. The following publication types were excluded: abstracts, editorials, letters, reviews, commentaries, guidelines, and studies by non–health care professionals. In addition, studies were excluded if the necessary data could not be obtained from the corresponding author. We also excluded studies that repeated data already published in the literature.

    Two reviewers independently screened all titles and abstracts to assess for relevance. Full texts of articles identified for further review were then assessed against the inclusion criteria. In cases of disagreement about the study eligibility of studies, a third reviewer was consulted for resolution.

    ‎
    Figure 1. Flowchart of study selection. EHR: electronic health record.

    Data Extraction and Synthesis

    For the included studies, we extracted relevant information including study design, geographical region, study duration, medical specialties involved, sample size, and relevant outcomes. The main outcomes included the prevalence of burnout in cross-sectional studies, the odds ratio (OR) along with its 95% CI in case-control studies, and the factors influencing burnout. We also documented the specific tools or measures used to assess these outcomes.

    Risk of Bias Assessment

    Two reviewers assessed the integrity, confirmability, and quality of the cross-sectional studies using the Joanna Briggs Institute (JBI) checklist [25] and the Newcastle-Ottawa Scale (NOS) [26] for the included case-control studies. Details of these assessments can be found in Multimedia Appendices 4-6, respectively.

    Statistical Analysis

    Meta-analysis was performed using R software (version 4.1.3; R Foundation for Statistical Computing). Heterogeneity was calculated using the Cochran Q test, and statistical significance was set at P<.05. If there was no statistical heterogeneity (I2<50%), the fixed-effects model was used to pool results; otherwise (I2>50%) the random-effects model was used [27,28]. We grouped the main outcomes according to the predictor and moderator factors described by the participants and derived from the outcome reports. Continuous variables were summarized using the mean and standardized mean difference, whereas rates were extracted for categorical variables. For cross-sectional studies, the effect size measure was the prevalence of burnout and its corresponding 95% CI. For case-control studies, the effect of EHR was assessed using the pooled OR and its 95% CI. Publication bias was analyzed using the Egger test [29] and the trim-fill funnel plot. A sensitivity analysis was performed for each omitted method to determine the robustness and reliability of the results.


    Characteristics of the Included Studies

    After reviewing a total of 2776 studies, 37 were selected for inclusion in our analysis (Figure 1) according to the predefined criteria and after elimination of duplicates. The baseline characteristics of the selected studies are summarized in Tables 1 and 2. For further details see Multimedia Appendix 7 [6,30-60].

    The studies included in our review covered the period from 2009 to 2022 and included regions in both Canada and the United States. They involved a total of 66,556 health care professionals. The sample sizes of these studies varied widely from 84 to 25,018 participants, and the response rates ranged from 8.9% to 73.0%.

    The primary measure used to assess burnout in the majority of studies was the MBI-HSS, which was used in 17 of 37 studies (46%). In addition, the mini-Z scale was used in 10 studies (27%). Notably, 2 studies using the MBI-HSS used cutoff definitions for burnout subcomponents that followed the standardized recommendations of the MBI-HSS.

    Table 1. Characteristics of the cross-sectional studies.
    AuthorData collectionRegionParticipantsSample (total)Burnout casesBurnout prevalence (%)
    Tawfik et al [30]2011United StatesPhysicians and other clinician staff6560358654.66
    Shanafelt et al [31]2014United StatesPhysicians193451726.73
    Tawfik et al [32]2015United StatesPhysicians and other clinician staff116562453.56
    Olson et al [33]2016United StatesPhysicians28212745.04
    Tai-Seale et al [34]2016United StatesPhysicians1074138.32
    Apaydin et al [35]2016United StatesPhysicians and other clinician staff1104440
    Livaudais et al [36]2016United StatesPhysicians and other clinician staff55726747.94
    Tran et al [37]2017United StatesPhysicians and other clinician staff179246525.95
    Marckini et al [38]2017Canada and United StatesPhysicians91933136.02
    Gardner et al [39]2017United StatesPhysicians2085124.52
    Hilliard et al [40]2017United StatesPhysicians and other clinician staff42211627.49
    Higgins et al [41]2017United StatesResidents1166253.45
    Czernik et al [42]2017United StatesResidents1638149.69
    Hauer et al [43]2018United StatesPhysicians1224436.07
    Gajra et al [44]2018United StatesPhysicians246853921.84
    Adler-Milstein et al [45]2018United StatesPhysicians1005252
    Somerson et al [46]2018United StatesResidents1286550.78
    Melnick et al [47]2018United StatesPhysicians2037838.42
    Coleman et al [48]2018United StatesPhysicians87039745.63
    Abraham et al [49]2018United StatesNurses36813436.41
    Kondrich et al [50]2018Canada and United StatesPhysicians87236041.28
    Kroth et al [51]2019United StatesPhysicians and other clinician staff85627632.24
    Tajirian et al[6]2019CanadaPhysicians and trainee2228437.84
    Mandeville et al [52]2019United StatesPhysicians and other clinician staff39610025.25
    Tiwari et al [53]2019United StatesPhysicians and other medical staff15,505506532.67
    Sinha et al [54]2019United StatesPhysicians1034139.81
    Anderson et al [55]2019United StatesPhysicians and trainee75637349.34
    Nair et al [56]2019United StatesPhysicians28112745.20
    Jha et al [57]2020United StatesPhysicians and other medical staff2308637.39
    Esmaeilzadeh and Mirzaei [58]2020IranPhysicians and other medical staff41620649.52
    Holzer et al [59]2020United StatesPhysicians and trainee843035.71
    Wilkie et al [60]2021CanadaPhysicians45710623.19
    Table 2. Characteristics of the case-control studies.
    AuthorData collectionParticipantsRegionExposureSample (total)Burnout casesORa (95% CI)
    Eschenroeder et al [61]2020PhysiciansUnited StatesAfter-hours EHRb charting time per week >6 hours25,01876162.43 (2.30-2.57)
    Sharp et al [62]2019Physician traineesUnited StatesWorking hours per week >70 hours5021592.80 (1.78-4.40)
    Peccoralo et al [63]2019Clinical facultyUnited StatesTime spent on EHR outside work >90minutes13463851.90 (1.40-2.78)
    Harris et al [64]2017Advanced practice registered nursesUnited StatesInsufficient time for EHR documentation333693.72 (1.78-7.80)
    Robertson et al [65]2015Primary care workersUnited StatesExtra time spent on EHR per week >6 hours5852162.90 (1.90-4.40)

    aOR: odds ratio.

    bEHR: electronic health record.

    Quality of Included Studies

    The quality of the cross-sectional studies was assessed using the JBI checklist. Of the cross-sectional studies reviewed, only 16 had a response rate of more than 50%. In addition, 24 studies provided a clear and precise description of their inclusion and exclusion criteria for participants. Additionally, 32 cross-sectional studies provided a detailed and thorough statistical analysis of their data and results.

    We used the NOS to assess the risk of bias and the overall quality of the case-control studies. In particular, one study failed to clarify its selection criteria for the control group and comparability with the exposed group, which resulted in a high risk of selection bias. Furthermore, none of the 5 case-control studies reported information on the nonresponse population, indicating a high risk of nonresponse bias. Overall, the risk of bias in the case-control studies was assessed as moderate. A full breakdown of the quality assessment for each study can be found in Multimedia Appendices 4 [6,30-60] and 5 [61-65].

    In our meta-analysis, we examined 37 studies that focused on identifying the prevalence of burnout associated with EHR use, involving a total of 66,556 health care professionals. The internal heterogeneity of 37 cross-sectional studies was evident in all included cross-sectional studies (I2=98.3%). Using random-effects models, we calculated the combined overall prevalence of EHR-related burnout of 40.4% (95% CI 37.6%-43.2%). Subgroup analysis showed that studies using the MBI-HSS reported a higher pooled prevalence of burnout (41.4%) than those using the mini-Z (35.1%) but lower than those using other instruments (43.2%). However, these differences were not statistically significant (Figures 2 and 3).

    ‎
    Figure 2. Forest plot of the pooled prevalence of burnout among health care professionals across cross-sectional studies [6,30-60]. IV: inverse variance methods.
    ‎
    Figure 3. Measurement tool subgroup analysis of the pooled prevalence of burnout among health care professionals in cross-sectional studies [6,30-60]. IV: inverse variance methods; MBI: Maslach Burnout Inventory.

    Publication Bias

    The Egger test and the funnel plot were used to estimate the publication bias in the included studies (t=1.35, P=.18), indicating no significant publication bias. The distribution of the points in the funnel plot is symmetric. There was no statistical difference in publication bias. The results are available in Multimedia Appendices 8 and 9.

    Sensitivity Analysis

    Sensitivity analysis was performed using the individual omission method. The results showed that no single study had a significant effect on the pooled prevalence of burnout. The results of the sensitivity analysis indicated that the meta-analysis was robust.

    The Association Between Time Spent on the EHR and Burnout

    Data from 5 case-control studies with 27,784 participants were available for the meta-analysis of the time spent on EHR and burnout prevalence. There was no significant within-study heterogeneity (I2=7.2%, P=.37), and a longer duration of EHR use was associated with a higher prevalence of burnout (OR 2.43, 95% CI 2.31-2.57) (Figure 4).

    ‎
    Figure 4. Forest plot of the association between the time spent using EHR and the risk of burnout [61-65]. EHR: electronic health record; IV: inverse variance methods; OR: odds ratio; SE: standard error of the TE; TE: take the logarithm of the effect value.

    Main Causes of Burnout and Proposed Solutions

    We have summarized the factors contributing to burnout among health care professionals in relation to EHR use in Table 3. Among these, challenges related to the design and availability of EHR systems were identified as the most significant contributors, as evidenced by 32 studies. Complaints from EHR users focused on several key issues: disruption to workflow [33]; cumbersome data entry (copy and paste) [59]; reduced direct communication with patients [38]; and annoyance with redundant, repetitive, or irrelevant alerts [52]. Poor EHR design has been shown to reduce work productivity and lead to prolonged EHR use [51,64]. This prolonged use has a negative impact on work-life balance of health care professionals and increasing burnout [42,57,65,66]. Workload factors, identified in 18 of the 32 studies, further exacerbate this problem. Specific aspects of workload that contribute to burnout include the number of hours worked per week [62-64], the frequency of night shifts [46,60], administrative documentation tasks [33,35,38,48,64], the volume of patient admissions [30,35,56], and the amount of information to manage in the EHR inbox [34,37,40]. Together, these factors exacerbate provider fatigue and increase the risk of burnout.

    EHR usability, recognized as a contributing factor to burnout, relates to issues of accessibility and functionality of the system. This includes instances where the system is frequently unavailable due to maintenance, updates, or technical failures, as well as situations where the system is not user-friendly and requires excessive time to navigate and use effectively, potentially leading to burnout among health care professionals.

    The factors contributing to burnout identified in the reviewed studies fall into 3 main categories: EHR use, work environment and organizational support, and the personal factors. Table 4 provides a summary of strategies to address these contributing factors. For example, the burden of medical clerical tasks imposed by EHR systems suggests the need to employ assistants or scribes to reduce the workload of health care professionals [31,67]. Evidence suggests that the EHR system itself can be improved by involving clinical staff in the design process [33], optimizing the user interface [39,64], minimizing the number of clicks required [52], and actively soliciting and incorporating user feedback [32]. In addition, some practitioners may not fully use health information technology in their roles and may be frustrated with EHR systems or similar systems [32]. To address this, health care organizations are advised to establish clear policies and procedures before implementing an EHR system and to provide ongoing health information technology education to reduce technology-related anxiety among users [32,52,68]. Finally, comprehensive and systematic initiatives are essential to effectively reduce burnout. Health care professionals are encouraged to work together to advocate for legislative and regulatory changes that ensure reasonable working hours, mandatory breaks, and safeguards against burnout [36,42,43,58,62].

    Moreover, research also suggests that sociodemographic characteristics, interpersonal dynamics, and the work environment have a significant impact on the prevalence of burnout. In particular, factors such as being female, younger, and less experienced correlate with higher rates of burnout [34,48,55]. Conversely, high levels of satisfaction or positive perspectives on the use of EHR systems may reduce burnout [36,42,58].

    Table 3. The influencing factors of burnout for studies.
    AuthorDesignRisk factors for burnoutProtective factors against burnoutMain EHRa factors influencing burnout
    Tawfik et al [30]Cross-sectionalNICUb with ≥10 weekly admissions, nursing care workload, and patient mortalityBurnout recognition education; implementation of burnout interventions at the individual and institutional levelUsing EHR outside working or at home; time on using EHR
    Shanafelt et al [31]Cross-sectionalUsing CPOEc, female gender, emergency medicine, each additional hour per weekAssistant order entry; documentation supportTime spent on clerical tasks
    Tawfik et al [32]Cross-sectionalHITd frustration, difficulty in falling asleepSupplemental EHR training; scribes to assist documentation；team-based documentation and inbox management；automating data-entry tasksFrustrated or stressed by EHR
    Olson et al [33]Cross-sectionalPoor control over workload, inefficient teamwork, lack of value alignment with leadership, and hectic-chaotic work atmosphereImprove professional satisfaction; nonphysician order entryUsing EHR outside working or at home; insufficient documentation time
    Tai-Seale et al [34]Cross-sectionalFemale gender and poor control over work scheduleFeeling highly valued; having good control over work schedule; working in a quiet or busy but reasonable environment; assist physician with email work; limit desktop medical work outside working hours (except in emergencies)Using EHR outside working or at home; number of EHR system-generated in basket messages
    Apaydin et al [35]Cross-sectionalManaging unscheduled or same-day patients, lack of pharmacist support, administrative work, excessive overall workload, difficulty communicating with other professionals, inadequate care coordination, and answering patient emailsInterventions to facilitate provider-led quality improvementManaging in-basket messages generated by EHR; responding to EHR alerts
    Livaudais et al [36]Cross-sectionalNegative perceptions of EHRPerceiving positive effect of EHR in practice；technical support for EHR when using systems; EHR optimization programManaging in-basket messages generated by EHR; poor EHR design; dealing with patient-call messages in systems
    Tran et al [37]Cross-sectionalClinical full-time equivalents >0.9 and more incomplete messages in inboxPerception positive attitudes about the effect of EHR or satisfied with EHRAverage additional 10 minutes spent on EHR after each visit; less efficient at completing EHR and inbox information
    Marckini et al [38]Cross-sectionalFemale gender and dissatisfaction for clerical tasksEHR optimization; improve physician efficiency; and job satisfactionManaging in-basket messages generated by EHR; dissatisfaction with EHR
    Gardner et al [39]Cross-sectionalPrimary care specialties, female gender, and reporting poor or marginal time for documentationPerception positive attitudes about the effect of EHR or satisfied with EHRExcessive data inputting in EHR; using EHR at home; frustrated with EHR
    Hilliard et al [40]Cross-sectionalHigh volume of patient call messages in the system and lack of control over workloadCopy and paste used in EHR documentation; assist with inbox tasks and create 2 administrative “desktops”Using EHR outside working or at home; excessive data inputting in EHR; managing in-basket messages generated by EHR
    Higgins et al [41]Cross-sectionalSelf-compassion, sleep disorder, lacking support from leaders, and poor control over schedulesPeer support, perceived appreciation and meaningfulness in work; maintaining values consistent with practice institutionPoor EHR usability; perception negative attitudes about the effect of EHR
    Czernik et al [42]Cross-sectionalFrustrated or stressed by EHRReducing the burden of documentation tasks; improving EHR usability; interventions to improve the EHRPoor usability of EHR; information overload; degradation of medical documentation
    Hauer et al [43]Cross-sectionalLoss of practicing autonomy, female gender, frustrated with EHR, and increasing insurance and government regulationImprove the functionality of EHR; enhance physician leadership and involvement; create a center for physician empowerment; create a physician health programUsing EHR outside workday
    Gajra et al [44]Cross-sectionalVariable reimbursement models, interactions with payers, and increasing treating and caring demandsUse advanced practice providers; hire additional administrative staff; invest in information technologyExcessive data inputting in EHR; frustrated or stressed by EHR; using EHR outside workday
    Adler-Milstein et al [45]Cross-sectionalPoor self-rated EHR skillsImprove EHR design; scribe or team documentation; reduce documentation requirementsUsing EHR outside working or at home; time spent on EHR; system-generated in-basket messages (>114) per week
    Somerson et al [46]Cross-sectionalWorking >80 hours per week, verbal abuse from faculty, educational debt, “scut” work >10 hours per weekNursing support; duty-hour restrictions; improve EHR functionality and efficiency; adequate, personalized training and support; adequate social work supportTime spent on EHR per week; used EHR >20 hours per week
    Melnick et al [47]Cross-sectionalPractice location (academic medical center) and medical specialtyImprove EHR usabilityUsing EHR outside working or at home; poor EHR usability
    Coleman et al [48]Cross-sectionalWork-related physical pain, work-home conflict, and younger ageBuild personal resilience, enhance wellness; peer support; reduce administrative or EHR burdenUsing EHR outside working or at home; increased EHR or documentation requirement
    Abraham et al [49]

    Cross-sectional    		Intraorganizational factorsEHR with multifunctional; reduce high EHR workload; work with supportive colleagues; improve team communicationHigh EHR workload
    Kondrich et al [50]Cross-sectionalFeeling undervalued by patients, lacking superior support, little promotion chances, perceived unfair clinical working schedule, and nonacademic environmentImprove physician well-beingFeeling that the EHR detracts from patient care
    Kroth et al [51]Cross-sectionalOverall stressImprove EHR design; clinician training; scribes to assist documentation; work at home boundaries; exercise, taking breaksInformation overloading; slow system response; excessive data inputting；fail to navigate quickly; note bloat; patient- clinician relationship interference; fear of missing something; billing oriented notes.
    Tajirian et al [6]Cross-sectionalWorkflow issuesReduce the administrative burden of EHR；improve EHRLower satisfaction and higher frustration with the EHR；poor intuitiveness and usability of EHR
    Mandeville et al [52]Cross-sectionalHIT-related stress and burnout and emergency medicineImproved workflowDaily frustration added by EHR；using EHR outside working or at home
    Tiwari et al [53]Cross-sectionalLack of physical exercise and weekly working hoursTeamwork and working satisfaction; self-care trainingPoor EHR usability; dissatisfaction with EHR
    Sinha et al [54]Cross-sectionalInterpersonal disengagementLower CLOCe ratio (total CLOC time to allocated appointment time); well-established personal resourcesUsing EHR outside working
    Anderson et al [55]Cross-sectionalFemale gender, younger age, shorter practicing years, and having children at homeTaking 20 days or more of vacation timeUsing EHR at home; ≥2-hour patient administration
    Nair et al [56]Cross-sectionalWorking long hours, weekly number of nursing patients, practice environment, disinterested health systems, and dissatisfaction with remunerationCaring for fewer patients per weekUsing EHR outside working or at home; EHR requirements
    Jha et al [57]Cross-sectionalCOVID-19 pandemic and in-house billingStay positive; improved EHR designDocumentation through EHR
    Esmaeilzadeh and Mirzaei [58]Cross-sectionalLess direct communication with patients, inadequate training for using HIT, and increasing computerization at workPositive perceptions of EHR; more policy and legal interventions to ensure meaningful use of EHR

    		Poor EHR usability; time spent entering data
    Holzer et al [59]Cross-sectionalReceive COVID-19 patientsUsing EHR to streamline clinical care activities; physician task reliefUsing EHR outside work; increased EHR workload
    Wilkie et al [60]Cross-sectionalHigh workload and insufficient resourcesGood leadership; prioritize work-life balancePoor EHR usability
    Eschenroeder et al [61]Case-controlSpecialtyOrganizational support for EHRAfter-hours EHR charting time per week >6 hours; time-consuming data entry
    Sharp et al [62]Case-controlWorking hours per week >70 hoursReport system to cover personal illness or emergency; access to mental health services; reduce EHR and clerical burden>90 minutes on the EHR outside of the workday
    Peccoralo et al [63]Case-controlClerical work time (>60 minutes/day) and poorer work-life integrationReducing time spent on EHR and clerical tasksUsing EHR outside working (>90 minutes/day); EHR adds to daily work frustration
    Harris et al [64]Case-controlInsufficient time for documentationImprove EHR usability; documentation practices optimizationUsing EHR outside working or at home; EHR adding to daily frustration
    Robertson et al [65]Case-controlDissatisfaction with work-life balance and female genderEHR proficiency trainingExtra time spent on EHR per week >6 hours

    aEHR: electronic health record.

    bNICU: neonatal intensive care unit.

    cCPOE: computerized physician order entry.

    dHIT: health information technology.

    eCLOC: clinician logged-in outside clinic time.

    Table 4. Proposed solutions for burnout mentioned.
    Perspectives/solutions and suggestionsMeasures
    EHRa

    		Improve EHR usability and performanceEnhance EHR user interface and design to reduce health care professionals to use

    		Institutions provide timely technical support during EHR useImproving the effectiveness and efficiency of technological responses

    		Institutions should offer comprehensive training courses for EHR usersEnsure users master EHR skills to reduce burnout from technological issue
    Working environment and organizational support

    		Institutions introduce mechanisms for regular assessment of EHR efficacyRegularly optimize and update the system based on user feedback

    		Establish a schedule, routine, and workflowDesign and optimize the workflow to ensure that the EHR aligns with the health care professional’s actual work, reducing unnecessary steps and improving work efficiency

    		Enhance peer, managerial, and technical supportProvide appropriate human resources, such as medical assistants, scribes, and improving teamwork to distribute workload among health care professionals

    		Development of transparent policies and objectivesEstablish clear policies and legislation to define the purpose, scope, and duration of EHR use, to delineate the responsibilities and obligations of health care professionals, and to reduce confusion and burnout
    Personal

    		Use of mental health resources and servicesCounseling services and mindfulness meditation therapy help health care professionals better manage work stress and reduce their psychological distress

    		Encourage academic and career developmentPlan career paths and training programs and create an environment for career development and learning

    aEHR: electronic health record.


    Key Findings

    This study explores the relationship between burnout and health care professionals. Our analysis revealed several key findings. First, the prevalence of burnout differs between assessment instruments, with the MBI-HSS indicating higher levels of burnout. However, this difference was not statistically significant. Second, there was a positive association between the average daily duration of EHR use and the risk of burnout. In particular, reducing the administrative burnout emerged as an effective strategy to reduce the risk of burnout [63]. Third, positive perceptions of the EHR and constructive work attitudes were correlated with the reduction in burnout.

    The MBI-HSS is valued for its extensive validation and widespread acceptance as an essential tool for assessing burnout. Our findings suggest that the MBI-HSS may report higher rates of burnout due to several factors: sensitivity to burnout constructs—unlike self-report measures, which may rely predominantly on respondents' respondents’ subjective feelings, the MBI-HSS comprehensively assesses burnout across multiple dimensions: emotional exhaustion, depersonalization, and personal accomplishment. This multidimensional assessment provides a nuanced perception of burnout, encompassing both its physical and psychological facets. These include the following: standardized cut-off scores—the MBI-HSS delineates specific cut-off scores for its dimensions, establishing clear criteria for identifying significant levels of burnout. This standardization promotes a consistent classification framework for burnout, which may contribute to the higher prevalence rates reported. Comprehensive assessment—the multidimensional approach of the MBI-HSS allows for a comprehensive assessment of burnout, including emotional exhaustion, depersonalization, and personal accomplishment. This thorough assessment is able to uncover more precise and detailed manifestations of burnout, thereby increasing detection rates. Benchmark for comparison—the MBI-HSS is often used as a benchmark for validating alternative burnout measures, and differences in results when compared with other instruments do not necessarily indicate a variance in prevalence. Rather, these differences underscore the accuracy of the MBI-HSS and the comprehensive scope of its assessment. The use of different instruments underlines the heterogeneity observed in our study results.

    Solutions

    This study demonstrates a robust relationship between workload, time spent using EHR, and burnout. Through a systematic review, we outline several pragmatic recommendations aimed at mitigating these problems.

    Reduce Documentation and EHR Workload

    A key strategy for alleviating workload concerns is to adopt a rational task allocation and effective teamwork model. Previous research highlights the effectiveness of this approach in reducing workload pressures [33,53]. By integrating medical assistants and scribes into the health care team, it is possible to distribute clerical tasks more evenly, thereby reducing the burden on health care professionals. This redistribution not only reduces workload but also increases overall operational efficiency [53,69,70]. In addition, the provision of targeted training is critical to improving teamwork dynamics, communication skills, and workflow efficiency. Such training efforts aim to cultivate a competent team capable of optimizing and streamlining workflow processes. The ultimate goal is to minimize documentation and EHR-related workloads, thereby making a significant contribution to reducing burnout among health care professionals [58,63].

    Optimizing EHR and Training Courses

    Continuous refinement of EHR systems through improved design, functionality, and integration of predesigned templates and phrases effectively increases system efficiency. The elimination of redundant steps and interactions further improves the user experience [32,71]. For example, customizing templates to include commonly used medical advice and alerts tailored to the specific needs of different departments significantly increases EHR efficiency [48,72]. Numerous studies have highlighted the critical role of improving user interaction with the EHR system. Developing a user-friendly interface that minimizes unnecessary clicks and reduces redundant and irrelevant data entry has been shown to significantly improve the user experience. Such improvements also significantly reduce the cognitive burden on health care professionals, resulting in a more streamlined and efficient health care delivery process [32,39,42]. In addition, comprehensive training and strong technical support are critical to improving the efficiency and effectiveness of EHR use. Systematic training aimed at promoting EHR proficiency among health care professionals can significantly improve operational efficiency and mitigate the effects of technology stress [46,58]. Research emphasizes the importance of training health care professionals to enhance EHR use and tailoring templates to specific clinical workflows.

    Artificial Intelligence–Based Solutions

    The integration of artificial intelligence (AI) into EHR systems represents a significant frontier for improvement. Innovations in machine learning, natural language processing (NLP), and large language models (LLMs) are poised to significantly increase the intelligence and automation capabilities of EHR systems [73,74]. Incorporating speech recognition and automated dictation or note-taking into hospital workflows can streamline the creation of medical documents, thereby increasing operational efficiency [75]. NLP is characterized by its ability to efficiently organize both unstructured and semistructured textual records, thereby facilitating a reduction in paperwork [76,77]. Recent research has highlighted the utility of LLMs, such as GPT-4, as powerful tools for medical documentation [78,79]. The use of technologies such as GPT-4 as a linguistic assistant or the use of intelligent templates can significantly speed up the medical documentation process for health care professionals, while improving the accuracy of documentation [79]. In addition, the researchers developed a data-driven method to generate recommendations for refining alert criteria through an explainable AI framework [80]. This advancement directly addresses the issue of overalerting in clinical decision support systems, which has been identified as a potential contributor to burnout among health care professionals. By reducing unnecessary alerts, this approach promises to reduce the cognitive and operational workload of health care professionals, thereby improving both the quality of patient care and the work-life balance of health care staff. While AI technology could potentially help reduce burnout, it is important to recognize that the causes of burnout are complex and require further research.

    Implications for Future Research

    There is considerable evidence to support the need for comprehensive redesign of EHR systems to improve efficiency [32,51,53,81]. However, the literature reveals a paucity of published empirical research quantifying EHR limitations, user fatigue and burnout. While some studies have indirectly demonstrated the poor usability of EHR by measuring pupillary reflex and cognitive fatigue [82,83], claims of inefficiency are primarily based on subjective perceptions of users. Thus, there is a need for more studies that objectively assess usability and user experience. Future research should aim to quantitatively assess the usability of EHR systems and their impact on the physical and mental well-being of health care professionals.

    Furthermore, the incorporation of AI, specifically LLMs, into EHR systems is an important future research direction to reduce burnout among health care professionals. Such research could include, but is not limited to, (1) reducing the amount of time health care professionals spend on nonclinical tasks by automating administrative tasks, including data entry, scheduling, and patient history taking; (2) using LLMs to efficiently generate and review medical documentation to ensure high quality and consistency of documentation while saving time; (3) improving the interpretability and transparency of clinical decision support to provide clinicians with trustworthy decision support to reduce their cognitive load; and (4) ensuring the ethical use of AI to guarantee that AI systems are used ethically and that algorithms are unbiased. The integration of AI into EHR systems must comply with strict privacy regulations to protect patient privacy [84]. Exploring the potential of AI could make a significant contribution to creating a more supportive and efficient health care ecosystem [73,79,85].

    Limitations

    This review has several limitations. First, it has a language bias by including only peer-reviewed literature published in English. This limitation may introduce information and selection bias by omitting non-English studies that may provide valuable insights or alternative viewpoints on the topic. Second, the internal heterogeneity of the included studies is remarkably high, with significant differences in methodology, participant demographics, and outcome measures between studies, which may bias the synthesis of findings. In addition, the geographical distribution of the selected studies is dominated by North American research, with only 1 study from Iran. This distribution may introduce regional bias, as health care practices and experiences in these areas may not accurately reflect global patterns.

    In addition, the temporal scope of the study, covering the years 2020 to 2022, was significantly influenced by the COVID-19 pandemic. Data collected during this period may be subject to bias or inaccuracy due to the unprecedented impact of the pandemic on global health systems. Additionally, the pandemic introduced new stressors and challenges for health care professionals, which may have influenced the incidence and manifestation of their burnout. These factors should be carefully considered when interpreting the study results, as they may limit the generalizability and significance of the findings beyond the specific context and timeframe of the pandemic.

    Conclusions

    This review highlights the significant impact of the EHR and the workload of health care professionals on burnout and emphasizes the need for targeted solutions such as workflow optimization, improved training, and the use of medical scribes. It also identifies that the potential of AI to improve EHR efficiency is a promising direction. Despite these findings, there remains a critical need for empirical research to accurately quantify the challenges associated with EHR use and their impact on provider well-being. Future studies are encouraged to explore innovative solutions to foster a more supportive health care environment.

    Data Availability

    All data generated or analyzed during this study are included in this published article and its supplementary information files.

    Authors' Contributions

    J Liu, J Lin, and SL conceived and designed the study. YW, SL, MW, J Liu, and J Lin developed the methods. YW, SL, CW, J Lin, and J Liu developed the search strategy. All authors participated in drafting the manuscript. All authors have read and approved the final article. There was no funding for this study.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.

    PDF File (Adobe PDF File), 98 KB
    Multimedia Appendix 2

    PROSPERO registration.

    PDF File (Adobe PDF File), 1901 KB
    Multimedia Appendix 3

    Search strategy.

    DOCX File , 13 KB
    Multimedia Appendix 4

    Joanna Briggs Institute checklist for the cross-sectional studies included.

    PDF File (Adobe PDF File), 58 KB
    Multimedia Appendix 5

    NOS results for the case-control studies included.

    PDF File (Adobe PDF File), 74 KB
    Multimedia Appendix 6

    Joanna Briggs Institute Prevalence Critical Appraisal Tool.

    DOCX File , 15 KB
    Multimedia Appendix 7

    Basic characteristics of the studies included.

    PDF File (Adobe PDF File), 70 KB
    Multimedia Appendix 8

    Funnel plot for the studies included.

    PNG File , 136 KB
    Multimedia Appendix 9

    The results of the publication bias test.

    PNG File , 45 KB
    1. Aldosari B. Patients' safety in the era of EMR/EHR automation. Inform Med Unlocked. 2017;9:230-233. [FREE Full text] [CrossRef]
    2. Gatiti P, Ndirangu E, Mwangi J, Mwanzu A, Ramadhani T. Enhancing healthcare quality in hospitals through electronic health records: a systematic review. J Health Inform Dev Ctries. 2021;15(2):1-25. [FREE Full text]
    3. Woldemariam MT, Jimma W. Adoption of electronic health record systems to enhance the quality of healthcare in low-income countries: a systematic review. BMJ Health Care Inform. Jun 2023;30(1):e100704. [FREE Full text] [CrossRef] [Medline]
    4. Li C, Parpia C, Sriharan A, Keefe DT. Electronic medical record-related burnout in healthcare providers: a scoping review of outcomes and interventions. BMJ Open. Aug 19, 2022;12(8):e060865. [FREE Full text] [CrossRef] [Medline]
    5. Heponiemi T, Gluschkoff K, Vehko T, Kaihlanen AM, Saranto K, Nissinen S, et al. Electronic health record implementations and insufficient training endanger nurses' well-being: cross-sectional survey study. J Med Internet Res. Dec 23, 2021;23(12):e27096. [FREE Full text] [CrossRef] [Medline]
    6. Tajirian T, Stergiopoulos V, Strudwick G, Sequeira L, Sanches M, Kemp J, et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res. Jul 15, 2020;22(7):e19274. [FREE Full text] [CrossRef] [Medline]
    7. Palojoki S, Saranto K, Reponen E, Skants N, Vakkuri A, Vuokko R. Classification of electronic health record-related patient safety incidents: development and validation study. JMIR Med Inform. Aug 31, 2021;9(8):e30470. [FREE Full text] [CrossRef] [Medline]
    8. Tutty MA, Carlasare LE, Lloyd S, Sinsky CA. The complex case of EHRs: examining the factors impacting the EHR user experience. J Am Med Inform Assoc. Jul 01, 2019;26(7):673-677. [FREE Full text] [CrossRef] [Medline]
    9. Jankovic I, Chen JH. Clinical decision support and implications for the clinician burnout crisis. Yearb Med Inform. Aug 2020;29(1):145-154. [FREE Full text] [CrossRef] [Medline]
    10. Thomas Craig KJ, Willis VC, Gruen D, Rhee K, Jackson GP. The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout. J Am Med Inform Assoc. Apr 23, 2021;28(5):985-997. [FREE Full text] [CrossRef] [Medline]
    11. Mohan V, Garrison C, Gold JA. Using a new model of electronic health record training to reduce physician burnout: a plan for action. JMIR Med Inform. Sep 20, 2021;9(9):e29374. [FREE Full text] [CrossRef] [Medline]
    12. Melnick ER, Harry E, Sinsky CA, Dyrbye LN, Wang H, Trockel MT, et al. Perceived electronic health record usability as a predictor of task load and burnout among US physicians: mediation analysis. J Med Internet Res. Dec 22, 2020;22(12):e23382. [FREE Full text] [CrossRef] [Medline]
    13. Mertz H. Electronic health record reform: an alternative response to physician burnout. Am J Med. 2021;134(9):e498. [CrossRef] [Medline]
    14. Dyrbye LN, Shanafelt TD, Sinsky CA, Cipriano PF, Bhatt J, Ommaya A, et al. Burnout among health care professionals: a call to explore and address this underrecognized threat to safe, high-quality care. NAM Perspectives. 2017;7(7). [FREE Full text] [CrossRef]
    15. Kumar S. Burnout and doctors: prevalence, prevention and intervention. Healthcare (Basel). 2016;4(3):37. [FREE Full text] [CrossRef] [Medline]
    16. Gesner E, Gazarian P, Dykes P. The burden and burnout in documenting patient care: an integrative literature review. Stud Health Technol Inform. 2019;264:1194-1198. [FREE Full text] [CrossRef] [Medline]
    17. Kang C, Sarkar IN. Interventions to reduce electronic health record-related burnout: a systematic review. Appl Clin Inform. 2024;15(1):10-25. [FREE Full text] [CrossRef] [Medline]
    18. Johnson KB, Neuss MJ, Detmer DE. Electronic health records and clinician burnout: a story of three eras. J Am Med Inform Assoc. 2021;28(5):967-973. [FREE Full text] [CrossRef] [Medline]
    19. Williams MS. Misdiagnosis: burnout, moral injury, and implications for the electronic health record. J Am Med Inform Assoc. 2021;28(5):1047-1050. [FREE Full text] [CrossRef] [Medline]
    20. Baxter SL, Saseendrakumar BR, Cheung M, Savides TJ, Longhurst CA, Sinsky CA, et al. Association of electronic health record inbasket message characteristics with physician burnout. JAMA Netw Open. 2022;5(11):e2244363. [FREE Full text] [CrossRef] [Medline]
    21. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151(4):W65-W94. [FREE Full text] [CrossRef] [Medline]
    22. Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory. In: Evaluating Stress. Lanham, MD. Scarecrow Education; 1997.
    23. The Stanford Model of Professional Fulfillment™. Stanford Medicine: WellMD & WellPhD. 2016. URL: https://wellmd.stanford.edu/about/model-external.html [accessed 2024-05-01]
    24. Shimotsu S, Poplau S, Linzer M. Validation of a brief clinician survey to reduce clinician burnout. J Gen Intern Med. 2015;30(2 suppl):S79-S80.
    25. Munn Z, Stone JC, Aromataris E, Klugar M, Sears K, Leonardi-Bee J, et al. Assessing the risk of bias of quantitative analytical studies: introducing the vision for critical appraisal within JBI systematic reviews. JBI Evid Synth. Mar 01, 2023;21(3):467-471. [CrossRef] [Medline]
    26. Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010;25(9):603-605. [FREE Full text] [CrossRef] [Medline]
    27. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. Sep 06, 2003;327(7414):557-560. [FREE Full text] [CrossRef] [Medline]
    28. Higgins JPT, Li T, Deeks JJ. Choosing effect measures and computing estimates of effect. In: Chandler J, Thomas J, Higgins JPT, Page MJ, Cumpston M, Li T, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions, Second Edition. Hoboken. Wiley; 2019:143-176.
    29. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. Sep 13, 1997;315(7109):629-634. [FREE Full text] [CrossRef] [Medline]
    30. Tawfik DS, Phibbs CS, Sexton JB, Kan P, Sharek PJ, Nisbet CC, et al. Factors associated with provider burnout in the NICU. Pediatrics. May 2017;139(5):e20164134. [FREE Full text] [CrossRef] [Medline]
    31. Shanafelt TD, Dyrbye LN, Sinsky C, Hasan O, Satele D, Sloan J, et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc. 2016;91(7):836-848. [CrossRef] [Medline]
    32. Tawfik DS, Sinha A, Bayati M, Adair KC, Shanafelt TD, Sexton JB, et al. Frustration with technology and its relation to emotional exhaustion among health care workers: cross-sectional observational study. J Med Internet Res. 2021;23(7):e26817. [FREE Full text] [CrossRef] [Medline]
    33. Olson K, Sinsky C, Rinne ST, Long T, Vender R, Mukherjee S, et al. Cross-sectional survey of workplace stressors associated with physician burnout measured by the Mini-Z and the maslach burnout inventory. Stress Health. 2019;35(2):157-175. [FREE Full text] [CrossRef] [Medline]
    34. Tai-Seale M, Dillon EC, Yang Y, Nordgren R, Steinberg RL, Nauenberg T, et al. Physicians' well-being linked to in-basket messages generated by algorithms in electronic health records. Health Aff (Millwood). 2019;38(7):1073-1078. [FREE Full text] [CrossRef] [Medline]
    35. Apaydin EA, Rose D, Meredith LS, McClean M, Dresselhaus T, Stockdale S. Association between difficulty with VA patient-centered medical home model components and provider emotional exhaustion and intent to remain in practice. J Gen Intern Med. 2020;35(7):2069-2075. [FREE Full text] [CrossRef] [Medline]
    36. Livaudais M, Deng D, Frederick T, Grey-Theriot F, Kroth PJ. Perceived value of the electronic health record and its association with physician burnout. Appl Clin Inform. 2022;13(4):778-784. [FREE Full text] [CrossRef] [Medline]
    37. Tran B, Lenhart A, Ross R, Dorr DA. Burnout and EHR use among academic primary care physicians with varied clinical workloads. AMIA Jt Summits Transl Sci Proc. 2019;2019:136-144. [FREE Full text] [Medline]
    38. Marckini DN, Samuel BP, Parker JL, Cook SC. Electronic health record associated stress: a survey study of adult congenital heart disease specialists. Congenit Heart Dis. 2019;14(3):356-361. [FREE Full text] [CrossRef] [Medline]
    39. Gardner RL, Cooper E, Haskell J, Harris DA, Poplau S, Kroth PJ, et al. Physician stress and burnout: the impact of health information technology. J Am Med Inform Assoc. 2019;26(2):106-114. [FREE Full text] [CrossRef] [Medline]
    40. Hilliard RW, Haskell J, Gardner RL. Are specific elements of electronic health record use associated with clinician burnout more than others? J Am Med Inform Assoc. 2020;27(9):1401-1410. [FREE Full text] [CrossRef] [Medline]
    41. Higgins MCSS, Siddiqui AA, Kosowsky T, Unan L, Mete M, Rowe S, et al. Burnout, professional fulfillment, intention to leave, and sleep-related impairment among radiology trainees across the United States (US): a multisite epidemiologic study. Acad Radiol. 2022;29(Suppl 5):S118-S125. [CrossRef] [Medline]
    42. Czernik Z, Yu A, Pell J, Feinbloom D, Jones CD. Hospitalist perceptions of electronic health records: a multi-site survey. J Gen Intern Med. 2022;37(1):269-271. [FREE Full text] [CrossRef] [Medline]
    43. Hauer A, Waukau HJ, Welch P. Physician burnout in Wisconsin: an alarming trend affecting physician wellness. WMJ. 2018;117(5):194-200. [FREE Full text] [Medline]
    44. Gajra A, Bapat B, Jeune-Smith Y, Nabhan C, Klink AJ, Liassou D, et al. Frequency and causes of burnout in US community oncologists in the era of electronic health records. JCO Oncol Pract. 2020;16(4):e357-e365. [FREE Full text] [CrossRef] [Medline]
    45. Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc. 2020;27(4):531-538. [FREE Full text] [CrossRef] [Medline]
    46. Somerson JS, Patton A, Ahmed AA, Ramey S, Holliday EB. Burnout among United States orthopaedic surgery residents. J Surg Educ. 2020;77(4):961-968. [CrossRef] [Medline]
    47. Melnick ER, Dyrbye LN, Sinsky CA, Trockel M, West CP, Nedelec L, et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clin Proc. 2020;95(3):476-487. [FREE Full text] [CrossRef] [Medline]
    48. Coleman DM, Money SR, Meltzer AJ, Wohlauer M, Drudi LM, Freischlag JA, et al. Vascular surgeon wellness and burnout: a report from the Society for Vascular Surgery Wellness Task Force. J Vasc Surg. 2021;73(6):1841-1850.e3. [FREE Full text] [CrossRef] [Medline]
    49. Abraham CM, Zheng K, Norful AA, Ghaffari A, Liu J, Topaz M, et al. Use of multifunctional electronic health records and burnout among primary care nurse practitioners. J Am Assoc Nurse Pract. 2021;33(12):1182-1189. [FREE Full text] [CrossRef] [Medline]
    50. Kondrich JE, Han R, Clark S, Platt SL. Burnout in pediatric emergency medicine physicians: a predictive model. Pediatr Emerg Care. 2022;38(2):e1003-e1008. [CrossRef] [Medline]
    51. Kroth PJ, Morioka-Douglas N, Veres S, Babbott S, Poplau S, Qeadan F, et al. Association of electronic health record design and use factors with clinician stress and burnout. JAMA Netw Open. 2019;2(8):e199609. [FREE Full text] [CrossRef] [Medline]
    52. Mandeville B, Cooper E, Haskell J, Viner-Brown S, Gardner RL. Use of health information technology by Rhode Island physicians and advanced practice providers, 2019. R I Med J (2013). 2020;103(1):21-24. [FREE Full text] [Medline]
    53. Tiwari V, Kavanaugh A, Martin G, Bergman M. High burden of burnout on rheumatology practitioners. J Rheumatol. 2020;47(12):1831-1834. [FREE Full text] [CrossRef] [Medline]
    54. Sinha A, Shanafelt TD, Trockel M, Wang H, Sharp C. Novel nonproprietary measures of ambulatory electronic health record use associated with physician work exhaustion. Appl Clin Inform. 2021;12(3):637-646. [FREE Full text] [CrossRef] [Medline]
    55. Anderson JC, Bilal M, Burke CA, Gaidos JK, Lopez R, Oxentenko AS, et al. Burnout among US gastroenterologists and fellows in training: identifying contributing factors and offering solutions. J Clin Gastroenterol. 2023;57(10):1063-1069. [FREE Full text] [CrossRef] [Medline]
    56. Nair D, Brereton L, Hoge C, Plantinga LC, Agrawal V, Soman SS, et al. Burnout among nephrologists in the United States: a survey study. Kidney Med. 2022;4(3):100407. [FREE Full text] [CrossRef] [Medline]
    57. Jha SS, Shah S, Calderon MD, Soin A, Manchikanti L. The effect of COVID-19 on interventional pain management practices: a physician burnout survey. Pain Physician. 2020;23(4S):S271-S282. [FREE Full text] [Medline]
    58. Esmaeilzadeh P, Mirzaei T. Using electronic health records to mitigate workplace burnout among clinicians during the COVID-19 pandemic: field study in Iran. JMIR Med Inform. 2021;9(6):e28497. [FREE Full text] [CrossRef] [Medline]
    59. Holzer KJ, Lou SS, Goss CW, Strickland J, Evanoff BA, Duncan JG, et al. Impact of changes in EHR use during COVID-19 on physician trainee mental health. Appl Clin Inform. 2021;12(3):507-517. [FREE Full text] [CrossRef] [Medline]
    60. Wilkie T, Tajirian T, Thakur A, Mistry S, Islam F, Stergiopoulos V. Evolution of a physician wellness, engagement and excellence strategy: lessons learnt in a mental health setting. BMJ Lead. 2023;7(3):182-188. [FREE Full text] [CrossRef] [Medline]
    61. Eschenroeder HC, Manzione LC, Adler-Milstein J, Bice C, Cash R, Duda C, et al. Associations of physician burnout with organizational electronic health record support and after-hours charting. J Am Med Inform Assoc. Apr 23, 2021;28(5):960-966. [FREE Full text] [CrossRef] [Medline]
    62. Sharp M, Burkart KM, Adelman MH, Ashton RW, Biddison LD, Bosslet GT, et al. A national survey of burnout and depression among fellows training in pulmonary and critical care medicine: a special report by the association of pulmonary and critical care medicine program directors. Chest. 2021;159(2):733-742. [FREE Full text] [CrossRef] [Medline]
    63. Peccoralo LA, Kaplan CA, Pietrzak RH, Charney DS, Ripp JA. The impact of time spent on the electronic health record after work and of clerical work on burnout among clinical faculty. J Am Med Inform Assoc. 2021;28(5):938-947. [FREE Full text] [CrossRef] [Medline]
    64. Harris DA, Haskell J, Cooper E, Crouse N, Gardner R. Estimating the association between burnout and electronic health record-related stress among advanced practice registered nurses. Appl Nurs Res. 2018;43:36-41. [CrossRef] [Medline]
    65. Robertson SL, Robinson MD, Reid A. Electronic health record effects on work-life balance and burnout within the I population collaborative. J Grad Med Educ. 2017;9(4):479-484. [FREE Full text] [CrossRef] [Medline]
    66. Shanafelt TD, Boone S, Tan L, Dyrbye LN, Sotile W, Satele D, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377-1385. [FREE Full text] [CrossRef] [Medline]
    67. Shultz CG, Holmstrom HL. The use of medical scribes in health care settings: a systematic review and future directions. J Am Board Fam Med. 2015;28(3):371-381. [FREE Full text] [CrossRef] [Medline]
    68. Green-McKenzie J, Somasundaram P, Lawler T, O'Hara E, Shofer FS. Prevalence of burnout in occupational and environmental medicine physicians in the United States. J Occup Environ Med. 2020;62(9):680-685. [FREE Full text] [CrossRef] [Medline]
    69. Nguyen OT, Turner K, Charles D, Sprow O, Perkins R, Hong YR, et al. Implementing digital scribes to reduce electronic health record documentation burden among cancer care clinicians: a mixed-methods pilot study. JCO Clin Cancer Inform. 2023;7:e2200166. [FREE Full text] [CrossRef] [Medline]
    70. Ghatnekar S, Faletsky A, Nambudiri VE. Digital scribe utility and barriers to implementation in clinical practice: a scoping review. Health Technol (Berl). 2021;11(4):803-809. [FREE Full text] [CrossRef] [Medline]
    71. Lourie EM, Utidjian LH, Ricci MF, Webster L, Young C, Grenfell SM. Reducing electronic health record-related burnout in providers through a personalized efficiency improvement program. J Am Med Inform Assoc. 2021;28(5):931-937. [FREE Full text] [CrossRef] [Medline]
    72. DeWitt D, Harrison LE. The potential impact of scribes on medical school applicants and medical students with the new clinical documentation guidelines. J Gen Intern Med. 2018;33(11):2002-2004. [FREE Full text] [CrossRef] [Medline]
    73. Liu S, McCoy AB, Wright AP, Carew B, Genkins JZ, Huang SS, et al. Leveraging large language models for generating responses to patient messages—a subjective analysis. J Am Med Inform Assoc. 2024:ocae052. [FREE Full text] [CrossRef] [Medline]
    74. Liu S, McCoy AB, Wright AP, Nelson SS, Huang SS, Ahmad HB, et al. Why do users override alerts? Utilizing large language model to summarize comments and optimize clinical decision support. J Am Med Inform Assoc. 2024:ocae041. [FREE Full text] [CrossRef] [Medline]
    75. Payne TH, Alonso WD, Markiel JA, Lybarger K, Lordon R, Yetisgen M, et al. Using voice to create inpatient progress notes: effects on note timeliness, quality, and physician satisfaction. JAMIA Open. 2018;1(2):218-226. [FREE Full text] [CrossRef] [Medline]
    76. Wang JX, Sullivan DK, Wells AC, Chen JH. ClinicNet: machine learning for personalized clinical order set recommendations. JAMIA Open. 2020;3(2):216-224. [FREE Full text] [CrossRef] [Medline]
    77. Dymek C, Kim B, Melton GB, Payne TH, Singh H, Hsiao CJ. Building the evidence-base to reduce electronic health record-related clinician burden. J Am Med Inform Assoc. 2021;28(5):1057-1061. [FREE Full text] [CrossRef] [Medline]
    78. Truhn D, Loeffler CM, Müller-Franzes G, Nebelung S, Hewitt KJ, Brandner S, et al. Extracting structured information from unstructured histopathology reports using Generative Pre-Trained Transformer 4 (GPT-4). J Pathol. 2024;262(3):310-319. [FREE Full text] [CrossRef] [Medline]
    79. Liu J, Wang C, Liu S. Utility of ChatGPT in clinical practice. J Med Internet Res. 2023;25:e48568. [FREE Full text] [CrossRef] [Medline]
    80. Liu S, McCoy AB, Peterson JF, Lasko TA, Sittig DF, Nelson SD, et al. Leveraging explainable artificial intelligence to optimize clinical decision support. J Am Med Inform Assoc. 2024;31(4):968-974. [FREE Full text] [CrossRef] [Medline]
    81. Atutxa A, Perez A, Casillas A, Atutxa A, Perez A, Casillas A. Machine learning approaches on diagnostic term encoding with the ICD for clinical documentation. IEEE J Biomed Health Inform. 2018;22(4):1323-1329. [FREE Full text] [CrossRef] [Medline]
    82. Khairat S, Coleman C, Ottmar P, Jayachander DI, Bice T, Carson SS. Association of electronic health record use with physician fatigue and efficiency. JAMA Netw Open. 2020;3(6):e207385. [FREE Full text] [CrossRef] [Medline]
    83. Murphy DR, Satterly T, Giardina TD, Sittig DF, Singh H. Practicing clinicians' recommendations to reduce burden from the electronic health record inbox: a mixed-methods study. J Gen Intern Med. 2019;34(9):1825-1832. [FREE Full text] [CrossRef] [Medline]
    84. Wang C, Liu S, Yang H, Guo J, Wu Y, Liu J. Ethical considerations of using ChatGPT in health care. J Med Internet Res. 2023;25:e48009. [FREE Full text] [CrossRef] [Medline]
    85. Liu S, Wright AP, Patterson BL, Wanderer JP, Turer RW, Nelson SD, et al. Using AI-generated suggestions from ChatGPT to optimize clinical decision support. J Am Med Inform Assoc. 2023;30(7):1237-1245. [FREE Full text] [CrossRef] [Medline]

    ‎
    AI: artificial intelligence
    EHR: electronic health record
    EMR: electronic medical record
    IV: inverse variation methods
    JBI: Joanna Briggs Institute
    LLM: large language model
    MBI-HSS: Maslach Burnout Inventory-Human Services Survey instrument
    NLP: natural language processing
    NOS: Newcastle-Ottawa Scale
    OR: odds ratio
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis

    Edited by C Lovis; submitted 27.11.23; peer-reviewed by JY Nam, J Wolff, I Mircheva, R Koppel; comments to author 14.01.24; revised version received 23.02.24; accepted 17.04.24; published 12.06.24.

    Copyright

    ©Yuxuan Wu, Mingyue Wu, Changyu Wang, Jie Lin, Jialin Liu, Siru Liu. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 12.06.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.