Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 12.11.19 in Vol 7, No 4 (2019): Oct-Dec

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/12648, first published Oct 30, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Navigating Through Electronic Health Records: Survey Study on Medical Students’ Perspectives in General and With Regard to a Specific Training

    1Department of Psychosomatic Medicine and Psychotherapy, Internal Medicine, University Hospital Tübingen, Tübingen, Germany

    2Process and Quality Management, Department of Medical Structure, University Hospital Tübingen, Tübingen, Germany

    3Department of Gastroenterology, Hepatology and Infectious Diseases, Internal Medicine, University Hospital Tübingen, Tübingen, Germany

    Corresponding Author:

    Teresa Loda, MSc

    Department of Psychosomatic Medicine and Psychotherapy

    Internal Medicine

    University Hospital Tübingen

    Osianderstr 5

    Tübingen, 72076

    Germany

    Phone: 49 070712980129

    Email: teresa.loda@med.uni-tuebingen.de


    ABSTRACT

    Background: An electronic health record (EHR) is the state-of-the-art method for ensuring all data concerning a given patient are up to date for use by multidisciplinary hospital teams. Therefore, medical students need to be trained to use health information technologies within this environment from the early stages of their education.

    Objective: As little is known about the effects of specific training within the medical curriculum, this study aimed to develop a course module and evaluate it to offer best practice teaching for today’s students. Moreover, we looked at the acceptance of new technologies such as EHRs.

    Methods: Fifth-year medical students (N=104) at the University of Tübingen took part in a standardized two-day training procedure about the advantages and risks of EHR use. After the training, students performed their own EHR entries on hypothetical patient cases in a safe practice environment. In addition, questionnaires—standardized and with open-ended questions—were administered to assess students’ experiences with a new teaching module, a newly developed EHR simulator, the acceptance of the health technology, and their attitudes toward it before and after training.

    Results: After the teaching, students rated the benefit of EHR training for medical knowledge significantly higher than before the session (mean 3.74, SD 1.05). However, they also had doubts about the long-term benefit of EHRs for multidisciplinary coworking after training (mean 1.96, SD 0.65). The special training with simulation software was rated as helpful for preparing students (88/102, 86.2%), but they still did not feel safe in all aspects of EHR.

    Conclusions: A specific simulated training on using EHRs helped students improve their knowledge and become more aware of the risks and challenges of such a system. Overall, students welcomed the new training module and supported the integration of EHR teaching into the medical curriculum. Further studies are needed to optimize training modules and make use of long-term feedback opportunities a simulated system offers.

    JMIR Med Inform 2019;7(4):e12648

    doi:10.2196/12648

    KEYWORDS



    Introduction

    Electronic health records (EHRs) comprise health information of a patient showing clinical data collected from all professionals involved in the patient’s care, including nurses, doctors, therapists, laboratories, and external specialists [1].

    Besides the immediate integration of a wealth of clinical data and examination results, implementing the usage of EHR provides numerous benefits, including increased adherence to guidelines in preventive care, decreased paperwork for providers, improvement in overall quality, efficiency of patient care [2], reduction of errors [3,4], enhanced monitoring of drug therapy [4], better daily workflow management [5], easy access of clinical data, legibility of notes, improved problem and medication lists, and better preventive care documentation. Challenges and risks, however, have been reported regarding heightened susceptibility to automation bias, decreased quality of notes because of copying and pasting [6,7], alert fatigue (desensitization) [8], disruption of the patient-physician relationship [9], mismatch of human and machine workflow models, and productivity loss potentially caused by EHR usability issues [2].

    However, despite all the current knowledge of the benefits and risks of use of EHR and other technology, there has not been much research on the acceptance of new health technology systems such as EHR particularly among students. Students seem to be generally positive and more receptive to new technologies than more experienced health care providers [4,10]. The acceptance of health technology is mainly influenced by 2 underlying factors: the devices’ perceived ease of use and perceived usefulness [11,12]. More perceived ease of use and higher usefulness might also underlie the findings of Tierney et al [10], with medical students as digital natives being closer to technology systems. However, medical students—despite their high exposure to and experience with electronic media—still need specific training in electronic health care systems as they rate their ability to use such clinical information systems as rather low [3,13-16]. The need for training is also mirrored by the fact that accreditation bodies and national catalogs of learning objectives expect medical graduates to be able to communicate clearly orally and in writing, including the documentation process in medical charts coining it a core competency [15,17-19]. However, so far, not enough clarity has emerged as to how and when such training in EHR usage should be integrated into the medical curriculum and which specific competencies should be reached [15,20-22]. In addition, Berndt and Fischer in their recent review [20] concluded that the growing use of EHR “for medical education, [...] poses many new challenges for teaching and learning (e.g., teaching of new data management skills; new roles and responsibilities for students and teachers) which have hardly been addressed.” Previous studies have shown that training in the implementation process of EHR in general is useful [2], training in EHR has specifically improved communication when using the EHR [23], and training in the usage of EHR should already be in the focus of medical education fairly early on [9,15]. This also takes into account that most errors in EHR usage come down to issues concerning adequate training, well-prepared implementation, and the possibility of getting accustomed to the system [24,25].

    Also requiring attention in line with these considerations are the technical, ethical, and legal points accompanying such training. Before digitalization, students could simply walk into the nurses’ station and pick up the paper chart [15]. With EHR, the procedure is quite different as students now need individual login data, and unfortunately, a lot of medical schools deny their students permission to document EHR live, which lessens the potential benefit EHR can have in medical education and might lead to information loss within health care teams [26-28]. Despite the widespread usage of EHR in clinical practice in Germany and elsewhere, surveys show that medical students are often not allowed to make use of its full potential [3,26,29,30]. Simulated training environments offer a safe solution to this issue and are well accepted by students but are so far only rarely used [24,31-33]. However, clear rules of responsibility have to be defined when students are working with live EHR, particularly when considering the complicated general legal regulations in the European Union and the German system [34,35].

    In summary, students need access to EHR to become knowledgeable and skilled in its use and to improve their understanding of system-based practice, because future medical practice environments will likely include the use of EHR. As students use EHR regardless of prior preparation, the need for training guidelines definitely exists [3,15,20]. Just as medical schools currently teach proper documentation as part of good clinical care in a paper-based world, they should be similarly obligated to teach students proper use of an EHR in an increasingly electronic world [26]. Atwater et al [9] concluded that “Best practices and strategies for teaching medical trainees in the setting of EHR have not been identified or widely shared with the medical education community.” Thus, in this study, we aimed to develop a course module and evaluate it to offer a best practice teaching example.


    Methods

    Study Design and Participants

    This longitudinal study took place at the Medical Faculty of the University of Tübingen in summer term 2018. A paper-based questionnaire was administered before and after the teaching session on EHR. Fifth-year medical students were recruited within their regular seminar in internal medicine. Participation in the EHR training was mandatory. However, participation in this study was on a voluntary basis. Out of 171 students, 116 (response rate 68.8%) participated in the study.

    Test System

    Teaching was conducted using a specially designed test system that exactly mirrored the EHR software program Meona (Meona GmbH, Freiburg, Germany) used in the clinical service at the University Hospital of Tübingen. It was created with 2 imaginary wards (internal medicine and surgery), allowing the virtual accommodation of up to 28 patients. Patient cases were developed by clinical experts in internal medicine before the teaching began. The cases were either simply created as plain characters or entered with a full medical history and doctor’s orders depending on the respective purpose. As there was no link to the actual EHR (Meona) version in clinical use, it provided a safe training environment without any implications for real patients. At the same time, however, the students were able to practice with a perfectly realistic copy of the original EHR system. The system was created and supported by the Information Technology (IT) Department of the University Hospital, which also maintains the actual clinical version. Once every 24 hours, it had to be updated after which one could either use the new blank version or upload the screenshot from before the update.

    Teaching

    The teaching course on EHR was held as a full-day intensive training over 2 consecutive days (6 hours per day). Before the actual teaching on day 1, students had to fill in the first questionnaire (T0). Afterward, teaching started with a lecture on the general advantages, disadvantages, and pitfalls of EHR as well as a specific training on how to use the Meona system. As EHR count as a medical device in Germany demanding formalized training, part of the teaching was a standardized video on how to use the EHR system. This was followed by an interactive class including a lecture on how to perform a chart review and common medical errors to avoid. After lunchbreak, students were shown specific procedures within the EHR system (eg, tasks when admitting or discharging a patient) and had ample time to practice with a fictive patient, who was created as a new admission, with the student being asked to enter all the necessary information into the system and make orders accordingly. Day 1 ended with a wrap-up discussion exchanging experience using the EHR. On day 2, teaching started with a short refresher course on main points from the day before. Afterward, students were given specifically designed patient cases to perform a chart review. The cases covered typical patients seen in internal medicine (eg, complicated diabetes and gastrointestinal bleeding). Students first had to work on their own; this was followed by an interactive discussion including medical and technical issues. At the end of day 2, students filled in the second questionnaire (T1).

    Teaching was conducted by 2 experienced clinicians who each held a certificate as an official Meona instructor as well as a Master’s Degree in Medical Education.

    Questionnaire

    We developed a questionnaire based on literature-derived common themes in EHR use and adapted from prior questionnaires in use [9,15,36]. The questionnaire had undergone cognitive pretesting using the method of think aloud, where the subject concurrently verbalizes thoughts when answering a questionnaire [37,38]. Consequently, minor adaptions to the questionnaire were made, and it was administered pre teaching (T0) and post teaching (T1) to allow for comparisons. The questionnaire can be obtained upon request. Students provided basic sociodemographic data (eg, age, gender, and semester), former training data, IT/electronic health–related data (eg, possession of devices and usage of the internet for health topics), and information regarding their prior experience with traditional chart reviews as well as EHR. In addition, they rated the general potential of EHR as well as the specific benefit for different professional groups (students, physicians, nurses, patients, and other professional groups) and their collaboration. Students also rated the teaching and the test system used. Table 1 provides an overview on the items used.

    Table 1. Overview of outcomes and their corresponding measurement of the questionnaire.
    View this table

    Data Analysis

    Data analysis was performed using SPSS version 24. For statistical analysis, frequencies, means, and associated SDs were calculated for different items of the questionnaire. Data were normally distributed as tested by the Kolmogorov-Smirnov test. T tests for 2-paired samples were conducted to allow comparisons of pre teaching and post teaching. For further comparison, analyses of variance were conducted. Here, the level of significance was P<.05. For the comparison of pre teaching and post teaching, data were included only when the students filled in both questionnaires. Furthermore, we considered the cumulative frequencies in percentages for several items such as prior usage of EHR. Here, questionnaires of all 116 students taking part in the study were included, and frequencies were calculated proportionately for each item. At the end of the study, 104 out of 116 students had returned the complete pre- and postquestionnaires and could be included in the analyses of comparisons. Again, on the singe-item level, frequencies were calculated proportionately. The absolute numbers might differ slightly from 116 or 104 students because of missing data.

    Ethics

    The Ethics Committee of Tübingen Medical Faculty (#260/2016BO2) approved this study.


    Results

    Sociodemographics

    A total of 116 students participated in the study, and 104 students returned the completed pre- and postquestionnaires and showed up for both appointments of the study. Moreover, 59 (56.7) students were female and 45 (43.3) were male. Their mean age was 25.6 (SD 3.0) years.

    Previous Experience With Electronic Devices

    Nearly all the students (103/113, 91.1%) had a mobile phone, 111 (98.2%) had a personal computer with internet connection, and 79 (69.9%) owned a tablet. Out of 112 students, 76 (67.8%) stated owning all 3 devices, and 108 (96.4%) students rated the internet as rather important or important for their daily lives. Students checked their private emails every day, which was significantly more often than their professional ones (F1,4=38.04; P<.001).

    Previous Experience With Electronic Health Records

    Out of 104 students, 67 (64.4%) had already participated in a chart review in general (paper or EHR). However, out of these, only 18 (27%) students had actively contributed to one. Mostly, the chart review was part of their mandatory clinical placements. In addition, 66 out of 101 (65.3%) students already had contact with an EHR system, with proportionally the largest group (36/47, 77% students) having watched someone else using it. Finally, 99 out of 103 students (96.1%) had thus far no formal training in EHR.

    Benefit for Different Professions

    The students’ judgment of the relative benefit of EHR for medical professionals did not vary significantly between T0 and T1 regardless of the group (see Table 2). In addition, students rated the benefit of EHR significantly higher for doctors and nurses than for any other professions both before and after training (pre teaching—benefit doctors, mean 4.11; nurses, mean 3.90; therapists, mean 3.67; patients, mean 3.10; medical students, mean 3.55; P<.001 for doctors and nurses compared with all other professions—and post teaching—benefit doctors, mean 3.96; nurses, mean 3.82; therapists, mean 3.68; patients, mean 3.29; medical students, mean 3.68; P<.001 for doctors and P=.03 for nurses compared with all other professions). Analyzed in detail, students rated the benefit of EHR for their medical knowledge significantly higher after the teaching session (Table 2).

    Table 2. Ratings of benefits, concerns, and inhibitions of electronic health record.
    View this table

    Concerns and Inhibitions

    There was no significant difference before and after training regarding concerns and inhibitions related to EHR use. However, students evaluated EHR’s potential long-term benefit as a collaboration tool in the multiprofessional health care team to be significantly lower at T1 compared with T0. Table 2 provides further details.

    Evaluation of the Test System

    The most frequently mentioned positive aspects were the protected and safe environment (29/58 students, 50%) in which to practice as well as the general benefits of an EHR system such as drug interaction warnings. EHR needs a substantial amount of training with proper facilities (16/70 students, 23%) and the fear that other hospitals might have different systems (2/70, 3%) for which they would then not be prepared were some of the critical issues mentioned by the students. In addition, students pointed out that the training system still had some technical difficulties (23/70, 33%; eg, no immediate connection to current treatment guidelines and inappropriate date of birth of the created patients). When presented with a list of areas where support in the future would be needed most, issues concerning active processes such as change the patient’s medication (17/104 students, 16%) and confident navigation through the system (28/104 students, 27%) were among the most frequent answers.

    Evaluation of the Teaching Module

    Out of 102 students, 88 (86.3%) stated that the teaching prepared them in a rather good or good way for later usage of EHR. When asked for which area they felt best prepared specifically (eg, navigation, patient admission, placing orders, and changing medication), there was a significant difference among the subthemes (F6,64=3.59; P=.002), with students feeling best prepared for reading and understanding the current medication scheme (mean 2.25, SD 0.66) and worst prepared for navigation through the EHR (mean 1.96, SD 0.65). Out of 103 students, 44 (42.7%) would have liked to have the teaching video in a web-based version as well, with another 24 students (23.3%) agreeing that it might be helpful to have such an additional option. However, they also generally appreciated the presence of a real teacher, as 74 out of 103 students (71.8%) stated that a web-based teaching program alone would not or possibly not be sufficient to reach the desired competencies and understanding.

    After the teaching, the students felt rather motivated to work with EHR in the future (mean 3.74, SD 1.05) and considered EHR as a useful tool in clinical practice (mean 3.7, SD 0.04). Looking closer at different aspects of time saving and patient safety when using EHR, EHRs were mostly considered as a very helpful or helpful tool in later work in hospitals by our students. For the advantages and details they identified, see Figure 1.

    In addition, 82 out of 104 students (78.8%) considered the system’s offer of templates (eg, normal findings on physical examination and electrocardiography) helpful or very helpful. Reasons for finding it only somewhat helpful or not helpful were producing data waste, limitation of expressions, and standard formulations are known by heart anyway. Accordingly, 98 out of 104 students (94.2%) considered the integrated support system of EHR (eg, immediate warnings about drug interactions) helpful or very helpful. The 6 students considering the system not helpful or only somewhat helpful were most critical on the following points: giving a false sense of security (n=3), danger of not thinking critically on one’s own (n=1), and limited flexibility through forced adherence to guidelines (n=1). However, the problem of alert fatigue, as mentioned in the Introduction, was not reported by our students. Our medical students seemed unsure about how to judge the potential problem of copy and paste—also one of the main risks and pitfalls of EHR—rating it mean 2.3 (SD 1.5) on the abovementioned scale. Of the 48 students being more reserved toward the copy and paste possibility, the majority mentioned worries along the issue of blind take-over of information/no cross-checking/no reflection on (potentially wrong) diagnoses (n=41). Only 3 students were concerned about the potential issue of loss of quality/reduced doctor-patient interaction.

    Figure 1. Percentage of students (N=104) who found the electronic health record very helpful, helpful, little helpful, and not helpful, respectively, with regard to time saving and patient safety aspects. Values less than 3% are not marked on the graph to improve readability.
    View this figure

    Discussion

    Summary

    This study looked at undergraduate medical students’ perspectives toward EHR in general and with a specific focus on a particularly designed teaching module. Teaching included a formalized introduction to EHR accounting for legal demands as well as plenty of contextual training applying medical knowledge in the electronic system.

    Perspectives on Electronic Health Records

    In general, the students in this study had a positive attitude toward EHR usage, which is generally in line with previous findings [4,10]. Interestingly, participants rated the benefit of EHR usage significantly higher for doctors and nurses than for other health care professionals or their patients at both measurements. This might be because of the fact that medical students still mostly see those 2 professions in action of patient care. Interestingly, students in this study rated the potential benefits for coworking in a multiprofessional team significantly lower after their teaching sessions. This seems counterintuitive as common access to medical charts should foster team collaboration, although caveats have been described in literature with current systems yet lagging the full potential [39-41]. The students’ reservations might be explained by the fact that through specific training, they become aware not only of the advantages but also of the shortcomings of EHR usage, as already mentioned in the Introduction, enabling them to evaluate clinical information systems more critically. In addition, they have not been using them in real clinical practice. Therefore, they can only imagine and anticipate or remember complex interactions they have been observing in clinical internships where frequent difficulties and problems with EHR are discussed more prominently than effectively working examples in team interactions. The possible influence of EHR on the patient-physician relationship was not an issue for our students. This is in line with literature showing effective patient-centered interactions despite usage of EHR in the encounters [42,43].

    Although clinical decision aids integrated into EHR offer great learning opportunities, there is a danger of alert fatigue in users [8,44]. Students in this study did not show such concerns. We assume that this phenomenon might not be prominent in students, who have not been using the system frequently so far but is more of an issue for experienced system users working with EHR on a daily basis. However, it seems crucial to create an awareness of this issue early on. This also accounts for possible negative implications of the copy&paste phenomenon. Our medical students were unsure how to rate this issue, but those concerned named well-known reasons in the clinical context [6,7]. So far, literature has not shown any negative educational consequences of copy and paste (eg, impaired critical thinking and reduced self-directed learning). However, there is certainly the need for more standardized examinations on that matter [44-46].

    Teaching

    In this study, students accepted the new technology well and felt highly motivated to use EHR. They all represented the generation of digital natives—as reflected in their possession and usage of technical devices and the internet and students thus might be especially receptive to the use of new technologies [10]. However, this might not be transferable to an adequate professional use, and despite being digital natives, students do need specific training in technical devices in the health care context [3,13,14,16]. As documentation is a core competency that graduates should show from day 1 of their clinical work, the need for specific training in the usage of EHR is thus undisputable [15,17,19]. There are even demands of whole longitudinal curricula on this issue [15]. This enables several levels of reality: starting with theoretical input in the early years and proceeding to simulated scenarios as well as a structured integration of live EHR use in clinical placements. However, reality does look different: students usually are not officially allowed to document in EHR or sometimes do so without proper training in the systems beforehand [3,26,29,30]. The students in this study also reported mostly just having watched someone using an EHR. However, some students had documented on their own but without training, which poses a legal problem in Germany as EHR count as a medical device is not allowed to be used without a formalized introductory teaching beforehand. Directors of medical schools should be aware of this potentially dangerous issue.

    Although the students evaluated their training course positively, it does not seem to have been thorough enough, as students still did not feel safe when navigating through the EHR afterward. This uncertainty might have resulted from students focusing on the medical information and casework, prioritizing this part of the task over organizational and structural learning objectives of this class. This was reflected in the in-class discussions where students’ questions mainly concerned medical issues, and EHR seemed to be merely a means for that purpose. A lack of EHR navigating skills is also what Morrow et al [23] discuss when finding that after training, students had significantly better communication skills within the EHR tool but did not show satisfying navigation skills such as finding previous data or creating trend graphs. It may be necessary to separate medical content from technical information or at least specifically stress the importance of structural skills [20].

    Simulated Electronic Health Record System

    When looking at students’ experiences with the new EHR software program (Meona) in general, the feedback was positive. Overall, the students appreciated the features they would also encounter in the live version, although they were also aware of the technical difficulties still present in the newly developed copy of the actual Meona. We want to draw attention to some of these, as we consider this as helpful for other medical schools planning to develop an EHR simulator. When creating a teaching version of an in-use EHR, it is important to keep in mind that the system needs constant updating. In our case, this meant reinstalling the initial version to delete the entries of one student group before the next one works with the program. However, this means that when you have admitted the patient in April and constantly back up to this initial version, the students who have their training class in June are supposed to work with patients who have been on the ward for 2 months with nothing having been done up to this point. In the whole process, it is also crucial to involve IT [47]. This accounts for making them familiar with the content of your teaching before they start to program the virtual patients. It does not foster the degree of felt reality when students work on 19-year-old patients who have been in and out of hospital for the past 20 years because of their poorly controlled diabetes. When creating such a system, it is also important to predefine who will be responsible for tasks, who has the administrator’s rights, and when the program is to be updated or reloaded so that you have a secured environment [47]. During our first term of teaching EHR, not having clarified all these issues, we more than once had to manually reenter all patient data because IT made an update without a screenshot first. In addition, in the beginning, we were unable to change minor issues ourselves as we did not have the rights to do so. Thus, it might be helpful to have key users with limited administrative rights who can customize the system accordingly, such as only updating it during semester break.

    Simulated systems are created to prepare for reality. There is ample literature regarding the rights of medical students in live EHR systems [3,48]. When using real systems, one has to find the balance between allowing students to be part of the team with the same duties and ownership as other team members on the one hand [3], whereas, on the other hand, taking into account legal issues of responsibility that might exceed a student’s capability level and will need to be reviewed [49,50]. By choosing a mirrored version of the actual EHR system used in our hospital, all students in the class automatically got the training necessary to be allowed to work with the live electronic chart. As a consequence of this teaching, the Medical Faculty of the University of Tübingen together with the Quality Management Department of the University Hospital defined and implemented those rights for all students in their final year to ensure quality of care and reproducibility of the clinical documentation within the EHR system. One key element of this process was to show students’ entries color coded as preliminary documentation that has to be checked and confirmed by a fully trained physician before release, although this has been shown to be a source of concern among deans of medical schools [30,45]. Thanks to such provisions, students could start using EHR immediately the day they entered their final practical year without endangering patient safety.

    Limitations

    The study has several limitations. First, we only looked at medical students at one semester and one faculty, which limits generalizability. In addition, the training class was relatively short, being an intensive course over 2 days; thus, some of the results might be not representative enough. Finally, we did not look at transfer into the clinical environment, thus not being able to say if the students’ self-ratings would hold up in the actual context of use.

    Despite these limitations, we strongly believe that our study delivers valuable insight into aspects of consideration when planning and implementing a teaching class on EHR into the medical curriculum.

    Conclusions

    Overall, the class showed several advantages, and the training was regarded as helpful. However, it might have been more helpful to separate medical content from the technical aspects to reduce cognitive overload or have at least more teaching time longitudinally, as already practiced in some medical schools [20,51]. Future development could include assigning person-specific logins to track individual progress. In addition, the potential of interprofessional as well as nationwide or even worldwide web-based learning opportunities should be considered [52].

    Conflicts of Interest

    None declared.

    References

    1. Garrett NY, Mishra N, Nichols B, Staes CJ, Akin C, Safran C. Characterization of public health alerts and their suitability for alerting in electronic health record systems. J Public Health Manag Pract 2011;17(1):77-83. [CrossRef] [Medline]
    2. Clarke MA, Belden JL, Kim MS. How does learnability of primary care resident physicians increase after seven months of using an electronic health record? A longitudinal study. JMIR Hum Factors 2016 Feb 15;3(1):e9 [FREE Full text] [CrossRef] [Medline]
    3. Hammoud MM, Margo K, Christner JG, Fisher J, Fischer SH, Pangaro LN. Opportunities and challenges in integrating electronic health records into undergraduate medical education: a national survey of clerkship directors. Teach Learn Med 2012;24(3):219-224. [CrossRef] [Medline]
    4. Rouf E, Chumley HS, Dobbie AE. Electronic health records in outpatient clinics: perspectives of third year medical students. BMC Med Educ 2008 Mar 31;8:13 [FREE Full text] [CrossRef] [Medline]
    5. Keenan CR, Nguyen HH, Srinivasan M. Electronic medical records and their impact on resident and medical student education. Acad Psychiatry 2006;30(6):522-527. [CrossRef] [Medline]
    6. O'Donnell HC, Kaushal R, Barrón Y, Callahan MA, Adelman RD, Siegler EL. Physicians' attitudes towards copy and pasting in electronic note writing. J Gen Intern Med 2009 Jan;24(1):63-68 [FREE Full text] [CrossRef] [Medline]
    7. Thornton JD, Schold JD, Venkateshaiah L, Lander B. Prevalence of copied information by attendings and residents in critical care progress notes. Crit Care Med 2013 Feb;41(2):382-388 [FREE Full text] [CrossRef] [Medline]
    8. Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006;13(5):547-556 [FREE Full text] [CrossRef] [Medline]
    9. Atwater AR, Rudd M, Brown A, Wiener JS, Benjamin R, Lee WR, et al. Developing teaching strategies in the EHR era: a survey of GME experts. J Grad Med Educ 2016 Oct;8(4):581-586 [FREE Full text] [CrossRef] [Medline]
    10. Tierney WM, Overhage JM, McDonald CJ, Wolinsky FD. Medical students' and housestaff's opinions of computerized order-writing. Acad Med 1994 May;69(5):386-389. [CrossRef] [Medline]
    11. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. Manag Inf Syst Q 1989;13(3):319-340. [CrossRef]
    12. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci 2000;46(2):186-204. [CrossRef]
    13. Krause N, Roulette GD, Papp KK, Kaelber D. Assessing medical informatics confidence among 1st and 2nd year medical students. AMIA Annu Symp Proc 2006:989 [FREE Full text] [Medline]
    14. Borycki E, Griffith J, Reid P, Kushniruk AW, Kuo MH. Do electronic health records help undergraduate health informatics students to develop health informatics competencies? Stud Health Technol Inform 2013;192:1106. [CrossRef] [Medline]
    15. Hammoud MM, Dalymple JL, Christner JG, Stewart RA, Fisher J, Margo K, et al. Medical student documentation in electronic health records: a collaborative statement from the Alliance for Clinical Education. Teach Learn Med 2012;24(3):257-266. [CrossRef] [Medline]
    16. Kirschner PA, De Bruyckere P. The myths of the digital native and the multitasker. Teach Teach Educ 2017;67:135-142. [CrossRef]
    17. Association of American Medical Colleges. Learning objectives for medical student education--guidelines for medical schools: report I of the Medical School Objectives Project. Acad Med 1999;74(1):461-462. [CrossRef] [Medline]
    18. Fischer MR, Bauer D, Mohn K, NKLM-Projektgruppe. Finally finished! National Competence Based Catalogues of Learning Objectives for Undergraduate Medical Education (NKLM) and Dental Education (NKLZ) ready for trial. GMS Z Med Ausbild 2015;32(3):Doc35 [FREE Full text] [CrossRef] [Medline]
    19. Association of American Medical Colleges. The Core Entrustable Professional Activities (EPAs) for Entering Residency   URL: https:/​/www.​aamc.org/​initiatives/​coreepas/​publicationsandpresentations/​426410/​publicationshometsr.​html [accessed 2019-06-01]
    20. Berndt M, Fischer MR. The role of electronic health records in clinical reasoning. Ann N Y Acad Sci 2018 Dec;1434(1):109-114. [CrossRef] [Medline]
    21. Pageler NM, Friedman CP, Longhurst CA. Refocusing medical education in the EMR era. J Am Med Assoc 2013 Dec 4;310(21):2249-2250. [CrossRef] [Medline]
    22. Wald HS, George P, Reis SP, Taylor JS. Electronic health record training in undergraduate medical education: bridging theory to practice with curricula for empowering patient- and relationship-centered care in the computerized setting. Acad Med 2014 Mar;89(3):380-386 [FREE Full text] [CrossRef] [Medline]
    23. Morrow JB, Dobbie AE, Jenkins C, Long R, Mihalic A, Wagner J. First-year medical students can demonstrate EHR-specific communication skills: a control-group study. Fam Med 2009 Jan;41(1):28-33 [FREE Full text] [Medline]
    24. Ludwick DA, Doucette J. Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inform 2009 Jan;78(1):22-31. [CrossRef] [Medline]
    25. Dornan T, Boshuizen H, King N, Scherpbier A. Experience-based learning: a model linking the processes and outcomes of medical students' workplace learning. Med Educ 2007 Jan;41(1):84-91. [CrossRef] [Medline]
    26. Mintz M, Narvarte HJ, O'Brien KE, Papp KK, Thomas M, Durning SJ. Use of electronic medical records by physicians and students in academic internal medicine settings. Acad Med 2009 Dec;84(12):1698-1704. [CrossRef] [Medline]
    27. Schenarts PJ, Schenarts KD. Educational impact of the electronic medical record. J Surg Educ 2012;69(1):105-112. [CrossRef] [Medline]
    28. Solarte I, Könings KD. Discrepancies between perceptions of students and deans regarding the consequences of restricting students' use of electronic medical records on quality of medical education. BMC Med Educ 2017 Mar 13;17(1):55 [FREE Full text] [CrossRef] [Medline]
    29. Welcher CM, Hersh W, Takesue B, Stagg Elliott V, Hawkins RE. Barriers to medical students' electronic health record access can impede their preparedness for practice. Acad Med 2018 Jan;93(1):48-53. [CrossRef] [Medline]
    30. Friedman E, Sainte M, Fallar R. Taking note of the perceived value and impact of medical student chart documentation on education and patient care. Acad Med 2010 Sep;85(9):1440-1444. [CrossRef] [Medline]
    31. March CA, Steiger D, Scholl G, Mohan V, Hersh WR, Gold JA. Use of simulation to assess electronic health record safety in the intensive care unit: a pilot study. BMJ Open 2013;3(4):pii: e002549 [FREE Full text] [CrossRef] [Medline]
    32. Joe RS, Otto A, Borycki E. Designing an electronic medical case simulator for health professional education. Know Manag E-Learn 2011;3(1):63-71. [CrossRef]
    33. Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, et al. Simulation technology for health care professional skills training and assessment. J Am Med Assoc 1999 Sep 1;282(9):861-866. [CrossRef] [Medline]
    34. Rienhoff OLC, van Ecke P, Wenzlaff P, Piccolo U. A legal framework for security in European health care telematics. Stud Health Technol Inform 2000;74:1-192. [Medline]
    35. van der Haak M, Wolff A, Brandner R, Drings P, Wannenmacher M, Wetter T. Data security and protection in cross-institutional electronic patient records. Int J Med Inform 2003 Jul;70(2-3):117-130. [CrossRef] [Medline]
    36. Yu P, Qian S. Developing a theoretical model and questionnaire survey instrument to measure the success of electronic health records in residential aged care. PLoS One 2018;13(1):e0190749 [FREE Full text] [CrossRef] [Medline]
    37. van Someren MW, Barnard YF, Sanberg JA. The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. London: Academic Press; 1994.
    38. Ericsson KA, Simon HA. Verbal reports as data. Psychol Rev 1980;87(3):215-251. [CrossRef]
    39. Lingard L. Paradoxical truths and persistent myths: reframing the team competence conversation. J Contin Educ Health Prof 2016;36(Suppl 1):S19-S21. [CrossRef] [Medline]
    40. Rudin RS, Bates DW. Let the left hand know what the right is doing: a vision for care coordination and electronic health records. J Am Med Inform Assoc 2014;21(1):13-16 [FREE Full text] [CrossRef] [Medline]
    41. O'Malley AS, Draper K, Gourevitch R, Cross DA, Scholle SH. Electronic health records and support for primary care teamwork. J Am Med Inform Assoc 2015 Mar;22(2):426-434 [FREE Full text] [CrossRef] [Medline]
    42. Duke P, Frankel RM, Reis S. How to integrate the electronic health record and patient-centered communication into the medical visit: a skills-based approach. Teach Learn Med 2013;25(4):358-365. [CrossRef] [Medline]
    43. Silverman H, Ho Y, Kaib S, Ellis WD, Moffitt MP, Chen Q, et al. A novel approach to supporting relationship-centered care through electronic health record ergonomic training in preclerkship medical education. Acad Med 2014 Sep;89(9):1230-1234 [FREE Full text] [CrossRef] [Medline]
    44. Tierney MJ, Pageler NM, Kahana M, Pantaleoni JL, Longhurst CA. Medical education in the electronic medical record (EMR) era: benefits, challenges, and future directions. Acad Med 2013 Jun;88(6):748-752. [CrossRef] [Medline]
    45. Knight AM, Kravet SJ, Harper GM, Leff B. The effect of computerized provider order entry on medical student clerkship experiences. J Am Med Inform Assoc 2005;12(5):554-560 [FREE Full text] [CrossRef] [Medline]
    46. Goddard K, Roudsari A, Wyatt JC. Automation bias: a systematic review of frequency, effect mediators, and mitigators. J Am Med Inform Assoc 2012;19(1):121-127 [FREE Full text] [CrossRef] [Medline]
    47. Milano CE, Hardman JA, Plesiu A, Rdesinski RE, Biagioli FE. Simulated electronic health record (Sim-EHR) curriculum: teaching EHR skills and use of the EHR for disease management and prevention. Acad Med 2014 Mar;89(3):399-403 [FREE Full text] [CrossRef] [Medline]
    48. Foster LM, Cuddy MM, Swanson DB, Holtzman KZ, Hammoud MM, Wallach PM. Medical student use of electronic and paper health records during inpatient clinical clerkships: results of a national longitudinal study. Acad Med 2018 Nov;93(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 57th Annual Research in Medical Education Sessions):S14-S20. [CrossRef] [Medline]
    49. Kirch DG. DocPlayer. 2014. Allowing Medical Student Documentation in the Electronic Health Record   URL: https:/​/docplayer.​net/​663664-Allowing-medical-student-documentation-in-the-electronic-health-record-background-and-purpose.​html [accessed 2019-10-10]
    50. Chi J, Kugler J, Chu IM, Loftus PD, Evans KH, Oskotsky T, et al. Medical students and the electronic health record: 'an epic use of time'. Am J Med 2014 Sep;127(9):891-895. [CrossRef] [Medline]
    51. Daniel M, George PF, Warrier S, Dodd K, Dollase R, Taylor JS. Warren Alpert Medical School's Doctoring program: a comprehensive, integrated clinical curriculum. Med Heal 2012;95(10):313-316 [FREE Full text]
    52. Frankovich J, Longhurst CA, Sutherland SM. Evidence-based medicine in the EMR era. N Engl J Med 2011 Nov 10;365(19):1758-1759. [CrossRef] [Medline]


    Abbreviations

    EHR: electronic health record
    IT: information technology


    Edited by G Eysenbach; submitted 30.10.18; peer-reviewed by J Graf, N Haller, M Kim, R Alkoudmani; comments to author 05.04.19; revised version received 14.06.19; accepted 19.08.19; published 12.11.19

    ©Anne Herrmann-Werner, Martin Holderried, Teresa Loda, Nisar Malek, Stephan Zipfel, Friederike Holderried. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 12.11.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.