Published on in Vol 8, No 11 (2020): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/23623, first published .
The Associations of Electronic Health Record Usability and User Age With Stress and Cognitive Failures Among Finnish Registered Nurses: Cross-Sectional Study

The Associations of Electronic Health Record Usability and User Age With Stress and Cognitive Failures Among Finnish Registered Nurses: Cross-Sectional Study

The Associations of Electronic Health Record Usability and User Age With Stress and Cognitive Failures Among Finnish Registered Nurses: Cross-Sectional Study

Original Paper

1Finnish Institute for Health and Welfare, Helsinki, Finland

2Department of Computer Science, Aalto University, Helsinki, Finland

3Finnish Institute of Occupational Health, Helsinki, Finland

4Department of Health and Social Management, University of Eastern Finland, Kuopio, Finland

5Finnish Nurses Association, Helsinki, Finland

Corresponding Author:

Anu-Marja Kaihlanen, PhD

Finnish Institute for Health and Welfare

P.O. Box 30

Helsinki, FI-00271

Finland

Phone: 358 295246033

Email: anu.kaihlanen@thl.fi


Background: Electronic health records (EHRs) are expected to provide many clinical and organizational benefits. Simultaneously, the end users may face unintended consequences, such as stress and increased cognitive workload, due to poor EHR usability. However, whether the effects of usability depend on end user characteristics, such as career stage or age, remains poorly understood.

Objective: The objective of this study was to examine the associations of EHR usability and user age with stress related to information systems and cognitive failures among registered nurses.

Methods: A cross-sectional survey design was employed in Finland in 2017. A total of 3383 registered nurses responded to the nationwide electronic survey. Multiple linear regression was used to examine the associations of EHR usability (eg, how easily information can be found and a patient’s care can be documented) and user age with stress related to information systems and cognitive failures. Interaction effects of EHR usability and age were also tested. Models were adjusted for gender and employment sector.

Results: Poor EHR usability was associated with higher levels of stress related to information systems (β=.38; P<.001). The strength of the association did not depend on user age. Poor EHR usability was also associated with higher levels of cognitive failures (β=.28; P<.001). There was a significant interaction effect between age and EHR usability for cognitive failures (β=.04; P<.001). Young nurses who found the EHR difficult to use reported the most cognitive failures.

Conclusions: Information system stress due to poor EHR usability afflicts younger and older nurses alike. However, younger nurses starting their careers may be more cognitively burdened if they find EHR systems difficult to use compared to older nurses. Adequate support in using the EHRs may be particularly important to young registered nurses, who have a lot to learn and adopt in their early years of practice.

JMIR Med Inform 2020;8(11):e23623

doi:10.2196/23623

Keywords



Electronic health record (EHR) systems have increasingly replaced paper-based practices in hospitals, with the expectation of providing many clinical and organizational benefits [1,2]. Implementation of EHRs will inevitably change work practices in health care [3,4] and, if not properly managed, may result in many unexpected and unintended consequences. In addition to the benefits identified (eg, reduction of medication errors), health care professionals have reported disadvantages, such as increased emotional strain and increased errors when trying to learn and adapt to new technologies and managing their workflow disruptions [2,5,6]. Implementation and use of EHRs have also required increased effort from professionals in performing their typical task flow [7], which in turn has resulted in increased cognitive workload and decreased cognitive performance [8]. In addition to missing focus on proactive workflow redesign during EHR implementation, earlier studies have found that many of the unfavorable consequences are connected with the usability issues of EHR systems, referring to how easy the system is to use and how precisely and efficiently required tasks can be performed [9,10].

Nurses, as the largest group of health care professionals, are the main end users of the EHRs, and their daily work is greatly influenced by ease of use as well as technical and functional quality of the systems. According to previous studies, both Finnish nurses and physicians are dissatisfied with the usability of their EHR systems [11]. Nurses’ experiences of the poor usability of EHRs and how they can negatively affect workflow appear to be consistent across countries [12,13]. Ease of use and high quality of information systems promote the use of technology and support the management of care records [14]. However, EHRs that are perceived as difficult to use have been shown to be associated with increased stress levels [15] and cognitive workload among nurses [16,17], which may consequently increase the risk of cognitive failures [18]. Cognitive failure is defined as “a cognitively based error that occurs during the performance of a task that a person is normally successful in executing” [19]. The failure can occur in a person’s memory functions, attention regulation, or actions [20], and the incidence is connected with work environment–related [18,21] and individual factors [20].

So far, only limited and contradictory knowledge exists on whether the consequences of poor EHR usability, particularly stress or impairment in cognitive functions, could depend on end user characteristics such as age. First, age-group differences in the likelihood of experiencing EHR-related stress have not been found [22]. However, experienced (and thus likely older) nurses can have more negative attitudes toward the use of new technologies in clinical work [23]. They may potentially experience more stress and higher cognitive workload than younger professionals, who may adapt better to digitization-related changes [16]. Second, youth has been associated with higher nursing informatics competence, such as skills in electronic documentation and use of information technology [24], which can make working with the EHRs easier and be a factor in protecting nurses’ well-being at work [15]. Nevertheless, while young nurses starting their careers may be more skilled in and used to using technology than older nurses, they are still probably less experienced in using EHR systems in their work. Multiple studies have suggested that integrating EHRs into daily workflow and performing EHR-related tasks may be easier and require less cognitive effort from more experienced EHR users than from novice users [17,25].

Based on our knowledge, there is little evidence of whether nurses of a certain age are more at risk of experiencing stress or increased cognitive workload due to poor usability of EHR systems. In light of previous evidence, differences may exist between nurses of different ages, but the findings are mixed and the potential moderating effect of EHR usability has not been investigated. Moreover, previous studies examining the negative outcomes linked to EHR usability, such as stress, have mainly focused on physicians [26-28] and less on nurses [22]. Identifying those most at risk of experiencing EHR-related disadvantages is important in order to provide them with adequate support in using the systems. Most importantly, the topic requires further investigation because problems related to EHR usability and subsequent issues of stress and impairment in cognitive performance are notable threats to the quality of care and patient safety [18,29,30]. This study aimed to investigate the associations of EHR usability and user’s age with stress related to information systems and cognitive failure at work among registered nurses. Additionally, we examined whether the possible associations of EHR usability with stress related to information systems and cognitive failures are modified by user age.


Setting, Data Collection, and Participants

In 2017, a nationwide cross-sectional survey was conducted in Finland on registered nurses’ experiences with currently used EHR systems [15,31,32]. The data were collected with a web-based questionnaire that was sent to all the registered nurses (n=29,283) who were members of the Finnish Nurses Association and the National Association of Health and Welfare Professionals and had provided an email address. Altogether, 3607 of the 29,283 nurses responded to the questionnaire (a 12.3% response rate). Nurses with missing information on any of the demographic variables (age, gender, employment sector) were excluded from the study (n=224), resulting in a final sample of 3383 nurses. In the Finnish public health care system, the EHR coverage has been 100% since 2010 [33]. Over 20 EHR brands are being used in different health and social care settings [31].

Measurements

The EHR usability was measured with 7 ease of use–related items (α=.84) from the validated National Usability-Focused Health Information System Scale (NuHISS) [34]. The items were as follows: (1) the arrangement of fields and functions is logical on a computer screen; (2) the systems keep me clearly informed about what it is doing (eg, saving data); (3) terminology on the screen is clear and understandable (eg, titles and labels); (4) routine tasks can be performed in a straightforward manner without the need for extra steps using the system; (5) it is easy to obtain necessary patient information using the information system; (6) entering and documenting patient data is quick, easy, and smooth; and (7) the information on the nursing record is in an easily readable format. Items were rated on a 5-point scale (1=fully disagree to 5=fully agree). A higher score on ease of use items indicates better experienced usability.

Stress related to information systems was measured with 2 items (α=.62) that evaluated how often during the past half-year period the person has been distracted, worried, or stressed about (1) constantly changing information systems and (2) difficult, poorly performing information technology equipment or software [26]. The items were rated on a 5-point scale ranging from 1 (never) to 5 (very often). This measure has been previously used with physicians and is associated with EHR usability and distress [27,35].

Cognitive failures were measured with 3 items (α=.59) modified from the 15-item Workplace Cognitive Failure Scale (WCFS) [20,36]. The WCFS includes 3 dimensions: failure in memory, failure in attention, and failure in action. Regarding the length of the survey questionnaire, we had to limit the number of questions and chose 1 item per dimension to measure nurses’ cognitive failures. The selection of these items was based on their highest loadings for the 3 factors or dimensions of cognitive failure [20]. Participants were asked to rate how often they have faced situations at work where they (1) have not remembered a work-related password, set of numbers, etc (memory failure); (2) have not fully listened to the instructions or requests they have received (attention failure); or (3) have accidentally started or closed the wrong device, system, or program (action failure). Items were answered on a 5-point scale ranging from 1 (never) to 5 (several times a day).

Other variables included were age, gender, and employment sector (1=hospital, 2=health center, 3=private sector, 4=social services, or 5=other).

Data Analysis

Continuous variables are summarized using mean and standard deviation, and categorical variables are presented as the number of participants and percentage. Multiple linear regression was used to examine the associations of EHR usability and nurse’s age with stress related to information systems and cognitive failures. This method was chosen because the associations were assumed to be linear, and it offered easily interpreted output coefficients and a less complex algorithm compared to many other methods. Analyses were conducted separately for both dependent variables (stress related to information systems and cognitive failures). In the first step, EHR usability and age were included as predictors in the model. In the second step, the combined effect of EHR usability and age was tested by adding an interaction term to the former model. Age was divided by 10 for the analysis to assess a given decade’s association and make the estimated coefficients easier to interpret. All models were adjusted for gender and employment sector. The analyses were conducted using RStudio.


Characteristics of the Participants

The majority of the participants were female (3204/3383, 94.7%). They were, on average, 46.2 years old (range: 22-66), and over half of the participants worked in hospitals. There were differences in the estimated EHR usability (P<.001), stress related to information systems (P<.001), and cognitive failures (P=.02) between nurses working in different work environments. The EHR usability was rated highest among nurses who worked in social services. Nurses working in hospitals gave the lowest EHR usability ratings and had more stress related to information systems than nurses working in other fields. There were no gender differences in the values of the variables studied. Characteristics of the participants and descriptive statistics of the study variables are presented in Table 1.

Table 1. Characteristics of the participants (N=3383) and descriptive statistics.
Characteristicn (%)MeanSDMinimumMedianMaximum
Age, yearsN/Aa46.2211.1224866
Gender
 Male169 (5.0)N/AN/AN/AN/AN/A
 Female3204 (94.7)N/AN/AN/AN/AN/A
 Other10 (0.3)N/AN/AN/AN/AN/A
Employment sector
 Hospital1796 (53.1)N/AN/AN/AN/AN/A
 Health center707 (20.9)N/AN/AN/AN/AN/A
 Private clinic173 (5.1)N/AN/AN/AN/AN/A
 Social services433 (12.8)N/AN/AN/AN/AN/A
 Other274 (8.1)N/AN/AN/AN/AN/A
UsabilityN/A3.040.78135
SRISbN/A3.020.89135
Cognitive failuresN/A1.960.51125

aN/A: not applicable.

bSRIS: stress related to information systems.

Associations of EHR Usability and User Age With Stress Related to Information Systems and Cognitive Failures

The results of the linear regression analyses are shown in Table 2. The EHR usability was associated with both stress related to information systems (β=.38; P<.001) and cognitive failures (β=.28; P<.001). Higher levels of usability were associated with lower levels of both stress related to information systems and cognitive failures. Age was associated with cognitive failures (β=.16; P<.001) but not with stress related to information systems. Younger nurses had higher levels of cognitive failure compared to older nurses.

There was a significant interaction effect between age and EHR usability for the cognitive failures (β=.04; P<.001). Younger nurses who evaluated the EHR as difficult to use had the highest levels of cognitive failures. Among older nurses, usability was not associated with their cognitive failure levels (Figure 1). There was no interaction effect between age and EHR usability for the stress related to information systems (Figure 2). Figure 1 and Figure 2 illustrate the interaction effects.

Table 2. The associations of age and EHR usability with stress related to information systems and cognitive failures.
VariableEstimateP value
SRISa

Age.10.15

Gender.13.10

Employment sector


HospitalReferenceN/Ab


Health center.10.03


Private clinic.32<.001


Social service.18<.001


Other.16.03

Usability .38<.001

Age × usability .01.80

Adjusted R20.16N/A
Cognitive failures

Age.16<.001

Gender.02.74

Employment sector


HospitalReferenceN/A


Health center.08.01


Private clinic.03.60


Social service.00.93


Other.04.33

Usability .28<.001

Age × usability.04<.001

Adjusted R20.04N/A

aSRIS: stress related to information systems.

bN/A: not applicable.

Figure 1. Interaction effect between EHR usability (ease of use) and user’s age for cognitive failures. The association is shown for low (mean − 1 SD), average, and high (mean + 1 SD) levels of ease of use. EHR: electronic health record.
View this figure
Figure 2. Interaction effect between EHR usability (ease of use) and user’s age for information system–related stress. The association is shown for low (mean − 1 SD), average, and high (mean + 1 SD) levels of ease of use. EHR: electronic health record.
View this figure

Principal Findings

This study examined the associations of EHR usability and user’s age with stress related to information systems and cognitive failures among Finnish registered nurses. The practical goal was to increase system vendors’, health care managers’, and nursing educators’ awareness of the potential consequences of poor EHR usability, a shared problem among nurses in many countries that may jeopardize the quality and safety of care [12,29]. As predicted, we found that EHR usability was associated with both stress related to information systems and cognitive failures. Nurses who provided higher usability ratings had less stress and fewer cognitive failures compared to nurses providing lower ratings. The nurses’ age, in turn, was not associated with stress related to information systems, but it was negatively associated with cognitive failures. We also found a significant interaction effect between age and EHR usability for cognitive failures, indicating that young nurses who rated EHRs as difficult to use had the most cognitive failures.

The finding that young nurses’ cognitive functions may be more impaired by poor EHR system usability compared to those of older nurses seems logical. The youngest nurses have probably worked in the field for the shortest time, and the early stages of a nursing career are known to be demanding and challenging, which can lead to their attentiveness and memory being strained [37,38]. In addition, older nurses with more experience of using EHRs and various EHR brands may find it easier to integrate information systems into daily workflow than less experienced nurses [25]. A previous study has shown conflicting results and found a relationship between higher age and increased risk of cognitive failures among nurses [21]. However, this result was explained by the fact that older nurses may have lower work ability, which is associated with an increased risk of cognitive failures in certain work environments [21]. Differences in work environments also emerged in this study, and it appears that EHRs may be particularly burdensome for nurses working in hospital settings, who found the systems most difficult to use and experienced the most stress compared to nurses working in other environments. It would be important to find out the views of nurses working in the hospital environment about the weaknesses of EHRs and how systems should be developed to improve their perceived usability and thereby reduce stress.

Due to new role adjustment, duties, responsibilities, and work environments, many new nurses experience increased stress and emotional exhaustion [39]. These symptoms have been associated with deterioration in cognitive performance (eg, in attention and memory functions), and this applies especially to professions with high levels of work pressure and intense cognitive demands, like nursing [40]. Although we only looked at stress related to information systems in this study, it is possible that the high level of strain early in their careers may partly explain why young nurses in this study had more cognitive failures. Moreover, due to lack of expertise and the fact that the youngest generation of nurses are the most likely to change jobs [41,42], they constantly have much to learn at work. This, on top of a load caused by EHRs that are difficult to use, may increase task stressors, such as performance constraints, task uncertainty, or difficulties managing time pressure and frequent interruptions, all of which are shown to foster cognitive failure [43].

It is evident that EHRs should support nurses in carrying out their work tasks and not in turn increase workload, stress, or cognitive burden. A recent review by Wisner et al concluded that EHRs have the potential to support the cognitive work of health care staff, but the scattering of information, information complexity, and lack of chronology often hampers this. Encountering problems while trying to find or synthesize information can affect a nurse’s ability to achieve and maintain clinical understanding and situational awareness, which can compromise patient safety [8]. Usability and stability of information systems as well as end user involvement in system development and work procedure planning may be significant factors in alleviating stress related to information systems [15,26]. Since improving the usability of EHR systems seems to be challenging, the importance of adequate orientation and support at work to use information systems is critical.

In this study, challenges were observed especially in young nurses, whereby there is also a need to discuss whether current nursing education provides students with adequate knowledge and skills on how to use and integrate EHRs into daily work. Shortcomings have been identified in both theoretical and practical studies and, for example, in students’ opportunities to practice documentation with real EHR systems during their education [44,45]. The fact that using the systems can often only be learned and practiced in the workplace after graduation puts an additional burden on young nurses when there is still a lack of mastery of the work and nursing as a whole. Moreover, the large number of different EHR brands and their differences in usage logic, for example, may slow the process of learning to use them.

Currently, work tasks that require the use of EHRs, such as documentation, take up a significant portion of nurses’ day-to-day working hours [46]. Potential time pressure can be alleviated by having a high-quality information system [15]. Our study suggests that young nurses in particular could benefit from well-designed and implemented EHR systems that support routine tasks (eg, easy access to the information needed to treat the patient). Another interesting finding was that while poor usability of EHRs was associated with nurses’ higher stress related to information systems, the level of stress did not vary significantly between younger and older nurses. In other words, the levels of tolerance of EHR usability problems appeared to be equal in nurses of different ages. The results of this study contradict the stereotypical idea that millennial nurses who have grown up with digitization and who are more accustomed to coping with a variety of electronic platforms and tasks simultaneously [47] would automatically be less burdened by information systems than those nurses who have had to learn to work with them at a later age. Older nurses may compensate for the slower adoption of information systems with their experience and better management of patients’ overall care.

Limitations

Possible limitations of this study should be considered when interpreting the results. First, in spite of representativeness of the responses in a large sample of Finnish registered nurses [31], the response rate to the survey remained rather low. This may limit the generalizability of the findings to a larger research population. Second, we were able to use only 3 items from the scale measuring cognitive failures (WCFS), and the reliability of this measure (0.59) can be considered low. The WCFS has demonstrated high internal consistency for the whole scale and subscale level and the 3 items that were chosen for this study are the most indicative of the 3 components (attention, memory, function) of cognitive failure [20]. Third, although we controlled the analysis for gender and employment sector, we are aware that some other variables may have contributed to stress related to information systems and cognitive failures as well (such as how long a person has used the current EHR system). Finally, the cross-sectional design did not allow the detection of causal relationships of the variables under study. The data used in this study was based on the first national survey of Finnish nurses gathered using the validated NuHISS [34]. A resurvey will be conducted in 2020, which will allow for further investigation of this topic.

Conclusions

Poor usability of EHRs can place a significant strain on the day-to-day work of nurses. This study suggests that cognitive performance, especially among young nurses, may be disturbed due to poor EHR usability. Young nurses need support and familiarization in many aspects of nursing during their first years in practice, and attention should be paid to providing them with appropriate support and training in the use of EHRs, which takes up a considerable amount of their working time. The results indicate that young nurses, who are typically believed to be fluent information technology users, may be burdened with poorly functioning information systems, possibly even more than their older colleagues are. System vendors have the primary responsibility to ensure the usability of their systems and to contribute to the quality of care and patient safety. It could be useful to investigate whether some usability factors are more critical than others. However, addressing the weaknesses of EHRs may be slow. In order to tackle the adverse consequences, it is important that employers provide adequate support for the right groups and that educational institutions provide students with adequate training in the use of EHRs. Further research should pay attention to the experiences of nurses of different ages and at different career stages in relation to the use of EHRs. It would also be useful to investigate the relationship between EHR education received as a student and early career stress and cognitive burden related to information systems. Finally, studies with longitudinal designs are needed to detect causal associations such as whether usability problems lead to cognitive failures.

Acknowledgments

This work was funded by the Strategic Research Council at the Academy of Finland (project 327145) and the Ministry of Social Affairs and Health (project 112241).

Authors' Contributions

AMK, KG, and TH conceptualized the study and developed the methodology. AMK and KG conducted the analysis. AMK wrote the original draft. All authors reviewed and edited the manuscript. TH provided supervision for the study.

Conflicts of Interest

None declared.

  1. Hyppönen H, Lumme S, Reponen J, Vänskä J, Kaipio J, Heponiemi T, et al. Health information exchange in Finland: Usage of different access types and predictors of paper use. Int J Med Inform 2019 Feb;122:1-6. [CrossRef] [Medline]
  2. Menachemi N, Collum TH. Benefits and drawbacks of electronic health record systems. Risk Manag Healthc Policy 2011 May;4:47-55 [FREE Full text] [CrossRef] [Medline]
  3. Vikkelsø S. Subtle redistribution of work, attention and risks: Electronic patient records and organisational consequences. Scandinavian Journal of Information Systems 2005;17(1):10 [FREE Full text]
  4. Irizarry T, Barton AJ. A sociotechnical approach to successful electronic health record implementation: five best practices for clinical nurse specialists. Clin Nurse Spec 2013;27(6):283-285 [FREE Full text] [CrossRef] [Medline]
  5. Fleming NS, Culler SD, McCorkle R, Becker ER, Ballard DJ. The financial and nonfinancial costs of implementing electronic health records in primary care practices. Health Aff (Millwood) 2011 Mar;30(3):481-489. [CrossRef] [Medline]
  6. Gephart SM, Bristol AA, Dye JL, Finley BA, Carrington JM. Validity and Reliability of a New Measure of Nursing Experience With Unintended Consequences of Electronic Health Records. Comput Inform Nurs 2016 Oct;34(10):436-447. [CrossRef] [Medline]
  7. Bristol AA, Nibbelink CW, Gephart SM, Carrington JM. Nurses' Use of Positive Deviance When Encountering Electronic Health Records-Related Unintended Consequences. Nurs Adm Q 2018;42(1):E1-E11. [CrossRef] [Medline]
  8. Wisner K, Lyndon A, Chesla CA. The electronic health record's impact on nurses' cognitive work: An integrative review. Int J Nurs Stud 2019 Jun;94:74-84. [CrossRef] [Medline]
  9. Belden JL, Grayson R, Barnes J. Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. Healthcare Information and Management Systems Society (HIMSS). 2009.   URL: https:/​/www.​researchgate.net/​publication/​277829258_Defining_and_Testing_EMR_Usability_Principles_and_Proposed_Methods_of_EMR_Usability_Evaluation_and_Rating [accessed 2020-10-27]
  10. Viitanen J, Hyppönen H, Lääveri T, Vänskä J, Reponen J, Winblad I. National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability. Int J Med Inform 2011 Oct;80(10):708-725. [CrossRef] [Medline]
  11. Kaipio J, Kuusisto A, Hyppönen H, Heponiemi T, Lääveri T. Physicians' and nurses' experiences on EHR usability: Comparison between the professional groups by employment sector and system brand. Int J Med Inform 2020 Feb;134:104018 [FREE Full text] [CrossRef] [Medline]
  12. Topaz M, Ronquillo C, Peltonen L, Pruinelli L, Sarmiento RF, Badger MK, et al. Nurse Informaticians Report Low Satisfaction and Multi-level Concerns with Electronic Health Records: Results from an International Survey. AMIA Annu Symp Proc 2016;2016:2016-2025 [FREE Full text] [Medline]
  13. Gephart S, Carrington JM, Finley B. A Systematic Review of Nurses' Experiences With Unintended Consequences When Using the Electronic Health Record. Nurs Adm Q 2015;39(4):345-356. [CrossRef] [Medline]
  14. Koivunen M, Saranto K. Nursing professionals' experiences of the facilitators and barriers to the use of telehealth applications: a systematic review of qualitative studies. Scand J Caring Sci 2018 Mar;32(1):24-44. [CrossRef] [Medline]
  15. Vehko T, Hyppönen H, Puttonen S, Kujala S, Ketola E, Tuukkanen J, et al. Experienced time pressure and stress: electronic health records usability and information technology competence play a role. BMC Med Inform Decis Mak 2019 Aug 14;19(1):160 [FREE Full text] [CrossRef] [Medline]
  16. Colligan L, Potts HW, Finn CT, Sinkin RA. Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record. Int J Med Inform 2015 Jul;84(7):469-476. [CrossRef] [Medline]
  17. Saitwal H, Feng X, Walji M, Patel V, Zhang J. Assessing performance of an Electronic Health Record (EHR) using Cognitive Task Analysis. Int J Med Inform 2010 Jul;79(7):501-506. [CrossRef] [Medline]
  18. Park Y, Kim SY. Impacts of Job Stress and Cognitive Failure on Patient Safety Incidents among Hospital Nurses. Saf Health Work 2013 Dec;4(4):210-215. [CrossRef] [Medline]
  19. Martin M. Cognitive failure: Everyday and laboratory performance. Bull Psychon Soc 2013 Oct 24;21(2):97-100. [CrossRef]
  20. Wallace JC, Chen G. Development and validation of a work-specific measure of cognitive failure: Implications for occupational safety. J Occup Organ Psychol 2005;78(4):615-632 [FREE Full text] [CrossRef]
  21. Abbasi M, Zakerian A, Kolahdouzi M, Mehri A, Akbarzadeh A, Ebrahimi MH. Relationship between Work Ability Index and Cognitive Failure among Nurses. Electron Physician 2016 Mar;8(3):2136-2143 [FREE Full text] [CrossRef] [Medline]
  22. Harris DA, Haskell J, Cooper E, Crouse N, Gardner R. Estimating the association between burnout and electronic health record-related stress among advanced practice registered nurses. Appl Nurs Res 2018 Oct;43:36-41. [CrossRef] [Medline]
  23. Kowitlawakul Y. The technology acceptance model: predicting nurses' intention to use telemedicine technology (eICU). Comput Inform Nurs 2011 Jul;29(7):411-418. [CrossRef] [Medline]
  24. Khezri H, Abdekhoda M. Assessing nurses’ informatics competency and identifying its related factors. Journal of Research in Nursing 2019 Apr 16;24(7):529-538. [CrossRef]
  25. Ward MM, Vartak S, Schwichtenberg T, Wakefield DS. Nurses' perceptions of how clinical information system implementation affects workflow and patient care. Comput Inform Nurs 2011 Sep;29(9):502-511. [CrossRef] [Medline]
  26. Heponiemi T, Hyppönen H, Vehko T, Kujala S, Aalto A, Vänskä J, et al. Finnish physicians' stress related to information systems keeps increasing: a longitudinal three-wave survey study. BMC Med Inform Decis Mak 2017 Oct 17;17(1):147 [FREE Full text] [CrossRef] [Medline]
  27. Heponiemi T, Kujala S, Vainiomäki S, Vehko T, Lääveri T, Vänskä J, et al. Usability Factors Associated With Physicians' Distress and Information System-Related Stress: Cross-Sectional Survey. JMIR Med Inform 2019 Nov 05;7(4):e13466 [FREE Full text] [CrossRef] [Medline]
  28. Babbott S, Manwell LB, Brown R, Montague E, Williams E, Schwartz M, et al. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc 2014 Feb;21(e1):e100-e106. [CrossRef] [Medline]
  29. Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, American Medical Informatics Association. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013 Jun;20(e1):e2-e8 [FREE Full text] [CrossRef] [Medline]
  30. Holden R. Cognitive performance-altering effects of electronic medical records: An application of the human factors paradigm for patient safety. Cognition, Technology & Work 2011 Mar;13(1):11-29 [FREE Full text] [CrossRef] [Medline]
  31. Hyppönen H, Lääveri T, Hahtela N, Suutarla A, Sillanpää K, Kinnunen UM, et al. Smart systems for capable users? Nurses' experiences on patient information systems 2017. Finnish Journal of eHealth and eWelfare 2018;1(10):30-59. [CrossRef]
  32. Kinnunen U, Heponiemi T, Rajalahti E, Ahonen O, Korhonen T, Hyppönen H. Factors Related to Health Informatics Competencies for Nurses-Results of a National Electronic Health Record Survey. Comput Inform Nurs 2019 Aug;37(8):420-429. [CrossRef] [Medline]
  33. Reponen J, Kangas M, Hämäläinen P. Use of information and communications technology in Finnish health care in 2014. Current situation and trends. Helsinki: National Institute for Health and Welfare (THL); 2015.   URL: https://www.julkari.fi/bitstream/handle/10024/126470/URN_ISBN_978-952-302-486-1.pdf [accessed 2020-10-27]
  34. Hyppönen H, Kaipio J, Heponiemi T, Lääveri T, Aalto A, Vänskä J, et al. Developing the National Usability-Focused Health Information System Scale for Physicians: Validation Study. J Med Internet Res 2019 May 16;21(5):e12875 [FREE Full text] [CrossRef] [Medline]
  35. Heponiemi T, Hyppönen H, Kujala S, Aalto A, Vehko T, Vänskä J, et al. Predictors of physicians' stress related to information systems: a nine-year follow-up survey study. BMC Health Serv Res 2018 Apr 13;18(1):284 [FREE Full text] [CrossRef] [Medline]
  36. Kalakoski V, Selinheimo S, Valtonen T, Turunen J, Käpykangas S, Ylisassi H, et al. Effects of a cognitive ergonomics workplace intervention (CogErg) on cognitive strain and well-being: a cluster-randomized controlled trial. A study protocol. BMC Psychol 2020 Jan 02;8(1):1 [FREE Full text] [CrossRef] [Medline]
  37. Labrague L, McEnroe-Petitte D. Job stress in new nurses during the transition period: an integrative review. Int Nurs Rev 2018 Dec;65(4):491-504. [CrossRef] [Medline]
  38. Halpin Y, Terry LM, Curzio J. A longitudinal, mixed methods investigation of newly qualified nurses' workplace stressors and stress experiences during transition. J Adv Nurs 2017 Nov;73(11):2577-2586. [CrossRef] [Medline]
  39. Rudman A, Gustavsson JP. Early-career burnout among new graduate nurses: a prospective observational study of intra-individual change trajectories. Int J Nurs Stud 2011 Mar;48(3):292-306. [CrossRef] [Medline]
  40. Deligkaris P, Panagopoulou E, Montgomery A, Maseura E. Job burnout and cognitive functioning: A systematic review. Work & stress 2014;28(2):107-123. [CrossRef]
  41. Salminen H. Turning the tide: Registered nurses' job withdrawal intentions in a Finnish university hospital. SA Journal of Human Resource Management 2012 Feb 17;10(2):1-11 [FREE Full text] [CrossRef]
  42. Rudman A, Omne-Pontén M, Wallin L, Gustavsson PJ. Monitoring the newly qualified nurses in Sweden: the Longitudinal Analysis of Nursing Education (LANE) study. Hum Resour Health 2010 Apr 27;8:10 [FREE Full text] [CrossRef] [Medline]
  43. Elfering A, Grebner S, Dudan A. Job characteristics in nursing and cognitive failure at work. Saf Health Work 2011 Jun;2(2):194-200 [FREE Full text] [CrossRef] [Medline]
  44. Miller L, Stimely M, Matheny P, Pope M, McAtee R, Miller K. Novice nurse preparedness to effectively use electronic health records in acute care settings: Critical informatics knowledge and skill gaps. Online Journal of Nursing Informatics (OJNI) 2014;18(2) [FREE Full text]
  45. Forman TM, Armor DA, Miller AS. A Review of Clinical Informatics Competencies in Nursing to Inform Best Practices in Education and Nurse Faculty Development. Nurs Educ Perspect 2020;41(1):E3-E7. [CrossRef] [Medline]
  46. Baumann LA, Baker J, Elshaug AG. The impact of electronic health record systems on clinical documentation times: A systematic review. Health Policy 2018 Aug;122(8):827-836. [CrossRef] [Medline]
  47. Gibson L, Sodeman W. Millennials and technology: Addressing the communication gap in education and practice. Organization Development Journal 2014;32(4):63-75 [FREE Full text]


EHR: electronic health record
NuHISS: National Usability-Focused Health Information System Scale
WCFS: Workplace Cognitive Failure Scale


Edited by C Lovis; submitted 18.08.20; peer-reviewed by Q Do, J Tayaben; comments to author 26.09.20; revised version received 01.10.20; accepted 11.10.20; published 18.11.20

Copyright

©Anu-Marja Kaihlanen, Kia Gluschkoff, Hannele Hyppönen, Johanna Kaipio, Sampsa Puttonen, Tuulikki Vehko, Kaija Saranto, Liisa Karhe, Tarja Heponiemi. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 18.11.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.