This paper is in the following e-collection/theme issue:

Adoption and Change Management of eHealth Systems (677) Artificial Intelligence (1214) Decision Support for Health Professionals (1145) Clinical Information and Decision Making (1339)

Published on in Vol 10, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34678, first published .
Perspective of Information Technology Decision Makers on Factors Influencing Adoption and Implementation of Artificial Intelligence Technologies in 40 German Hospitals: Descriptive Analysis

Perspective of Information Technology Decision Makers on Factors Influencing Adoption and Implementation of Artificial Intelligence Technologies in 40 German Hospitals: Descriptive Analysis

Perspective of Information Technology Decision Makers on Factors Influencing Adoption and Implementation of Artificial Intelligence Technologies in 40 German Hospitals: Descriptive Analysis

Authors of this article:

Lina Weinert1 Author Orcid Image ;   Julia Müller1 Author Orcid Image ;   Laura Svensson1 Author Orcid Image ;   Oliver Heinze1 Author Orcid Image
Article Authors Cited by (6) Tweetations (2) Metrics

    Original Paper

    Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany

    Corresponding Author:

    Lina Weinert, MSc

    Institute of Medical Informatics

    Heidelberg University Hospital

    Im Neuenheimer Feld 130.3

    Heidelberg, 69120

    Germany

    Phone: 49 622156 ext 34367

    Email: lina.weinert@med.uni-heidelberg.de


    Background: New artificial intelligence (AI) tools are being developed at a high speed. However, strategies and practical experiences surrounding the adoption and implementation of AI in health care are lacking. This is likely because of the high implementation complexity of AI, legacy IT infrastructure, and unclear business cases, thus complicating AI adoption. Research has recently started to identify the factors influencing AI readiness of organizations.

    Objective: This study aimed to investigate the factors influencing AI readiness as well as possible barriers to AI adoption and implementation in German hospitals. We also assessed the status quo regarding the dissemination of AI tools in hospitals. We focused on IT decision makers, a seldom studied but highly relevant group.

    Methods: We created a web-based survey based on recent AI readiness and implementation literature. Participants were identified through a publicly accessible database and contacted via email or invitational leaflets sent by mail, in some cases accompanied by a telephonic prenotification. The survey responses were analyzed using descriptive statistics.

    Results: We contacted 609 possible participants, and our database recorded 40 completed surveys. Most participants agreed or rather agreed with the statement that AI would be relevant in the future, both in Germany (37/40, 93%) and in their own hospital (36/40, 90%). Participants were asked whether their hospitals used or planned to use AI technologies. Of the 40 participants, 26 (65%) answered “yes.” Most AI technologies were used or planned for patient care, followed by biomedical research, administration, and logistics and central purchasing. The most important barriers to AI were lack of resources (staff, knowledge, and financial). Relevant possible opportunities for using AI were increase in efficiency owing to time-saving effects, competitive advantages, and increase in quality of care. Most AI tools in use or in planning have been developed with external partners.

    Conclusions: Few tools have been implemented in routine care, and many hospitals do not use or plan to use AI in the future. This can likely be explained by missing or unclear business cases or the need for a modern IT infrastructure to integrate AI tools in a usable manner. These shortcomings complicate decision-making and resource attribution. As most AI technologies already in use were developed in cooperation with external partners, these relationships should be fostered. IT decision makers should assess their hospitals’ readiness for AI individually with a focus on resources. Further research should continue to monitor the dissemination of AI tools and readiness factors to determine whether improvements can be made over time. This monitoring is especially important with regard to government-supported investments in AI technologies that could alleviate financial burdens. Qualitative studies with hospital IT decision makers should be conducted to further explore the reasons for slow AI.

    JMIR Med Inform 2022;10(6):e34678

    doi:10.2196/34678

    Keywords

    artificial intelligence; AI readiness; implementation; decision-making; descriptive analysis; quantitative study 


    Background

    In recent years, artificial intelligence (AI) in medicine has gained significant attention, with innovative technologies promising better quality of diagnosis [1-3], treatment [1], advancements in personalized medicine [1,4], and improvements in workflow [5]. Simultaneously, these technologies have the potential to save time and cost [1,6]. The use of AI could free health care workers from repetitive and tedious tasks and enable them to allocate their attention and time more effectively [7]. However, fears surrounding AI in health care persist. Common fears include possible job losses because of automation and negative effects on the patient-physician relationship [2,8,9]. For this study, we used the definition by He et al [10]. They define AI as “a branch of applied computer science wherein computer algorithms are trained to perform tasks typically associated with human intelligence” [10]. There are different relevant subcategories of AI, such as machine learning and deep learning, with different implications for professional users and health care organizations. However, in this study, we focused on the general concept of AI in hospitals.

    A recent systematic review by Yin et al [5] demonstrated hesitancy and slow uptake of AI technologies. The authors reported on real-life implementations of AI in health care. Their search retrieved 51 real-life clinical implementations of AI worldwide, with most studies conducted in the United States. The most common applications of AI tools were in the field of decision support. These technologies mainly focus on specific diseases such as sepsis, breast cancer, and diabetic retinopathy [5]. Diverging outcome measures and low-quality studies were prevalent in the review, making it difficult for decision makers to compare and evaluate AI effectiveness, advantages, and disadvantages. Furthermore, they found that outcome evaluation and acceptance measures only included patients and health care workers [5]. Their search strategy retrieved only one paper from Germany, which is in contrast with the German government’s AI strategy [11] and recent political efforts to increase the use of AI in hospitals [12]. Hence, we identified a need to investigate the current spread of AI technologies in hospitals and their stage of development as well as AI readiness factors in Germany.

    The transfer of new and innovative technologies into practice is usually associated with barriers and requires employees’ and institutions’ ability to adapt to change [13,14]. Recently, existing frameworks and learnings on the dissemination of innovative technologies have been applied to AI [15]. Three main components can be outlined: (1) adoption, which entails the decision to use an innovation [16]; (2) readiness, encompassing the assessment of the conditions needed to engage in an activity [17]; and (3) implementation, describing an innovation’s transfer into practice [15].

    Although new AI technologies are being developed at a high speed, strategies and practical experiences surrounding the adoption and implementation of AI in health care are lacking [10,18]. This is partly because of the high implementation complexity of AI, as it is neither easy to use nor easy to deploy [17,19]. Furthermore, AI can be difficult to understand and has been described as a black box, meaning a machine with nontransparent workings and inexplicable results of automated algorithms. This has the potential to lower trust and discourage decision makers and users [4,20,21].

    Aims

    This study presents the first large-scale web-based survey on the current adoption and implementation of AI technologies in randomly selected German hospitals. We further aimed to gain insights into the number, type, and developmental stage of the AI technologies currently in use. In addition to the literature on AI readiness and adoption, we examined the applicability of existing AI readiness factors to the German health care sector.


    Study Design

    A quantitative study design was used to obtain a general overview of the situation in Germany. Data were collected using an anonymous web-based questionnaire. We invited chief information officers (CIOs) from randomly selected German hospitals. We identified CIOs as important intermediaries because their position is linked to the clinical implementation of AI as well as to developers, technology companies, and regulatory authorities. Anonymity was ensured throughout the study.

    Ethics Approval

    The study was approved by the Ethics Committee of Heidelberg University Hospital (S-490/2020). The study was conducted according to the Checklist for Reporting Results of Internet E-Surveys checklist for quantitative research [22].

    Instrument Development and Design

    After consulting existing literature on AI readiness, implementation, and adoption, the authors conducted a creative brainstorming process to develop preliminary survey items. The preliminary items were compared with existing theoretical frameworks.

    Jöhnk et al [15] developed a model that focused on organizational AI readiness. They described AI readiness both as a predecessor and a constant influence on AI adoption and implementation [15]. Jöhnk et al [15] identified 18 organizational readiness factors in 5 categories (strategic alignment, resources, knowledge, culture, and data) and pointed out that these factors continuously foster AI adoption [15]. Awareness of these factors can improve the adoption and implementation outcomes, as a higher level of organizational readiness is believed to increase the success of innovation adoption while lowering the risk of failure [20,23]. For example, knowledge and awareness of AI were shown to be prerequisites for successful AI adoption [15,24,25].

    The technological-organizational-environmental framework by DePietro et al [26] describes the adoption, implementation, and use of technology in firms as dependent on the technological, organizational, and the environmental context [27]. Pumplun et al [24] first applied this framework to AI and discussed that challenges to AI readiness can be observed at all of these levels. Observed technological challenges often stem from data accessibility issues owing to AI’s need for extensive databases and adjacent data privacy considerations [24,28]. Environmental challenges include questions about consumer and patient trust in AI, regulatory acceptance, and in some cases, mandated work councils (mandated institutions of nonunion employee representation) [6,24,29,30]. Concerning organizational challenges, a lack of (top) managerial support has been identified as very relevant [17]. A further challenge is the need for highly skilled and trained staff (eg, data scientists, a very sought-after group of professionals) [15,17]. Financial aspects, such as unclear reimbursement processes for health care delivered by AI and liability issues, contribute to hesitancy in AI adoption and implementation [1].

    On the basis of these theoretical considerations, LW, JM, and LS refined the survey design and wording of the questions. In the first section, the questionnaire focused on participants’ general professional opinions on AI in hospitals to assess the hospital’s strategic alignment and their stance in the AI adoption phase. The second section asked participants to state their hospital’s use of AI technologies, which helped us gain insight into the dissemination of AI technologies. In the following sections, the survey presents items on known perceived barriers, opportunities, and resources needed for the implementation of AI in hospitals. In addition to these questions, the questionnaire also asked for sociodemographic data of the participants, hospital size, and hospital ownership (private, public, or nonprofit). A translated English version of the survey can be found in Multimedia Appendix 1.

    The survey was pretested by 6 researchers from the field of medical informatics, using a cognitive pretesting method [31]. The pretest participants suggested changes in the wording and order of questions. These suggestions were implemented, and the final survey was created.

    The final survey did not include any randomized or alternated items. Adaptive questioning was used to reduce the length of the questionnaires. On average, the 10-page questionnaire contained 6.3 items per page. Possible answers were either presented on a 5-point Likert scale or as yes or no, with I don’t know and prefer not to say as alternative options. Few questions were asked for further elaboration of answers in open-text formats. Automatic checks for completeness were performed, and participants were required to choose an answer for each question. Cookies were used to assign unique user IDs. Participants were offered the option to return and modify their answers. They were also able to leave the survey and continue it later. IP addresses of participants were neither saved nor checked. REDCap (Research Electronic Data Capture; Vanderbilt University) [32,33] hosted at the Heidelberg University Hospital was used for data collection and management. REDCap is a secure web-based software platform designed to support data capture for research studies [32,33].

    Data Collection and Analysis

    From a publicly available database of all hospitals in Germany provided by the German Hospital Federation [34], we randomly selected the hospitals we wanted to include in our recruitment process by performing a spreadsheet calculation. We aimed for an equal, realistic representation of hospital size (measured through the number of hospital beds) in each sample. We then checked whether the selected hospitals were actually in operation. Other specific inclusion and exclusion criteria were not applied, as we wanted to depict a realistic reflection of all the hospitals in Germany. In addition to this random selection, we included all academic hospitals in Germany in our recruitment efforts. CIOs and their contact details were manually retrieved from the websites of hospitals. We recruited participants from 609 hospitals in 4 rounds of recruitment. Initially, participants were invited via email to participate in the study. The emails contained a link to access the open survey and information about the study (eg, purpose of the study, length of questionnaire, data protection guidelines, and investigators). As participation in this study was voluntary and anonymous, we regarded survey completion as consent for study participation and data use.

    Although all 4 rounds followed the same administrative process, we used additional measures in recruitment rounds 3 and 4 to increase the number of participants. In round 3, we used telephonic prenotifications when an office telephone number was publicly available. In round 4 of recruitment, we designed invitational leaflets that were sent via mail. The leaflets encompassed a short informational text and a QR code, leading to the open survey. For each round, we sent 2 reminders via email. Our survey was not advertised elsewhere, as we wanted to include only members of our specific target group in the sample. No incentives were offered to the study participants.

    Data were collected from October 2020 to February 2021. After completion, all data were exported from REDCap to SPSS statistical software (version 27, IBM). All data were checked for plausibility and analyzed by LW. Descriptive analyses were conducted. For open-item responses, recurring keywords and phrases were paraphrased and summarized.


    Overview

    Our database recorded 50 surveys, of which 10 were terminated early, usually in the first third of the survey. A total of 40 surveys were fully completed and were included in the analysis, resulting in a response rate of 6.6%. Timeframes were analyzed, but no unusual timeframes were observed. No statistical corrections were performed.

    Demographic Characteristics

    A total of 40 fully completed surveys were included in the analysis. Table 1 provides information on participant characteristics. Most participants were aged between 46 and 55 years (23/40, 58%), and most of the participants were male (33/40, 83%). Of the 40 participants, 26 (65%) said they were CIOs or leaders of the IT department of their institution. Other commonly mentioned professions included IT department employee (7/40, 18%) and research associate (4/40, 1%). Participants stated the ownership of their hospitals as follows: public hospital (30/40, 75%), nonprofit hospital (8/40, 20%), private hospital (2/40, 5%), and hospital with an academic affiliation (15/40, 38%)

    Table 1. Participant characteristics (N=40).
    CharacteristicsParticipants
    Gender, n (%)

    		Female5 (13)

    		Male33 (83)

    		Prefer not to say2 (5)
    Age group (years), n (%)

    		26 to 352 (5)

    		35 to 458 (20)

    		46 to 5523 (58)

    		56 to 655 (13)

    		>652 (5)
    Hospital ownership, n (%)

    		Public30 (75)

    		Nonprofit8 (20)

    		Private2 (5)
    Academic affiliation, n (%)

    		Academic15 (38)

    		Nonacademic25 (63)
    Number of beds in hospital, n (%)

    		1 to 1993 (8)

    		200 to 3995 (13)

    		400 to 5997 (18)

    		600 to 7994 (10)

    		>80021 (52)
    Positiona, n (%)

    		Chief information officer or head of IT26 (65)

    		Chief data officer1 (3)

    		Chief medical officer1 (3)

    		IT department employee7 (18)

    		Research associate4 (10)

    		Data scientist3 (8)

    		No answer1 (3)

    		Other3 (8)

    aSelection of multiple items possible.

    Participants’ Professional Opinions and Assessments

    Most participants were either undecided or said they rather disagreed with the statement that AI is relevant for the current health care provision in their hospital and in Germany. However, most participants agreed or rather agreed that AI would be relevant in the future, both in Germany (37/40, 93%) and in their own hospital (36/40, 90%). This fits well with most participants fully agreeing or rather agreeing that AI plays a role in their hospital’s strategy (22/40, 55%). On the topic of information about the possible application of AI in hospitals, the participants were more undecided. In all, 13% (5/40) of the participants fully agreed with the statement that they were well informed, and 38% (15/40) of the participants rather agreed that they were well informed. A total of 38% (15/40) of the respondents were undecided, and 13% (5/40) of the respondents said they were rather uninformed. Overall, the participants were rather optimistic about the use of AI technologies in their hospitals. Of the 40 participants, 14 (35%) rather agreed that their hospital was ready for AI, 14 (35%) were undecided, 7 (18%) said they were rather not ready, and only 4 (10%) stated that their hospital was not ready at all. One participant did not respond to this question.

    AI Technologies in Use or in Planning

    The next section of the questionnaire focused on AI tools and technologies. In the first subcategory, participants were asked whether their hospital used or planned to use AI technologies. Of the 40 participants, 26 (65%) answered “yes.” Through the following questions, participants were asked to describe these technologies in more detail. Most AI technologies were used or planned for patient care, followed by biomedical research, administration, and logistics and central purchasing. Other areas mentioned by the participants in free text were marketing, malware detection, and pathology. Participants were presented with a list of common AI technologies when they answered “yes” to the first question in this subcategory (Multimedia Appendix 1 provides the full list of technologies). For every listed AI technology, they could categorize their hospital’s current stance on this technology. The options included the following: in planning, in research and developmental stage, implementation phase, routine care, and not applicable. The most commonly chosen technologies overall were as follows: speech recognition and text analysis systems (20/26, 77%, assigned one of the stances other than not applicable), systems for picture recognition (17/26, 65%), and robotics and autonomous systems (17/26, 65%).

    Sensorics and communication systems were the least picked (10/26, 38%). Most technologies were in the planning phase.

    Concerning the integration of these technologies into the overarching system architecture, 27% (7/26) of the participants stated that technologies in their hospital were integrated, in 23% (6/26) of hospitals, technologies were not integrated but integration was planned, 38% (10/26) were partly integrated, and 12% (3/26) were not integrated. In free text, participants provided reasons for the lack of integration, which included missing interfaces; missing standards for interfaces, processes, and organization; unfavorable cost-benefit relationship; missing evaluation and overall concepts; and immaturity of the AI technology.

    In a question allowing for multiple choice, participants stated that some or all AI technologies in their institution were commonly developed with industry partners (23/26, 88%) or university-based research partners (9/26, 35%). Only 12% (3/26) of the participants stated that some or all of their AI technologies were developed within their own institutions.

    Barriers to AI Use and Possible Opportunities Associated With AI

    The second subcategory included questions about perceived barriers to the use of AI (Table 2). Through a matrix design, we presented the participants with a list of known barriers compiled from the literature. The barrier most participants (36/40, 90%) agreed or partly agreed with was lacking resources (staff, knowledge, financial). Other relevant barriers were lacking compatibility or interoperability with existing IT infrastructure (33/40, 83%) and quality of data (30/40, 75%). Participants also disagreed or rather disagreed with some of the barriers derived from the literature. Here, the barriers with the least agreement were leadership acceptance (4/40, 10%, agreed or rather agreed with the statement) and patient acceptance (4/40, 10%). Other barriers with low agreement were user (eg, physicians and nurses) acceptance (9/40, 23%) and corporate culture (13/40, 33%). In free text, some participants described additional barriers. These contained immaturity of available AI technologies, fear of high expenses in the training and learning phase of AI, and cloud strategies of AI producers.

    Table 2. Perceived barriers to implementation and use of artificial intelligence (N=40).
    RankingBarrierTotal participants in agreement and sample percentages, n (%)a
    1Lacking resources (staff, knowledge, and financial)36 (90)
    2Lacking compatibility or interoperability with existing IT infrastructure33 (83)
    3Quality of data30 (75)
    4Availability of data26 (65)
    5Ethical aspects (eg, liability issues)24 (60)
    6Product range on the market23 (58)
    7Data protection22 (55)
    7Quantity of data22 (55)
    8Legal regulations19 (48)
    9Consent of the work council15 (38)
    10Corporate culture13 (33)
    11User (eg, physicians, nurses, and administration) acceptance9 (23)
    12Leadership acceptance4 (10)
    12Patient acceptance4 (10)

    aResponses of “agree” or “rather agree” were grouped together.

    In the third subcategory, participants were asked about positive prospects possibly associated with AI (Table 3). Then, they had to state their agreement with these opportunities on a 5-point Likert scale. The opportunity with the highest agreement was increase in efficiency due to time-saving effects (29/40, 73% agreed or rather agreed with the statement). Other statements also yielded high agreement rates. The opportunity participants agreed with least was financial savings. Only 40% (16/40) of the participants said they agreed or rather agreed with the statement that AI could lead to financial savings in their hospital, whereas 40% (16/40) of the participants disagreed or rather disagreed. Overall, this subcategory yielded homogeneous results. No further opportunities were raised in free text.

    A detailed presentation and graphs presenting the results of these 2 subcategories can be found in Multimedia Appendix 2.

    Table 3. Perceived opportunities associated with the implementation and use of artificial intelligence (N=40).
    RankingOpportunityTotal participants in agreement and sample percentages, n (%)a
    1Increase in efficiency due to time-saving effects29 (73)
    2Competitive advantage27 (69)
    3Increase in quality of care25 (66)
    4Easing the workload of employees21 (53)
    5Financial savings16 (40)

    aResponses of “agree” or “rather agree” were grouped together.

    Resources and Requirements for AI Use in Hospitals

    For the fourth subcategory, we focused on the resources required for the use of AI technologies in hospitals. Again, the participants were presented with a list of known critical resources for AI implementation, and they had to indicate their level of agreement with these findings from literature (Table 4). The resource most people needed was staffing resources (35/40, 90% agreed or rather agreed with the statement). The resource with the least relevance was organizational frameworks (25/40, 64%). As seen in the other subcategories, the distribution of answers was homogeneous. A detailed presentation and graphs presenting the results of this subcategory can be found in Multimedia Appendix 2.

    Table 4. Resources needed for use and implementation of artificial intelligence (N=40).
    RankingResourceTotal participants in agreement and sample percentages, n (%)a
    1Staffing resources35 (90)
    2Time34 (87)
    3Knowledge33 (85)
    4Financial resources32 (84)
    5Technical resources31 (79)
    6Data base27 (69)
    7Organizational frameworks25 (64)

    aResponses of “agree” or “rather agree” were grouped together.

    The next item asked participants whether their hospital needed to fulfill any further requirements or resources besides those already mentioned in a yes or no format. A total of 60% (24/40) of the participants answered “yes” and provided explanations in free text. Here, organizational aspects were most common (eg, competencies and responsibilities), followed by workflow and legal issues. Technical aspects were described in detail, such as lacking hardware and software, interoperability, difficulties with data transfer from old to new systems, need for additional modules for data capture, and Wi-Fi availability and speed.

    Considering the tech industry and its offerings on the market, the participants were highly undecided. Furthermore, 58% (23/40) of the participants said that they did not know if the supply met the demand for AI technologies in their hospital. Only 7% (3/40) of the participants stated that offerings on the market were sufficient.


    Principal Findings

    This study provided insights into the current and planned dissemination of AI tools as well as perceived barriers and opportunities for the implementation and adoption of AI tools in 40 hospitals in Germany. We designed a web-based survey based on existing literature on the implementation of AI in hospitals. Our participants were mainly from an IT background, with 28 decision makers in leadership positions. Two-thirds of the participants said that they used or planned to use AI tools in their institution. Speech recognition and text analysis systems, systems for picture recognition, and robotics and autonomous systems were the tools or systems most commonly used, or their use was planned. We did not find differing opinions among hospitals of different sizes or ownership. The results showed that most participants recognized the implementation of AI in hospitals as a relevant, forthcoming part of their IT strategy. However, lack of resources and compatibility or interoperability with the existing IT infrastructure were identified as barriers to implementation. Staffing resources, time, knowledge, financial resources, and technical resources required for the implementation of AI were all highly relevant resources. A possible increase in efficiency because of time-saving effects, competitive advantage, and increase in quality of care was seen as the most important opportunity associated with AI use. We conclude that AI readiness factors derived from the literature are applicable to the hospital context in Germany. The following discussion highlights the most relevant barriers to AI readiness, adoption, and implementation while also presenting possible ways to overcome these barriers.

    AI in Hospital Strategies

    AI readiness as a concept has been described recently [15,24]. Strategic alignment was identified as 1 of 5 key aspects of organizational AI readiness. Our survey included a question addressing whether AI was a part of the participants’ hospital IT strategy. To this question, 55% (22/40) of the participants agreed or rather agreed that AI was a part of their strategy. In addition, most participants agreed or rather agreed that AI would be relevant in the future, both in Germany (37/40, 93%) and in their own hospital (36/40, 90%). However, this also means that there are decision makers who recognize the relevance of AI in the future but do not consider it a part of their hospitals’ strategy. First, this could be because of the complexity of AI implementation (eg, uncertainties surrounding the workings of the technology, acceptance of the technology, and an unclear regulatory situation) [1,10,17,19,29,35]. Second, the hesitancy to include AI in a hospital’s IT strategy could be explained by high costs and unclear reimbursement schemes [1]. In our study, 80% (32/40) of the participants agreed that their institution lacked financial resources, and 90% (36/40) said that a lack of resources overall was a barrier for AI implementation. At the same time, only 40% (16/40) of the participants agreed with the statement that AI holds a potential for financial savings. This paints a picture of AI as a resource-intensive technology with limited financial rewards. To overcome this barrier and compensate for the financial burden because of investments in digital technologies, the German government recently introduced a new law, the hospital future act (ie, Krankenhauszukunftsgesetz). Through this law, hospitals trying to implement digital technologies, including decision support systems, can apply for financial support to facilitate necessary acquisitions [12]. The law went into effect during our data collection period; thus, we cannot report on the possible impacts of this law. However, as the financial aspects were reported as a relevant barrier in our study, it could be of interest for future research to evaluate the effects of the new law.

    Although there are both expectations and observations of AI as a possible tool to save cost and generate high revenue [1,6,29], for example, through higher efficiency, high-quality evidence analyzing the cost and benefits of AI implementation in hospitals is missing [7]. Hence, decision makers lack evidence and information, and the business case for AI in hospitals remains unclear [10,29], which in turn inhibits organizational AI readiness [15].

    AI Acceptability

    With regard to further barriers to the implementation of AI, soft factors such as user, patient, and leadership acceptance were seen as less relevant barriers by the participants in our survey. This impression might be caused by limited contact of IT department members with users, leadership, and especially with patients. Acceptance issues might also become more obvious to decision makers over time, as most participants in our study had not yet implemented AI in their hospital. Nonetheless, it is important to consider the evidence that acceptability is a relevant antecedent of AI adoption and implementation. For example, a paper reviewing 9 studies on the acceptance of AI in health care concluded that consumers have a robust reluctance toward medical care delivered by AI compared with human providers [36]. In another study, only 3% of patients found that the possible negative aspects of AI outweighed the potential benefits [37]. Overall, there is mixed evidence regarding patients’ acceptance of AI in the medical context, and further research is needed [5].

    Leadership acceptance and support have been identified as important antecedents for AI implementation [15,24]. The acceptance of AI users, such as physicians and hospital employees, has also been identified as relevant in other studies [9,38]. Following the technology acceptance model, perceived ease of use and usefulness can positively affect favorable attitudes toward a new technology, which in turn improves its acceptability and use [13,39]. Hence, special attention should be paid to these aspects when deciding on acquiring and implementing new AI tools in a hospital.

    Finally, the issue of AI acceptability can be addressed by investing in the concept of explainable AI, meaning a more transparent, understandable AI with high performance levels [40]. Although little evidence exists, it is reasonable to expect that this new approach could increase AI acceptability by increasing understanding and trust in the new technology [13,40-42]. IT decision makers should not underestimate the issue of AI acceptability and should take the fears and perceptions surrounding AI seriously when planning to implement new AI technology.

    Possible Mismatch in Supply and Demand

    Another finding in our study was that only 7% (3/40) of the participants said that the supply of applicable AI solutions to the tech market was sufficient for their needs. Another 58% (23/40) of participants reported that they were unsure. One reason could be that we did not reach the right people in the institution, and they were thus unable to assess the tech market. Another possibility could be that our participants did not spend time researching the offerings in the tech market. This could be especially true for those who are not using or planning to use AI tools. However, it could also be possible that the offerings on the market do not fit the requirements of their potential clients. This result could be of value for tech companies trying to reach decision makers in hospitals. This finding is especially important considering that only 12% of the AI tools were developed within the hospitals in our survey. Hence, partnerships for the development of AI tools are common and must be fostered.

    Generalizability

    We created this survey instrument based on an extensive literature research and theoretical frameworks and used cognitive pretesting to ensure understandability. Participants usually completed the survey in <10 minutes. Hence, our survey instrument enabled us to collect data both efficiently and in a theoretically informed manner. This survey could serve as a template for other studies, especially in countries with a similar level of dissemination of AI technologies. Country-specific items, such as the work council, should be adapted to the context in question. Although our survey included these country-specific aspects, they did not appear to be of high relevance in our sample. However, we think that these aspects should be surveyed, as their importance in other contexts is not predictable.

    Strengths and Limitations

    This study investigated the status quo of AI technologies in 40 German hospitals and the applicability of AI readiness factors derived from the literature. Owing to the low response rate and resulting small sample size, our results are not representative but describe a first impression. We surveyed hospital CIOs, a group we identified as important intermediaries for digital innovation adoption and implementation. While other studies about the perceptions, barriers, and issues surrounding AI questioned users (eg, physicians and health professionals), patients, or other stakeholders [37,43-45], we focused on the seldom studied group of IT decision makers. Although focusing exclusively on one stakeholder group may introduce a bias, we believe that the focus on this seldom studied group makes our study unique and relevant, thus warranting the risk of bias. The presented perspective of hospital CIOs depicts barriers to AI use and acceptance on a decision or leadership level. Our results can further the holistic discussion about the real-world implementation of AI and AI readiness.

    We analyzed the differences in opinions of hospitals differing in size and ownership, which did not produce relevant results. This finding should be interpreted cautiously, as our sample size could be too small to produce significant results.

    Owing to technical limitations, we were unable to report the number of unique site visitors. This impedes the calculation of correct survey response rates. Although we used various recruitment methods (emails, letters, and telephone calls) over a prolonged period, our sample size remained small compared with the number of hospitals in Germany (1914 hospitals in 2019 [35]). The small number of respondents may be explained by a general lack of interest in the survey’s topic [46], time constraints because of the COVID-19 pandemic, or because of the requirements of a leadership position and by a hesitancy to click on links sent via email owing to fear of security breaches. We tried to reduce this fear by establishing an offline contact with possible participants (letters and telephonic prenotification), but the effect is unclear. At the same time, people who chose to participate in the survey might have a stronger interest or profound experience with AI. We tried to minimize this effect by pointing out in invitations that no knowledge or experience with AI is necessary for participation. However, there was a risk of nonresponse bias in our study.

    Considering the demographics of the survey respondents, the sample was very homogeneous, as most participants were middle-aged and male. This distribution was expected and represents the composition of IT departments in Germany [47]. As we included all academic hospitals in our recruitment efforts, larger hospitals were overrepresented in our sample. We expected academic hospitals to be more involved in AI research and thus wanted to invite them to participate in our study. In addition, very small hospitals sometimes do not have a CIO position or outsource their IT services. In such situations, it is possible that our survey invitations did not reach the right person.

    As AI is a new and complex technology, it is possible that our participants misunderstood some questions or falsely claimed that they had used AI in their hospital. We managed this risk by closely aligning our survey design with the results from the 6 pretests. Pretest participants suggested not to include a general definition of AI but to give examples for the specific tools in question 2 (“Please assess the current stage of implementation of these AI tools in your hospital”). To keep the survey as short as possible and by keeping in mind that our target group consisted of experts in a related field, we followed this suggestion. However, this risk must be considered when comparing our results.

    Conclusions

    This study paints a mixed picture of the status quo of AI in German hospitals. In our sample, few tools have been implemented in routine care, and many hospitals do not use or plan to use AI in the future. This can likely be explained by missing or unclear business cases, which complicates decision-making and resource attribution. We also observed a mismatch or lack of information about AI offerings in the tech market. This is another important aspect to be monitored, as most AI technologies that are already in use were developed in cooperation with external partners. Therefore, these relationships should be fostered. IT decision makers in hospitals should assess their hospitals’ readiness for AI individually with a focus on resources. Further research should continue to monitor the dissemination of AI tools and AI readiness factors to determine whether improvements can be made over time, especially with regard to government-supported investments in AI technologies that could alleviate the financial burden. Qualitative studies with hospital IT decision makers should be conducted to explore the reasons for slow AI adoption in more detail. The results of our study may infer that AI adoption is not only a topic solely for the IT department but also for the whole hospital as an enterprise, including management, medical staff, and business in terms of an important building block of the digital transformation.

    Acknowledgments

    The authors would like to thank all study participants for their contributions to this study. The authors would also like to thank Carolin Anders (Heidelberg University Hospital, Institute of Medical Informatics) for her support. This study was funded by the Baden-Wuerttemberg (Germany) Ministry of Science, Research and the Arts, under reference number 42-04HV.MED(19)/15/1 as part of the project ZIV (Zentrum fuer Innovative Versorgung).

    Authors' Contributions

    LW drafted and prepared the original manuscript. OH was the principal investigator of the study. LW and JM were responsible for study design and protocol. All authors contributed to the concept and design of the study and preparation of the manuscript. LW, JM, and LS constructed and tested the survey design and the quantitative data collection tool. LW analyzed survey data. LW interpreted and phrased the results of the quantitative data. All the authors provided substantial comments and approved the final version of the manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Translated survey.

    DOCX File , 47 KB
    ‎
    Multimedia Appendix 2

    Bar graphs.

    DOCX File , 64 KB
    1. Dilsizian SE, Siegel EL. Artificial intelligence in medicine and cardiac imaging: harnessing big data and advanced computing to provide personalized medical diagnosis and treatment. Curr Cardiol Rep 2014 Jan;16(1):441. [CrossRef] [Medline]
    2. Fogel AL, Kvedar JC. Artificial intelligence powers digital medicine. NPJ Digit Med 2018;1:5 [FREE Full text] [CrossRef] [Medline]
    3. Haenssle HA, Fink C, Schneiderbauer R, Toberer F, Buhl T, Blum A, Reader study level-Ilevel-II Groups, et al. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann Oncol 2018 Aug 01;29(8):1836-1842 [FREE Full text] [CrossRef] [Medline]
    4. Fröhlich H, Balling R, Beerenwinkel N, Kohlbacher O, Kumar S, Lengauer T, et al. From hype to reality: data science enabling personalized medicine. BMC Med 2018 Aug 27;16(1):150 [FREE Full text] [CrossRef] [Medline]
    5. Yin J, Ngiam KY, Teo HH. Role of artificial intelligence applications in real-life clinical practice: systematic review. J Med Internet Res 2021 Apr 22;23(4):e25759 [FREE Full text] [CrossRef] [Medline]
    6. Agarwal Y, Jain M, Sinha S, Dhir S. Delivering high‐tech, AI‐based health care at Apollo Hospitals. Glob Bus Organ Excell 2020;39(2):20-30. [CrossRef]
    7. Wolff J, Pauling J, Keck A, Baumbach J. The economic impact of artificial intelligence in health care: systematic review. J Med Internet Res 2020 Feb 20;22(2):e16866 [FREE Full text] [CrossRef] [Medline]
    8. Rubeis G. The disruptive power of Artificial Intelligence. Ethical aspects of gerontechnology in elderly care. Arch Gerontol Geriatr 2020 Jul 15;91:104186. [CrossRef] [Medline]
    9. Castagno S, Khalifa M. Perceptions of artificial intelligence among healthcare staff: a qualitative survey study. Front Artif Intell 2020;3:578983 [FREE Full text] [CrossRef] [Medline]
    10. He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K. The practical implementation of artificial intelligence technologies in medicine. Nat Med 2019 Jan;25(1):30-36 [FREE Full text] [CrossRef] [Medline]
    11. Strategie Künstliche Intelligenz der Bundesregierung. Nationale Strategie für Künstliche Intelligenz. Berlin: Die Bundesregierung; 2018 Nov.   URL: https:/​/www.​bundesregierung.de/​resource/​blob/​975226/​1550276/​3f7d3c41c6e05695741273e78b8039f2/​2018-11-15-ki-strategie-data.​pdf?download=1 [accessed 2022-05-27]
    12. Riedel W, Riedel H. Krankenhauszukunftsgesetz: Die große Digitalisierungsoffensive. kma - Klinik Management aktuell 2020;25(12):55-57. [CrossRef]
    13. Romero-Brufau S, Wyatt KD, Boyum P, Mickelson M, Moore M, Cognetta-Rieke C. A lesson in implementation: a pre-post study of providers' experience with artificial intelligence-based clinical decision support. Int J Med Inform 2020 May;137:104072. [CrossRef] [Medline]
    14. Shortliffe EH, Sepúlveda MJ. Clinical decision support in the era of artificial intelligence. JAMA 2018 Dec 04;320(21):2199-2200. [CrossRef] [Medline]
    15. Jöhnk J, Weißert M, Wyrtki K. Ready or not, AI comes— an interview study of organizational AI readiness factors. Bus Inf Syst Eng 2020 Dec 22;63(1):5-20. [CrossRef]
    16. Frambach RT, Schillewaert N. Organizational innovation adoption: a multi-level framework of determinants and opportunities for future research. J Bus Res 2002 Feb;55(2):163-176 [FREE Full text] [CrossRef]
    17. Lokuge S, Sedera D, Grover V, Dongming X. Organizational readiness for digital innovation: development and empirical calibration of a construct. Inf Manag 2019 Apr;56(3):445-461. [CrossRef]
    18. Panch T, Mattie H, Celi LA. The "inconvenient truth" about AI in healthcare. NPJ Digit Med 2019;2:77 [FREE Full text] [CrossRef] [Medline]
    19. Gallivan MJ. Organizational adoption and assimilation of complex technological innovations: development and application of a new framework. Data Base Adv Inf Syst 2001 Jul;32(3):51-85. [CrossRef]
    20. Weiner BJ. A theory of organizational readiness for change. Implement Sci 2009 Oct 19;4:67 [FREE Full text] [CrossRef] [Medline]
    21. Reddy S, Allan S, Coghlan S, Cooper P. A governance model for the application of AI in health care. J Am Med Inform Assoc 2020 Mar 01;27(3):491-497 [FREE Full text] [CrossRef] [Medline]
    22. Eysenbach G. Improving the quality of Web surveys: the checklist for reporting results of Internet E-surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
    23. Snyder-Halpern R. Indicators of organizational readiness for clinical information technology/systems innovation: a Delphi study. Int J Med Inform 2001 Oct;63(3):179-204. [CrossRef] [Medline]
    24. Pumplun L, Tauchert C, Heidt M. A new organizational chassis for artificial intelligence - exploring organizational readiness factors. In: Proceedings of the 27th European Conference on Information Systems. 2019 Presented at: ECIS '19; June 8-14, 2019; Stockholm, Sweden p. 8-14   URL: https://aisel.aisnet.org/ecis2019_rp/106
    25. Alsheibani S, Cheung Y, Messom C. Artificial intelligence adoption: AI-readiness at firm-level. In: Proceedings of 2018 Pacific Asia Conference in Information Systems. 2018 Presented at: PACIS '18; June 26-30, 2018; Yokohama, Japan   URL: https://researchmgt.monash.edu/ws/portalfiles/portal/273209396/254798983_oa.pdf
    26. DePietro R, Wiarda E, Fleisher M. The processes of technological innovation. In: Tornatzky LG, Fleisher M, editors. The Context for Change: Organization, Technology and Environment. Washington, DC, USA: Lexington Books; 1990:151-175.
    27. Zhu K, Kraemer KL. Post-adoption variations in usage and value of e-business by organizations: cross-country evidence from the retail industry. Inf Syst Res 2005 Mar;16(1):61-84. [CrossRef]
    28. Cypko M, Emmert MY, Falk V, Meyer A. [Artificial intelligence in cardiac surgery]. Chirurg 2020 Mar;91(3):235-239. [CrossRef] [Medline]
    29. Alsheiabni S, Cheung Y, Messom C. Factors inhibiting the adoption of artificial intelligence at organizational-level: a preliminary investigation. In: Proceedings of the 2019 Americas Conference on Information Systems. 2019 Presented at: AMCIS '19; August 15-17, 2019; Cancun, Mexico   URL: https://researchmgt.monash.edu/ws/portalfiles/portal/287736273/287674072_oa.pdf
    30. Jirjahn U, Smith SS. Nonunion employee representation: theory and the German experience with mandated works councils. Ann Public Cooperative Econ 2018 Jan 31;89(1):201-233. [CrossRef]
    31. Lenzner T, Neuert C, Otto W. Cognitive Pretesting (Version 2). GESIS Survey Guidelines. GESIS - Leibniz Institute for the Social Sciences. 2016.   URL: https:/​/www.​ssoar.info/​ssoar/​bitstream/​handle/​document/​56369/​ssoar-2016-lenzner_et_al-Cognitive_Pretesting_Version_20.​pdf?sequence=3 [accessed 2022-05-27]
    32. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    33. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, REDCap Consortium. The REDCap consortium: building an international community of software platform partners. J Biomed Inform 2019 Jul;95:103208 [FREE Full text] [CrossRef] [Medline]
    34. Mission and Objectives. The German Hospital Federation. Berlin: The German Hospital Federation   URL: https://www.dkgev.de/englisch/the-german-hospital-federation/mission-and-objectives/ [accessed 2022-05-27]
    35. Medical facilities, hospital beds and movement of patient. Statistisches Bundesamt. 2021.   URL: https:/​/www.​destatis.de/​EN/​Themes/​Society-Environment/​Health/​Hospitals/​Tables/​gd-hospitals-years.​html [accessed 2022-05-27]
    36. Longoni C, Bonezzi A, Morewedge CK. Resistance to medical artificial intelligence. J Consum Res 2019 Dec;46(4):629-650. [CrossRef]
    37. Tran VT, Riveros C, Ravaud P. Patients' views of wearable devices and AI in healthcare: findings from the ComPaRe e-cohort. NPJ Digit Med 2019;2:53 [FREE Full text] [CrossRef] [Medline]
    38. Strohm L, Hehakaya C, Ranschaert ER, Boon WP, Moors EH. Implementation of artificial intelligence (AI) applications in radiology: hindering and facilitating factors. Eur Radiol 2020 Oct;30(10):5525-5532 [FREE Full text] [CrossRef] [Medline]
    39. Holden RJ, Karsh BT. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010 Feb;43(1):159-172 [FREE Full text] [CrossRef] [Medline]
    40. Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 2018 Sep 17;6:52138-52160 [FREE Full text] [CrossRef]
    41. Reddy S. Use of artificial intelligence in healthcare delivery. In: Heston TF, editor. eHealth - Making Health Care Smarter. London, UK: IntechOpen; 2018. [CrossRef]
    42. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med 2019 Oct 29;17(1):195 [FREE Full text] [CrossRef] [Medline]
    43. Laï MC, Brian M, Mamzer MF. Perceptions of artificial intelligence in healthcare: findings from a qualitative survey study among actors in France. J Transl Med 2020 Jan 09;18(1):14 [FREE Full text] [CrossRef] [Medline]
    44. Ongena YP, Haan M, Yakar D, Kwee TC. Patients' views on the implementation of artificial intelligence in radiology: development and validation of a standardized questionnaire. Eur Radiol 2020 Feb;30(2):1033-1040 [FREE Full text] [CrossRef] [Medline]
    45. Pinto Dos Santos D, Giese D, Brodehl S, Chon SH, Staab W, Kleinert R, et al. Medical students' attitude towards artificial intelligence: a multicentre survey. Eur Radiol 2019 Apr;29(4):1640-1646. [CrossRef] [Medline]
    46. Keusch F. Why do people participate in Web surveys? Applying survey participation theory to Internet survey data collection. Manag Rev Q 2015 Jan 9;65(3):183-216. [CrossRef]
    47. Weitzel T, Eckhardt A, Laumer S, Maier C, Oelhorn C, Wirth J, et al. Women in IT: Eine empirische Untersuchung mit den Top 1000 Unternehmen aus Deutschland sowie den Top 300 Unternehmen aus den Branchen Finanzdienstleistung, Health Care und IT. Recruiting Trends. 2017.   URL: https:/​/www.​uni-bamberg.de/​fileadmin/​uni/​fakultaeten/​wiai_lehrstuehle/​isdl/​4_Women_in_IT_20170210_WEB.​pdf [accessed 2022-05-27]

    ‎
    AI: artificial intelligence
    CIO: chief information officer
    REDCap: Research Electronic Data Capture

    Edited by C Lovis; submitted 04.11.21; peer-reviewed by D Pinto dos Santos, K Wyatt, A Joseph, M Sedlmayr; comments to author 02.01.22; revised version received 15.02.22; accepted 11.03.22; published 15.06.22

    Copyright

    ©Lina Weinert, Julia Müller, Laura Svensson, Oliver Heinze. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 15.06.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.