Published on in Vol 9, No 3 (2021): March

Preprints (earlier versions) of this paper are available at, first published .
Regional Resource Assessment During the COVID-19 Pandemic in Italy: Modeling Study

Regional Resource Assessment During the COVID-19 Pandemic in Italy: Modeling Study

Regional Resource Assessment During the COVID-19 Pandemic in Italy: Modeling Study

Original Paper

1Department of Surgical and Medical Sciences, University of Catanzaro, CZ, Italy

2Ecampus University, Novedrate, Italy

*these authors contributed equally

Corresponding Author:

Pietro H Guzzi, PhD

Department of Surgical and Medical Sciences

University of Catanzaro




Phone: 39 09613694148


Background: COVID-19 has been declared a worldwide emergency and a pandemic by the World Health Organization. It started in China in December 2019, and it rapidly spread throughout Italy, which was the most affected country after China. The pandemic affected all countries with similarly negative effects on the population and health care structures.

Objective: The evolution of the COVID-19 infections and the way such a phenomenon can be characterized in terms of resources and planning has to be considered. One of the most critical resources has been intensive care units (ICUs) with respect to the infection trend and critical hospitalization.

Methods: We propose a model to estimate the needed number of places in ICUs during the most acute phase of the infection. We also define a scalable geographic model to plan emergency and future management of patients with COVID-19 by planning their reallocation in health structures of other regions.

Results: We applied and assessed the prediction method both at the national and regional levels. ICU bed prediction was tested with respect to real data provided by the Italian government. We showed that our model is able to predict, with a reliable error in terms of resource complexity, estimation parameters used in health care structures. In addition, the proposed method is scalable at different geographic levels. This is relevant for pandemics such as COVID-19, which has shown different case incidences even among northern and southern Italian regions.

Conclusions: Our contribution can be useful for decision makers to plan resources to guarantee patient management, but it can also be considered as a reference model for potential upcoming waves of COVID-19 and similar emergency situations.

JMIR Med Inform 2021;9(3):e18933



COVID-19 is a disease that was reported in Wuhan, China in December 2019 [1]. It has been stressing health structures and governments worldwide due to the difficulties in containing its diffusion [2-4]. The virus appears as a flu, but it attacks the pulmonary apparatus, and on average, 6% of symptomatic patients require hospitalization in intensive care units (ICUs) due to severe respiratory syndromes. The rapid diffusion of the virus caused a high number of infections. Only a fraction of patients who are infected need hospitalization in ICUs, a relatively high number of which do not survive the virus. In Italy, in almost 2 months during the first peak, there have been more than 100,000 known infections and nearly 35,000 COVID-19–related deaths [5-7].

The virus also spread in other countries across the world with different modalities and aggressiveness. During its first wave, from March to May 2020, Italy had the second highest number of patients who were infected. All countries reported difficulties in answering to the high number of requests for ICU beds and reliable detection of the real infection numbers. In countries where the virus spread later with respect to Italy, such as the United States, France, Spain, and other European countries, it diffused with similar trends but with different absolute numbers, as reported by the World Health Organization [3,8-13]. Nevertheless, the impact on health structure resources has been similar. In fact, the number of infections detected is strictly related to the number of swab tests performed in the population. Tradigo et al [14] assessed the real number of people who are infected with respect to the known ones. In contrast, the number of infections is much higher than the known ones and includes patients who are asymptomatic (ie, those who got the infection but who did not manifest any symptoms). The number of ICU beds is always related to the number of real infections.

Regions such as Lombardia in the north of Italy have been strongly affected by COVID-19, and it seems that this is due to a large number of patients who were asymptomatic already in the middle of January 2020 and late adoption of containment measures such as limitation of circulation and delay in applying rules such as smart working [15-17].

We focus on the problem of rapidly estimating resources during the exponential phase of the COVID-19 emergency, in particular, being aware of the differences among regions in terms of health structure resources such as ICU beds. We show how the proposed model scales at the regional level and how it can help decision makers plan expansions of resources near saturation or reroute patients to neighboring regions.

The prediction of COVID-19 diffusion is a relevant problem, and it has been discussed in other papers [18-20]. Some papers do not consider the regional level and local differences that are relevant in some countries such as Italy. For instance, Li et al [21] developed a model starting from Hubei Province data, and they used the model for prediction in other countries such as Italy and Korea. Other papers did not consider the prediction of ICU resources. Conversely, our study is scalable on a regional level, and it is able to predict ICU needs. In a previous study [22-24], we developed a preliminary model for resource planning; here, we present an extension of the model with a particular focus on the assessment of the predictions.

The model presented here has been assessed comparing the simulated and predicted resource values with the measured ones. The rapid diffusion trend in high-income countries’ populations and in cities with high density stressed the health structure in many countries. Indeed, a small portion of patients with COVID-19 require ICU admission. The exponential diffusion in terms of an increased number of infections per day required a larger number of ICU beds than the ones available. We report our model as being scalable at both the regional and subregional levels. We claim that it can be used in different countries and in future contexts where virus diffusion will require well-planned health resource management [13,25].

The paper is structured as follows. The Methods section reports the proposed assessed model and the Italian infection data. The Results section reports the application of the model on three sample regions out of 20, Lombardia (north), Toscana (central), and Sicilia (south). The Discussion section reports on the limitations of this study and comparisons with other work. However, our model is general enough to be successfully applied to other pandemic situations in other contexts.

ICU Situation in Italy

Italy was affected by COVID-19 by the end of January 2020, starting from northern regions such as Lombardia and Veneto. By the end of February, the increasing trend of infection numbers per day obliged the governments at the regional level—and at the national level starting on March 10–to introduce containment measures.

For example, on March 26, 2020, in Italy, we had 24,747 total reported COVID-19 infection cases, of which 20,603 had the disease, 1809 had died, and 2335 had recovered from it. Regarding patients who were infected, 9268 were treated in their homes since they did not have severe illness, 9663 were hospitalized, and 1672 were admitted to ICUs. The trend continued increasing until April 19, 2020, which has been the peak of COVID-19 infections in Italy.

In reaction to the exponential growth of patients who are infected that require hospitalization, one possible measure adopted by many countries has been to build emergency hospitals dedicated to patients with COVID. In Italy, one strategy consisted in improving existing structures by extending the number of ICU resources and beds, and using dedicated health structures. For example, one study [26] focuses on accelerating the process of acquiring and furnishing hospitals with assisted breathing devices.

Italy has approximately 5200 ICU beds in total, which have been dimensioned by design to be equal to 80% of their average occupancy at any given time. In addition, they are allocated at a regional level proportional to the local population and are usually managed locally. Table 1 reports the ICU bed distribution among regions associated with the demography. The COVID-19 pandemic called these choices into question, thus introducing the necessity of emergency units in cities where the virus rapidly diffused and where existing resources were limited.

Table 1. Distribution of ICU beds in each Italian region ordered by regional population. The number of beds could increase in the future due to government investments for the emergency.
RegionICUa beds, nPopulation, nICU beds per citizen (%)
Emilia Romagna5394,459,4770.0121
Friuli Venezia Giulia801,215,2200.0066
Trentino Alto Adige711,072,2760.0066
Valle D’Aosta15125,6660.0119
Italy (total)515660,359,5460.0085

aICU: intensive care unit.

Because of ICU bed limitations, many patients have been moved from ICUs to subintensive units or to other regions to free up spaces. Indeed, ICU slots are often used for treating postsurgery patients and patients affected by pulmonary diseases. At the date of the peak (ie, April 19, 2020), almost 2635 ICU beds were occupied, 108,257 infections were confirmed by swab tests, and 25,033 patients had recovered without using ICU beds. Thus, most of the infections were asymptomatic, and patients quarantined at home. Even if the number of required ICU beds is less than the total number of available ICU beds in Italy (see Table 1), the infection distribution is not homogeneous among regional departments and does not follow a regular geographical distribution.

Thus, performing a flexible and reliable model that can predict and control resource requirements and distribution at a regional scale is required. The number of patients in the ICUs is also related to the requests of other clinical units such as emergency units for non–COVID-19, but still serious, diseases (eg, cardiovascular-affected patients).

Moreover, considering that the average survival time for patients with COVID-19 that die has been measured to be approximately 10 days after ICU admission, the need to plan resources is urgent. It may involve making new ICU beds and planning logistics to move patients among regions or to optimize the grouping of patients with COVID-19 in dedicated health structures. It is trivial that such a decision must be based on the correct estimation of ICU beds that are occupied by patients, but this estimation is still a matter of discussion [26].

Model Description and Assessment

We report here the description and assessment of the proposed model by using Italian cases.

We start by considering a time window of six consecutive infection values (one reading per day) from the official Italian COVID-19 data set. We then calculate an exponential fitting function for these values, since we know that the viral phase follows an exponential growth.

In Figure 1, the first four time windows (ie, 6, 7, 8, and 9 days) and the related fitting functions are reported. The exponential fitting function for the first window is , where x is time (ie, days) and y is the number of infections. We use the calculated fitting equation to predict the number of patients infected with COVID-19 for the succeeding days; for the first time window, we predicted 1086 total infections on the seventh day. We compared the predicted value with the observed infections (ie, real number of infections) from the data set, and we calculated the difference and the percentage increase, which will be useful during the assessment phase. We then proceeded by extending the time window by 1 day, and we redid all the steps (exponential fitting, prediction of the infections for the succeeding day, difference, and percentage increase).

To assess the precision of the first step, we considered the calculated percentage increase between the predicted values and the observed ones. As reported in Figure 2, the percentage increase was around 40%.

In the second step, we consider the number of occupied ICU beds as a function of the number of COVID-19 infections. In this case, we adopted the weighted average as a fitting function. Figure 3 depicts this correlation (in blue) between total infections (x-axis) and ICU beds occupied (y-axis) together with the weighted average fitting for the whole data set (in light blue).

Figure 1. Exponential fitting of infection levels for the first four time windows. Each is longer than the previous by 1 day. The shown time windows are W1 (6 days), W2 (7 days), W3 (8 days), and W4 (9 days).
View this figure
Figure 2. Percentage increase between the predicted and the observed number of infections. On the x-axis, we have time windows and, on the y-axis, the percentage increase of the predicted infection values with respect to the observed ones.
View this figure
Figure 3. Correlation between occupied ICU beds and COVID-19 infections. ICU: intensive care unit.
View this figure

For each time window (W1, W2, …, W15; see Figure 4), we consider three adjacent data point coordinates (infections for the x-axes and ICU for the y-axes) to calculate a linear equation as a weighted average fitting function for the values contained in it. We then used such a function to estimate the future ICU bed occupation for the following day by using the predicted infected value. We then calculated the difference between the predicted and the observed ICU values, and similarly to the first step, we reported the percentage increase between the two. Table 2 reports an example of percentage increase values of the predicted versus observed ICU resources for an Italian region’s data set. The percentage increase is above 40% for only a few values, but the majority are near 20%, as represented in Figure 5.

Figure 4. Time windows W1, W2, …, W15 are defined incrementally starting from a period of 6 consecutive days, which has been considered the minimum number of data points to calculate the fitting function.
View this figure
Table 2. Observed versus predicted ICU beds for the Lombardia Region for each time window (W1, ..., W15) considered in the time period from February 24 to March 15, 2020.
Observed ICUa bedsb, nPredicted ICU bedsc, nPercentage increase (%)

aICU: intensive care unit.

bObserved (ie, real) ICU beds measured during the COVID-19 emergency.

cCalculated by our model.

Figure 5. Percentage increase between the predicted and the observed ICU beds occupied. ICU: intensive care unit.
View this figure

We applied the described method both at the national and regional scale, and we report the results in the next section.

In this section, we show the application of the described model to the Italian official COVID-19 data set [27], and we briefly discuss the limitations of the current model and its application to the Italian use case at a regional level. We show that, by using our method, it has been possible to predict future ICU bed occupancy with fair accuracy.

The proposed model works in the exponential phase of the infection spread, while for the nonexponential stage, other models can be used such as the Verhulst logistic model [9]. In its present form, the model is tailored to the Italian COVID-19 data set. However, with minimal adaptation, it could work with other data sets of infectious diseases with different data schemas.

The presented model works in the exponential phase of the infection. Model sensitivity has not been considered in the case of this model because we focused only on the exponential growth of the infections, which is the crucial moment that ICU bed and resource availability are most stressed and inadequate.

Changing the assumption (ie, nonexponential growth) is considering a time window in which ICU resources are surely available with respect to the requests. For instance, we performed experiments that modeled the nonexponential infection phase with a Verhulst logistic model, but again, when there is no emergency, the ICU predictions are not useful since resources are largely available.

The final goal is to predict the number of future beds needed in the ICUs as a function of the level of infection in a given region. The ability to predict future resource occupation can be a powerful and useful tool for local decision makers with the responsibility of managing and optimizing clinical resources during the emergency.

We report the application of the presented model for three Italian regions: Lombardia, Toscana, and Sicilia, which represent a balanced sample of northern, central, and southern Italian regions. We extracted and transformed the relevant data from the official Italian COVID-19 data set and considered the total number of patients who were infected and the ICU beds occupied by patients with COVID-19 reported by the various local health structures.

In the data set, we have 17 total features (eg, latitude, longitude, date, the total number of infections, number of patients who are hospitalized, number of deaths, and number of recoveries) and one reading per day for each region. We selected the features of interest and aggregated the tuples by region before estimating the prediction model parameters. For each region, we considered the number of infections, and we calculated an exponential fitting equation. By using such an equation, we were able to estimate the number of patients who will be infected in the succeeding days. We then considered the relation between ICUs and infections, with which we can use the predicted infection levels to estimate future values of ICU and resource occupation. These predictions can be a valuable tool for rapidly planning ICU resources in case of shortages during clinical emergencies in general, for instance, by reallocating patients in other regions with lower levels of ICU occupancies.

In Figure 6 (upper left), we report COVID-19 data about the Lombardia region between February 24 and March 15, 2020, a time period in which infection levels (in blue) were growing in an exponential fashion. We report the exponential fitting function for the infections (in light blue), the number of hospitalized with symptoms (in red), and the number of deaths related to COVID-19 (in yellow). Figure 6 (upper right) depicts the occupied ICU beds as a function of the number of people infected with COVID-19 in the same aforementioned time period. The fitting function (in light blue) is a weighted average with a modulus of 3, with which we predict future ICU bed occupation from a given infection value.

Similar to the Lombardia region, we report the application of the proposed model to COVID-19 infection data and resource necessity prediction for both the Toscana and Sicilia regions (central and lower part of Figure 6, respectively). We report three example regions (Figure 6) to represent the northern regions (ie, Lombardia; which are the more affected part of the country), the central regions (ie, Toscana), and the south (ie, Sicilia). They are needed to show how COVID-19 diffused differently from the north to the south of Italy.

Figure 6. The figure depicts Lombardia, Toscana, and Sicilia regions as representative of infection situations in the northern, central, and southern regions of Italy, respectively, in a time window between days (0 days to 21 days; ie, February 24 to March 15, 2020) of infection in the official data set (ie, 3 weeks). In the left column, we report the number of infections per day, while in the right column, we have the occupied ICU beds as a function of the number of COVID-19 infections. In light blue, we report the fitting functions for the considered data (left column: exponential function; right column: weighted average with a modulus of 3). The red lines in the left column show the hospitalized patients with symptoms, and the yellow lines show the number of deaths. ICU: intensive care unit.
View this figure


The presented model only works in a scenario of an exponential growth of infections, since it is a crucial moment in which ICU bed and resource availability are most stressed and inadequate.

The nonexponential phase might be modeled, for instance, by using models such as the Verhulst logistic one. However, our focus is on time windows in which resources are scarcely available with respect to the rapidly increasing requests, such as ICU beds in the COVID-19 pandemic.

Another limitation of the proposed model regards the impossibility of considering predictions too far ahead in the future, limiting the applicability of the prediction to a few days. However, this is generally sufficient to help in planning ICU resources during an emergency.

Comparison With Prior Work

Modeling of the COVID-19 spread is currently a hot topic considering the pandemic. Consequently, many different works have been proposed. Some of them are based on a deterministic model that uses ordinary differential equations for predicting the number of infected people (eg, [11,12,28]). Some other approaches use Markov modeling and compartmental models (eg, [29-31]). To the best of our knowledge, only the work of Rossman et al [10] presents a scalable granularity (at a state level). With respect to those works, we also tried to predict ICU needs (including data about existing ICU occupancy and the trend of ICU use) with the aim to support health care managers.


The COVID-19 pandemic has been characterized by the rapid spread of an aggressive virus, which has stressed the health system. We think that patient management is strictly related to the ability of health structures to deal with this kind of disease, which requires nonstandard protocols such as the use of respiratory devices. We think that, by using a scalable predictive model at regional and district levels, the granularities may support decision makers (eg, national governments) in better managing the emergency.

The COVID-19 pandemic has reached different regions in various countries worldwide. Furthermore, it is expected that the virus will cyclically reappear in the near future. To this end, the proposed model could be applied during these new outbreaks and as a decision support tool in other similar pandemics or situations where resource prediction is necessary.


We thank Italian Protezione Civile for freely providing online data, which allows studies on the COVID-19 pandemic.

Conflicts of Interest

None declared.

  1. Malta M, Rimoin AW, Strathdee SA. The coronavirus 2019-nCoV epidemic: is hindsight 20/20? EClinicalMedicine 2020 Mar;20:100289 [FREE Full text] [CrossRef] [Medline]
  2. Arabi YM, Fowler R, Hayden FG. Critical care management of adults with community-acquired severe respiratory viral infection. Intensive Care Med 2020 Feb;46(2):315-328 [FREE Full text] [CrossRef] [Medline]
  3. Chinazzi M, Davis JT, Ajelli M, Gioannini C, Litvinova M, Merler S, et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science 2020 Apr 24;368(6489):395-400 [FREE Full text] [CrossRef] [Medline]
  4. Day M. Covid-19: Italy confirms 11 deaths as cases spread from north. BMJ 2020 Feb 26;368:m757. [CrossRef] [Medline]
  5. Gaeta G. Data analysis for the COVID-19 early dynamics in Northern Italy. arXiv. Preprint posted online March 4, 2020.
  6. Guan W, Ni Z, Hu Y, Liang W, Ou C, He J, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med 2020 Apr 30;382(18):1708-1720. [CrossRef]
  7. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020 Feb 15;395(10223):497-506 [FREE Full text] [CrossRef] [Medline]
  8. WHO Coronavirus Disease (COVID-19) Dashboard. World Health Organization. 2020.   URL: [accessed 2020-07-05]
  9. Bacaër N. Verhulst and the logistic equation (1838). In: A Short History of Mathematical Population Dynamics. London: Springer; 2011:35-39.
  10. Rossman H, Keshet A, Shilo S, Gavrieli A, Bauman T, Cohen O, et al. A framework for identifying regional outbreak and spread of COVID-19 from one-minute population-wide surveys. Nat Med 2020 May;26(5):634-638 [FREE Full text] [CrossRef] [Medline]
  11. Liu Y, Gayle AA, Wilder-Smith A, Rocklöv J. The reproductive number of COVID-19 is higher compared to SARS coronavirus. J Travel Med 2020 Mar 13;27(2) [FREE Full text] [CrossRef] [Medline]
  12. Tang B, Bragazzi NL, Li Q, Tang S, Xiao Y, Wu J. An updated estimation of the risk of transmission of the novel coronavirus (2019-nCov). Infect Dis Model 2020;5:248-255 [FREE Full text] [CrossRef] [Medline]
  13. Zhao S, Musa SS, Lin Q, Ran J, Yang G, Wang W, et al. Estimating the unreported number of novel coronavirus (2019-nCoV) cases in China in the first half of January 2020: a data-driven modelling analysis of the early outbreak. J Clin Med 2020 Feb 01;9(2) [FREE Full text] [CrossRef] [Medline]
  14. Tradigo G, Guzzi PH, Veltri P. On the assessment of more reliable COVID-19 infected number: the italian case. medRxiv. Preprint posted online March 27, 2020 2021. [CrossRef]
  15. Keeling MJ, Rohani P. Modeling Infectious Diseases in Humans and Animals. Princeton, NJ: Princeton University Press; 2008.
  16. Liew MF, Siow WT, MacLaren G, See KC. Preparing for COVID-19: early experience from an intensive care unit in Singapore. Crit Care 2020 Mar 09;24(1):83 [FREE Full text] [CrossRef] [Medline]
  17. Lu R, Zhao X, Li J, Niu P, Yang B, Wu H, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet 2020 Feb 22;395(10224):565-574 [FREE Full text] [CrossRef] [Medline]
  18. Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ 2020 Apr 07;369:m1328 [FREE Full text] [CrossRef] [Medline]
  19. Huang C, Xu X, Cai Y, Ge Q, Zeng G, Li X, et al. Mining the characteristics of COVID-19 patients in China: analysis of social media posts. J Med Internet Res 2020 May 17;22(5):e19087 [FREE Full text] [CrossRef] [Medline]
  20. Ambikapathy B, Krishnamurthy K. Mathematical modelling to assess the impact of lockdown on COVID-19 transmission in India: model development and validation. JMIR Public Health Surveill 2020 May 07;6(2):e19368 [FREE Full text] [CrossRef] [Medline]
  21. Li L, Yang Z, Dang Z, Meng C, Huang J, Meng H, et al. Propagation analysis and prediction of the COVID-19. Infect Dis Model 2020;5:282-292 [FREE Full text] [CrossRef] [Medline]
  22. Rezaeetalab F, Mozdourian M, Amini M, Javidarabshahi Z, Akbari F. COVID-19: a new virus as a potential rapidly spreading in the worldwide. J Cardio-Thoracic Med 2020;8(1):563-564.
  23. Yaesoubi R, Cohen T. Generalized Markov models of infectious disease spread: a novel framework for developing dynamic health policies. Eur J Oper Res 2011 Dec 16;215(3):679-687 [FREE Full text] [CrossRef] [Medline]
  24. Guzzi PH, Tradigo G, Veltri P. Spatio-temporal resource mapping for intensive care units at regional level for COVID-19 emergency in Italy. Int J Environ Res Public Health 2020 May 12;17(10) [FREE Full text] [CrossRef] [Medline]
  25. Jung S, Akhmetzhanov AR, Hayashi K, Linton NM, Yang Y, Yuan B, et al. Real-time estimation of the risk of death from novel coronavirus (COVID-19) infection: inference using exported cases. J Clin Med 2020 Feb 14;9(2) [FREE Full text] [CrossRef] [Medline]
  26. Remuzzi A, Remuzzi G. COVID-19 and Italy: what next? Lancet 2020 Apr 11;395(10231):1225-1228 [FREE Full text] [CrossRef] [Medline]
  27. pcm-dpc / COVID-19. GitHub.   URL: [accessed 2020-07-05]
  28. Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study. Lancet 2020 Feb 29;395(10225):689-697 [FREE Full text] [CrossRef] [Medline]
  29. Arango-Londoño D, Ortega-Lenis D, Muñoz E, Cuartas D, Caicedo D, Mena J, et al. Predicciones de un modelo SEIR para casos de COVID-19 en Cali, Colombia. Rev salud pública 2020 Mar 01;22(2):1-6. [CrossRef]
  30. Dye C, Gay N. Modeling the SARS epidemic. Science 2003 Jun 20;300(5627):1884-1885. [CrossRef] [Medline]
  31. Gatto M, Bertuzzo E, Mari L, Miccoli S, Carraro L, Casagrandi R, et al. Spread and dynamics of the COVID-19 epidemic in Italy: effects of emergency containment measures. Proc Natl Acad Sci U S A 2020 May 12;117(19):10484-10491 [FREE Full text] [CrossRef] [Medline]

ICU: intensive care unit

Edited by G Eysenbach; submitted 27.03.20; peer-reviewed by B Smith, M Hamasha; comments to author 04.05.20; revised version received 05.06.20; accepted 17.01.21; published 09.03.21


©Pietro H Guzzi, Giuseppe Tradigo, Pierangelo Veltri. Originally published in JMIR Medical Informatics (, 09.03.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.