Development, Acceptance, and Concerns Surrounding App-Based Services to Overcome the COVID-19 Outbreak in South Korea: Web-Based Survey Study

Background: Since the COVID-19 outbreak, South Korea has been engaged in various efforts to overcome the pandemic. One of them is to provide app-based COVID-19–related services to the public. As the pandemic continues, a need for various apps has emerged, including COVID-19 apps that can support activities aimed at overcoming the COVID-19 pandemic. Objective: We aimed to determine which apps were considered the most necessary according to users and evaluate the current status of the development of COVID-19–related apps in South Korea. We also aimed to determine users’ acceptance and concerns related to using apps to support activities to combat COVID-19. Methods: We collected data from 1148 users from a web-based survey conducted between November 11 and December 6, 2020. Basic statistical analysis, multiple response analysis, and the Wilcoxon rank sum test were performed using R software. We then manually classified the current status of the development of COVID-19–related apps. Results: In total, 68.4% (785/1148) of the respondents showed high willingness to protect themselves from COVID-19 by using related apps. Users considered the epidemiological investigation app to be the most necessary app (709/1148, 61.8%) overall, followed by the self-management app for self-isolation (613/1148, 53.4%), self-route management app (605/1148, 52.7%), COVID-19 symptom management app (483/1148, 42.1%), COVID-19–related information provision app (339/1148, 29.5%), and mental health management app (270/1148, 23.5%). Despite the high intention to use these apps, users were also concerned about privacy issues and media exposure. Those who had an underlying disease and had experience using COVID-19–related apps showed significantly higher intentions to use those apps (P=.05 and P=.01, respectively). Conclusions: Targeting users is very important in order to design and develop the most necessary apps. Furthermore, to gain the public’s trust and make the apps available to as many people as possible, it is vital to develop diverse apps in which privacy protection is maximized. (JMIR Med Inform 2021;9(7):e29315) doi: 10.2196/29315


Background
Since the outbreak of COVID-19, countries worldwide have been engaging in various efforts to overcome the challenges associated with it.One of these efforts include providing app-based services, such as COVID-19 contact tracing apps, to support activities aimed at combating COVID-19 [1][2][3][4].
South Korea has been integrating digital technology to make it applicable to all fields [5,6], including surveillance, testing, contact tracing, and self-isolation, as well as apps providing COVID-19-related information.Several COVID-19-related apps have been developed and are currently being used, including the Self-Quarantine Safety Protection app [7] and apps for COVID-19 symptom management app and self-isolation.These apps have greatly helped South Korea in responding to the COVID-19 crisis.However, as the COVID-19 pandemic continues, the need for more diverse apps is emerging, such as COVID-19 vaccine apps [8], epidemiological investigation apps, self-route management apps, and mental health management apps.
To support activities aimed at overcoming COVID-19, diverse apps need to be developed for specific purposes.It is also vital to ensure that the majority of people can be assisted through these apps.Therefore, to ensure the effectiveness of COVID-19-related apps, we need to learn more about the apps that people need, as well as their acceptance and concerns regarding using these apps, for example, concerns regarding security issues.However, although security and information protection issues may arise while developing and using these apps [5,[9][10][11], the use of technology during COVID-19 has focused on using larger amounts of personal data to contain the spread of COVID-19 [12], rather than reflecting on users' intentions or concerns.
For COVID-19-related technologies to be effective, most people need to be able to use them.To achieve this, we need to focus on users' intentions and concerns, rather than adopting a technical approach [13].Therefore, in this study, we aimed to determine the most necessary apps as preferred by users and identify the current status of the development of COVID-19-related apps in South Korea.Furthermore, we aimed to determine users' acceptance and concerns related to using apps to overcome the COVID-19 crisis.
In early 2020, there were many apps providing COVID-19-related information, but over time, these evolved into COVID-19 symptom management and self-route management apps.Informational apps focus on providing information on the current status of COVID-19; subsequently, information relevant to the present state of COVID-19, such as information about masks and vaccines, is gradually updated and modified to remain relevant.For apps related to self-route management and mapping of COVID-19 cases, however, information is automatically saved using GPS or a QR code.Furthermore, these apps feature a function notifying users of the risk rate, such as mapping confirmed persons with COVID-19.Detailed information about the apps can be found in Table S1 of Multimedia Appendix 1.

Study Sample
We conducted a web-based survey between November 11 and December 6, 2020.The number of confirmed COVID-19 cases during the survey period ranged from 143 (on November 11) to 631 (on December 6).On November 1, 2020, the Korean government announced a plan to reorganize social distancing measures by subdividing social distancing into three to five stages; this came into effect on November 7, 2020.Thus, during XSL • FO RenderX the survey period, social distancing levels ranged from stage 1 to stage 2, based on the five stages of social distancing [14].
We had limitations in conducting a survey that included the total Korean population.Therefore, the survey was conducted keeping in mind the cost and time of distributing the questionnaire.In South Korea, as of December 6, 2020, Seoul, Gyeonggi-do, Incheon, and Daegu had the highest number of COVID-19 cases nationwide, accounting for 79% of all COVID-19 cases in South Korea [15].
We posted the survey recruitment notice on bulletin boards of online cafes, such as Korean portal online cafes (NAVER) [16], as well as university and college student community bulletin boards.In addition, a questionnaire was also distributed through referrals from cafe users.A total of 1170 people responded.After duplicate and incorrect responses were excluded, 1148 valid, completed questionnaires were obtained.The survey ended on December 6, where the proportion of survey respondents by region was similar to the proportion of COVID-19 cases by region as of December 6.

Review of COVID-19-Related Apps and Functions Developed in South Korea
To determine the current status of apps developed in South Korea, we conducted a search on application software downloading services such as the Apple App Store, Google Play Store, and Naver One Store.We aimed to find all COVID-19-related apps developed after January 2020, that is, after the COVID-19 outbreak was reported.We used keywords such as "COVID," "COVID-19," "Corona," "Corona 19," and "infectious disease."We excluded COVID-19-related apps developed by the Ministry of the Interior and Safety and the Ministry of Health and Welfare.Thus, we found a total of 54 apps.Among these, overseas apps and apps introduced before the COVID-19 outbreak were excluded.For the remaining 48 apps, two medical informatics professors (JP and MJR) and two researchers (JH and YK) manually organized the app features into categories (described below) over four meetings.
To categorize these apps, it was necessary to largely classify them by app features.However, there was no clear criteria for categorizing the app functions.Based on previous studies [12,17,18], we classified the apps developed in South Korea thus far into the following main function types to determine their current status: (1) COVID-19-related information provision, (2) COVID-19 symptom management, (3) COVID-19 self-diagnosis, (4) self-route management, (5) mapping of COVID-19 cases, and (6) self-report of COVID-19 confirmed cases.

The Intention to Use COVID-19-Related Apps
We developed a questionnaire determining the intention to use COVID-19-related apps based on previous studies [19,20].Intention to use is the most frequently used variable in research on technology acceptance and is widely used in the health care field [21,22].Additionally, the questionnaire items were modified for this study.That is, "intention to use" was defined as the degree to which a user's behavioral intention indicated their willingness to use COVID-19-related apps.Responses were given on a 5-point Likert scale ranging from 1 = "very unwilling" to 5 = "very willing."

Searches of App-Based Services to Support Activities to Combat COVID-19
COVID-19-related apps that were currently deemed as necessary were selected based on the six abovementioned functions.However, we added additional apps, namely the epidemiological investigation app, self-management app for self-isolation, and mental health management app.

Statistical Analysis
The question asking participants which app services are needed to support activities aimed at overcoming the COVID-19 crisis was a multiple-response question; thus, multiple response analysis was used.The Wilcoxon rank sum test [23] was used to analyze people's intention to use app-based services required to overcome COVID-19.Basic statistical analysis, multiple response analysis, and Wilcoxon rank sum test were conducted using R software (version 3.6.1).Furthermore, we manually classified the current status of the development of COVID-19-related apps.

Ethics
The study procedures were carried out in accordance with the Declaration of Helsinki and were approved by the Institutional Review Board of Catholic University (MC20QISI0125).Participants' data were anonymized to ensure confidentiality was maintained.

Intention to Use COVID-19-Related Apps
This study assessed participants' willingness to use COVID-19-related apps as shown in Figure 1.The first question asked the 1148 respondents if they were willing to protect themselves from COVID-19 by using COVID-19-related health care apps (Table 3), to which 68.4% (n=785) reported that they were "willing" or "very willing."The second question asked the respondents whether they wanted to be monitored through a COVID-19 management app, to with 47.6% (n=546) of the respondents reporting that they wanted to be monitored.However, 35.4% (n=406) of the respondents had a neutral opinion about this.The last question asked respondents if they wanted to be protected through a COVID-19 management app; 51% (n=586) of the respondents wanted to be protected through a COVID-19 management app, whereas 32.9% (n=378) had a neutral opinion.

Intention to Use and Reasons for Reluctance to Use the Epidemiological Investigations App
First, we inquired whether the respondents were willing to use the epidemiological investigation app, which was reported as the most necessary service.In total, 554 of the 1148 (48.3%) respondents reported that they would use this app, with 296 (25.8%) indicating that they were very willing (Figure 2 and Table 3).
Second, we inquired why they were reluctant to use the app.Regarding this, of the 1148 respondents, 480 (41.8%) of respondents cited privacy concerns, 449 (39.1%) expressed concerns about personal information exposure and media disclosure, and 202 (17.6%) did not have a reason (Table 5).The response rate of those who were not reluctant was very low (13/1148, 1.1%).

Intention to Use App-Based Services Required to Overcome the COVID-19 Crisis
The intention to use app-based services required to overcome COVID-19 were compared using the Wilcoxon rank sum test.The various app-based services evaluated in this study were as follows: (1) epidemiological investigation app, (2) self-management app for self-isolation, (3) self-route management app, and (4) COVID-19 symptom management app.The results indicated whether there were any differences in the intention to use these four apps according to the COVID-19-related characteristics of the respondents.These characteristics included the following: (1) presence of an underlying disease, (2) self-isolation experience, (3) COVID-19 test experience, (4) confirmed COVID-19 cases, (5) family members or friends with a confirmed COVID-19 case, (6) occupations that are easily exposed to COVID-19, (7) a company with good COVID-19 prevention strategies, and ( 8) experience with COVID-19-related apps (Table 6).
Regarding the presence of underlying disease and COVID-19-related app experience, there were significant differences in respondents' intention to use the epidemiological investigation app, self-management app for self-isolation, self-route management app, and COVID-19 symptom management app.Moreover, those who had an underlying disease and had experience using COVID-19-related apps showed significantly higher intention to use these four apps (P=.05 and P=.01, respectively; Table 6).

Discussion
This study aimed to determine the most essential apps required to overcome COVID-19 and the current status of the development of COVID-19-related apps in South Korea.Furthermore, this study aimed to determine users' acceptance of and concerns related to the use of these apps.
First, respondents expressed a high level of willingness to use COVID-19-related apps.Many respondents indicated that they wanted to be protected and monitored by using COVID-19-related apps.However, many also had a neutral opinion.Thus, these apps need to be developed in a way to gain the trust of prospective users.
Second, the need to develop multiple apps emerged, which included epidemiological investigation apps, self-management apps for self-isolation, self-route management apps, COVID-19 symptom management apps (42%), and mental health management apps.Most of the respondents (61.8%) considered the epidemiological investigation app as the most needed app.In addition, the self-management app for self-isolation (53.4%), self-route management app (52.7%),COVID-19 symptom management app (42.1%), and mental health management app (23.5%) were marked as important, in that order.
In South Korea, there exists a self-management app for self-isolation, called "Self-quarantine Safety Protection App" [7,24].However, based on the survey responses, it appears that various apps for self-management need to be developed.Regarding the self-route management app, apps using GPS and QR are increasingly being released; nevertheless, more apps are needed since their important continues to increase.To illustrate, the symptom management app helps identify new symptoms of COVID-19 and estimates the predicted value of specific symptoms [25].In addition, these apps appear to be helpful in developing reliable screening tools.Thus, it is important to develop and utilize symptom management apps that can be used by the general public.Moreover, it was confirmed that there is also a demand for an app that can manage fatigue, mental health, and symptoms such as depression and anxiety caused by working from home and COVID-19 itself.There is ongoing research about COVID-19 survivors [26] and mental illness issues such as depression and anxiety caused by COVID-19 [27][28][29].It has been reported that some people experienced worsened mental health after the pandemic [30].This problem also applies to the medical staff such as physicians and nurses [31][32][33].Therefore, active participation from the private sector and government is required to overcome the challenges posed by COVID-19.Furthermore, mental health problems need to be urgently addressed for groups such as COVID-19 survivors, medical staff, and women [29].
In the event of the COVID-19 pandemic, the main purpose of epidemiological investigations is to prevent early spread [34]; therefore, if the epidemiological investigation is delayed, secondary and tertiary disease transmission can occur, and people may become infected without knowing when or how they were infected.However, when a pandemic such as COVID-19 occurs, difficulties in epidemiological investigations and lack of workforce to conduct epidemiological investigation is often evident [35].Therefore, there is also an urgent need to increase the number of epidemiological investigators, but this goal is difficult to achieve.To facilitate epidemiological investigations, a system that can actively cooperate with such investigations is needed.Consequently, if an epidemiological investigation app is developed, it can help actively provide basic information and medical records, including one's own movements, at the time of confirmation by the epidemiological investigator [36].However, respondents expressed concern about infringement of personal information used by these services, such as COVID-19 contact tracing apps based on GPS or smartphone logs.Therefore, like the epidemiological investigation app, a self-route management app is also needed to reduce the fear of personal information infringement and increase the amount of information provided for epidemiological investigations.
Third, the importance of privacy invasion issues of COVID-19-related apps was emphasized in this study.Despite the high intention to use the epidemiological investigation app, people were very concerned about privacy invasion issues, personal information exposure, and media exposure.Thus, it is vital to consider how to resolve people's concerns about using these services, even after the necessary services are developed and available.Similarly, previous studies have found that people did not download and use contact tracing apps due to privacy concerns [37,38].These findings suggest that it is important to design and develop apps deemed as necessary in order to overcome the COVID-19 crisis; however, to gain the public's trust and make such apps available to many people, minimum amounts of personal information should be used and seek the public interest based on this.In this regard, a service where users have authority over their information should be developed [39].
Fourth, we found that those who had an underlying disease and had experience using COVID-19-related apps showed a significantly higher intention to use apps such as the epidemiological investigation app, self-management app for self-isolation, self-route management app, and COVID-19 symptom management app.Interestingly, even if users reported self-isolation experiences, COVID-19 test experiences, COVID-19 confirmed experiences, and nearby confirmed cases, their willingness to use COVID-19-related apps was not higher.In addition, no differences were found between the intention to use the apps among respondents engaged in occupations that had a relatively high exposure to COVID-19 cases or those employed by companies that complied with COVID-19 quarantine regulations.This is a surprising result; that is, the spread of COVID-19 is prevalent, but this does not directly lead to the use of apps.Hence, understanding people's needs in the current situation is essential.The current findings suggest that a focus on promoting and distributing the service in view of the high intention of use by those with underlying diseases and those who have used COVID-19-related apps should be prioritized.In addition, the app should be promoted and distributed intensively in hospitals or health centers wherein people with underlying diseases may be easily accessible.It would also be beneficial to include a function that recommends other apps over existing apps so that various apps can be exposed to active prospective users.Furthermore, it should be considered that many people reported that they do want to use apps to overcome the COVID-19 pandemic.COVID-19-related apps developed and used in South Korea ranged from those providing information to those used for symptom management, COVID-19 self-diagnosis, self-route management, mapping of COVID-19 cases, and reporting of COVID-19 confirmed cases.Based on the information needed at present, the COVID-19-related information app was found to be faithful to its function.As the COVID-19 pandemic continues, the development and use of GPS-and QR-based self-movement management and mapping of COVID-19 case services are needed.However, as mentioned earlier, these apps still have privacy issues.In addition, according to existing studies, the development ratio of Android-and iOS-based apps are similarly developed and used for COVID-19-related apps [12], but in South Korea, COVID-19 apps are mostly based on Android.Thus, a need to develop iOS-based apps for various Korean smartphone users is evident.
Despite the meaningful results discussed thus far, this study has several limitations.First, a total of 1148 survey respondents were analyzed.However, there were only four patients with confirmed COVID-19 among these participants, which is a low rate of 0.3% of the total respondents.Thus, to obtain more meaningful results, additional samples of COVID-19 confirmed cases should be collected.Second, although there are many COVID-19-related studies, there is limited published literature available.Third, 51.6% of the survey respondents were employed in white-collar jobs and managerial positions.Thus, occupational biases might have influenced the interpretation of results.Finally, to determine the current status of apps developed in South Korea, we conducted a search on application software downloading services.Two medical informatics professors and two researchers manually organized the app features in four meetings.To improve on this method, future research should apply tools to investigate the apps instead.Despite these limitations, there are meaningful implications of the study's findings.It was found that the COVID-19 apps may support activities aimed at overcoming the COVID-19 pandemic.However, our findings emphasized how several actions and requirements are necessary to accomplish this aim.Our findings further identified the most essential apps, as well as provided future directions for app development to overcome COVID-19.This study also emphasized the need for information protection to guarantee maximum privacy for users, thus increasing the likelihood of more users.Overall, several insights into the development of apps related to COVID-19 were identified, which can be utilized in future developments and improvements of new and existing apps related to COVID-19.

Table 5 .
Reasons for reluctance to use the epidemiological investigation app (N=1148).Participants, n (%) Question and responses If you are reluctant to use the epidemiological investigation app, why?

Table 1 .
COVID-19-related apps and app functions in South Korea.

Table 4 .
App-based services needed to support activities to overcome COVID-19.