Review
Abstract
Background: Telehealth was rapidly incorporated into primary care during the COVID-19 pandemic. However, there is limited evidence on which primary care visits used telehealth.
Objective: The objective of this study was to conduct a systematic review to assess what visit types in primary care with use of telehealth during the COVID-19 pandemic were reported; for each visit type identified in primary care, under what circumstances telehealth was suitable; and reported benefits and drawbacks of using telehealth in primary care during the COVID-19 pandemic.
Methods: This study was a systematic review using narrative synthesis. Studies were obtained from four databases (Ovid [MEDLINE], CINAHL Complete, PDQ-Evidence, and ProQuest) and gray literature (NSW Health, Royal Australian College of General Practitioners guidelines, and World Health Organization guidelines). In total, 3 independent reviewers screened studies featuring telehealth use during the COVID-19 pandemic in primary care. Levels of evidence were assessed according to the Grading of Recommendations Assessment, Development, and Evaluation. Critical appraisal was conducted using the Mixed Methods Appraisal Tool. Benefits and drawbacks of telehealth were assessed according to the National Quality Forum Telehealth Framework.
Results: A total of 19 studies, predominately cross-sectional surveys or interviews (13/19, 68%), were included. Seven primary care visit types were identified: chronic condition management (17/19, 89%), existing patients (17/19, 89%), medication management (17/19, 89%), new patients (16/19, 84%), mental health/behavioral management (15/19, 79%), post–test result follow-up (14/19, 74%), and postdischarge follow-up (7/19, 37%). Benefits and drawbacks of telehealth were reported across all visit types, with chronic condition management being one of the visits reporting the greatest use because of a pre-existing patient-provider relationship, established diagnosis, and lack of complex physical examinations. Both patients and clinicians reported benefits of telehealth, including improved convenience, focused discussions, and continuity of care despite social distancing. Reported drawbacks included technical barriers, impersonal interactions, and semi-established reimbursement models.
Conclusions: Telehealth was used for different visit types during the COVID-19 pandemic in primary care, with most visits for chronic condition management, existing patients, and medication management. Further research is required to validate our findings and explore the long-term impact of hybrid models of care for different visit types in primary care.
Trial Registration: PROSPERO CRD42022312202; https://tinyurl.com/5n82znf4
doi:10.2196/40469
Keywords
Introduction
Background
The COVID-19 pandemic has radically disrupted all aspects of health care, notably the rapid adaption of telehealth within routine care [
- ]. Telehealth, defined as telecommunications, videoconferencing, or other digital modes, is used to remotely deliver health-related services to patients [ , ]. Before the COVID-19 pandemic, telehealth provided convenience, specifically for patients living in rural or remote settings, but was not routinely used in health care settings [ ]. Telehealth during the pandemic was used across many medical specialties such as internal medicine, psychiatry, preventative medicine, surgery, neurology, dermatology, pediatrics, and infectious diseases [ ].In particular, some general practitioners (GPs) and patients welcomed telehealth in primary care general practice settings during the pandemic. A survey conducted by the Royal Australian College of General Practitioners (RACGP) involving >420 Australian GPs saw 1 in 5 respondents report 61% to 80% of their patients requesting a telehealth consultation during the COVID-19 pandemic [
]. Some patients and GPs have advocated for the long-term use of telehealth beyond the COVID-19 pandemic, for example, in the form of hybrid models of care [ , - ]. Several countries (eg, Australia, the United States, and the United Kingdom) have introduced long-term funding for telehealth in primary care because of the pandemic.There is potential for telehealth in primary care in nonpandemic settings [
]. However, the current model of telehealth may not be fit to sustain the long-term delivery of primary care [ , , ]. As the rapid adoption of telehealth and other forms of remote care is witnessed, its limitations need to be examined [ ]. Most telehealth systems were rolled out rapidly without much research into the risks (eg, lack of patient choice, missed diagnoses, challenges to the patient-clinician relationship, and inequality experienced by those affected by the digital divide) [ , , ]. Identifying which in-person encounters are appropriate to be supported by telehealth consultation is one of the critical questions facing today’s health care delivery.A cross-sectional study conducted by Donaghy et al [
] explored the acceptability and suitability of telehealth for specific encounters, where they reported telehealth as suitable for a range of patient visit types and concerns such as prescription refills, discussion-based activities, nonsensitive test results, and patients with chronic conditions with established diagnoses. A systematic review by Shah and Badawy [ ] evaluated the feasibility, accessibility, satisfaction, and treatment outcomes related to telehealth services among pediatric populations, with findings suggesting telehealth to be a suitable alternative to in-person care. A previous systematic review by Snoswell et al [ ] aimed to synthesize literature on the clinical effectiveness of telehealth for specific medical conditions from 2010 to 2019. However, to our knowledge, this is the first systematic review to focus on what visit types in primary care are suitable for telehealth based on studies where data were collected during the COVID-19 pandemic.Objectives
The objective of this study was to conduct a systematic review to assess (1) what visit types in primary care with use of telehealth during the COVID-19 pandemic were reported; (2) for each visit type identified in primary care, under what circumstances telehealth was suitable; and (3) reported benefits and drawbacks of using telehealth in primary care during the COVID-19 pandemic.
Methods
Information Sources
This review is PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)-compliant. See
for the completed checklist of PRISMA guidelines.Our search included the following electronic databases: Ovid (MEDLINE), CINAHL Complete, PDQ-Evidence, and ProQuest. Gray literature sources included NSW Health publications, RACGP guidelines, and World Health Organization guidelines.
Search Strategy
A modified population, exposure, and outcome [
] strategy was used, with population corresponding to primary care general practice clinicians and patients; exposure as the exposure to telehealth as a replacement of in-person consultation; and outcomes as benefits and drawbacks of telehealth, which are assessed according to the National Quality Forum (NQF) Telehealth Framework [ ], namely, access to care, effectiveness, experience, and financial impact or cost. Clinical outcomes outside the scope outlined per the NQF telehealth measures were not analyzed in detail in this systematic review because of the lack of available data. However, clinical outcomes (eg, mental health status, shielding status, and number of examinations) were also extracted in [ , , - ] if they were available.Individualized search strategies were formulated for each selected database with various Medical Subject Headings and searchable terms combined with Boolean operators. The complete search strategy is provided in
. An initial full search was conducted in March 2020. A final full search was conducted in August 2022. Conducting 2 searches ensured that the most recent and relevant literature was included in this systematic review analysis. Including both searches also reflects the rapid rate at which research is being conducted on telehealth services used in primary care settings following the COVID-19 pandemic.Eligibility Criteria
Eligibility criteria were developed to include studies (1) published between December 2019 and August 2022 to encompass the COVID-19 era, (2) that discussed GP-patient consultations delivered within a telehealth format, (3) that provided insight into the visit types in primary care where telehealth was used, and (4) that included outcome measures on patients’ or clinicians’ perceived suitability of or satisfaction with the teleconsultation experience. Studies featuring multiple health care settings may also be included based on the fact that only data from primary care clinicians or patients were used for this systematic review.
The exclusion criteria were (1) telehealth services that did not reflect a consultation format (ie, did not involve bidirectional communication between clinician and patient) within the primary care general practice setting (specialist consultations excluded), (2) studies where it was not explicit in what visit type in primary care was telehealth being used, and (3) studies not written in English. The complete eligibility criteria are provided in
.Article Selection Process
Initially, titles and abstracts of studies were retrieved using our search strategy and uploaded to an EndNote (Clarivate Analytics) library [
]. Duplicates were removed before uploading to the Rayyan software (Rayyan Systems Inc) [ ] for titles and abstracts to be screened independently by three reviewers (KW, FS, and NNK). The full texts of the selected studies were assessed in greater detail by lead reviewer KW. Disagreements in article screening decisions were resolved through consensus.Data Extraction and Management
Data from the included studies were extracted using an adapted version of the Joanna Briggs Institute data abstraction form (
) [ ]. Publication details, study design, participant demographics, primary care visit type, telehealth intervention, and outcome measures were extracted from the included studies. Benefits and drawbacks of telehealth were extracted as outcome measures, presented according to the NQF Telehealth Framework. The NQF Telehealth Framework addresses the assessment of whether telehealth specifically can be used to deliver quality care and related outcomes in comparison with in-person consultations [ ]. Definitions of each outcome measure used in this framework—namely, access to care, effectiveness, experience, and financial impact or cost—are reported in [ ]. Only relevant statistics or narrative excerpts were extracted. Effect measures were quoted from individual studies with no further statistical comparison.Outcome measures and their definitions according to the National Quality Forum Telehealth Framework.
Definitions of outcome measures
- Access to care: the ability to receive health services promptly and appropriately; consideration for accessibility to technology, living in rural and urban communities, living in medically underserved areas, access to appropriate health specialists, and provider capacity to provide care
- Effectiveness: the systematic, clinical, operational, and technical success or barriers of telehealth; considerations of the overall system and care coordination established, impact on health outcomes or quality, how clinically integrated telehealth is within the health center, and ability to record and transmit necessary data
- Experience: the usability and effect of telehealth on patients and providers with consideration of the appropriateness of services, increase in patients’ knowledge of care, patient compliance with care regimens, the difference in morbidity and mortality rates, patient safety, patient-centeredness, efficiency, diagnostic accuracy, ability to obtain actionable information, comfort, and satisfaction
- Financial impact or cost: potential cost savings or losses to patients, families, or providers regarding costs to access care, travel expenses, added value, and feasibility surrounding the technology involved
Critical Appraisal of the Included Studies
One reviewer (KW) led the critical appraisal. The Mixed Methods Appraisal Tool was used to appraise study designs of qualitative, quantitative, and mixed methods studies [
]. The level of evidence was assessed according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) [ ]. Studies were not excluded based on outcomes of the critical appraisal; however, it was used to interpret findings. More details of the critical appraisal are provided in [ , ].Results
Screening Process
outlines the article screening process, where 19 studies met the eligibility criteria and were included in a narrative synthesis.
Study Characteristics
Of the 19 included studies, 6 (32%) were conducted in the United States; 4 (21%) were conducted in the United Kingdom; 7 (37%) were conducted in Europe (Norway, Germany, Sweden, Netherlands, and Denmark); 3 (16%) were conducted in the Middle East (Israel and Oman); and the remaining 8 (42%) were conducted in Pakistan, Australia, and New Zealand (
).Telephone communication (17/19, 89%) was the most frequent telehealth intervention in our included studies, followed by video communication (15/19, 79%), SMS text messaging (6/19, 32%), and email messaging (6/19, 32%).
provides a statistical breakdown of the types of telehealth interventions in the included studies.Type of telehealth modea | Studies, n (%) |
Telephone communication | 17 (89) |
Video communication | 15 (79) |
SMS text messaging | 6 (32) |
Email messaging | 6 (32) |
aThe included studies can discuss more than one telehealth mode.
Visit Types in Primary Care With Telehealth Support During the COVID-19 Pandemic That Were Reported
Visit types in primary care with telehealth support during the COVID-19 pandemic that were reported are outlined in
. Definitions of each visit type were informed by Medicare item descriptions ( [ , - ]) after extraction from the included studies.and outline the reported benefits and drawbacks of using telehealth during the COVID-19 pandemic for each visit type in primary care. Seven visit types in primary care with telehealth use during the COVID-19 pandemic were reported, namely, chronic condition management (17/19, 89%), existing patients (17/19, 89%), medication management (17/19, 89%), new patients (16/19, 84%), mental health/behavioral management (15/19, 79%), post–test result follow-up (14/19, 74%), and postdischarge follow-up (7/19, 37%).
Visit types in primary care with telehealth support during the COVID-19 pandemic that were reported [
]. Visit types do not categorize within age groups. Patient age is considered as a benefit or drawback finding for this review.Visit types and description
- Chronic condition management: 6-month or other routine chronic condition reviews, diabetes checkups, asthma or chronic obstructive pulmonary disease medication or management reviews, or chronic pain (ie, arthritis or musculoskeletal pain) discussions
- Mental health and behavioral management: anxiety, depression, behavioral treatment reviews, talking therapy, or mental health medication reviews; specialist visits excluded from this review
- Medication management: acute concerns (ie, antibiotics), medication reviews, oral contraceptive prescriptions, or dermatology prescriptions
- Post–test result follow-up: follow-up after magnetic resonance imaging examinations, x-rays, blood tests, or laboratory testing with their general practitioner (GP) to discuss given results
- Postdischarge follow-up: follow-up after a procedure or discharge from the hospital for patients with cancer after tumor removals, hospital admission following acute severe adverse reaction, or after pregnancy delivery
- Existing patients (acute or existing concerns): standard consultations with an annual checkup session or acute concerns (ie, cold or flu symptoms or dermatology concerns) with a patient the GP has a pre-existing patient-provider relationship; inclusive of patients with COVID-19 or shielding patients
- New patients (acute or existing concerns): standard consultations such as one-off sessions (eg, vaccination) or acute concerns (ie, cold or flu symptoms or dermatology concerns) with a patient with whom the GP has no pre-existing patient-provider relationship; inclusive of patients with COVID-19 or shielding patients
Visit type | Studies that reported the use of telehealth | Benefit findings of telehealth | |||||
Studies, n (%) | Level 1 | Level 2 | Level 3 | Level 4 | Level 5 | ||
Chronic condition management (n=17) |
| 13 (76) | N/Ad | N/A |
|
|
|
Medication management (nonchronic condition; n=17) |
| 11 (65) | N/A | N/A |
|
|
|
Existing patients (acute or existing concern; n=17) |
| 11 (65) | N/A | N/A |
|
| —e |
New patients (acute or existing concern; n=16) |
| 7 (44) | N/A | N/A |
|
|
|
Mental health and behavioral management (n=15) |
| 11 (73) | N/A | N/A |
|
|
|
Post–test result follow-up (n=14) |
| 5 (36) | N/A | N/A | — |
| — |
Postdischarge follow-up (n=7) |
| 5 (71) | N/A | N/A |
|
|
|
aDefinitions of the different visit types are informed by the Department of Health Medicare Benefits Scheme item definitions [
] ( ). Levels of evidence were derived from the Grading of Recommendations Assessment, Development, and Evaluation scoring [ ]. Level 1 is systematic reviews, level 2 is randomized controlled trials, level 3 is nonrandomized experimental studies or comparative (observational) studies, level 4 is case series (cohort studies), and level 5 is opinion pieces or clinical guidelines. Each article can report more than one visit type supported with telehealth during the COVID-19 pandemic.bRACGP: Royal Australian College of General Practitioners.
cMBS: Medicare Benefits Schedule.
dN/A: not applicable.
eNo data available for the category specified.
Visit type | Studies that reported the use of telehealth | Drawback findings of telehealth | |||||
Studies, n (%) | Level 1 | Level 2 | Level 3 | Level 4 | Level 5 | ||
Chronic condition management (n=17) |
| 6 (35) | N/Ad | N/A |
|
| —e |
Medication management (nonchronic condition; n=17) |
| 3 (18) | N/A | N/A |
|
| — |
Existing patients (acute or existing concern; n=17) |
| 1 (6) | N/A | N/A | — |
| — |
New patients (acute or existing concern; n=16) |
| 9 (56) | N/A | N/A | — |
|
|
Mental health and behavioral management (n=15) |
| 3 (20) | N/A | N/A | — |
| — |
Post–test result follow-up (n=14) |
| 3 (21) | N/A | N/A | — |
| — |
Postdischarge follow-up (n=7) |
| 3 (43) | N/A | N/A | — |
| — |
aDefinitions of the different visit types are informed by the Department of Health Medicare Benefits Scheme item definitions [
] ( ). Levels of evidence were derived from the Grading of Recommendations Assessment, Development, and Evaluation scoring [ ]. Level 1 is systematic reviews, level 2 is randomized controlled trials, level 3 is nonrandomized experimental studies or comparative (observational) studies, level 4 is case series (cohort studies), and level 5 is opinion pieces or clinical guidelines. Each article can report more than one visit type supported with telehealth during the COVID-19 pandemic.bRACGP: Royal Australian College of General Practitioners.
cMBS: Medicare Benefits Schedule.
dN/A: not applicable.
eNo data available for the category specified.
The benefits and drawbacks of using telehealth during the COVID-19 pandemic in primary care were reported across all visit types. Visit types with >60% of studies reporting benefits included chronic condition management, mental health/behavioral management, medication management, and existing patients, whereas the visit types with 40% of studies reporting drawbacks of telehealth included new patients and postdischarge follow-up.
Diverse study designs according to GRADE were reported in the included studies, with most (13/19, 68%) corresponding to level-4 evidence (cohort studies, interviews, and surveys), followed by level 3 (nonrandomized experimental studies or comparative or observational studies; 4/19, 21%) and level 5 (opinion pieces or clinical guidelines; 2/19, 11%). No randomized controlled trials (level-2 evidence) or systematic reviews (level-1 evidence) were found to have met the eligibility criteria to be included in this systematic review.
Suitability of Using Telehealth Support for Each Visit Type During the COVID-19 Pandemic
Overview
For each visit type in primary care during the COVID-19 pandemic where telehealth support was reported, benefits and drawbacks are outlined in this section.
provides a summary of the circumstances when telehealth was reported as suitable and not suitable per patient visit types during the COVID-19 pandemic. For more details on supporting evidence, please refer to [ , , - , - , , , - ].Visit type and subcategory | Circumstances when telehealth was suitable | Circumstances when telehealth was NOT suitable | |
Condition- or concern-based | |||
Chronic condition management |
|
| |
Medication (nonchronic condition) management |
|
| |
Mental health and behavioral management |
|
| |
Post–test result follow-up |
|
| |
Postdischarge follow-up |
|
| |
Patient characteristics–based | |||
Existing patients (acute or existing concern) |
|
| |
New patients (acute or existing concern) |
|
|
Chronic Condition Management
Chronic condition management visits in primary care were reported as being one of the visit types with the greatest number of studies reporting the use of telehealth during the COVID-19 pandemic (17/19, 89%). Of these 17 studies, 13 (76%) reported benefits and 6 (35%) reported drawbacks.
In the included studies, chronic condition management visits were often reported as suitable for telehealth because of a pre-existing patient-provider relationship, established diagnosis, and lack of complex physical examinations. Routine visits for chronic conditions (eg, diabetes checkups) could be facilitated using telehealth, as these tasks often relied on discussions (eg, diet and medication) [
, , ]. Some of the examinations could be completed by patients at home under clinician guidance, such as foot examinations or weight measurements [ , , , , ]. Patients could show their list of medications at home by reading the labels [ ], and they could be educated on ways to use and administer medications at home (eg, asthma inhalers) and assisting with potential safety hazards or home support systems (eg, pets) [ ]. Self-management education could also be enhanced if patients could share with their GPs during telehealth their home setting and at-home tools (eg, at-home blood pressure cuffs, glucose monitors, and heart rate monitors) [ ].A drawback of telehealth for chronic condition management in the included studies was when close monitoring (eg, complex comorbidities or cancer diagnoses) [
] or complex physical examinations (eg, pediatric examinations or smear examinations) were required [ ]. Some patients reported being hesitant to use telehealth because of their unfamiliarity with the technology [ ]. However, most patients with chronic conditions expressed high satisfaction and willingness to engage with telehealth again [ ]. Patients with chronic conditions particularly favored the remote nature of telehealth as they were often at a higher risk of adverse symptoms if infected with COVID-19 when attending in-person clinics [ , , , ].Existing Patients
Existing patient consultations were reported as being one of the visit types with the greatest number of studies reporting the use of telehealth during the COVID-19 pandemic (17/19, 89% of the included studies). Of these 17 studies, 11 (65%) reported benefits and 1 (6%) reported drawbacks.
In the included studies, telehealth was reported as suitable for visits with a pre-existing patient-provider relationship as clinicians understood the patients’ history and had a pre-established rapport [
, , , , ]. Issues primarily reliant on assessing visual symptoms, such as dermatological concerns, could be shared with clinicians via photos or video [ ]. In some cases, clinicians reported higher efficiency using telehealth. They could reduce the downtime involved in transiting between different patients during in-person encounters and see more patients via telehealth [ ].In the included studies, existing patients reported satisfaction with telehealth, especially for straightforward matters (eg, medication refill) and patients at high risk of COVID-19 [
, , ]. However, a drawback of telehealth was when new diagnoses were involved, even among people with pre-existing patient-provider relationships, because of the poor ability to conduct physical examinations [ ].Medication Management
Medication management consultations were reported as being one of the visit types with the greatest number of studies reporting the use of telehealth during the COVID-19 pandemic (17/19, 89% of eligible studies). Of these 17 studies, 11 (65%) reported benefits and 3 (18%) reported drawbacks.
In the included studies, telehealth was reported as making medication reconciliations easier, improving patients’ adherence to their medications [
, , , ]. Telehealth was reported as supporting prescription refills for patients familiar with the medication’s side effects and risks and for straightforward health concerns such as oral contraceptives [ , , ]. Patients reported being satisfied with their telehealth experience related to medications [ , , ]. For example, patients could share their medications at home via video and image sharing with their clinicians. Furthermore, clinicians expressed greater relief when not being pressured to prescribe addictive drugs to at-risk patients during telehealth [ ].Drawbacks reported in the studies included concerns when physical examinations were necessary (eg, checking for infections when prescribing antibiotics) and prescription of new medications [
, , ]. Poorer communication in patient education of medications was also observed in some telehealth consultations, potentially affecting patients’ understanding of their medications [ , ].New Patients
New patient consultations with the use of telehealth during the COVID-19 pandemic were reported in 84% (16/19) of eligible studies. Of these 16 studies, 7 (44%) reported benefits and 9 (56%) reported drawbacks.
In the included studies, telehealth was reported as only suitable for new patients when the consultation focused on pre-existing diagnosed concerns, acute concerns (eg, dermatological concerns) that could be assessed via visual cues (such as via photo or video sharing), or when there was no need for physical examinations [
, , , ]. It is important to note that new patients are not always supported by health care reimbursement (eg, Medicare for Australian patients) outside certain criteria (ie, positive COVID-19 status, close contact, hot spot area, and emergency consultation), which affects the number of studies included for this visit type.However, telehealth was reported as not suitable for new diagnoses when there was no pre-existing patient-provider relationship, lack of knowledge of patient history, or no pre-established patient rapport [
, ]. Telehealth for new patients would be particularly difficult when complex symptoms are involved or when patients are not forthcoming with their concerns (eg, feeling shy or experiencing language or cultural barriers). Managing new patients over telehealth would rely on trusting patients’ self-reported symptoms and patient-directed examination, which can become complicated when there is an absence of pre-existing knowledge of the patient [ ]. In addition, technical problems within telehealth consultations can make building rapport with new patients even harder [ ].Mental Health and Behavioral Management
Mental health and behavioral management consultations with the use of telehealth during the COVID-19 pandemic were reported in 79% (15/19) of the included studies. Of these 15 studies, 11 (73%) reported benefits and 3 (20%) reported drawbacks.
In the included studies, telehealth was reported as only suitable for mental health and behavioral management when the consultation predominately focused on discussion and counseling activities [
, , , ]. Telehealth was suitable for patients with mild mental health issues (ie, patients not at risk to themselves or others), those without high cognitive impairments, and those who did not prefer a physical presence in consultations [ ]. Studies involving patients with more complex mental health concerns referred to specialists (ie, psychiatrists) and participants in specialist mental health telehealth programs were excluded from this review. Patients with mental health concerns reported the benefits of reduced wait times when using telehealth during the COVID-19 pandemic, resulting in fewer barriers to accessing mental health care support [ , ]. Patients also reported being satisfied with their telehealth experience for mental health issues during the COVID-19 pandemic, particularly because of consultations being completed in a discreet manner (ie, the privacy of their own home) [ , , ].Drawbacks reported in the studies included patients’ hesitancy to disclose over telehealth because of the stigma around mental health concerns, cultural or language barriers, and confidentiality around disclosing sensitive matters where there was a lack of privacy at home [
, ]. It was challenging to conduct telehealth consultations with patients with unstable mental health concerns (eg, suicidal ideation) [ ] or concerns requiring lengthier consultations [ ]. There were mixed views about the need for physical examinations for screening tests [ ].Post–Test Result Follow-up
Post–test result follow-up consultations with the use of telehealth during the COVID-19 pandemic were reported in 74% (14/19) of the included studies. Of these 14 studies, 5 (36%) reported benefits and 3 (21%) reported drawbacks.
In the included studies, post–test result follow-up was often suitable for telehealth as the primary activity involved discussions of test results rather than conducting physical examinations [
, , , , ]. For patients and clinicians, practices used procedures to ensure confidentiality via telehealth when receiving (and discussing) test results [ ]. For example, some practices used confirmation ID numbers or asked patients to confirm their date of birth before revealing sensitive medical information because of the absence of in-person confirmation [ ]. In some cases, telehealth also improved the ability to share test results with patients compared with in-person consultations (eg, screen sharing of test results with patients over video consultation) rather than the patient attempting to reach over to read the test result on the GP’s computer screen during in-person encounters [ ].A drawback of telehealth reported for this visit type was the poorer communication patterns observed when explaining to patients complex medical jargon used in test results. This is possibly related to the impersonal nature of telehealth, the inability to use visual aids, the lack of a physical presence, or other elements required to explain test results remotely [
]. Other clinic staff may communicate test results if results are satisfactory or do not require additional follow-up, resulting in minimal benefit and drawback findings reported for this visit type. Unsatisfactory results may lead to GP-patient consultations, possibly resulting in more drawbacks reported for this visit type.Postdischarge Follow-up
Postdischarge follow-up consultations with the use of telehealth during the COVID-19 pandemic were reported in 37% (7/19) of the included studies. Of these 7 studies, 5 (71%) reported benefits and 3 (43%) reported drawbacks.
In the included studies, telehealth was reported as suitable for postdischarge follow-up visits when patients lived far away or had difficulty arranging same-day or frequent follow-up visits (eg, antenatal visits) [
, ]. Patients with pre-existing patient-provider relationships linked to the same postoperative clinic also reported satisfaction [ ].However, there was the drawback of it being harder to coordinate care [
]. This visit type often involved multiple care team members and complex physical examinations by various clinic members (eg, nurses and practitioners to address wound care) [ , ]. It was also challenging to share documentation from multiple team members [ ].Benefits and Drawbacks of Using Telehealth in Primary Care During the COVID-19 Pandemic
This section outlines the benefits and drawbacks of using telehealth in primary care during the COVID-19 pandemic from patient and clinician perspectives reported according to the NQF Telehealth Framework. For more details on supporting evidence, please refer to
[ , , , - ].Access to Care
The NQF outcome measure “Access to care” (ie, the ability to receive health services promptly and appropriately) was reported in 84% (16/19) of the included studies. A summary of benefits and drawbacks of telehealth per this outcome factor is provided in
.Both patients and clinicians reported the benefits of using telehealth to maintain timely and frequent contact, shortening wait times in between visits and having a satisfactory experience [
, , , , , ]. Patients particularly enjoyed the additional benefits of reduced travel time [ , ], the convenience of being at home [ , ], having quicker access to care for simple concerns [ , , ], and being able to access care that was only available for a teleconsultation but not available for in-person consultations (eg, outside clinic opening hours) [ , ], whereas clinicians reported the benefits of seeing more patients using telehealth [ ] and connecting with patients who preferred technology over in-person encounters [ , ].Perspective and benefits of telehealth | Drawbacks of telehealth | |
Primary care clinician perspective | ||
|
| |
Patient perspective | ||
|
| |
Both primary care clinician and patient perspective | ||
|
|
However, patients and clinicians reported insufficient technical support, infrastructure, or equipment to access telehealth and difficulty with more complex telehealth systems that required special hardware or software support [
, ]. Some patients reported difficulty finding privacy at home to attend teleconsultations [ ]. Some patients felt excluded or deterred from seeking help because of unfamiliarity with technology [ , ]. Some clinicians reported drawbacks of telehealth, such as it being harder to address language or cognition barriers with patients without physical cues [ ] as well as feeling concerned with risks on digital platforms (eg, cyberattacks, security, and confidentiality in web-based communication) [ ].Effectiveness
The NQF outcome measure “Effectiveness” (ie, represents the systematic, clinical, operational, and technical success or barriers of telehealth) was reported in 84% (16/19) of the included studies. A summary of benefits and drawbacks of telehealth per this outcome factor is provided in
. Both patients and clinicians reported that telehealth was suitable (ie, clinical appropriateness) for infections, dermatological concerns, renewal of prescriptions, or self-monitoring programs [ , , ]. Most patients reported being sufficient at self-assessing whether they should seek a teleconsultation or an in-person consultation according to their health concerns [ ]. Furthermore, patients could show their medication or self-care practices at home, allowing clinicians to better understand how their home environment may affect their self-management, thus improving clinicians’ advice dispensed to support their patients [ ]. Clinicians also noted the benefits of sharing medical records with patients via screen sharing, improving their understanding [ ].However, telehealth was reported as not suitable for specific patient groups (eg, people with unstable mental concerns or low hearing and vision, young children unable to describe symptoms themselves, and people with cognitive impairment) [
] or for complex symptom presentations or diagnoses that required physical examinations (eg, chest pain, stomach pain, and potential new cancer) [ , ]. There is currently a lack of guidance on identifying and addressing severe adverse events that may occur because of telehealth (eg, lack of guidance on safety netting for teleconsultation, uncertainty about who else is also present but hiding during the teleconsultation, or recording consultations without consent) [ ]. Furthermore, there is a tendency to rely more on patient-reported outcomes and patient-directed examinations during telehealth, affecting a GP’s assessment of the patient’s health status, which may inevitably result in in-person consultations later on despite having had a teleconsultation [ , ].Perspective and benefits of telehealth | Drawbacks of telehealth | ||
Primary care clinician perspective | |||
|
| ||
Patient perspective | |||
|
| ||
Both primary care clinician and patient perspective | |||
|
|
Experience
The NQF outcome measure “Experience” (ie, represents the usability and effect of telehealth on patients and providers) was reported in 89% (17/19) of the included studies. A summary of benefits and drawbacks of telehealth per this outcome factor is provided in
.Both clinicians and patients were satisfied with a perceived lower risk of infection transmission during the COVID-19 pandemic as a result of using telehealth [
, - , , ]. Some reported feeling positive that they were able to maintain a patient-provider connection via telehealth during the COVID-19 pandemic [ , , ]. Primary care clinicians reported several personal benefits of telehealth, including improved work-life balance and the ability to conduct some consultations more efficiently [ ]. Clinicians also reported perceiving their patients as feeling more relaxed in their home environments compared with in-person consultations [ ]. Overall, most patients reported having a satisfactory experience and a willingness to use telehealth again [ , ].Perspective and benefits of telehealth | Drawbacks of telehealth | |
Primary care clinician perspective | ||
|
| |
Patient perspective | ||
|
| |
Both primary care clinician and patient perspective | ||
|
|
As reported by both clinicians and patients, the main drawback of telehealth was dissatisfaction with a lack of in-person physical examinations [
]. Some clinicians faced the additional drawbacks of addressing language or cultural barriers without in-person cues [ ] and the lack of stimulating work when there was little in-person interaction with patients [ ]. In addition, telehealth sometimes required clinicians to take on multiple roles in the practice to ensure it ran smoothly (eg, secretary, IT support, and clinician) [ , ]. Patients similarly needed to combat barriers such as the lack of opportunity to develop rapport with their clinicians, impersonal consultations [ ], language or cultural barriers to disclosing issues, technological barriers, and confidential concerns during web-based communication via telehealth [ ].Financial Impact or Cost
The NQF outcome measure “Financial Impact/Cost” (ie, potential cost savings or losses to patients, families, or providers) was reported in 63% (12/19) of the included studies. A summary of benefits and drawbacks of telehealth per this outcome factor is provided in
. From the clinicians’ perspective, the infrastructure, processes, and long-term reimbursement models of telehealth were important considerations before its full potential and benefits could be unleashed [ , ]. For patients, removing the need to travel and reducing the loss of pay from taking time off work to attend in-person consultations were important drivers for choosing telehealth [ ].Perspective and benefits of telehealth | Drawbacks of telehealth | ||
Primary care clinician perspective | |||
|
| ||
Patient perspective | |||
|
|
However, issues relating to long-term models of financing and reimbursing telehealth remained a major concern [
]. For both patients and clinicians, there were concerns that remain to be researched about the expensive costs of acquiring the necessary software, hardware, and infrastructure to set up telehealth when it is unclear whether telehealth will remain a permanent service delivery mode in the long term. Furthermore, there is potential for commercial entities to exploit the charging or provision of telehealth when there remains uncertainty from the government on its long-term funding model [ ]. There were mixed views regarding whether patients were willing to pay the same rate for telehealth consultations when compared with in-person consultations or an alternative appropriate cost [ ].Discussion
Principal Findings
To our knowledge, this is the first systematic review reporting visit types in primary care where telehealth was used during the COVID-19 pandemic. Most of the included studies (13/19, 68%) were level-4 evidence (cohort studies, interviews, and surveys), reflecting the early experience of the pandemic. Seven primary care visit types were identified: chronic condition management (17/19, 89%), existing patients (17/19, 89%), medication management (17/19, 89%), new patients (16/19, 84%), mental health and behavioral management (15/19, 79%), post–test result follow-up (14/19, 74%), and postdischarge follow-up (7/19, 37%). Benefits and drawbacks were reported across all visit types, with chronic condition management visits being one of the visit types with use of telehealth reporting the greatest number of studies during the pandemic (17/19, 89%). Reasons for why telehealth was deemed suitable for chronic condition management visits included patients having pre-existing diagnoses, established patient-provider relationships, and lack of complex physical examinations required. Insights into both the primary care clinician and patient perspective of telehealth use for specific visit types (ie, access to care, effectiveness, experience, and financial impact or cost) were also provided. Overall, benefits of telehealth included improved convenience, focused discussions, and continuity of care despite social distancing practices during the COVID-19 pandemic. Drawbacks of telehealth included technical barriers, impersonal interactions, and semi-established reimbursement models.
Strengths and Limitations
The strengths of this study include following a rigorous approach at all stages of the systematic review. For example, a wide range of academic databases and gray literature were searched to ensure great coverage of literature. In total, 3 independent researchers following predetermined eligibility criteria were involved in article screening to reduce the risks of selection bias. Data extraction templates (eg, the Joanna Briggs Institute data abstraction form) were used to standardize reporting of findings between studies. Well-established tools (eg, GRADE and the Mixed Methods Appraisal Tool) were used to conduct a critical appraisal and assess levels of evidence for each included study. Furthermore, definitions and terminologies from widely accepted frameworks in the telehealth and primary care communities (such as the NQF Telehealth Framework, the RACGP, and the Medicare Benefits Schedule) were used to ease the translation of our review.
The limitations of this review include restricting it to studies between late 2019 and August 2022 as definitions of the COVID-19 era, limiting it to studies written in English, and the decision to focus on broadness rather than narrowness in our search strategy. Publication bias (ie, the tendency to report positive results) may be present in the included studies because of the novel adoption of telehealth during the COVID-19 pandemic and growing interest in this research space [
]. Since our review, additional studies may have been published focusing on the experience of telehealth as GPs and patients have become more experienced with its use within routine primary care settings. Thus, despite multiple search cycles, our review may only reflect early experiences of telehealth during the COVID-19 era. In addition, this systematic review focuses on the early experience of the COVID-19 pandemic, where primary studies on clinical outcomes of using telehealth during the pandemic were not yet available. Future reviews should examine the long-term clinical outcomes of patients using telehealth (or hybrid models of care) in primary care settings. Our search strategy did not use keywords related to specific visit types in primary care. Instead, we chose to focus broadly on primary care to ensure we captured all studies with telehealth support conducted in primary care during the pandemic that were reported. Future reviews could include non-English studies or specific visit types to increase the generalizability and scope of the findings.Comparison With Prior Work
Before the COVID-19 pandemic, studies on telehealth focused on issues such as particular visit types (eg, medication reviews or chronic condition management visits) [
, ], patient satisfaction [ , ], or nonsynchronous patient-provider communication (eg, e-consultation portals) [ ]. For example, a review by Polisina et al [ ] explored the use of an at-home management program for a chronic condition such as diabetes. A systematic review by Hanjani et al [ ] focused explicitly on medication reviews via telehealth and identified similar facilitators and barriers to those of our review. Most of the benefits and drawbacks of telehealth reported in this review, such as ease of use, reduced travel times, low cost, and improved communication (in some instances), were also found by Kruse et al [ ] in their systematic review. Other studies such as that by Hollander and Goldwater [ ] examined the use of telehealth in orthopedic surgery, and Villarreal et al [ ] reviewed mobile systems designed for health care monitoring.Our systematic review focused on studies published in the COVID-19 era to consider how telehealth was used in primary care during the pandemic. A recent systematic review by Snoswell et al [
] aligns with our recommendations, stating that telehealth services are equivalent to or (at times) more effective than in-person care. However, Snoswell et al [ ] did not report telehealth experience during the COVID-19 pandemic, instead focusing on studies from 2010 to 2019. A recent systematic review from Carrillo de Albornoz et al [ ] evaluated the effectiveness of teleconsultations in primary care and mental health services in comparison with in-person visits, providing similar insights into the usability of telehealth as an effective alternative to in-person consultations. However, although this study was published following the emergence of COVID-19, the included studies were not conducted during the COVID-19 pandemic and, therefore, this study does not reflect on the effectiveness of teleconsultations in light of the pandemic.A rapid scoping review by Jonnagaddala et al [
] explored facilitators and inhibitors of primary care informatics to COVID-19 in Australia. Similarly, we found limited high-quality evidence on the effectiveness, access, equity, utility, safety, and quality of digital health during the COVID-19 pandemic. However, our review differs in the systematic review approach. We identified 7 visit types where telehealth was used in primary care during the pandemic, outlining the benefits and drawbacks of using telehealth for each visit type and in primary care overall.Implications for Digital Health, Clinical Practice, and Future Research
In total, 3 key insights have emerged from this review.
Key Insight 1: Rigorous Research Is Needed to Investigate Which Visit Types Are Indeed Suitable for Telehealth in Primary care
The results of our systematic review identified a lack of quality evidence on primary care visit types suitable for telehealth. Most of the included studies (13/19, 68%) were level-4 evidence (ie, case series or cross-sectional studies), which are subject to self-report bias. Furthermore, there is a lack of focus on how telehealth was used for different visit types in primary care. The saturation of level-4 evidence in this space conveys that these study designs are indeed the current state of the art, presumably from the relatively short time since the start of the pandemic as well as the lack of ability to conduct follow-up or person-facing studies because of social distancing restrictions. As we move into the era of living with COVID-19, studies with a longitudinal follow-up that focus on specific visit types are required to assess the long-term suitability of telehealth in primary care. In addition, there was a lack of research in the included studies reporting clinical outcomes related to telehealth use during the pandemic, presumably because, at the time of searching and writing (ie, early phases of the COVID-19 pandemic), studies assessing clinical outcomes of using telehealth during the pandemic would not have yet been available. When those studies become available, future systematic reviews may wish to assess clinical outcomes of using telehealth during the pandemic so that the findings in this review reporting the suitability of telehealth for primary care visits can be validated.
Key Insight 2: Long-term Models of Telehealth and Their Impact on Patient Outcomes and Health Service Use
As a result of COVID-19, several countries (eg, Australia, the United States, and the United Kingdom) have introduced permanent or long-term funding for telehealth in primary care. For example, the Australian government introduced long-term funding for telehealth in December 2021 to align with initiatives to reduce community COVID-19 transmission [
]. Australians have welcomed telehealth consultations, with >86 million primary care telehealth consultations completed in Australia since the beginning of the COVID-19 pandemic [ ]. Other countries such as the United States and the United Kingdom are exploring a permanent funding scheme for telehealth within their existing health care models. Almost every state Medicaid program has a reimbursement coverage account for telehealth services in the United States [ ]. The Centers for Disease Control and Prevention also introduced multiple waivers during the COVID-19 pandemic to grant payment parity for telehealth [ ].Before the pandemic, telehealth policies in the United Kingdom alone were underdetermined across England, Wales, Northern Ireland, and Scotland. Challenges related to outdated systems and underinvestment in telehealth have hindered the progress of digitization [
]. During the COVID-19 pandemic, health care services under the National Health Service took a “total triage” approach where all patients were referred first to telehealth services over face-to-face services [ ]. According to the Health Foundation, this initiative has caused a rapid and significant increase in telehealth use, reporting the highest-ever number of telephone consultations in English primary care as a consequence of the pandemic [ ]. For example, a videoconferencing telehealth platform called “Near Me” reported having been used by approximately 300 people per week at the start of 2020, rising to approximately 20,000 appointments every week by mid-2020 [ ]. By July 2021, >1 million appointments were delivered via telehealth services [ ]. Furthermore, 11.4 million telephone consultations were reported to have been completed in March 2021 compared with 3.5 million in March 2019 [ ]. This rapid and unforeseen uptake of telehealth services raises questions as to whether unintended consequences and safety risks may have been introduced as well [ ].Governments have recognized the value of telehealth during the pandemic, especially for patients who struggle with mobility [
, ], live remotely or rurally [ ], or are unable to find suitable times to attend in-person consultations [ ], regardless of their COVID-19 status. Future research ought to examine how long-term funding models of telehealth affect patient outcomes, help-seeking behaviors, and health service use patterns. For example, further research is required to compare the health outcomes and quality of care between patients who primarily use telehealth experiences versus those who use in-person care. In addition, further research is required to analyze how changes in health service use patterns because of routine telehealth use affect the funneling of resources, particularly training opportunities for health care providers on how to use telehealth optimally and the communication skills required in telehealth.Furthermore, there is the additional consideration of how designs of telehealth need to evolve with emerging safety, ethical, and equitable concerns, for example, how to ensure that all patients can equally access care, regardless of the digital divide, if more resources are directed to providing telehealth over in-person services. In addition, further research is required to explore how to support patient-provider relationships when care is delivered across a blended model of approaches, as well as further research into appropriate safety-netting practices during teleconsultations [
].Key Insight 3: Patient Safety at Home Is Paramount as Care and Technology Are Increasingly Used Outside Clinical Settings
Increasingly, care is moved closer to patients’ homes, blended with technology. The pandemic has accelerated the movement of blending care and technology at home. For example, home oximetry monitoring programs have been introduced for monitoring positive COVID-19 patients in the United Kingdom, and a recent prospective study has reported patient satisfaction and early success [
]. Other digital health services have also been increasingly introduced for use outside clinical settings, such as assistive technology to support independent living at home [ , ], remote monitoring mobile apps [ , ], and e–mental health services (eg, Betterhelp and Headspace) [ ].Introducing technologies directly into patients’ homes as part of routine service delivery may encourage more frequent monitoring of signs and symptoms. However, patient-facing medical devices and at-home care can introduce a new dimension of patient risk [
]. Historically, the role of conducting physical examinations and use of medical devices was reserved for health care professionals [ ]. However, with telehealth and remote care services, the responsibility of physical examination and monitoring falls onto the patient, requiring patients to have the necessary knowledge and skills to conduct these previously clinician-directed tasks effectively by themselves or be aware of when to seek additional assistance [ ]. As a result, patients could become vulnerable to unanticipated risks such as inaccurate self-examination [ , ], unreliable patient self-reports, reduced person-centered care because of language or cognitive barriers, inability to conduct a physical examination properly, or incapacity to receive care properly because of technological limitations [ , ]. Further investigation is required to identify the types of adverse events that can occur during remote care (eg, whether people are using technologies as intended or whether technologies are introducing unintended consequences) and ways to combat these adverse events [ ].Conclusions
This systematic review identified 7 visit types in primary care with telehealth support during the COVID-19 pandemic, with the greatest number of studies reporting benefit findings for chronic condition management visits (17/19, 89%). Benefits and drawbacks of using telehealth were reported across different visit types from patient and clinician perspectives, as well as the circumstances in which telehealth was found to be suitable (or not) for each primary care visit type. As telehealth potentially becomes a long-term care delivery model, improving telehealth consultation delivery while monitoring patient safety at home will emerge as an important priority area.
Acknowledgments
KW was supported with a Higher Degree Research scholarship from Macquarie University. AYSL was supported by the National Health and Medical Research Council grant APP1134919 (Centre for Research Excellence in Digital Health) and the New South Wales Health Early-Mid Career Fellowship.
Authors' Contributions
KW and AYSL contributed to the conception of the study. KW, FS, and NNK were involved in the literature search, screening, and data extraction. KW conducted the analyses and manuscript write-up with support from AYSL and SV. All authors approved the final manuscript.
Conflicts of Interest
None declared.
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
DOCX File , 26 KB
Study Characteristics.
DOCX File , 51 KB
Search Strategy.
DOCX File , 620 KB
Eligibility Criteria.
DOCX File , 15 KB
Data Extraction Template.
DOCX File , 16 KB
Risk and Bias Critical Appraisal.
DOCX File , 26 KB
Visit Type Medicare Descriptions.
DOCX File , 32 KB
Supporting Evidence of Suitability of Telehealth for each Visit Type during COVID-19.
DOCX File , 55 KB
Supporting Evidence of Benefit and Drawback of using Telehealth in Primary care during COVID-19 according to outcomes of the NQF Framework.
DOCX File , 28 KBReferences
- Johnsen TM, Norberg BL, Kristiansen E, Zanaboni P, Austad B, Krogh FH, et al. Suitability of video consultations during the COVID-19 pandemic lockdown: cross-sectional survey among Norwegian general practitioners. J Med Internet Res 2021 Feb 08;23(2):e26433 [FREE Full text] [CrossRef] [Medline]
- Bavli I, Sutton B, Galea S. Harms of public health interventions against covid-19 must not be ignored. BMJ 2020 Nov 02;371:m4074. [CrossRef] [Medline]
- Douglas M, Katikireddi SV, Taulbut M, McKee M, McCartney G. Mitigating the wider health effects of covid-19 pandemic response. BMJ 2020 Apr 27;369:m1557 [FREE Full text] [CrossRef] [Medline]
- Nickelson DW. Telehealth and the evolving health care system: strategic opportunities for professional psychology. Prof Psychol Res Pract 1998 Dec;29(6):527-535. [CrossRef]
- Snoswell CL, Caffery LJ, Haydon HM, Thomas EE, Smith AC. Telehealth uptake in general practice as a result of the coronavirus (COVID-19) pandemic. Aust Health Rev 2020 Sep;44(5):737-740. [CrossRef] [Medline]
- Doraiswamy S, Abraham A, Mamtani R, Cheema S. Use of telehealth during the COVID-19 pandemic: scoping review. J Med Internet Res 2020 Dec 01;22(12):e24087 [FREE Full text] [CrossRef] [Medline]
- Tsirtsakis A. GPs have embraced telehealth, survey finds. The Royal Australian College of General Practitioners. 2020 Aug 6. URL: https://www1.racgp.org.au/newsgp/professional/gps-have-embraced-telehealth-survey-finds#:~:text=COVID%2D19%20virus.-,',seek%20the%20care%20they%20need [accessed 2021-02-14]
- Evans J. Telehealth services to become a permanent part of healthcare system, following COVID-19 success. ABC News. 2021 Dec 13. URL: https://www.abc.net.au/news/2021-12-13/telehealth-services-to-be-made-permanent/100694844 [accessed 2022-01-25]
- De Guzman KR, Snoswell CL, Giles CM, Smith AC, Haydon HH. GP perceptions of telehealth services in Australia: a qualitative study. BJGP Open 2022 Mar;6(1):BJGPO.2021.0182 [FREE Full text] [CrossRef] [Medline]
- Reeves JJ, Ayers JW, Longhurst CA. Telehealth in the COVID-19 era: a balancing act to avoid harm. J Med Internet Res 2021 Feb 01;23(2):e24785 [FREE Full text] [CrossRef] [Medline]
- Duckett S. What should primary care look like after the COVID-19 pandemic? Aust J Prim Health 2020 Jun;26(3):207-211. [CrossRef] [Medline]
- Mroz G, Papoutsi C, Rushforth A, Greenhalgh T. Changing media depictions of remote consulting in COVID-19: analysis of UK newspapers. Br J Gen Pract 2020 Dec 28;71(702):e1-e9 [FREE Full text] [CrossRef] [Medline]
- Donaghy E, Atherton H, Hammersley V, McNeilly H, Bikker A, Robbins L, et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract 2019 Sep;69(686):e586-e594 [FREE Full text] [CrossRef] [Medline]
- Shah AC, Badawy SM. Telemedicine in pediatrics: systematic review of randomized controlled trials. JMIR Pediatr Parent 2021 Feb 24;4(1):e22696 [FREE Full text] [CrossRef] [Medline]
- Snoswell CL, Chelberg G, De Guzman KR, Haydon HH, Thomas EE, Caffery LJ, et al. The clinical effectiveness of telehealth: a systematic review of meta-analyses from 2010 to 2019. J Telemed Telecare 2021 Jun 29:1357633X211022907. [CrossRef] [Medline]
- Morgan RL, Whaley P, Thayer KA, Schünemann HJ. Identifying the PECO: a framework for formulating good questions to explore the association of environmental and other exposures with health outcomes. Environ Int 2018 Dec;121(Pt 1):1027-1031 [FREE Full text] [CrossRef] [Medline]
- Hollander J, Ward M, Alverson D, Bashshur R, Darkins A, DePhillips H. Creating a framework to support measure development for Telehealth. National Quality Forum. Washington, DC, USA: National Quality Forum; 2017 Aug 31. URL: https://www.aristamd.com/wp-content/uploads/2018/10/telehealth_final_report.pdf [accessed 2021-03-20]
- Jetty A, Jabbarpour Y, Westfall M, Kamerow DB, Petterson S, Westfall JM. Capacity of primary care to deliver telehealth in the United States. J Am Board Fam Med 2021 Feb;34(Suppl):S48-S54 [FREE Full text] [CrossRef] [Medline]
- Grossman Z, Chodick G, Reingold SM, Chapnick G, Ashkenazi S. The future of telemedicine visits after COVID-19: perceptions of primary care pediatricians. Isr J Health Policy Res 2020 Oct 20;9(1):53 [FREE Full text] [CrossRef] [Medline]
- Jabbarpour Y, Jetty A, Westfall M, Westfall J. Not telehealth: which primary care visits need in-person care? J Am Board Fam Med 2021 Feb;34(Suppl):S162-S169 [FREE Full text] [CrossRef] [Medline]
- van de Poll-Franse LV, de Rooij BH, Horevoorts NJ, May AM, Vink GR, Koopman M, et al. Perceived care and well-being of patients with cancer and matched norm participants in the COVID-19 crisis: results of a survey of participants in the Dutch PROFILES registry. JAMA Oncol 2021 Feb 01;7(2):279-284 [FREE Full text] [CrossRef] [Medline]
- Gomez T, Anaya YB, Shih KJ, Tarn DM. A qualitative study of primary care physicians' experiences with telemedicine during COVID-19. J Am Board Fam Med 2021 Feb;34(Suppl):S61-S70 [FREE Full text] [CrossRef] [Medline]
- Hasani SA, Ghafri TA, Al Lawati H, Mohammed J, Al Mukhainai A, Al Ajmi F, et al. The use of telephone consultation in primary health care during COVID-19 pandemic, Oman: perceptions from physicians. J Prim Care Community Health 2020;11:2150132720976480 [FREE Full text] [CrossRef] [Medline]
- Imlach F, McKinlay E, Middleton L, Kennedy J, Pledger M, Russell L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract 2020 Dec 13;21(1):269 [FREE Full text] [CrossRef] [Medline]
- Gabrielsson-Järhult F, Kjellström S, Josefsson KA. Telemedicine consultations with physicians in Swedish primary care: a mixed methods study of users' experiences and care patterns. Scand J Prim Health Care 2021 Jun;39(2):204-213 [FREE Full text] [CrossRef] [Medline]
- Murphy M, Scott LJ, Salisbury C, Turner A, Scott A, Denholm R, et al. Implementation of remote consulting in UK primary care following the COVID-19 pandemic: a mixed-methods longitudinal study. Br J Gen Pract 2021 Feb 25;71(704):e166-e177 [FREE Full text] [CrossRef] [Medline]
- Schweiberger K, Hoberman A, Iagnemma J, Schoemer P, Squire J, Taormina J, et al. Practice-level variation in telemedicine use in a pediatric primary care network during the COVID-19 pandemic: retrospective analysis and survey study. J Med Internet Res 2020 Dec 18;22(12):e24345 [FREE Full text] [CrossRef] [Medline]
- New items for COVID-19 telehealth and phone services. The Royal Australian College of General Practitioners. 2021 May 17. URL: https://www.racgp.org.au/running-a-practice/practice-resources/medicare/medicare-benefits-schedule/new-items-for-covid-19-telehealth-services [accessed 2021-03-03]
- MBS Changes factsheet - COVID-19 temporary MBS telehealth services. Department of Health, Australian Government. 2020 Sep 18. URL: http://www.mbsonline.gov.au/internet/mbsonline/publishing.nsf/Content/0C514FB8C9FBBEC7CA25852E00223AFE/$File/Factsheet-COVID-19-Bulk-billed-MBS%20telehealth-Services-Overarching-17.09.2020.pdf [accessed 2021-03-03]
- Mozes I, Mossinson D, Schilder H, Dvir D, Baron-Epel O, Heymann A. Patients' preferences for telemedicine versus in-clinic consultation in primary care during the COVID-19 pandemic. BMC Prim Care 2022 Feb 22;23(1):33 [FREE Full text] [CrossRef] [Medline]
- Javanparast S, Roeger L, Kwok Y, Reed RL. The experience of Australian general practice patients at high risk of poor health outcomes with telehealth during the COVID-19 pandemic: a qualitative study. BMC Fam Pract 2021 Apr 08;22(1):69 [FREE Full text] [CrossRef] [Medline]
- Assing Hvidt E, Christensen NP, Grønning A, Jepsen C, Lüchau EC. What are patients' first-time experiences with video consulting? A qualitative interview study in Danish general practice in times of COVID-19. BMJ Open 2022 Apr 15;12(4):e054415 [FREE Full text] [CrossRef] [Medline]
- Due TD, Thorsen T, Andersen JH. Use of alternative consultation forms in Danish general practice in the initial phase of the COVID-19 pandemic - a qualitative study. BMC Fam Pract 2021 Jun 02;22(1):108 [FREE Full text] [CrossRef] [Medline]
- Manski-Nankervis JA, Davidson S, Hiscock H, Hallinan C, Ride J, Lingam V, et al. Primary care consumers’ experiences and opinions of a telehealth consultation delivered via video during the COVID-19 pandemic. Aust J Prim Health 2022 Jun;28(3):224-231. [CrossRef] [Medline]
- The EndNote Team. EndNote. Clarivate. Philadelphia, PA, USA: Clarivate; 2013. URL: https://endnote.com/ [accessed 2021-03-25]
- Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev 2016 Dec 05;5(1):210 [FREE Full text] [CrossRef] [Medline]
- Peters MD, Godfrey C, McInerney P, Mun Z, Tricco AC, Khalil H. Appendix 11.1 JBI template source of evidence details, characteristics and results extraction instrument. In: Aromataris E, Munn Z, editors. Joanna Briggs Institute Reviewer's Manual. Adelaide, Australia: Joanna Briggs Institute; 2017.
- Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Educ Inf 2018 Dec 18;34(4):285-291. [CrossRef]
- Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol 2011 Apr;64(4):380-382. [CrossRef] [Medline]
- Jiang M, Xie YQ, Xie JX, Zou XW, Lai KF. Methodology for development of the Chinese evidence-based clinical practice guideline of the diagnosis and management of cough. J Thorac Dis 2018 Nov;10(11):6310-6313 [FREE Full text] [CrossRef] [Medline]
- Medicare benefits schedule book operating from January 1 2020. Department of Health, Australian Government. 2021 Jul 21. URL: http://www.mbsonline.gov.au/internet/mbsonline/publishing.nsf/Content/8F3FA58ED97DCA35CA2584BE00111151/$File/202001-MBS%2017Jan2020.pdf [accessed 2021-07-23]
- COVID-19 Telehealth MBS items. MBS Online. Phillip, Australia: Department of Health and Ageing, Australian Government; 2020 Aug 13. URL: http://www.mbsonline.gov.au/internet/mbsonline/publishing.nsf/Content/news-2020-03-29-latest-news-March [accessed 2021-07-23]
- Chronic Disease Management - Provider Information. The Department of Health and Aged Care. Phillip, Australia: Department of Health and Aged Care, Australian Government; 2016 Sep 2. URL: https://www1.health.gov.au/internet/main/publishing.nsf/Content/mbsprimarycare-factsheet-chronicdisease.htm [accessed 2021-07-23]
- DeVito NJ, Goldacre B. Catalogue of bias: publication bias. BMJ Evid Based Med 2019 Apr;24(2):53-54. [CrossRef] [Medline]
- Polisena J, Coyle D, Coyle K, McGill S. Home telehealth for chronic disease management: a systematic review and an analysis of economic evaluations. Int J Technol Assess Health Care 2009 Jul;25(3):339-349. [CrossRef] [Medline]
- Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open 2017 Aug 03;7(8):e016242 [FREE Full text] [CrossRef] [Medline]
- Hollander JE, Goldwater J. Telemedicine research and quality assessment. In: Atanda Jr A, Lovejoy III JF, editors. Telemedicine in Orthopedic Surgery and Sports Medicine: Development and Implementation in Practice. Cham, Switzerland: Springer; 2021:157-168.
- Villarreal V, Hervás R, Bravo J. A systematic review for mobile monitoring solutions in m-health. J Med Syst 2016 Sep;40(9):199. [CrossRef] [Medline]
- Shafiee Hanjani L, Caffery LJ, Freeman CR, Peeters G, Peel NM. A scoping review of the use and impact of telehealth medication reviews. Res Social Adm Pharm 2020 Aug;16(8):1140-1153. [CrossRef] [Medline]
- Carrillo de Albornoz S, Sia KL, Harris A. The effectiveness of teleconsultations in primary care: systematic review. Fam Pract 2022 Jan 19;39(1):168-182 [FREE Full text] [CrossRef] [Medline]
- Jonnagaddala J, Godinho MA, Liaw ST. From telehealth to virtual primary care in Australia? A Rapid scoping review. Int J Med Inform 2021 Jul;151:104470. [CrossRef] [Medline]
- Scott A, Bai T, Zhang Y. Association between telehealth use and general practitioner characteristics during COVID-19: findings from a nationally representative survey of Australian doctors. BMJ Open 2021 Mar 24;11(3):e046857 [FREE Full text] [CrossRef] [Medline]
- Fact Sheet: Telehealth. American Hospital Association. 2019 Feb 1. URL: https://www.aha.org/factsheet/telehealth [accessed 2022-02-01]
- Using Telehealth to Expand Access to Essential Health Services during the COVID-19 Pandemic. Centers for Disease Control and Prevention. 2020 Jun 10. URL: https://www.cdc.gov/coronavirus/2019-ncov/hcp/telehealth.html [accessed 2022-02-01]
- Hutchings R. The impact of Covid-19 on the use of digital technology in the NHS. Nuffield Trust. 2020 Aug 27. URL: https://www.nuffieldtrust.org.uk/research/the-impact-of-covid-19-on-the-use-of-digital-technology-in-the-nhs [accessed 2022-02-01]
- Fraser C, Fisher R. How has the COVID-19 pandemic impacted primary care? The Health Foundation. 2021 May 27. URL: https://www.health.org.uk/news-and-comment/charts-and-infographics/how-has-the-covid-19-pandemic-impacted-primary-care [accessed 2022-09-05]
- Greenhalgh T, Rosen R, Shaw SE, Byng R, Faulkner S, Finlay T, et al. Planning and evaluating remote consultation services: a new conceptual framework incorporating complexity and practical ethics. Front Digit Health 2021 Aug 13;3:726095 [FREE Full text] [CrossRef] [Medline]
- Clarke J, Flott K, Fernandez Crespo R, Ashrafian H, Fontana G, Benger J, et al. Assessing the safety of home oximetry for COVID-19: a multisite retrospective observational study. BMJ Open 2021 Sep 14;11(9):e049235 [FREE Full text] [CrossRef] [Medline]
- Hospital in the home (HITH) - Performance. NSW Health. 2021 Aug 17. URL: https://www.health.nsw.gov.au/Performance/Pages/hith.aspx [accessed 2022-01-18]
- Miner AS, Laranjo L, Kocaballi AB. Chatbots in the fight against the COVID-19 pandemic. NPJ Digit Med 2020 May 4;3:65 [FREE Full text] [CrossRef] [Medline]
- Clay-Williams R, Rapport F, Braithwaite J. The Australian health system response to COVID-19 from a resilient health care perspective: what have we learned? Public Health Res Pract 2020 Dec 09;30(4):3042025 [FREE Full text] [CrossRef] [Medline]
- Guise V, Anderson J, Wiig S. Patient safety risks associated with telecare: a systematic review and narrative synthesis of the literature. BMC Health Serv Res 2014 Nov 25;14:588 [FREE Full text] [CrossRef] [Medline]
- Stokke R, Melby L, Isaksen J, Obstfelder A, Andreassen H. A qualitative study of what care workers do to provide patient safety at home through telecare. BMC Health Serv Res 2021 Jun 05;21(1):553 [FREE Full text] [CrossRef] [Medline]
- Stevens WJ, van der Sande R, Beijer LJ, Gerritsen MG, Assendelft WJ. eHealth apps replacing or complementing health care contacts: scoping review on adverse effects. J Med Internet Res 2019 Mar 01;21(3):e10736 [FREE Full text] [CrossRef] [Medline]
- Akhtar M, Van Heukelom PG, Ahmed A, Tranter RD, White E, Shekem N, et al. Telemedicine physical examination utilizing a consumer device demonstrates poor concordance with in-person physical examination in emergency department patients with sore throat: a prospective blinded study. Telemed J E Health 2018 Oct;24(10):790-796 [FREE Full text] [CrossRef] [Medline]
Abbreviations
GP: general practitioner |
GRADE: Grading of Recommendations Assessment, Development, and Evaluation |
NQF: National Quality Forum |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
RACGP: Royal Australian College of General Practitioners |
Edited by C Lovis; submitted 22.06.22; peer-reviewed by E Donaghy, C Kruse, A Ritchie; comments to author 27.07.22; revised version received 16.08.22; accepted 02.10.22; published 28.11.22
Copyright©Kanesha Ward, Sanjyot Vagholkar, Fareeya Sakur, Neha Nafees Khatri, Annie Y S Lau. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 28.11.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.