This paper is in the following e-collection/theme issue:

Clinical Communication, Electronic Consultation and Telehealth (615)

Published on in Vol 7, No 3 (2019): Jul-Sep

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/13354, first published .
Improving the Referral Process, Timeliness, Effectiveness, and Equity of Access to Specialist Medical Services Through Electronic Consultation: Pilot Study

Improving the Referral Process, Timeliness, Effectiveness, and Equity of Access to Specialist Medical Services Through Electronic Consultation: Pilot Study

Improving the Referral Process, Timeliness, Effectiveness, and Equity of Access to Specialist Medical Services Through Electronic Consultation: Pilot Study

Authors of this article:

Véronique Nabelsi1 Author Orcid Image ;   Annabelle Lévesque-Chouinard2 Author Orcid Image ;   Clare Liddy3, 4 Author Orcid Image ;   Maxine Dumas Pilon5, 6 Author Orcid Image
Article Authors Cited by (18) Tweetations (3) Metrics

    Original Paper

    1Département des Sciences Administratives, Université du Québec en Outaouais, Gatineau, QC, Canada

    2Groupe de Médecine de Famille Universitaires de Gatineau du Centre Intégré de Santé et des Services Sociaux de l’Outaouais, Gatineau, QC, Canada

    3Department of Family Medicine, University of Ottawa, Ottawa, Ontario, ON, Canada

    4CT Lamont Primary Health Care Research Centre, Bruyère Research Institute, Ottawa, ON, Canada

    5Department of Family Medicine, McGill University, Montréal, QC, Canada

    6Collège Québécois des Médecins de Famille, Montréal, QC, Canada

    Corresponding Author:

    Véronique Nabelsi, BSc, MScA, PhD

    Département des Sciences Administratives

    Université du Québec en Outaouais

    101, rue St-Jean-Bosco

    Gatineau, QC, J8X 3X7

    Canada

    Phone: 1 18195953900 ext 1915

    Email: veronique.nabelsi@uqo.ca


    Background: Access to specialty care remains a major challenge in the Canadian health care system. Electronic consultation (eConsult) services allow primary care providers to seek specialist advice often without needing the patient to go for a face-to-face consultation. It improves overall access to specialists and the referral process using an electronic care consultation service in urban and rural primary care clinics. This study describes the preliminary results of a pilot study with an eConsult service across 3 regions in the province of Quebec, Canada.

    Objective: The main objective of this study was to provide a 1-year snapshot of the implementation of the eConsult Quebec Service in rural and urban primary care clinics to improve access to care and the specialty referral process for primary care providers (PCPs).

    Methods: We established an eConsult service that covers urban and rural communities in 3 regions of Quebec. We conducted a quantitative analysis of all eConsult cases submitted from July 4, 2017, to December 8, 2018.

    Results: For over a year, 1016 eConsults have been generated during the course of this study. A total of 97 PCPs submitted requests to 22 specialty groups and were answered by 40 different specialists. The most popular specialty was internal medicine (224/1016, 22%). Overall, 63% (640/1016) of completed cases did not require a face-to-face visit. PCPs rated the service as being of high or very high value for themselves in 98% (996/1016) of cases.

    Conclusions: The preliminary data highlight the success of the implementation of the eConsult Quebec Service across 6 primary care clinics. The eConsult platform proves to be effective, efficient, and well received by both patients and physicians. If used more widely, eConsult could help reducing wait times significantly. Recently, the Ministry of Health and Social Services of Quebec has identified developing a strategic plan to scale eConsults throughout other regions of the province as a top priority.

    JMIR Med Inform 2019;7(3):e13354

    doi:10.2196/13354

    Keywords

    primary health care; referrals; physicians; specialists; health information systems 


    Background

    Wait times for specialized medical care are a major issue in the Canadian health care system [1-4]. Patients wait several weeks or months for an initial appointment. The Commonwealth Fund’s 2016 enquiry, conducted in 11 industrialized countries on timeliness of care, has ranked Canada last in terms of wait times for specialized health care [5]. A large percentage of Canadian family physicians reported long waits for specialist consultation and procedures [6]. The average wait time to see a specialist after referral from a primary care provider (PCP) increased substantially from 3.7 weeks in 1993 to 9.4 weeks in 2016 [7]. At the provincial level, Quebec is faced with the same challenges as the other provinces. The impact of waiting for access to specialists is significant for patients, with longer delays increasing stress, anxiety, and pain, affecting daily activities and sometimes leading to deterioration in health [2]. Delayed access to specialist care can result in diagnostic delays, duplication of tests and services, dissatisfaction among patients and providers, and rising costs [2,8].

    Deficiencies in the Current Referral Process

    The referral process from primary care to specialty care has several weaknesses that can lead to a duplication of tests, multiple medications taken for the same health condition, and deterioration of patient health [9,10]. However, the issue of wait time extends beyond the amount of resources available; an investigation of the causes of wait times is necessary [11,12]. Problems at various stages of the specialist referral process are mentioned in the literature. An incomplete gathering of patient information [9,13-16] and inadequate screening [13,17,18] are 2 initial shortcomings that may be encountered. The knowledge and expertise of the PCPs as well as their work environment are important factors that may influence triage [19] and presence or absence of referral [9]. Referral to the wrong specialists may also occur [20].

    Second, the quality of the referral is often lacking [21]. A Canadian study that surveyed 3000 general practitioners and specialists showed that 51% of the referrals were inadequate in that the reason for referral was unclear [22]. Moreover, when the referral is lacking essential patient information [9], the specialist must then collect this information, increasing wait times and likely delaying clinical decisions. Gandhi et al [16] noted in a study comprising 48 general practitioners and 200 specialists that the primary source of delay was in the gathering of patient data. Clearly, inefficient communication is a source of ambiguity or confusion for specialists [9].

    Mehrotra et al [9] also noted ambiguity with regards to coordination of patient care. There may be miscommunications concerning who will take responsibility for patient care as well as disagreements upon the treatment plan. Patients may be left with contradicting information. Stille et al [15] observed that parents of 38% of pediatric patients were required to transmit information from 1 physician to another and that most parents were uncomfortable fulfilling this role. It seems up to 50% of new appointments with some categories of specialists are individual patients referring themselves. Patient dissatisfaction with the traditional referral model may be 1 explanation for this phenomenon [23]. The literature review highlights multiple issues with our current referral process [15,16,24,25]. As the Haggerty et al [26] continuity of care model shows, issues in the referral process may arise on an informational, administrative, or relational level. We believe that there is a need to improve the quality of the communication and collaboration between PCPs and specialists to optimize patient care and safety.

    Process-Based Solution

    On the basis of a systematic review, 1 of the interventions highlighted by Blank et al [17] is aimed directly at the referral process. These include interventions such as insuring communication between the general practitioner and the specialist before referring and electronic systems for referral as well as support for decision making.

    Liddy et al have been tackling these issues by developing, implementing, and evaluating an innovative electronic health solution called the Champlain BASE (Building Access to Specialists through eConsultation) service [2,3,27,28]. This eConsult service has been extensively tested in eastern Ontario region, Canada, and currently operates as a fully funded program. eConsult BASE innovation has been reported to improve coordination in health systems by allowing direct communication between PCPs and specialists, improving access to shared records, and improving continuity of care by providing direct access to multiple specialty types [1,2,27,28]. eConsult BASE services reduce wait times for specialists, avoid unnecessary referrals, and therefore, have a large impact on costs [24,29]. Finally, PCPs, specialists, and patients were highly satisfied [29].

    Liddy et al [27] found that the family physicians using the service feel more confident when treating their patients. They also appreciate the educational aspect of this platform, which allows them to better manage certain medical conditions in the clinic. Keely et al [2] report that the specialists using this platform say it allows them to be more innovative in patient care and improves their communication with family physicians. In addition, Keely et al [29] demonstrated that 50% of the electronic consultations (eConsults) conducted in endocrinology, hematology, and dermatology were answered without the patient and the specialist needing to meet in person, as it normally would have taken place. However, it is reported that patients have mixed views concerning this electronic platform. A total of 46% of patients believe that it presents a viable alternative to face-to-face meetings with the specialist, as it reduces time and effort to set up a meeting with a specialist and allows them to get answers more rapidly [30]. Johansson et al [31] reported that video consultation would facilitate access to health specialists for those living in rural areas and for the elderly. This being said, 46% of the patients interviewed said they were uncertain if they preferred a video consultation over an in-person encounter.

    The College of Family Physicians Canada shared these results with their provincial section. Among them, the Quebec College of Family Physicians (QCFP) chose to tackle the project of implementing an eConsult-like service within the province. A team was gathered in 2016 bringing together the QCFP, RUIS McGill Telehealth, Centre intégré de santé et de services sociaux de l’Outaouais, Centre intégré universitaire de santé et de services sociaux de la Mauricie-et-Centre-du-Québec, and Centre intégré de santé et de services sociaux de l’Abitibi-Témiscamingue with the mentorship of the Champlain BASE eConsult team. The team adopted a governance that ensured the coordination of the activities under the entity of eConsult Quebec. In 2017, the team joined the pan Canadian Connected medicine initiative from the Canadian Foundation for Healthcare Improvement, which was a learning collaborative intended of supporting the spread and scale of eConsult BASE.

    The objective of this study was to describe the initial experience with the implementation of eConsult Quebec Service in rural and urban primary care clinics.


    Study Setting

    This study took place in 6 clinics (4 urban and 2 rural) located across 3 different regions of the province of Quebec: Outaouais, Abitibi-Témiscamingue, and Mauricie. Quebec is the largest of Canada’s 10 provinces in area and is second only to Ontario in population. Figure 1 shows the extent of the 3 regions. The current population of Outaouais is 382,604 and has a land area of 30,504 km2. As Outaouais, Abitibi-Témiscamingue is located in western Quebec, Canada, with a population of 145,690 and a land area of 57,726 km2. Mauricie has the largest population with 512,300 and has a land area of 45,000 km2.

    All 3 regions volunteered to be early adopters of the service and identified significant access issues and delays for specialists’ appointments in their regions.

    The first phase, in the Outaouais region, involved 2 primary care clinics (1 rural and 1 urban), which included 25 specialists representing 20 specialties and 29 PCPs. This first phase began in July 2017. The second phase, which began in February 2018, corresponded to the deployment of eConsult service in the Abitibi-Témiscamingue region. This phase included 3 primary care clinics (2 urban and 1 rural), with 10 specialists representing 7 specialties and 41 PCPs. The third phase, which began in April 2018, was held in the Mauricie region. A total of 1 urban primary care clinic was involved, with 5 specialists representing 5 specialties and 27 PCPs. To meet the needs of PCPs, some specialists have agreed to respond to the requests from all of the regions.

    Study participants have been recruited from urban and rural primary care practices across the 3 regions of Quebec. From the very beginning of this initiative, a few PCPs and specialists proposed themselves to be a champion to enrolled participants but also PCPs were self-identified after learning about the service through presentations or word of mouth. Specialty services were added based on feedback from the primary care participants and interest expressed from specialists.

    ‎
    Figure 1. Map of Quebec.
    View this figure
    Development of the Electronic Consultation Service

    An eConsult service was established in 2010 by author CL and Dr E Keely in partnership with the Champlain Local Health Integration Network, The Bruyère Research Institute, and Winchester District Memorial Hospital. CL and her Champlain BASE project team were attempting to respond to the challenges of referrals between PCPs and specialists by developing, implementing, and evaluating a secure online platform for eConsult. Given the success of the eConsult concept in Ontario and other regions of Canada, the leadership as described above, developed and implemented an eConsult service tested in 3 regions of the province of Quebec. There are variations in the design of the eConsult service because Quebec is different from the other jurisdictions in Canada on a number of fronts, including policy and regulations (eg, licensing, privacy, and liability), financing (eg, provider remuneration) and, of course, language, where French is the majority language as opposed to English elsewhere.

    The Champlain BASE business model was replicated onto an enterprise telehealth platform already in operation on the Quebec Healthcare Network. Privacy impact and threat risk assessments were also performed in compliance with the Personal Health Information Protection Act of the Ministry of Health and Social Services of Quebec.

    Design of the Service Workflow

    Like the Champlain BASE eConsult service, eConsult Quebec is a service providing a platform for communication between PCPs and specialists. It is a secure Web-based application that allows PCPs to submit questions to specialists, to gain insight on the best management plan for patients.

    The eConsult begins with a PCP’s clinical question. The PCP submits their question via a standardized secure Web form, along with any relevant demographic information and supplementary files (eg, photos, lab results, electronic medical record–generated letter, and pictures of cutaneous lesions). The form is kept extremely simple and focused to ensure favorable user adoption. A centralized coordinator receives all PCP requests and dispatches them to participating physicians of the appropriate specialty. The specialist receives an email prompt, is given 7 days to respond to the request, and is remunerated at a rate of Can $200 per hour prorated to their self-reported time required to complete the eConsult. For every consult, the specialist offers clinical recommendations, may ask for further clarification from the PCP, or may suggest an in-person consultation. PCPs and specialists may correspond back and forth until the PCP closes the request.

    The user’s dashboard (Figure 2) contains all requests across all communication types (eConsults, patient forms and messages, teleconsultations, and transfer requests). The view filters and possible actions are dynamically adapted according to user roles and permissions. Patient data are encrypted and accessible only to the physicians involved in the eConsult or their delegated staff through role-based access control. The platform is installed on-premise in a secure data center within Quebec’s official dedicated health network, complies with all applicable governmental regulations, and is audited weekly for security (vulnerability assessments etc).

    ‎
    Figure 2. Dashboard of the eConsult (electronic consultation) Quebec Service.
    View this figure

    User may choose card view (as shown in Figure 2) or table view. Main common status filters are as follows:

    • Active: contains all pending actions for the current user groups. Draft eConsults and those requiring a response or further tasks to complete are shown here.
    • Waiting: requests awaiting actions from others, such as a specialist’s response.
    • Completed: after all actions are completed, item is shown here for reference.
    • Archived: optionally, users may choose to archive completed items, in which case they will be shown here. Organizations may choose to implement automatic archival parameters (not the case for this project at present). An archived case remains fully accessible.

    In addition, we have defined the role of each user group that control access to the platform for easy management of security (Table 1).

    In preparation for eConsult Quebec service implementation, test and demonstration environments separate from the production environment were used by PCPs and specialists to evaluate the platform, suggest improvements, experiment, train, and support change management efforts. A training group session was offered for all participants but was not mandatory, and training videos were available too.

    We identified the specialties needed by region with “Wait Times 1” to identify the specialties that were the most referred to and with the longest wait times. Wait Times 1 is defined as period between the initiation of a referral by a PCP and the moment the patient sees that specialist. With the information provided by “Wait Times 1,” the local champions were asked to recruit the identified specialties per region. Ongoing communications with the PCP allowed us to identify new specialties that would add value to the services.

    Assessment

    Following completion of the eConsult, the PCP receives a mandatory close-out survey to rate the outcome and the value of the interaction with a 5-question close-out survey (Textbox 1). Question 1 asks about the perceived usefulness of the advice the PCP received from the eConsult. Question 2 asks about the result of the eConsult in regard to referral. Questions 3 and 4 are answered on a 5-point Likert scale and ask PCPs about the value of the service for their patients (Q3) and themselves (Q4). The last is an open-ended question (optional) for any additional comments about the eConsult service (Q5).

    Data Sources

    We conducted a quantitative analysis of 1016 eConsult cases completed from July 4, 2017 to December 8, 2018. We used a combination of on-going real-time system utilization data collected through the eConsult Quebec service. Briefly, for each eConsult case submitted at all primary care clinics, the system automatically collects data regarding the PCP, the consulting specialist, the clinical questions posed, and the answers provided. The system also collects data on the user’s log-in time, time spent on the consultation, time for reply, closure of the case, and responses to a mandatory satisfaction survey completed after each eConsult case is closed.

    This study was approved by the institutional review ethics board of the Integrated Health and Social Services of the Centre of Outaouais.

    Ethics Approval

    Ethical approval was obtained from the research ethics board of Centre intégré de santé et des services sociaux de l'Outaouais (ref. number 2016-183_88) in Quebec, Canada. This study did not include direction patient contact, and thus, formal consent was not obtained.

    Table 1. User groups permissions and authentication.
    User GroupsDescription
    Requesting clinicianCan create new electronic consultations (eConsults), follow-up on existing ones, complete the close-out research survey, and archive own completed eConsults (typically primary care practitioners: general practitioner, family physician, nurse).
    Requesting clinician delegateAble to accomplish all tasks of the requesting clinician but as a delegate. The system contains a full audit trail with history of changes, and all delegated actions are shown as (Delegate Name) on behalf of (Clinician Name; typically primary care practitioners: general practitioner, family physician, nurse).
    Responding clinicianResponds to eConsults, can request further information or documents, specify whether a referral is required, and archive own completed eConsults (typically specialists).
    Responding clinician delegateAble to accomplish all tasks of the responding clinician but as a delegate. The system contains a full audit trail with history of changes, and all delegated actions are shown as “(Delegate Name) on behalf of (Clinician Name)” (typically specialists).
    DispatchAssigns incoming eConsults to specialists depending on availability, conditions, etc. Reviews the status dashboard to ensure process goes smoothly and eConsults are answered in a timely manner (typically planning, programming, and research officer).
    Super dispatchSame permissions as dispatch but views all cases regardless of group, institution, or network (typically planning, programming, and research officer).
    ManagerAccess to business intelligence dashboards, reports, and statistics.
    AdministratorManages users, groups, and other system parameters.
    Mandatory close-out survey completed by primary care providers at the end of each electronic consultation.

    Q1. Which of the following best describes the outcome of this electronic consultation (eConsult) for your patient:

    1. I was able to confirm a course of action that I originally had in mind
    2. I got good advice for a new or additional course of action
    3. I did not find the response very useful
    4. None of the above (please comment)

    Q2. As a result of this eConsult, would you say that

    1. Referral was originally contemplated but now avoided at this stage
    2. Referral was originally contemplated and is still needed—this eConsult likely leads to a more effective visit
    3. Referral was not originally contemplated and is still not needed—this eConsult provided useful feedback/information
    4. Referral was not originally contemplated, but eConsult process resulted in a referral being initiated
    5. There was no particular benefit to using eConsult for your patient in this case
    6. Other (please comment)

    Q3. Please rate the overall value of the eConsult service in this case for your patient:

    Minimal 1 – 2 – 3 – 4 – 5 Excellent

    Q4. Please rate the overall value of the eConsult service in this care for as primary care provider:

    Minimal 1 – 2 – 3 – 4 – 5 Excellent

    Q5. We would value any additional feedback you provide:

    [Optional free text field]

    Textbox 1. Mandatory close-out survey completed by primary care providers at the end of each electronic consultation.

    Assessment of the Electronic Consultation Quebec Service

    The eConsult service has shown a great interest during its implementation for the province of Quebec. A total of 97 PCPs (94%) of the 103 registered in 3 regions completed 1016 referrals during the 19 months. Figure 3 illustrates the eConsult case volume for all regions per financial period based on the calendar of the Ministry of Health and Social Services of Quebec. The first eConsult in the Outaouais region was July 1, 2017, and the first cases in Abitibi-Témiscamingue and Mauricie were January 16, 2018, and March 28, 2018, respectively. The monthly volume of cases started slowly in the last 2 quarters of 2017 but grew more rapidly after the first quarter of 2018 (see Figure 3).

    The breadth of specialties accessed by patients is shown in Table 2. A total of 97 PCPs (94%) of the 103 registered submitted at least 1 eConsult. A total of 97 PCPs submitted requests to 22 specialty groups and answered by 40 different specialists. The most commonly referred to specialties were internal medicine (224/1016, 22%), dermatology (203/1016, 20%), gynecology/obstetrics (117/1016, 12%), endocrinology (75/1016, 7%), and orthopedics (57/1016, 6%), followed closely by psychiatry (50/1016, 5%) and gastroenterology (47/1016, 5%).

    Specialists provided a response in an average of 4 days. In 87% of cases (884/1016), they took less than the 7-day response period. The self-reported time specialist spent completing the referral was 12.43 min.

    The self-reported time it took for a specialist to complete the eConsult (specialties that had 13 or more completed cases; N=986) was less than 10 min in 29% of cases, 10 to 15 min in 54% of cases, 15 to 20 in 7% of cases, and over 20 min in 10% of cases (Table 3).

    In 77.1% of cases (783/1016), PCPs who submitted a request required a single correspondence with the specialist and 19.4% (197/1016) required 2 correspondences to clarify or collect further information on the clinical case. The maximum number of correspondences was 6 for just 1 case (Table 4).

    The most common question types were based on treatment, general management, investigation indications, diagnostic, test interpretation, prognostic, resource availability, and continuing education.

    Adaptations to the Akinox Platform support the eConsult Quebec Service cost Can $25,000. The delivery costs of eConsult in 3 regions of Quebec were Can $31,395, which includes user setup and registration, user support, flow, operational support and hosting services, and administrative costs. The cost of remunerating specialists was Can $23,000. The total cost of the eConsult Quebec Service during the period study was Can $79,395.

    Table 5 reports the average specialist remuneration cost per specialty (for specialty groups that had 13 or more completed cases; N=986). For 13 or more completed cases, the less expensive were cardiology (24 cases) for Can $27.75/eConsult and infectious diseases (13 cases) for Can $28.18/eConsult, and the higher were gastroenterology (47 cases) for Can $67.31 and psychiatry (50 cases) for Can $66.93/eConsult.

    ‎
    Figure 3. Electronic consultation (eConsult) case volume—the number of cases completed per financial period and cumulative total.
    View this figure
    Table 2. Specialty distribution.
    Specialty groupsElectronic consultation case volumePercentage
    Anesthesiology10
    Dental medicine20
    Pain medicine20
    Ophthalmology40
    Fertility61
    Allergology81
    Pulmonary diseases71
    Infectious diseases131
    Neurosurgery172
    Cardiology242
    Ear, nose, and throat252
    Rheumatology263
    General surgery303
    Neurology414
    General pediatrics374
    Psychiatry505
    Gastroenterology475
    Orthopedics576
    Endocrinology757
    Gynecology/obstetrics11712
    Dermatology20320
    Internal medicine22422
    Table 3. Self-reported time it took nonfamily physician specialists to complete electronic consultations (13 or more completed cases).
    Time to complete electronic consultationReferrals, n (%)
    <10 min286 (29)
    10-15 min536 (54)
    15-20 min67 (7)
    >20 min97 (10)
    Table 4. Number of correspondence and correspondences between the primary care provider and the specialist per case (N=1016).
    Number of correspondence and correspondencesCases, n (%)
    1783 (77.1)
    2197 (19.4)
    328 (2.8)
    47 (0.7)
    50 (0.0)
    61 (0.1)
    Table 5. Average specialist remuneration cost per electronic consultation (eConsult) and average specialist self-reported time to complete an eConsult (for specialty services that had 13 or more eConsults completed).
    Specialty groupsAverage specialist remuneration cost per eConsult (Can $)Average time to complete (min)Cases completed (n)
    Gastroenterology67.3120.2147
    Psychiatry66.9320.1050
    Rheumatology60.8418.2726
    Neurology50.3615.1241
    Dermatology43.1412.96203
    Ear, nose, and throat41.2912.4025
    General surgery40.5212.1730
    General pediatrics40.5012.1637
    Internal medicine38.8711.67224
    Neurosurgery35.2610.5917
    Gynecology/obstetrics31.739.53117
    Orthopedics30.389.1257
    Endocrinology29.308.8075
    Infectious diseases28.188.4613
    Cardiology27.758.3324

    During this study, 57% (563/986) of consults offered good advice for a new or additional course of action (see Figure 4). Merely less than 2% of cases were not found to be useful. A total of 97 PCPs (94%) of the 103 registered perceived 98% of eConsult cases to be of very good or excellent value for themselves. As illustrated in Figure 5, in 40% (394/986) of the cases submitted, a referral was originally contemplated but was now avoided. In 23% (227/986) of cases, a referral was originally contemplated and still needed—this eConsult likely leads a more effective visit. In 29% (286/986) of cases, a referral was not originally contemplated and was still not necessary, but the consultation allowed transmission of useful feedback or instruction. Overall, 63% (621/986) of completed cases did not require a face-to-face visit. These numbers varied across specialty services. In particular, endocrinology had the highest rate avoided referral with 52% (39/75), followed by psychiatry with 50% (25/50).

    ‎
    Figure 4. Impact of electronic consultation (eConsult) on the course of action by the primary care provider by specialty services that had 13 or more eConsults completed.
    View this figure
    ‎
    Figure 5. Impact of electronic consultation on need for face-to-face referral by specialty service.
    View this figure

    Principal Findings

    The results of our pilot study demonstrate that it is possible to spread an innovative model of care to improve access such as eConsult in another health system, and achieve similar uptake and outcomes as the original pilot program. The eConsult Quebec Service is the first eConsult service in the province of Quebec modeled after the Champlain BASE program. More than 1000 people received an eConsult during the study period and received advice within the expected parameters of the service except in rare cases. The service was established and offered multispecialty access across high-demand specialty areas. The costs were comparable with the implementation cost described in other jurisdictions [26,29]. The overall satisfaction of the PCPs was rated high, confirming the added value of this model in Quebec [29,32].

    The eConsult BASE innovation has been reported as improving coordination within the health system by facilitating direct communication between PCPs and specialists, better access to shared records, and better continuity of care thanks to direct access to multiple providers across specialty areas [1,2]. eConsult BASE services reduce wait times for specialists, avoid unnecessary referrals, and have a large impact on cost savings through efficient care [27].

    More recent data available of the experimentation of eConsult BASE in Ontario [33], among 33,327 eConsults, demonstrated that 67% of cases did not require a face-to-face consultation. Our study showed similar results with 63% of cases not requiring face-to-face consultation.

    In Ontario, in 4% of cases, eConsult prompted a medical consultation, whereas this proportion reached 8% in Québec. The median response time was 0.9 days unlike 4 days in Québec [33]. One could think that this is most likely secondary to a volume effect. In fact, outliers specialists physicians with response time above the requested 7 days will affect more powerfully the average mean response time on a lower number of eConsults than on larger volume.

    A surprising finding is the average time spent on an eConsult. Liddy et al [34] describe the 2 extremes of eConsults completed in less than 10 min and more than 20 min to be respectively 48.8% and 3.9%, whereas the Quebec experience finds these percentages to be 29% and 10%, suggesting that Quebec specialist are self-reporting longer times to answer eConsults. One could wonder about an experience effect; could specialists in Ontario have gained speed simply by using the service frequently and for a longer period of time? An alternative explanation could be cultural differences in corresponding: could Quebec specialist physicians write lengthier sentences, polite forms, and other variations explaining this discrepancy? An in-depth text analysis comparing both type of answers could clarify this question.

    The specialty distribution of Quebec demonstrates a higher proportion of eConsult in internal medicine (22%) followed closely by dermatology (20%). This compares interestingly with BASE Champlain specialty distribution, with dermatology being the main specialty but not internal medicine, representing solely 3% of the total eConsults [35,36]. The high popularity of internal medicine is most likely explained by the limited availability of other specialties such as cardiology, hematology, and neurology in the all of the 3 regions. We expect these specialties to gain in interest as they become more available.

    One new finding that this study brings is the number of iterations, showing that the majority of eConsults are resolved within 1 iteration; however, up to 20% of eConsult will require 2 iterations, explaining maybe the longer average response time observed.

    Another interesting finding is the apparent correlation between the length of time spent on eConsult, the face-to-face consultations avoided, and the new or additional course of action section. Indeed, from the closing survey answer analysis, the top 5 specialties for the self-reported time to complete eConsult, (ie, gastroenterology, psychiatry, rheumatology, neurology, and dermatology) appear to be the same as the top 5 specialties for the highest proportion to “referral now avoided” as well as above the average for having a higher proportion of the category “New or additional course of action.” This may reflect knowledge gaps of PCPs in these specialties, creating an inverse correlation between the reflex of referring when knowledge is limited. To the contrary, cardiology has the shortest competition time, the highest “confirmed course of action,” and 1 of the top 3 lower percentage of “referral now avoided.” We expect that confirming an action takes less time than explaining “New a course of action.” Individual characteristics of physicians’ type may also explain these differences [37].

    The above findings could help to inform continuous medical education as described by Archibald et al [38] and Davis et al [39]. This finding may also help guiding deployment strategies and remuneration discussions. This being said, the study was not designed to identify such an effect, and further research and perspective would be required to explore this topic thoroughly.

    These findings confirmed that a Champlain BASE eConsult model could be replicated in Quebec with the same promising outcomes. Since completion of the pilot, the program continues to be offered and has received interim program–level support funding from the ministry of health. Plans are now underway to create a strategy to scale up the Quebec eConsult program across the whole population of 8. 39 million people.

    Key implementation components included a focus on the local context of wait times, harnessing local clinical champions from primary and specialty care, engagement and commitment of local health service organization at both the individual clinic and regional level, and building on existing digital health assets to support the actual technology platform.

    Limitations

    Although a strength of the study was the participation across 3 regions, this was on a voluntary basis, and thus, our very positive results may be affected by the selection bias of having particularly interested and motivated health care workers involved in the study. Our data were drawn from routinely collected utilization data. We did not directly interview patients nor collect patient level data to assess quality of actual eConsult response nor patient perspectives Future studies could be undertaken to explore barriers to the implementation of eConsult nationwide. We have collaborated with team members, a project manager, physicians’ champions, PCPs, specialists, and patient advisors to validate the organizational model, the processes, and the platform. These were tested in each primary care clinic, verifying that eConsult was adequately supported by local practices. This practical method of testing also allowed for participants to take ownership of the eConsult system, which secures future user uptake as participants have personally experienced the benefits of eConsult.

    Conclusions

    Implementation of eConsult, a secure Web-based specialist consultation system, in Quebec was successful and resulted in overall similar outcomes that those observed in the Champlain BASE eConsult service. Some new insights about the correlations between eConsults self-reported time to completion and referral avoided warrant future research.

    The eConsult Quebec Service is intended to replace, partially, traditional referrals from PCPs to specialists, thereby limiting wait times, patient inconvenience, and potential for miscommunication. Results from our eConsult project support its implementation in Quebec. The Ministry of Health and Social Services of Quebec made the scale-up of eConsult in primary health care 1 of their top priorities and are looking to put this innovation on the provincial policy agenda.

    Acknowledgments

    Key stakeholders from the 3 regions of the province of Quebec under study have accepted to collaborate actively in this study. The authors would like to thank them for their collaboration in this project. This pilot project was supported by Canadian Foundation for Healthcare Improvement (7-UQO_FR) and the Canadian Institute for Health Research.

    Authors' Contributions

    VN and CL designed this study and were responsible for data collection. VN wrote the first draft of the manuscript. All authors (VN, CL, MDP, and ALC) contributed to the data analysis, manuscript revisions, and approved the final manuscript.

    Conflicts of Interest

    None declared.

    1. Liddy C, Joschko J, Keely E. Policy innovation is needed to match health care delivery reform: the story of the champlain BASE eConsult service. Health Reform Observ 2015;3(2):1-11. [CrossRef]
    2. Liddy C, Afkham A, Drosinis P, Joschko J, Keely E. Impact of and satisfaction with a new eConsult service: a mixed methods study of primary care providers. J Am Board Fam Med 2015;28(3):394-403 [FREE Full text] [CrossRef] [Medline]
    3. Liddy C, Rowan MS, Afkham A, Maranger J, Keely E. Building access to specialist care through e-consultation. Open Med 2013;7(1):e1-e8 [FREE Full text] [Medline]
    4. Schoen C, Osborn R, Squires D, Doty MM. Access, affordability, and insurance complexity are often worse in the United States compared to ten other countries. Health Aff (Millwood) 2013;32(12):2205-2215. [CrossRef] [Medline]
    5. Wait Times for Priority Procedures in Canada. Ottawa, ON: Canadian Institute for Health Information; 2017.
    6. Schoen C, Osborn R, Doty MM, Squires D, Peugh J, Applebaum S. A survey of primary care physicians in eleven countries, 2009: perspectives on care, costs, and experiences. Health Aff (Millwood) 2009;28(6):w1171-w1183. [CrossRef] [Medline]
    7. Barua B, Ren F. Fraser Institute. 2016. Waiting Your Turn: Wait Times for Health Care in Canada, 2016 Report   URL: https:/​/www.​fraserinstitute.org/​sites/​default/​files/​waiting-your-turn-wait-times-for-health-care-in-canada-2016.​pdf [WebCite Cache]
    8. Barua B. Fraser Institute. 2017. Waiting Your Turn: Wait Times for Health Care in Canada, 2017 Report   URL: https://www.fraserinstitute.org/sites/default/files/waiting-your-turn-2017.pdf [WebCite Cache]
    9. Mehrotra A, Forrest CB, Lin CY. Dropping the baton: specialty referrals in the United States. Milbank Q 2011 Mar;89(1):39-68 [FREE Full text] [CrossRef] [Medline]
    10. Globerman S. Reducing Wait Times For Health Care: What Canada Can Learn From Theory And International Experience. Vancouver, British Columbia: Fraser Institute; 2013.
    11. Eriksson H, Bergbrant I, Berrum I, Mörck B. Reducing queues: demand and capacity variations. Int J Health Care Qual Assur 2011;24(8):592-600. [CrossRef] [Medline]
    12. Harrison AJ, Appleby J. Optimising waiting: a view from the English national health service. Health Econ Policy Law 2010;5(4):397-409. [CrossRef] [Medline]
    13. Bungard TJ, Smigorowsky MJ, Lalonde LD, Hogan T, Doliszny KM, Gebreyesus G, et al. Cardiac EASE (ensuring access and speedy evaluation)-the impact of a single-point-of-entry multidisciplinary outpatient cardiology consultation program on wait times in Canada. Can J Cardiol 2009;25(12):697-702 [FREE Full text] [CrossRef] [Medline]
    14. O'Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med 2011 Jan 10;171(1):56-65. [CrossRef] [Medline]
    15. Stille CJ, McLaughlin TJ, Primack WA, Mazor KM, Wasserman RC. Determinants and impact of generalist-specialist communication about pediatric outpatient referrals. Pediatrics 2006;118(4):1341-1349. [CrossRef] [Medline]
    16. Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW. Communication breakdown in the outpatient referral process. J Gen Intern Med 2000 Sep;15(9):626-631 [FREE Full text] [CrossRef] [Medline]
    17. Blank L, Baxter S, Woods HB, Goyder E, Lee A, Payne N, et al. Referral interventions from primary to specialist care: a systematic review of international evidence. Br J Gen Pract 2014;64(629):e765-e774 [FREE Full text] [CrossRef] [Medline]
    18. Widdifield J, Bernatsky S, Thorne JC, Bombardier C, Jaakkimainen RL, Wing L, et al. Wait times to rheumatology care for patients with rheumatic diseases: a data linkage study of primary care electronic medical records and administrative data. CMAJ Open 2016;4(2):E205-E212 [FREE Full text] [CrossRef] [Medline]
    19. Diamant A, Cleghorn MC, Milner J, Sockalingam S, Okrainec A, Jackson TD, et al. Patient and operational factors affecting wait times in a bariatric surgery program in Toronto: a retrospective cohort study. CMAJ Open 2015;3(3):E331-E337 [FREE Full text] [CrossRef] [Medline]
    20. Bal R, Mastboom F, Spiers HP, Rutten H. The product and process of referral: optimizing general practitioner-medical specialist interaction through information technology. Int J Med Inform 2007 Jun;76(Suppl 1):S28-S34. [CrossRef] [Medline]
    21. Wåhlberg H, Valle PC, Malm S, Broderstad AR. Impact of referral templates on the quality of referrals from primary to secondary care: a cluster randomised trial. BMC Health Serv Res 2015 Aug 29;15:353 [FREE Full text] [CrossRef] [Medline]
    22. Neimanis I, Gaebel K, Dickson R, Levy R, Goebel C, Zizzo A, et al. Referral processes and wait times in primary care. Can Fam Physician 2017 Aug;63(8):619-624 [FREE Full text] [Medline]
    23. Forrest CB, Reid RJ. Passing the baton: HMOs' influence on referrals to specialty care. Health Aff (Millwood) 1997;16(6):157-162. [CrossRef] [Medline]
    24. Ireson CL, Slavova S, Steltenkamp CL, Scutchfield FD. Bridging the care continuum: patient information needs for specialist referrals. BMC Health Serv Res 2009 Sep 15;9:163 [FREE Full text] [CrossRef] [Medline]
    25. Ramelson H, Nederlof A, Karmiy S, Neri P, Kiernan D, Krishnamurthy R, et al. Closing the loop with an enhanced referral management system. J Am Med Inform Assoc 2018 Jun 1;25(6):715-721. [CrossRef] [Medline]
    26. Haggerty JL, Reid RJ, Freeman GK, Starfield BH, Adair CE, McKendry R. Continuity of care: a multidisciplinary review. Br Med J 2003 Nov 22;327(7425):1219-1221 [FREE Full text] [CrossRef] [Medline]
    27. Liddy C, Drosinis P, Deri AC, McKellips F, Afkham A, Keely E. What are the cost savings associated with providing access to specialist care through the Champlain BASE eConsult service? A costing evaluation. BMJ Open 2016 Dec 23;6(6):e010920 [FREE Full text] [CrossRef] [Medline]
    28. Liddy C, Maranger J, Afkham A, Keely E. Ten steps to establishing an e-consultation service to improve access to specialist care. Telemed J E Health 2013;19(12):982-990 [FREE Full text] [CrossRef] [Medline]
    29. Keely E, Liddy C, Afkham A. Utilization, benefits, and impact of an e-consultation service across diverse specialties and primary care providers. Telemed J E Health 2013 Oct;19(10):733-738 [FREE Full text] [CrossRef] [Medline]
    30. Keely E, Drosinis P, Afkham A, Liddy C. Perspectives of Champlain BASE specialist physicians: their motivation, experiences and recommendations for providing eConsultations to primary care providers. Stud Health Technol Inform 2015;209:38-45. [CrossRef] [Medline]
    31. Johansson AM, Lindberg I, Söderberg S. The views of health-care personnel about video consultation prior to implementation in primary health care in rural areas. Prim Health Care Res Dev 2014 Apr;15(2):170-179 [FREE Full text] [CrossRef] [Medline]
    32. Malagrino GD, Chaudhry R, Gardner M, Kahn M, Speer L, Spurrier BR, et al. A study of 6,000 electronic specialty consultations for person-centered care at the mayo clinic. Int J Pers Cent Med 2012;2(3):458-466. [CrossRef]
    33. Keely E. OntarioMD. 2018. The Successful Integration of eConsult Service into a Family Health Teams Workflow   URL: https://tinyurl.com/y2c267za [accessed 2019-05-22] [WebCite Cache]
    34. Liddy C, Deri AC, McKellips F, Drosinis P, Afkham A, Keely E. Choosing a model for eConsult specialist remuneration: factors to consider. Informatics 2016 Jun 18;3(2):8. [CrossRef]
    35. Liddy C, Deri AC, McKellips F, Keely E. A comparison of referral patterns to a multispecialty eConsultation service between nurse practitioners and family physicians: the case for eConsult. J Am Assoc Nurse Pract 2016 Mar;28(3):144-150. [CrossRef] [Medline]
    36. Liddy C, Moroz I, Mihan A, Nawar N, Keely E. A systematic review of asynchronous, provider-to-provider, electronic consultation services to improve access to specialty care available worldwide. Telemed J E Health 2019;25(3):184-198. [CrossRef] [Medline]
    37. Scherpbier-de Haan ND, van Gelder VA, van Weel C, Vervoort GM, Wetzels JF, de Grauw WJ. Initial implementation of a web-based consultation process for patients with chronic kidney disease. Ann Fam Med 2013;11(2):151-156 [FREE Full text] [CrossRef] [Medline]
    38. Archibald D, Liddy C, Lochnan HA, Hendry PJ, Keely EJ. Using clinical questions asked by primary care providers through eConsults to inform continuing professional development. J Contin Educ Health Prof 2018;38(1):41-48. [CrossRef] [Medline]
    39. Davis A, Gilchrist V, Grumbach K, James P, Kallenberg R, Shipman SA. Advancing the primary/specialty care interface through econsults and enhanced referrals. Ann Fam Med 2015;13(4):387-388 [FREE Full text] [CrossRef] [Medline]

    ‎
    BASE: Building Access to Specialists through eConsultation
    eConsult: electronic consultation
    PCP: primary care provider
    QCFP: Quebec College of Family Physicians

    Edited by C Lovis; submitted 09.01.19; peer-reviewed by C Perrin, J Pecina, MS Aslam, S Housbane; comments to author 26.02.19; revised version received 22.05.19; accepted 05.06.19; published 10.07.19

    Copyright

    ©Véronique Nabelsi, Annabelle Lévesque-Chouinard, Clare Liddy, Maxine Dumas Pilon. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 10.07.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.