Published on 19.05.16 in Vol 4, No 2 (2016): Apr-Jun
Putting Meaning into Meaningful Use: A Roadmap to Successful Integration of Evidence at the Point of Care
Pressures to contain health care costs, personalize patient care, use big data, and to enhance health care quality have highlighted the need for integration of evidence at the point of care. The application of evidence-based medicine (EBM) has great promise in the era of electronic health records (EHRs) and health technology. The most successful integration of evidence into EHRs has been complex decision tools that trigger at a critical point of the clinical visit and include patient specific recommendations. The objective of this viewpoint paper is to investigate why the incorporation of complex CDS tools into the EMR is equally complex and continues to challenge health service researchers and implementation scientists. Poor adoption and sustainability of EBM guidelines and CDS tools at the point of care have persisted and continue to document low rates of usage. The barriers cited by physicians include efficiency, perception of usefulness, information content, user interface, and over-triggering. Building on the traditional EHR implementation frameworks, we review keys strategies for successful CDSs: (1) the quality of the evidence, (2) the potential to reduce unnecessary care, (3) ease of integrating evidence at the point of care, (4) the evidence’s consistency with clinician perceptions and preferences, (5) incorporating bundled sets or automated documentation, and (6) shared decision making tools. As EHRs become commonplace and insurers demand higher quality and evidence-based care, better methods for integrating evidence into everyday care are warranted. We have outlined basic criteria that should be considered before attempting to integrate evidenced-based decision support tools into the EHR.
JMIR Med Inform 2016;4(2):e16
Field of Evidence-Based Medicine
Pressures to contain health care costs, personalize patient care, use of big data, and enhance health care quality have highlighted the need for integration of evidence at the point of care [- ]. In the field of evidence-based medicine (EBM), we talk about the evidence cycle ( shows this) [ ]. The EBM cycle starts with a question (ask), then accessing the evidence (acquire), appraising the evidence, applying the evidence to care for our patients, and analyzing and adjusting [ ]. The application step is where researchers and policy makers have struggled with implementation and often failed. Furthermore, the constant evolving evidence-based guidelines, clinical prediction rules (CPRs), and comparative effectiveness results makes it challenging for providers to apply the latest evidence at the point of care. But the direct application of EBM has great promise in the era of electronic health records (EHRs) and health technology.
With the onset of Health Information Technology for Economic and Clinical Health Act and Meaningful Use initiatives in 2009, researchers have been hopeful that health technology will be the solution to bringing EBM to the point of care. Substantial investments of funding, intellect, and energy have yielded an array of EHRs and electronic clinical decision support (CDS) tools to improve patients’ quality of care and reduce inappropriate use of critical resources.
The most successful integration of evidence into EHRs has been complex decision tools that trigger at a critical point of the clinical visit and include patient specific recommendations. In contrast, most of the CDS tools being launched are uni-dimensional and not incorporated into the physicians’ workflow. For the purpose of this article, we have designated these forms of evidence integration as “flat reminders”: one-dimensional alerts that are typically triggered by one or two EHR components such as an element of patient history [- ]. Examples include, flu-shot reminders at annual visits or reminders for colon-cancer screening triggered by patients’ age ( shows this). These flat CDS tools unlike complex CDS rarely include patient-specific medical information, are not integrated into the providers’ clinical workflow, do not include tools to support workflow (bundled order sets or documentation corresponding to the tool), or inclusive of patient-centered decision-making tools [ - ].
Complex, multidimensional forms of CDS are patient-specific, provide specific recommendations for rapid frontline decision making, and therefore have had a greater impact on patient outcomes and resource utilization. CPRs are forms of complex CDS. Based on real-time patient data points such as medical history, physical examination, and laboratory data, CPRs are EBM based algorithms that are able to personalize the patient’s diagnosis, prognosis, and likely response to treatment . CPRs weigh patient data and generate a composite score to stratify patients’ risk of disease onset, disease progression, or outcome events. Physicians find these tools more useful, compared to the flat reminders, when decision making is complex, the clinical stakes are high, or cost savings can be achieved without compromising patient care [ ]. Adoption of CPRs have been problematic in that applying complex algorithms at the point of care takes additional time, providers’ forget to apply the rule, and they don’t document the usage.
Incorporating complex CDS tools, such as CPRs, into an EHR holds great promise for finally realizing their potential by standardizing their application, reinforcing their application, and documentation. The caveat is that incorporation of complex CDS tools into the EMR is equally complex and continues to challenge health service researchers and implementation scientists. Poor adoption and sustainability of CDS tools at the point of care has persisted and continues to have low rates of usage [- ]. The barriers cited by physicians include efficiency, perception of usefulness, information content, user interface, and over-triggering [ , ].
Over the past five years, our research team has been working to improve the integration and adoption of complex CDS tools. Similar to the EBM cycle, we see CDS integration as a step wise process of: identifying a clinical problem, reviewing the evidence, usability testing of the tool, integration and deployment of the tool into the EHR, incorporation of shared decision making, and continuous monitoring and maintenance for sustained effectiveness (shows this).
Aim of the Study
During our research, we have encountered challenges that have repeatedly emerged. In this paper, we propose strategies to overcome those challenges to the integration of complex CDS in order to improve EHR-embedded CDS tools adoption rates, patient outcomes, and resource utilization [, ].
Key Considerations for Integrating Evidence-Based Medicine Clinical Decision Support Tools at the Point of Care
Key Strategies for Successful Clinical Decision Support Tools
Building on the traditional EHR implementation frameworks, we review keys strategies for successful CDSs: (1) the quality of the evidence, (2) the potential to reduce unnecessary care, (3) ease of integrating evidence at the point of care, (4) the evidence’s consistency with clinician perceptions and preferences, (5) incorporating bundled sets or automated documentation, and (6) shared decision-making tools.
Quality of the Evidence
The first consideration to successful adoption of CDS tools is assessing the quality of the evidence. This may seem an obvious step, but this critical element is often overlooked, with inaccurate assumptions about evidence and impeding the hoped-for results. Therefore, a formal process of evaluating and grading the evidence of the CDS prior to integration is critical. In order for the CDS tool to have a significant impact on health care outcomes, it must be based on high-quality evidence .
The quality of CPRs is determined by how well they have been validated and tested. CPRs are typically developed in a three-step process: (1) derivation of the rule and creation of a model, usually with a retrospective database; (2) validation of the rule, in which the model is tested, preferably in a prospective fashion in several different sites to demonstrate that it is transportable and stable; and (3) impact analysis, when the rule’s impact on clinical behavior is assessed (shows this) [ ]. The further along in the development process, the higher the level or quality of evidence and the more ready it is for integration in the EHR. Only CPRs that have reached a level 1 or 2 of evidence and have shown to have a consistent predictive accuracy should be considered for integration.
Several risk-stratification tools with poor and unclear levels of evidence are currently in wide use, for example, the Modified Early Warning Scoring and the pulmonary embolism rule criteria rule for pulmonary embolism. The rules have been derived, but haven’t shown consistency in prospective validations performed in various clinical settings [- ].
Potential to Reduce Unnecessary Care
A second consideration we identified as critical is the potential for the evidence to have a significant effect on health care delivery. Historically, CDS and CPR tools have often been introduced in clinical areas plagued by overuse of diagnostic tests or treatments. CPRs aim to accurately identify patients at very low risk who can possibly forgo further testing and those at high risk who can be prioritized for further diagnostic tests or immediate treatment. If the goal of evidence integration is to reduce unnecessary testing or treatment in low risk populations, then estimating how many patients fall into the low risk category will help give an accurate measure of the potential impact of a prediction rule. Our experience has been that estimating this risk will allow you to weigh the potential impact to the work/resources need to build and implement an EHR based CDS tool.
For example, CPRs that guide clinicians through the complex process of risk stratification usually shift the distribution of patients from higher to lower risk. With a CPR such as the strep or pneumonia rule, shifting patients from medium to low risk could reduce orders for antibiotics, which are recommended for patients with medium or high risk; if this constitutes a large proportion of patients, the CPR will have a substantial impact on public health implications (antibiotic resistance) and reduce unnecessary usage of antibiotics.
Ease of Integrating Evidence at Point of Care
A key to both clinician adoption of CDS tools at the point of care and successful integration is how it easy it is to meld the CPR into workflow and how the patient specific data are entered into the tool. Some CDS tools are extremely complex, requiring multiple data points that may not be automatically integrated into the CDS tool and thus require manual entry. In some practice settings, the EHR may not automatically interface with required data such as x-ray results in the emergency departments or rapid point-of-care test results in primary care clinics. Busy clinicians are unlikely to adopt tools that require them to manually derive, obtain, or enter data. Examples of overly complex tools are the Pneumonia Severity Index (PSI) used in emergency departments to help providers decide to admit patients. The rule has over 20 data elements . Attempts to integrate PSI in emergency room workflow have failed due to poor adoption of the model.
Automatic, Seamless Triggers
A related issue to ease of integration is “triggering” of the tool. To be truly effective, CDS tools need to be an active (automatic) trigger and seamlessly integrated into the flow of care. Providers should not have to activate the decision support, but rather be automatically offered it in the appropriate setting and related to the appropriate patient. Certain phrases or orders and combinations can act as trigger points in the EMR, such as chief complaint or diagnosis. For a trigger to be successful, it needs to trigger accurately (when truly needed) and not be overly sensitive. In our study on using a CPR for pneumonia, entering cough in the chief complaint section was one method of automatically triggering the complex decision support tool. Ideally, decision support is triggered infrequently and is targeted to the specific condition where it can most assist the provider. If there is no method for accurate triggering, the decision tool may not be effective in changing clinicians’ behavior.
Consistency of the Evidence With Provider Perceptions and Preferences
Clinicians are most likely to adopt decision support tools or act on evidence guidelines that align with their predispositions about care. Literature suggests providers’ understand the value of CPRs and state they utilize them in decision making, but CPR adoption rates continue to be low and vary across CPRs [, , , , ]. We have therefore found it helpful to conduct a needs assessment and survey providers on their beliefs and attitudes to better understand their reception and potential for adopting the rules. Furthermore, it allows us to anticipate and approach the cultural barriers to CPR adoption. For example, the success of two accurate CPRs, the Ottawa Ankle Rule (OAR) and the Thrombolysis in Myocardial Infarction (TIMI), varied in clinical impact, not based on the quality of evidence, but upon the attitudes the providers’ had on the utility of the CPR in their practice, which hindered the adoption. Dr Ian Stiell derived and validated the OAR CPR to reduce x-ray ordering in emergency rooms among low risk patients presenting with ankle injuries. Implementation of the rule reduced x-ray ordering by over 30% [ ]. In contrast, several prediction rules for chest pain risk stratification in emergency rooms have not been widely adopted despite their demonstrated accuracy [ - ]. Physicians in both examples were presented with accurate CPRs, but behaved differently in each situation. In the case of the OAR, most physicians (89.6%) reported using the rule always or most of the time in appropriate circumstances and 42.2% reported basing their decisions to order radiography primarily on the rule [ ]. In contrast, physicians using the TIMI rule reported that they looked at the CPR during the triage in 46% of eligible patients, but only one triage decision (1%) was changed by it [ , ]. The OAR CPR in this situation supports their predisposition to confirm their clinical gestalt and empowers them to follow through. In contrast, patients presenting with chest pain may present physicians with a challenging decision that evidence introduction will not help and therefore evidence alone will not change practice patterns. Performing a needs assessment and survey prior to integrating evidence into workflow will potentially uncover these biases and lead to insight on how to overcome those biases.
Incorporating Bundled Sets or Automated Documentation
CPRs that can stratify risk and have a corresponding management plan or diagnostic testing, which can be streamlined and bundled into order sets, will likely have more buy in by physicians, leading to higher usage and therefore larger impact on patient outcomes. The largest incentive we have witnessed through our usability testing is how the CPR and CDS tools can streamline clinical practice instead of impeding and slowing it. By incorporating order sets or automated documentation in progress notes of the EMR and automated documentation in progress notes of the EMR, physicians see the CDS as a facilitator rather than a burden. Therefore, we work to develop CDS tools that offer some incentive to using the tool. In our models, we embedded patient education material in both English and Spanish for patients to take home [, , ]. We also developed order sets for recommended antibiotics for patients identified as high risk. Both these aspects were popular with providers.
Shared Decision-Making Tools
The final piece of completing the evidence cycle, which has yet to be sufficiently studied, is the integration of shared decision making when it’s appropriate and as long as it’s based on the best available evidence. Shared decision making (SDM) is becoming an integral part of patient centered care and is seen as a method to improve patient-clinician communication [, ]. SDM is a process in which the clinician and patient share information about the disease and treatment options and discuss the patient’s preferences to arrive at a decision about a management plan. Decision aids are typically used during the discussions to describe risk of disease and impact of treatment on morbidity and mortality, and have shown to have positive impacts on patient and clinical outcomes [ ]. In a systematic review of the literature, it is suggested that patients may benefit from the use of SDM in the emergency department and that SDM is feasible [ ]. A randomized controlled trial used SDM tools in patients with chest pain and showed an increase in patients’ knowledge and engagement in decision making and patients decided less frequently to be admitted to the observation unit [ , ]. The combination of CPR with SDM allows for tailored messages around their severity of disease and treatment plans, and through the use of the EMR SDM, reminders, tools, and documentation in clinical visits, CDS is becoming easier.
As EHRs become commonplace and insurers demand higher quality and evidence-based care, better methods for integrating evidence into everyday care are warranted. We have outlined basic criteria that should be considered before attempting to integrate evidenced-based decision support tools into the EHR. First and foremost, this process emphasizes a critical appraisal of the quality of the evidence behind the decision support. Second, CDS tools should be evaluated for their ability to perform and impact clinical care through assessments of providers’ perception of utility. Finally, usability testing and integration into workflow need to be thoroughly evaluated prior to attempts to integrate evidence. Evaluation of the evidence and usability testing, however, are often lacking in research design, implementation methodology, and training of researchers in this area. If the federal government, EHR vendors, or health care institutions do not support research in these areas, the integration of successful CDS tools will continue to lag in creating change in patient outcomes. At this critical juncture of widespread EHRs and pressure to bend the cost curve, incentives to help industry, government, and academic health centers to support these research areas is urgent.
Conflicts of Interest
- Blumenthal D. Launching HITECH. N Engl J Med 2010 Feb 4;362(5):382-385. [CrossRef] [Medline]
- Linder JA, Chan JC, Bates DW. Evaluation and treatment of pharyngitis in primary care practice: The difference between guidelines is largely academic. Arch Intern Med 2006 Jul 10;166(13):1374-1379. [CrossRef] [Medline]
- Medicare and Medicaid Programs. 2006 Jul 10. Electronic health record incentive program--Stage 2. Proposed Rule URL: https://www.federalregister.gov/articles/2012/09/04/2012-21050/medicare-and-medicaid-programs-electronic-health-record-incentive-program-stage-2 [accessed 2016-03-28] [WebCite Cache]
- Center for Medicare and Medicaid Services (CMS). Federal Register. 2010. Federal register | electronic health record (EHR) incentive program URL: https://www.federalregister.gov/regulations/0938-AP78/electronic-health-record-ehr-incentive-program-cms-0033-f- [accessed 2016-03-26] [WebCite Cache]
- King J. ONC Data Brief, no. 7. 2012. Physician adoption of electronic health record technology to meet meaningful use objectives URL: https://www.healthit.gov/sites/default/files/onc-data-brief-7-december-2012.pdf [accessed 2016-03-28] [WebCite Cache]
- McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS. Users' guides to the medical literature: XXII: How to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA 2000 Jul 5;284(1):79-84. [Medline]
- Sackett DW. Evidence-based medicine: How to practice and teach EBM. In: Evidence based medicine: how to practice and teach EBM. Edinburgh: Churchill Livingstone; 2000.
- Fritz D, Ceschi A, Curkovic I, Huber M, Egbring M, Kullak-Ublick GA, et al. Comparative evaluation of three clinical decision support systems: Prospective screening for medication errors in 100 medical inpatients. Eur J Clin Pharmacol 2012 Aug;68(8):1209-1219. [CrossRef] [Medline]
- Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: A systematic review. JAMA 1998 Oct 21;280(15):1339-1346. [Medline]
- Randolph AG, Haynes RB, Wyatt JC, Cook DJ, Guyatt GH. Users' guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system. JAMA 1999 Jul 7;282(1):67-74. [Medline]
- Overhage JM, Tierney WM, Zhou XH, McDonald CJ. A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc 1997;4(5):364-375 [FREE Full text] [Medline]
- Ansari M, Shlipak MG, Heidenreich PA, Van OD, Pohl EC, Browner WS, et al. Improving guideline adherence: A randomized trial evaluating strategies to increase beta-blocker use in heart failure. Circulation 2003 Jun 10;107(22):2799-2804 [FREE Full text] [CrossRef] [Medline]
- Subramanian U, Fihn SD, Weinberger M, Plue L, Smith FE, Udris EM, et al. A controlled trial of including symptom data in computer-based care suggestions for managing patients with chronic heart failure. Am J Med 2004 Mar 15;116(6):375-384. [CrossRef] [Medline]
- Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou XH, Eckert GJ, et al. Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med 2003 Dec;18(12):967-976 [FREE Full text] [Medline]
- Hemens BJ, Holbrook A, Tonkin M, Mackay JA, Weise-Kelly L, Navarro T, CCDSS Systematic Review Team. Computerized clinical decision support systems for drug prescribing and management: A decision-maker-researcher partnership systematic review. Implement Sci 2011;6:89 [FREE Full text] [CrossRef] [Medline]
- Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: Cluster randomised controlled trial. BMJ 2002 Oct 26;325(7370):941 [FREE Full text] [Medline]
- Litvin CB, Ornstein SM, Wessell AM, Nemeth LS, Nietert PJ. Use of an electronic health record clinical decision support tool to improve antibiotic prescribing for acute respiratory infections: The ABX-TRIP study. J Gen Intern Med 2013 Jun;28(6):810-816 [FREE Full text] [CrossRef] [Medline]
- Cresswell K, Majeed A, Bates DW, Sheikh A. Computerised decision support systems for healthcare professionals: An interpretative review. Inform Prim Care 2012;20(2):115-128. [Medline]
- Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: A systematic review. Ann Intern Med 2012 Jul 3;157(1):29-43. [CrossRef] [Medline]
- Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: Making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003;10(6):523-530 [FREE Full text] [CrossRef] [Medline]
- Li A, Kannry JL, Kushniruk A, Chrimes D, McGinn TG, Edonyabo D, et al. Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support. Int J Med Inform 2012 Nov;81(11):761-772. [CrossRef] [Medline]
- Mann DM, Kannry JL, Edonyabo D, Li AC, Arciniega J, Stulman J, et al. Rationale, design, and implementation protocol of an electronic health record integrated clinical prediction rule (iCPR) randomized trial in primary care. Implement Sci 2011;6:109 [FREE Full text] [CrossRef] [Medline]
- Churpek MM, Yuen TC, Edelson DP. Risk stratification of hospitalized patients on the wards. Chest 2013 Jun;143(6):1758-1765 [FREE Full text] [CrossRef] [Medline]
- Kyriacos U, Jelsma J, Jordan S. Monitoring vital signs using early warning scoring systems: A review of the literature. J Nurs Manag 2011 Apr;19(3):311-330. [CrossRef] [Medline]
- AydoÄŸdu M, TopbaÅŸi SN, DoÄŸan NO, OÄŸuzülgen IK, Demircan A, Bildik F, et al. Wells score and pulmonary embolism rule out criteria in preventing over investigation of pulmonary embolism in emergency departments. Tuberk Toraks 2014;62(1):12-21 [FREE Full text] [Medline]
- Bokobza J, Aubry A, Nakle N, Vincent-Cassy C, Pateron D, Devilliers C, et al. Pulmonary embolism rule-out criteria vs D-dimer testing in low-risk patients for pulmonary embolism: A retrospective study. Am J Emerg Med 2014 Jun;32(6):609-613. [CrossRef] [Medline]
- Crichlow A, Cuker A, Mills AM. Overuse of computed tomography pulmonary angiography in the evaluation of patients with suspected pulmonary embolism in the emergency department. Acad Emerg Med 2012 Nov;19(11):1219-1226 [FREE Full text] [CrossRef] [Medline]
- Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE, et al. A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med 1997 Jan 23;336(4):243-250. [CrossRef] [Medline]
- Graham ID, Stiell IG, Laupacis A, O'Connor AM, Wells GA. Emergency physicians' attitudes toward and use of clinical decision rules for radiography. Acad Emerg Med 1998 Feb;5(2):134-140 [FREE Full text] [Medline]
- Perry JJ, Goindi R, Symington C, Brehaut J, Taljaard M, Schneider S, et al. Survey of emergency physicians' requirements for a clinical decision rule for acute respiratory illnesses in three countries. CJEM 2012 Mar;14(2):83-89. [Medline]
- Perry JJ, Stiell IG. Impact of clinical decision rules on clinical care of traumatic injuries to the foot and ankle, knee, cervical spine, and head. Injury 2006 Dec;37(12):1157-1165. [CrossRef] [Medline]
- Goldman L, Cook EF, Johnson PA, Brand DA, Rouan GW, Lee TH. Prediction of the need for intensive care in patients who come to the emergency departments with acute chest pain. N Engl J Med 1996 Jun 6;334(23):1498-1504. [CrossRef] [Medline]
- Pearson SD, Goldman L, Garcia TB, Cook EF, Lee TH. Physician response to a prediction rule for the triage of emergency department patients with chest pain. J Gen Intern Med 1994 May;9(5):241-247. [Medline]
- Hess EP, Agarwal D, Chandra S, Murad MH, Erwin PJ, Hollander JE, et al. Diagnostic accuracy of the TIMI risk score in patients with chest pain in the emergency department: A meta-analysis. CMAJ 2010 Jul 13;182(10):1039-1044 [FREE Full text] [CrossRef] [Medline]
- Brehaut JC, Stiell IG, Visentin L, Graham ID. Clinical decision rules "in the real world": How a widely disseminated rule is used in everyday practice. Acad Emerg Med 2005 Oct;12(10):948-956 [FREE Full text] [CrossRef] [Medline]
- Pearson MR, Leonard RB. Posterior sternoclavicular dislocation: A case report. J Emerg Med 1994;12(6):783-787. [Medline]
- McGinn TG, McCullagh L, Kannry J, Knaus M, Sofianou A, Wisnivesky JP, et al. Efficacy of an evidence-based clinical decision support in primary care practices: A randomized clinical trial. JAMA Intern Med 2013 Sep 23;173(17):1584-1591. [CrossRef] [Medline]
- Barry MJ, Edgman-Levitan S. Shared decision making--pinnacle of patient-centered care. N Engl J Med 2012 Mar 1;366(9):780-781. [CrossRef] [Medline]
- Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, et al. Shared decision making: A model for clinical practice. J Gen Intern Med 2012 Oct;27(10):1361-1367 [FREE Full text] [CrossRef] [Medline]
- Flynn D, Knoedler MA, Hess EP, Murad MH, Erwin PJ, Montori VM, et al. Engaging patients in health care decisions in the emergency department through shared decision-making: A systematic review. Acad Emerg Med 2012 Aug;19(8):959-967 [FREE Full text] [CrossRef] [Medline]
- Hess EP, Knoedler MA, Shah ND, Kline JA, Breslin M, Branda ME, et al. The chest pain choice decision aid: A randomized trial. Circ Cardiovasc Qual Outcomes 2012 May;5(3):251-259 [FREE Full text] [CrossRef] [Medline]
- Pierce MA, Hess EP, Kline JA, Shah ND, Breslin M, Branda ME, et al. The chest pain choice trial: A pilot randomized trial of a decision aid for patients with chest pain in the emergency department. Trials 2010;11:57 [FREE Full text] [CrossRef] [Medline]
|CDS: clinical decision support|
|CPRs: clinical prediction rules|
|EBM: evidence-based medicine|
|EHRs: electronic health records|
|OAR: Ottawa Ankle Rule|
|PSI: Pneumonia Severity Index|
|SDM: shared decision making|
|TIMI: Thrombolysis in Myocardial Infarction|
Edited by G Eysenbach; submitted 18.04.15; peer-reviewed by B Tilahun, L Nemeth, D Mann; comments to author 16.08.15; revised version received 26.08.15; accepted 22.09.15; published 19.05.16
©Thomas McGinn. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 19.05.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.