This paper is in the following e-collection/theme issue:

Decision Support for Health Professionals (1210) Advanced Data Analytics in eHealth (142) Secondary Use of Clinical Data for Research and Surveillance (375) Clinical Informatics (1050) Clinical Information and Decision Making (1434)

Published on in Vol 10, No 1 (2022): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/31356, first published .
Real-world Health Data and Precision for the Diagnosis of Acute Kidney Injury, Acute-on-Chronic Kidney Disease, and Chronic Kidney Disease: Observational Study

Real-world Health Data and Precision for the Diagnosis of Acute Kidney Injury, Acute-on-Chronic Kidney Disease, and Chronic Kidney Disease: Observational Study

Real-world Health Data and Precision for the Diagnosis of Acute Kidney Injury, Acute-on-Chronic Kidney Disease, and Chronic Kidney Disease: Observational Study

Authors of this article:

Karen Triep1 Author Orcid Image ;   Alexander Benedikt Leichtle2 Author Orcid Image ;   Martin Meister3 Author Orcid Image ;   Georg Martin Fiedler4 Author Orcid Image ;   Olga Endrich2 Author Orcid Image
Article Authors Cited by (6) Tweetations (3) Metrics

    Original Paper

    1Medical Directorate, Medizincontrolling, Inselspital, University Hospital Bern, Insel Gruppe, Bern, Switzerland

    2Insel Data Science Center, Inselspital, University Hospital Bern, Insel Gruppe, Bern, Switzerland

    3Directorate of Technology and Innovation, Inselspital, University Hospital Bern, Insel Gruppe, Bern, Switzerland

    4University Institute of Clinical Chemistry, Inselspital, University Hospital Bern, Insel Gruppe, Bern, Switzerland

    *all authors contributed equally

    Corresponding Author:

    Karen Triep, Dr med

    Medical Directorate, Medizincontrolling

    Inselspital, University Hospital Bern

    Insel Gruppe

    S96 C223

    Schwarztorstrasse 96

    Bern, 3010

    Switzerland

    Phone: 41 31 632 51 96

    Email: karen.triep@insel.ch


    Background: The criteria for the diagnosis of kidney disease outlined in the Kidney Disease: Improving Global Outcomes guidelines are based on a patient’s current, historical, and baseline data. The diagnosis of acute kidney injury, chronic kidney disease, and acute-on-chronic kidney disease requires previous measurements of creatinine, back-calculation, and the interpretation of several laboratory values over a certain period. Diagnoses may be hindered by unclear definitions of the individual creatinine baseline and rough ranges of normal values that are set without adjusting for age, ethnicity, comorbidities, and treatment. The classification of correct diagnoses and sufficient staging improves coding, data quality, reimbursement, the choice of therapeutic approach, and a patient’s outcome.

    Objective: In this study, we aim to apply a data-driven approach to assign diagnoses of acute, chronic, and acute-on-chronic kidney diseases with the help of a complex rule engine.

    Methods: Real-time and retrospective data from the hospital’s clinical data warehouse of inpatient and outpatient cases treated between 2014 and 2019 were used. Delta serum creatinine, baseline values, and admission and discharge data were analyzed. A Kidney Disease: Improving Global Outcomes–based SQL algorithm applied specific diagnosis-based International Classification of Diseases (ICD) codes to inpatient stays. Text mining on discharge documentation was also conducted to measure the effects on diagnosis.

    Results: We show that this approach yielded an increased number of diagnoses (4491 cases in 2014 vs 11,124 cases of ICD-coded kidney disease and injury in 2019) and higher precision in documentation and coding. The percentage of unspecific ICD N19-coded diagnoses of N19 codes generated dropped from 19.71% (1544/7833) in 2016 to 4.38% (416/9501) in 2019. The percentage of specific ICD N18-coded diagnoses of N19 codes generated increased from 50.1% (3924/7833) in 2016 to 62.04% (5894/9501) in 2019.

    Conclusions: Our data-driven method supports the process and reliability of diagnosis and staging and improves the quality of documentation and data. Measuring patient outcomes will be the next step in this project.

    JMIR Med Inform 2022;10(1):e31356

    doi:10.2196/31356

    Keywords

    acute kidney injury; chronic kidney disease; acute-on-chronic; real-world health data; clinical decision support; KDIGO; ICD coding 


    Background

    Many definitions of diagnoses are rule-based and contain complex algorithms. This applies in particular to the diagnoses of kidney injury and kidney disease (KD). For example, the diagnosis of acute kidney injury (AKI) stage 3 according to the Kidney Disease: Improving Global Outcomes (KDIGO) guidelines is defined as follows: an increase in serum creatinine (SCr) from under 4 mg/dL (353.6 µmol/L) to over 4 mg/dL within 7 days or an increase of SCr by 200% or more within 7 days. The increase and decrease have to be considered as follows: the gradient of increase versus the absolute increase, the increase versus decrease, and the highest stage. Moreover, the SCr baseline calculation has to be conducted: the lowest value during hospitalization or the arithmetic mean of all outpatient measurements before the index admission.

    With the increasing availability of health data, automatic deducing of complex diagnoses has become possible. Correctly assigning diagnoses requires high precision, validity and reliability, the varying interrater reliability of diagnosis and the International Classification of Diseases (ICD) coding, affecting accuracy [1-4]. Interrater reliability shows insufficient values for certain diagnoses when comparing ICD codes or patients’ records of the diagnoses of AKI and chronic KD (CKD) [5,6].

    The global burden of KDs is high. Using a modification of the original glomerular filtration rate (GFR) estimating equation (the Chronic Kidney Disease Epidemiology Collaboration [CKD-EPI] equation), it was discovered that 11.6% of the adult residents in the United States have CKD stages 1-4, and its prevalence has increased over the past decade. Similar figures have been reported in several other countries [7-10]. In 2009, the US Renal Data System estimated that depending on the estimating equations used, the prevalence of CKD had increased by 20%-25% over the preceding decade [11].

    The diagnoses of AKI, CKD, and acute-on-chronic KD are highly relevant as a comorbidity, intercurrent disease, or complication [12,13]. Inpatients with KD and kidney injury show a higher mortality and the staging implies an impact on outcomes [14,15]. The 2012 KDIGO Clinical Practice Guideline for AKI [16] and the Clinical Practice Guideline for the Evaluation and Management of CKD [17] offer guidelines containing definitions and classifications; ongoing areas of controversies and limitations of the evidence are also discussed in these documents. The definitions of AKI and CKD require a complex analysis of a patient’s recent and historical laboratory values, a time-consuming process impeded by missing values and prone to errors if conducted manually. Misclassification impairs the choice of therapeutic approach, outcomes, high-quality documentation, data validity, and reimbursement. Moreover, an unclear definition of the individual creatinine baseline level and the approximate ranges of normal values without adjusting for age, ethnicity, comorbidities, and treatment aggravate the difficulties of diagnosis [18-27].

    Clinical decision support systems can provide a systematic and objective way to enhance complex reasoning related to differential diagnostics. They can facilitate the process of diagnosis, contributing to its reliability [28-33]. Accumulating health data enables the providers to access relevant information for timely diagnosis, supporting effective management throughout care [10,34]. In recent times, national health systems, such as the National Health Service (NHS), have started supporting more advanced approaches for detecting patients with kidney injuries [35].

    In Switzerland, since 2017, based on the official coding rules, AKI and CKD have been coded according to the KDIGO classification. However, documentation of the exact staging is often missing in the discharge documentation in many cases.

    At our hospital (quaternary care university level), KD shows a rising relevance because the prevalence of patients with a GFR of <60 ml/min measured has been increasing during the recent years. Moreover, the ICD diagnoses of KD are relevant for reimbursement. Nevertheless, many inpatient cases with a GFR of <60 ml/min were not ICD-coded for any KD, and a clinical decision support has not yet been implemented.

    Objectives

    This study aims to evaluate a novel data-driven method to assign highly specific diagnoses of AKI and CKD by extracting historical and real-time data from the hospital’s data warehouse. We hypothesize that by using a data-driven approach of diagnosis on routinely collected laboratory values, we can improve the detection and precision of the diagnosis and staging of AKI and CKD.


    Study Population and Setting

    Administrative and laboratory data of all inpatient and outpatient cases were used (Inselspital University Hospital Bern, 2014-2019; all Insel Gruppe, Bern, 2016-2019 with 200,000 inpatient and outpatient cases per year, of which, approximately 62,000 inpatient cases had ICD-coded diagnoses). Data from 2014 to 2016 were used for benchmarking purposes as a baseline at the start of the study (2017). Test data sets of cases from 2016 were used to evaluate the accuracy of the algorithm. The data for measuring the impact were selected from 2017 to 2019.

    Definition of AKI

    According to the KDIGO Clinical Practice Guidelines (2012) for AKI [16], we defined and staged AKI as follows (plasma creatinine instead of SCr):

    • Stage 3: increase of SCr from under 4 mg/dL (353.6 µmol/L) to over 4 mg/dL within 7 days
    • Stage 3: increase of SCr by 200% or more within 7 days
    • Stage 2: increase of SCr by 100%-200% within 7 days
    • Stage 1: increase of SCr by 50%-100% within 7 days
    • Stage 1: increase of SCr by 0.3 mg/dL (26.52 µmol/L) within 48 hours

    The decrease in SCr to baseline levels after starting the in-hospital measurement was interpreted as suggested by the KDIGO guidelines. With several positive findings, the gradient of the increase versus the absolute increase, the increase versus decrease, and the highest stage were prioritized for applying the specific stage. All available SCr measurements, along with date and time stamps were used. Inpatients with no available SCr measurements were classified as not having AKI.

    Oliguria

    Oliguria is still a controversial diagnostic criterion with regard to definition and practice of measurement, especially outside the intensive care setting. The hourly urine output data required to determine oliguria within any 6-, 12-, or 24-hour window is not reliably captured in the non–intensive care unit setting [25]. Therefore, we did not include it in the AKI definition of this study, which was consistent with the NHS England National Patient Safety Alert [35,36].

    Baseline Definition

    The baseline estimation was not specifically defined by the KDIGO guidelines; however, several methods were compared for baseline estimation [16,19,21,24,25,37].

    We defined the baseline value for AKI as either the lowest value during hospitalization or the arithmetic mean of all outpatient SCr measurements 90 days before the index admission, if available, and took the lowest values for diagnosis. Either one may reasonably reflect the patient’s premorbid baseline. Using the values at admission was considered; however, although the values may be the lowest for community-acquired AKI, they may be missing. Different approaches were not compared in this study.

    Definition of CKD

    In this study, a possible CKD was defined according to the KDIGO Clinical Practice Guideline for the Evaluation and Management (2012) of CKD [17], that is, a decreased GFR of <60 mL/min/1.73 m2, an albumin creatinine ratio (ACR) of >30 mg/g (>3 mg/mmol), or a history of kidney transplantation (estimated according to the CKD-EPI equation). GFR categories were assigned as follows:

    • Stage 5: all values under 15 mL/min/1.73 m2 for >91 days
    • Stage 4: all values under 30 mL/min/1.73 m2 for >91 days
    • Stage 3: all values under 60 mL/min/1.73 m2 for >91 days
    • Stage 2: all values under 90 mL/min/1.73 m2 for >91 days

    Definition of ACR

    In addition, according to the KDIGO criteria we integrated albuminuria into the model as a marker of kidney damage, related to mortality and kidney outcome in CKD [17,37], using the ACR values, as follows:

    • Severely increased: SCr (µmol/L)/albumin (g/L) >30 mg/g
    • Moderately increased: SCr (µmol/L)/albumin (g/L) between 3 and 30 mg/g
    • Normal to mildly increased: SCr (µmol/L)/albumin (g/L) <30 mg/g

    Values from one sample or values measured within an interval of 30 days were considered.

    Architecture and Algorithm

    A complex dataflow was established to make all the required variables available for calculation. First, an SQL-based algorithm processed the data warehouse’s data (rule engine and HL7 [Health Level Seven International] messages) and detected the potential cases of KD. All available SCr measurements with date and time stamps were used. The patient identification number was defined as the primary key but was only used as a linkage code for administrative and clinical or laboratory data. Patient- and case-related laboratory and administrative historical and real-time data had to be extracted from the source systems, merged, and computed for diagnosis and stage. Second, the output of the correlating ICD [38,39] code was connected by the detection date to the distinct date of the patient’s inpatient case (the case ID linked to the entry and discharge dates related to the patient ID). Third, the test results were processed to the recipient and included a staging of AKI and CKD according to the abovementioned criteria. The architecture and dataflow of AKI and CKD are illustrated in Figure 1, and the architecture and dataflow of the retrospective calculation are shown in Figure 2.

    ‎
    Figure 1. Architecture and dataflow. AKI: acute kidney injury; CKD: chronic kidney disease; ICD: International Classification of Diseases.
    View this figure
    ‎
    Figure 2. Architecture for retrospective analysis. OPUS: laboratory information system by OSM Group; SAP ISH: Systems Applications and Products in Data Processing Industry Solution Healthcare.
    View this figure

    The steps of computation were as follows: (1) for AKI, selecting inpatients hospitalized during a specified period, selecting laboratory values (SCr) 7 days before admission until discharge, mapping values from 48 hours to 7 days apart, and classifying values according to the ICD standard [38,39]; and (2) for CKD, selecting inpatients’ or outpatients’ laboratory values (estimated GFR [eGFR]), mapping the values of eGFR at least three months apart, calculating the mean minimum and maximum values of each period and the difference of the mapped values in hours, and classifying values according to the ICD standard.

    The output for AKI was defined as the highest stage of diagnosis with the shortest period between the mapped values. The relevant result for CKD was defined as the highest stage of diagnosis with the longest period between mapped values. All patients with fulfilled criteria during the previous year for the specific diagnosis and with values positively corresponding to diagnosis during the last 3 months were detected. The algorithm for AKI is presented in Figure 3 and for CKD, in Multimedia Appendix 1. The algorithm was tested on testing data sets by technicians and clinicians. The algorithm was technically adjusted until all tested cases showed correct diagnoses and stages according to the formal definitions provided.

    ‎
    Figure 3. Algorithm of diagnosis of AKI. AKI: acute kidney injury; SCr: serum creatinine; UI: user interface.
    View this figure

    Text Mining

    A text mining pipeline was implemented using Apache Solr (The Apache Software Foundation) to compare the results of the algorithms with those of the reports. In this process, all relevant reports were loaded into a Solr collection and searched for terms, such as AKI, CKD, eGFR, KDIGO, creatinine, and renal failure (German translation: kreatinin, niereninsuffizienz, and nierenversagen), and the exact KDIGO staging (eg, G1A1 [GFR ≥90 ml/min per 1.73 m2 ACR <30 mg/g (<3mg/mmol)]).

    For terms with a tilde character (“~”), a fuzzy search algorithm was applied to ensure that not only one spelling of a term was found. The Damerau-Levenshtein distance algorithm was used for this purpose. A separate CSV file was generated for each search term, including the case ID, date of report generation, and report type. Each row corresponded to a finding of the respective search term.

    The CSV files were then loaded into the database containing the algorithm results and other case data. Using a transact-SQL script, the results from all sources were then aggregated at the case level. On this basis, the cases could be filtered and evaluated for constellations of interest.

    Process of Diagnosis

    Being aware of the purely arithmetic method of diagnosis implemented in 2017, clinical judgment was integrated into the process, especially to verify the chronic diagnoses and distinguish between AKI and unstable CKD [40,41]. Therefore, the real-time information and retrospectively detected diagnoses were compared with the documentation in the patients’ health records using ICD diagnoses coded manually (comparison of automatically generated and manually coded ICD codes) and text mining (diagnoses and stages). Differences were then analyzed by the clinicians. Mostly, the cases with singular ICD codes relevant for reimbursement were analyzed and validated. After rejecting a certain fraction of the automatically generated diagnoses because of the clinician’s judgment or lack of documentation, the corresponding codes were deleted. Only validated diagnoses were retained in the database. The effect of the validation was monitored by analyzing the mutation of diagnoses from generated to coded ICD codes (log file of all ICD code mutations).

    During the period of the project, the process of diagnosis was supported by documentation templates, instruction, and close communication with the clinicians. The data processed were not used to set up an alerting system but were validated retrospectively after the patients’ discharge. The diagnosis process is illustrated in Figure 4.

    ‎
    Figure 4. Process of diagnosis. ICD: International Classification of Diseases; KDIGO: Kidney Disease: Improving Global Outcomes.
    View this figure

    Catalogs

    Bound by the Swiss regulations, the following catalogs were applied [38,39]: for the discharge year 2014, the International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification (ICD-10-GM) 2012; from 2015 to 2016, the ICD-10-GM 2014; from 2017 to 2018, the ICD-10-GM 2016; and for 2019, the ICD-10-GM 2018. Because of a mutation in codes for AKI (ICD N17-) from 2014 to 2016, some analyses could only be conducted for the data from 2017 onward (Multimedia Appendix 2); ICD-10-GM codes catalogs from 2012-2018, effective in Switzerland from 2014 to 2020.

    Reimbursement

    To measure the effect after the successful implementation of the algorithm we planned a simulation of Swiss Diagnosis Related Groups, Inpatient Tariff (SwissDRG) income of 6 months’ coding (inpatient cases from February 1, 2020, to July 31, 2020) in 2020 with and without grouping the automatically calculated ICD diagnoses; the SwissDRG web-based batch grouper version 9.0 2020/2020 was used.

    Analysis and Software

    The automatically generated, previously coded, rejected, and validated ICD diagnoses were compared per code category and per specific code. The prevalence of the codes was calculated for all inpatient cases and for inpatient cases with coded KD (all diagnoses). The proportion of specific medical information (text, laboratory values, reference to KDIGO classification, and formal KDIGO staging) documented in the corresponding discharge letters was calculated.

    The following software were used during analyses: Medical coding software Systems Applications and Products in Data Processing Industry Solution Healthcare (SAP IS-H), Medical Coding Tool ID Diacos, Clinical Data Phoenix CGM, Business Data Ware House SAP BW, Microsoft Excel 2010, R developing software (R version 3.5.0 2018-4-23), RStudio version 1.1.453, and RStudio Team (2016) as well as RStudio: Integrated Development for R (RStudio, Inc) and ggplot2 version 3.1.0.

    Ethics

    The ethics committee of the Canton Bern approved this study (BASEC-Req-2018-01184).


    General Remarks

    The method applied in this study to assign the specific diagnoses and exact stages of AKI and CKD produced highly reliable results. Moreover, the process of communicating and verifying the diagnoses improved the validity in the medical context of the individual patient. Diagnoses and stages could be displayed in near to real time and retrospective calculations could be conducted for the previous 6 years. As the algorithm considered acute and chronic diseases, this project is one of the few to integrate the diagnosis of acute-on-chronic KD. The specific diagnoses documentation and the exact staging in the patients’ discharge letters could be improved.

    Overview

    An increasing prevalence of inpatient cases with a measured eGFR of <60 ml/min can be shown for the discharge years 2014-2019 (from 4362/42,703, 10.21% cases in 2014 to 12,519/66,958, 18.69% cases in 2019). The proportion of ICD-coded inpatient cases with ICD codes for any KD diagnosis in the ICD categories N17-/N18-/N19- during the same period increased for all inpatients (from 4491/42,703, 10.52% cases in 2014 to 11,124/66,958, 16.62% cases in 2019) and for the group of cases with an eGFR of <60 ml/min (from 2167/4362, 49.48% cases in 2014 to 7596/12,519, 60.68% in 2019). The proportion of coded cases of KD with an eGFR of <60 ml/min was 49.68% (2167/4362) in 2014 and 45.09% (5005/11,100) in 2016 and dropped to 60.68% (7596/12,519) in 2019. Between 2014 and 2019, the prevalence of all KD-coded cases increased from 10.52% (4491/42,703) cases in 2014 to 16.61% 11,124/66,958) cases in 2019. The main increase in the prevalence of coded cases of KD was observed between 2017 and 2019, after project initiation as shown in Table 1.

    Table 1. Prevalence of cases with estimated glomerular filtration rates (eGFRs) of <60 ml/min and kidney injury (KI) coding (all International Classification of Diseases [ICD] codes N17-/N18-/N19-).
    DistributionYear of discharge

    		201420152016201720182019Total
    Inpatient cases, N42,70345,13864,47865,14666,03866,958350,461
    Inpatient cases with measured eGFR, n (% of inpatient cases total)20,610 (48.26)37,326 (82.69)40,917 (63.46)40,109 (61.57)41,552 (6292)46,800 (69.89)227,314 (64.86)
    Inpatient cases with an eGFR of <60 ml/min, n (% of inpatient cases total)4362 (10.21)8786 (19.47)11,100 (17.22)10,695 (16.42)10,570 (16.01)12,519 (18.67)58,032 (16.65)
    Any KI-coded (ICD N17-/N18-/N19-) cases, n (%)4491 (10.51)4786 (10.6)8422 (13.06)8512 (13.06)10,165 (15.39)11,124 (16.61)47,500 (13.55)
    Any KI-coded (ICD N17-/N18-/N19-) inpatient cases with an eGFR of <60 ml/min, n (%)2167 (49.68)4029 (45.86)5005 (45.09)5031 (47.04)5983 (56.6)7596 (60.68)29,811 (51.37)

    Figure 5 highlights an increase in cases with specifically coded diagnosis (ICD codes N17-/N18- with staging) and acute-on-chronic KD (ICD codes N17-/N18-) in 2014-2019 of all KD-coded cases, for example, acute-on-chronic KD cases increased from 0.26% (111/42,703) cases in 2014 and 2.62% (1706/65,146) cases in 2017 to 3.47% (2320/66,958) cases in 2019 (Multimedia Appendices 3 and 4).

    ‎
    Figure 5. Proportion of specific ICD KD codes in all cases coded with any ICD code for KD (KD-coded cases). A: data for specific codes; B: data for unspecific codes. ICD: International Classification of Diseases; ICD-10-GM: International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification; KD: kidney disease.
    View this figure

    Correspondingly, unspecified diagnoses (ICD N19) decreased from 2014 to 2019 (see all prevalence data in Multimedia Appendices 3 and 4 and Figure 5). A sharp decrease can be observed among 2016, 2017 (onset of the project), and 2019 in the proportion of all unspecified diagnoses (all N17-, N18-, and N19-, without staging) of all KD-coded cases, that is, 41.91% (3530/8422) cases in 2016, 22.1% (1881/8512) cases in 2017, and 15.46% (1720/11,124) cases in 2019 (Multimedia Appendices 3 and 4 and Figure 5).

    Moreover, the mutation of unspecified diagnoses (ie, ICD N19-) to more precise coding (ICD N17- for AKI and N18-for CKD, including stages) during the process of diagnosis of individual cases can be demonstrated, for example, the conversion of ICD N19- to more specific codes, rising in 2017. Tables 2 and 3 illustrate the impact on the prevalence of ICD N19-.

    Table 2. Impact of manual validation—conversion of unspecific N19 codes to specific codes and the rejection of any International Classification of Diseases coding.
    Discharge yearN19 codes generated, NN17 codes from the N19 codes generated, n (%)N18 codes from the N19 codes generated, n (%)N19 codes from the N19 codes generated, n (%)
    20142967188 (6.34)1705 (57.47)357 (12.03)
    20156279475 (7.56)3126 (49.78)684 (10.89)
    20167833460 (5.87)3924 (50.10)1544 (19.71)
    201776052027 (26.65)3831 (50.37)301 (3.96)
    201875602420 (32.01)4571 (60.46)467 (6.18)
    201995013204 (33.72)5894 (62.04)416 (4.38)
    Table 3. Prevalence of cases with estimated glomerular filtration rates (eGFR) of <60 ml/min and unspecified kidney injury (KI) coding (International Classification of Diseases [ICD] N19) compared with those from 2016.
    Year of dischargeCases with an eGFR of <60 ml/min, NKI-coded (ICD N19-) cases with an eGFR of <60 ml/min, n (%)
    201611,1001544 (13.91)
    2017a10,695301 (2.81)
    201810,570467 (4.42)
    201912,519416 (3.32)

    aStart of the project.

    Regarding discharge documentation, we observed an increase in the proportion of documented diagnoses for some KD code categories but mostly an increase in references to the KDIGO classification mentioning eGFR and SCr. Concerning the cases with coded CKD, the correct KDIGO staging could be detected more often, with all ICD N18- coded cases being 1.5% in 2014, 4.7% in 2017, and 6.3% in 2019 (Figure 6 and Multimedia Appendix 5).

    ‎
    Figure 6. Proportion of positive text mining results in discharge letters of International Classification of Diseases N18–coded cases (chronic kidney disease). eGFR: estimated glomerular filtration rate; ICD-10-GM: International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification; KDIGO: Kidney Disease: Improving Global Outcomes; KI: kidney injury.
    View this figure

    Regarding the diagnosis of acute-on-chronic KD, a drop in documentation of the textual diagnosis could be observed at the onset of the project. Nevertheless, the SCr, eGFR, and KDIGO references were documented more often (Figure 7 and Multimedia Appendix 6). The results for AKI are shown in Figure 8 and Multimedia Appendix 7.

    ‎
    Figure 7. Proportion of positive text mining results in discharge letters of International Classification of Diseases N17/N18–coded cases (acute-on-chronic kidney disease). eGFR: estimated glomerular filtration rate; ICD-10-GM: International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification; KDIGO: Kidney Disease: Improving Global Outcomes.
    View this figure
    ‎
    Figure 8. Proportion of positive text mining results in the discharge letters of International Classification of Diseases N17–coded cases (acute kidney injury). ICD-10-GM: International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification; KI: kidney injury; KDIGO: Kidney Disease: Improving Global Outcomes.
    View this figure

    The effect on SwissDRG income after successful implementation of this approach accounted for a case-mix difference of 198.87 points analyzing the relevant inpatient cases (5877) from February 2020 to July 2020. Multiplied by the current standard base rate (CHF 10,800 [Swiss francs]; US $11,800), this results in CHF 2,147,753 (US $2,337,700) for this period (Table 4).

    Table 4. Delta income of Swiss Diagnosis Related Groups, Inpatient Tariff from February 2020 to July 2020 owing to the automatization of the International Classification of Diseases (ICD) of kidney disease (KD).
    CharacteristicsValues
    Period for inpatient cases02/01/2020 to 07/31/2020
    Cases, N28,314
    Case diagnosesa, n (%)5876 (20.75)
    CMb with ICD, n14,340.08
    CM without ICD, n14,141.21
    Delta CM, n198.87
    Delta Swiss francsc, CHF2,147,752.80d

    aAny ICD diagnosis of KD automatically generated and validated afterward.

    bCM: casemix.

    cStandard base rate USD $11,800.

    dUSD $2,337,700.


    Principal Findings

    After introducing the algorithm to apply AKI or CKD diagnoses, we observed an increase in the number of ICD-coded diagnoses and a shift toward higher precision in the applied stages of the diseases. Correspondingly, the number of unspecifically coded diagnoses (ICD N19-) dropped. Moreover, the documentation also improved (the correct KDIGO staging of CKD for all ICD N18- coded cases was 1.5% in 2014 and 6.3% in 2019).

    Strengths of the Project

    Most studies concerning an algorithm to apply AKI or CKD diagnoses and stages consider only one diagnosis, either AKI or CKD [28,29,31]. As our project combines the 2 diagnostic criteria formulated by the KDIGO for both AKI and CKD, it improves the validity of diagnosis and enables the clinicians to easily recognize acute-on-chronic KD.

    By referring to the same data set when testing for both AKI and CKD diagnoses, consistency could be improved.

    This project established a link to the acknowledged impact on health at discharge by involving a defined process of validation that is conducted by text mining and communication with the clinician for retrospectively defining the exact diagnosis and staging. The process of validation of automatically generated diagnoses resulted in a decrease of unspecific diagnoses both in coding and documentation and therefore had a practical impact on the clinician’s work and on the SwissDRG income.

    Many projects conducted so far have been limited to outpatients, causing a bias when calculating the overall prevalence. In particular, severe stages associated with underlying morbidities treated in inpatient care might not be recognized [10,18,24,34,42,43]. The availability of inpatient and outpatient data from the previous 6 years stored in the Insel Data Platform for all patients offered the advantage of calculating the diagnoses and the disease stages for the inpatients.

    Limitations

    The validation of ICD diagnoses was strongly aimed at ICD codes with an impact on reimbursement, resulting in a bias toward validating cases with potentially higher income. Consecutively, the exact staging of diagnoses was limited to this group. Furthermore, the KDIGO classification of CKD grade 1 could not be considered for technical reasons (no limiting value of eGFR defined by KDIGO). Data on inpatient cases of all Insel Gruppe sites are available only for the years 2017-2019. Therefore, we could neither benchmark outpatient cases nor compare the data with the data of previous years. The study was limited to the description of the impact of the automatization of diagnosis; it was not designed to compare methods concerning the impact of the ACR or to determine the baseline SCr.

    Algorithm and Precision of Diagnosis

    As the data required contains only laboratory results, the time stamp of the taken samples, and a patient and case identifier, the algorithms for both AKI and CKD that are presented here are transferable and ready to use.

    Moreover, the process of diagnosis is facilitated and staging as a time-consuming back-calculation can be automated instead. As the algorithm applies criteria of both diagnoses separately at a specific point of time for the same case, cases with the calculated diagnosis of acute-on-chronic KD can be easily extracted to evaluate an unstable CKD versus AKI in the clinical context.

    A weakness of the algorithm caused by the classifications themselves lies in the definition of CKD grade 1 according to KDIGO and ICD N18.1. As no upper value of eGFR is set, the formal testing of the data produces no sensible results. The diagnosis of CKD stage 1 can be defined only with an effective diagnosis.” [17,38].

    The results displayed show the impact on (1) the increasing number of diagnoses and (2) the increasing precision in staging, documentation, and ICD coding. The higher validity and precision of diagnosis will not only improve the quality of documentation and data but also specific and timely treatment when integrated into a decision support system [30,32,34]. As the findings are translated into ICD-10 codes within the algorithm and the data of diagnosis and stage are stored, as encoded by ICD, the algorithm and the data extracted support international benchmarking and quality control by standardized diagnoses.

    Baseline

    The absence of a shared approach to baseline SCr definitions [22,24,42,44] and an inter- and intraindividual and technical variability has resulted in a variability among centers regarding the interpretations for diagnosis and classification. The use of inpatient creatinine measurements as surrogates for baseline function resulted in misclassification, and the use of a minimum SCr value as a baseline inflated disease incidence [44]. In contrast to an imputed or minimum SCr value, use of the admission SCr value as a baseline resulted in nearly 50% reduction in the reported incidence of AKI compared with that of using a known outpatient baseline value [12,24,25]. This decrease is perhaps best explained by the missed diagnosis of community-acquired AKI that improves during hospitalization. The higher mortality rates observed when using this baseline reflect the bias of using this method, which is only sensitive to AKI that continues to worsen during hospitalization. Because of this lack of joint approach to baseline SCr definitions and lack of other markers, we specified the following to reflect the patients’ premorbid state: either baseline SCr is the lowest value during hospitalization or the arithmetic mean of all outpatient SCr measurements 90 days before the index admission (relying on the lowest value of both methods for diagnosis) is the lowest value.

    The comparability of studies concerning AKI, including this project, might be impaired regarding the baseline definition, a weakness that can only to be resolved by additional consensus criteria to better characterize preadmission AKI and by specifying a standard method to incorporate previously known baseline data. Being aware of the potential inflation of diagnosis when using the lowest inpatient SCr [44], the approach would ensure a higher sensitivity regarding the clinician’s awareness.

    Electronic Health Records

    Integrating data and computer-based entries into electronic health records may support precision, standardization, and decision regarding patients’ health care and lead to a more specific, valid, reliable, and consistent database. Greater data integration may also provide information not only for timely treatment but also disease registries and clinical trials [15,28,30,31,33,34]. Automated decision support based on arithmetic algorithms may be too rigid. Therefore, with the experience gained from this project, we favor an integrated solution that closes the loop between an automated alert and clinicians’ validation. As demonstrated in this study, part of the validation can be automated by text mining to minimize the workload [30]. However, many cases require manual validation. Lack of documentation as seen in the inpatient cases of 2016 (fusion of data and documentation of all Insel Gruppe sites) compromises automatization.

    Lessons Learned and Future Work

    The project will be an important achievement for inpatient and outpatient care, especially with chronic diseases, such as CKD and acute-on-chronic KD and its complex algorithm. As the prevalence of KD is underestimated [7,8,11], the higher validity and precision of diagnosis will not only improve the reliability of documentation and data but will also improve treatment and reimbursement. This will result in the efficiency and quality of the diagnosis process, a higher reliability, and a highly standardized database.

    The difficulty of defining the right baseline for AKI could not finally be solved. Missing values before admission should be addressed and anticipated. Clinicians and other medical experts should be closely involved in the process of setting up requirements and validating diagnoses.

    This project introduced an end-to-end approach to clinical decision support at the Insel Gruppe hospitals.

    Acknowledgments

    The authors would like to thank Matthias Kämpf for supporting the project and for his technical and conceptual expertise; Reto Baumgartner, Nenad Torbica, and Roger Mathis for their technical support; team Medizincontrolling Insel Gruppe Bern for professional support; and Ben von Huenerbein for reviewing the manuscript.

    This interdisciplinary initiative involved the university hospital’s cardiovascular clinic, the Directorate of Technology and Innovation, the Medical Directorate, and the Data Science Center IDSC (Insel Data Science Center) of the Insel University Hospital Bern.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Algorithm for all diagnoses.

    PPTX File , 75 KB
    ‎
    Multimedia Appendix 2

    International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification (ICD-10-GM) code catalogs from 2012 to 2018 that were effective in Switzerland from 2014 to 2020.

    DOCX File , 14 KB
    ‎
    Multimedia Appendix 3

    Counts of cases with N17 coded.

    DOCX File , 15 KB
    ‎
    Multimedia Appendix 4

    Counts of cases with N18, N19, acute-on-chronic, unspecified kidney injury, and kidney disease (KI/KD) coded.

    DOCX File , 14 KB
    ‎
    Multimedia Appendix 5

    Proportion of International Classification of Diseases (ICD)–coded cases N18- with documentation in the discharge letter.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 6

    Proportion of International Classification of Diseases (ICD)–coded cases N17- and 18- acute-on-chronic with documentation in discharge letter.

    DOCX File , 13 KB
    ‎
    Multimedia Appendix 7

    Proportion of International Classification of Diseases (ICD)–coded cases N17- with documentation in the discharge letter.

    DOCX File , 14 KB
    1. Entezarjou A, Bonamy AE, Benjaminsson S, Herman P, Midlöv P. Human- versus machine learning-based triage using digitalized patient histories in primary care: comparative study. JMIR Med Inform 2020 Sep 03;8(9):e18930 [FREE Full text] [CrossRef] [Medline]
    2. Kalatharan V, McArthur E, Nash DM, Welk B, Sarma S, Garg AX, et al. Diagnostic accuracy of administrative codes for autosomal dominant polycystic kidney disease in clinic patients with cystic kidney disease. Clin Kidney J 2021 Feb;14(2):612-616 [FREE Full text] [CrossRef] [Medline]
    3. Pellathy T, Saul M, Clermont G, Dubrawski AW, Pinsky MR, Hravnak M. Accuracy of identifying hospital acquired venous thromboembolism by administrative coding: implications for big data and machine learning research. J Clin Monit Comput 2021 Feb 08;10 (forthcoming). [CrossRef] [Medline]
    4. Cerullo E, Quinn TJ, McCleery J, Vounzoulaki E, Cooper NJ, Sutton AJ. Interrater agreement in dementia diagnosis: a systematic review and meta-analysis. Int J Geriatr Psychiatry 2021 Aug;36(8):1127-1147. [CrossRef] [Medline]
    5. Waikar SS, Wald R, Chertow GM, Curhan GC, Winkelmayer WC, Liangos O, et al. Validity of International Classification of Diseases, Ninth Revision, clinical modification codes for acute renal failure. J Am Soc Nephrol 2006 Jun;17(6):1688-1694 [FREE Full text] [CrossRef] [Medline]
    6. Tomlinson LA, Riding AM, Payne RA, Abel GA, Tomson CR, Wilkinson IB, et al. The accuracy of diagnostic coding for acute kidney injury in England - a single centre study. BMC Nephrol 2013 Mar 13;14:58 [FREE Full text] [CrossRef] [Medline]
    7. Mills KT, Xu Y, Zhang W, Bundy JD, Chen C, Kelly TN, et al. A systematic analysis of worldwide population-based data on the global burden of chronic kidney disease in 2010. Kidney Int 2015 Nov;88(5):950-957 [FREE Full text] [CrossRef] [Medline]
    8. Bikbov B, Purcell C, Levey A, Smith M, Abdoli A, Abebe M, et al. Global, regional, and national burden of chronic kidney disease, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. The Lancet 2020 Feb;395(10225):709-733. [CrossRef]
    9. Hoste EA, Bagshaw SM, Bellomo R, Cely CM, Colman R, Cruz DN, et al. Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study. Intensive Care Med 2015 Aug;41(8):1411-1423. [CrossRef] [Medline]
    10. Sawhney S, Fraser SD. Epidemiology of AKI: utilizing large databases to determine the burden of AKI. Adv Chronic Kidney Dis 2017 Jul;24(4):194-204 [FREE Full text] [CrossRef] [Medline]
    11. Saran R, Robinson B, Abbott KC, Agodoa LY, Bragg-Gresham J, Balkrishnan R, et al. US Renal Data System 2018 annual data report: epidemiology of kidney disease in the United States. Am J Kidney Dis 2019 Mar;73(3 Suppl 1):A7-A8. [CrossRef] [Medline]
    12. Coca SG, Yusuf B, Shlipak MG, Garg AX, Parikh CR. Long-term risk of mortality and other adverse outcomes after acute kidney injury: a systematic review and meta-analysis. Am J Kidney Dis 2009 Jun;53(6):961-973 [FREE Full text] [CrossRef] [Medline]
    13. Bello AK, Alrukhaimi M, Ashuntantang GE, Basnet S, Rotter RC, Douthat WG, et al. Complications of chronic kidney disease: current state, knowledge gaps, and strategy for action. Kidney Int Suppl (2011) 2017 Oct;7(2):122-129 [FREE Full text] [CrossRef] [Medline]
    14. Indicator details: all cause mortality rates by eGFR category/stage. Centers for Disease Control and Prevention.   URL: https://nccd.cdc.gov/CKD/detail.aspx?Qnum=Q185#refreshPosition [accessed 2021-12-26]
    15. Liu KD, Forni LG, Heung M, Wu V, Kellum JA, Mehta RL, Acute Disease Quality Initiative Investigators. Quality of care for acute kidney disease: current knowledge gaps and future directions. Kidney Int Rep 2020 Oct;5(10):1634-1642 [FREE Full text] [CrossRef] [Medline]
    16. Kellum JA, Lameire N, Aspelin P, Barsoum RS, Burdmann EA, Goldstein SL, et al. Kidney disease: improving global outcomes (KDIGO) acute kidney injury work group. KDIGO clinical practice guideline for acute kidney injury. Kidney Int Supplements 2012 Mar;2(1):1-138 [FREE Full text]
    17. Eknoyan G, Lameire N. KDIGO 2012 clinical practice guideline for the evaluation and management of chronic kidney disease. Official J Int Soc Nephrol 2013 Jan;3(1) [FREE Full text]
    18. Zappitelli M, Parikh CR, Akcan-Arikan A, Washburn KK, Moffett BS, Goldstein SL. Ascertainment and epidemiology of acute kidney injury varies with definition interpretation. Clin J Am Soc Nephrol 2008 Jul;3(4):948-954 [FREE Full text] [CrossRef] [Medline]
    19. Siew ED, Matheny ME, Ikizler TA, Lewis JB, Miller RA, Waitman LR, et al. Commonly used surrogates for baseline renal function affect the classification and prognosis of acute kidney injury. Kidney Int 2010 Mar;77(6):536-542 [FREE Full text] [CrossRef] [Medline]
    20. Bernier-Jean A, Beaubien-Souligny W, Goupil R, Madore F, Paquette F, Troyanov S, et al. Diagnosis and outcomes of acute kidney injury using surrogate and imputation methods for missing preadmission creatinine values. BMC Nephrol 2017 Apr 28;18(1):141 [FREE Full text] [CrossRef] [Medline]
    21. Liu KD, Hsu C, Yang J, Tan TC, Zheng S, Ordonez JD, et al. Acute kidney injury ascertainment is affected by the use of first inpatient versus outpatient baseline serum creatinine. Kidney Int Rep 2018 Jan;3(1):211-215 [FREE Full text] [CrossRef] [Medline]
    22. Siew ED, Matheny ME. Choice of reference serum creatinine in defining acute kidney injury. Nephron 2015;131(2):107-112 [FREE Full text] [CrossRef] [Medline]
    23. Levey A, Inker L. Assessment of glomerular filtration rate in health and disease: a state of the art review. Clin Pharmacol Ther 2017 Sep;102(3):405-419. [CrossRef] [Medline]
    24. Lafrance J, Miller DR. Defining acute kidney injury in database studies: the effects of varying the baseline kidney function assessment period and considering CKD status. Am J Kidney Dis 2010 Oct;56(4):651-660. [CrossRef] [Medline]
    25. De Rosa S, Samoni S, Ronco C. Creatinine-based definitions: from baseline creatinine to serum creatinine adjustment in intensive care. Crit Care 2016 Mar 15;20:69 [FREE Full text] [CrossRef] [Medline]
    26. Björk J, Nyman U, Larsson A, Delanaye P, Pottel H. Estimation of the glomerular filtration rate in children and young adults by means of the CKD-EPI equation with age-adjusted creatinine values. Kidney Int 2021 Apr;99(4):940-947 [FREE Full text] [CrossRef] [Medline]
    27. Hsu C, Yang W, Parikh RV, Anderson AH, Chen TK, Cohen DL, CRIC Study Investigators. Race, genetic ancestry, and estimating kidney function in CKD. N Engl J Med 2021 Nov 04;385(19):1750-1760. [CrossRef] [Medline]
    28. Al-Jaghbeer M, Dealmeida D, Bilderback A, Ambrosino R, Kellum JA. Clinical decision support for in-hospital AKI. J Am Soc Nephrol 2018 Feb;29(2):654-660 [FREE Full text] [CrossRef] [Medline]
    29. Howarth M, Bhatt M, Benterud E, Wolska A, Minty E, Choi K, et al. Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury. BMC Med Inform Decis Mak 2020 Nov 04;20(1):287 [FREE Full text] [CrossRef] [Medline]
    30. Hoste EA, Kashani K, Gibney N, Wilson FP, Ronco C, Goldstein SL, 15 ADQI Consensus Group. Impact of electronic-alerting of acute kidney injury: workgroup statements from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis 2016 Feb 26;3:10 [FREE Full text] [CrossRef] [Medline]
    31. James MT, Hobson CE, Darmon M, Mohan S, Hudson D, Goldstein SL, Acute Dialysis Quality Initiative (ADQI) Consensus Group. Applications for detection of acute kidney injury using electronic medical records and clinical information systems: workgroup statements from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis 2016 Feb 26;3:9 [FREE Full text] [CrossRef] [Medline]
    32. Mohamadlou H, Lynn-Palevsky A, Barton C, Chettipally U, Shieh L, Calvert J, et al. Prediction of acute kidney injury with a machine learning algorithm using electronic health record data. Can J Kidney Health Dis 2018 Jun 8;5:2054358118776326 [FREE Full text] [CrossRef] [Medline]
    33. Holmes J, Rainer T, Geen J, Roberts G, May K, Wilson N, Welsh AKI Steering Group. Acute kidney injury in the era of the AKI E-Alert. Clin J Am Soc Nephrol 2016 Dec 07;11(12):2123-2131 [FREE Full text] [CrossRef] [Medline]
    34. Siew ED, Basu RK, Wunsch H, Shaw AD, Goldstein SL, Ronco C, 15th ADQI Consensus Group. Optimizing administrative datasets to examine acute kidney injury in the era of big data: workgroup statement from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis 2016 Feb 26;3:12 [FREE Full text] [CrossRef] [Medline]
    35. Selby NM, Hill R, Fluck RJ, NHS England 'Think Kidneys' AKI Programme. Standardizing the early identification of acute kidney injury: the NHS England national patient safety alert. Nephron 2015;131(2):113-117 [FREE Full text] [CrossRef] [Medline]
    36. Acute Kidney Injury (AKI) algorithm. NHS England.   URL: https://www.england.nhs.uk/akiprogramme/aki-algorithm/ [accessed 2021-12-26]
    37. Fiedler GM, Vogt B. [Laboratory tests for kidney disease]. Internist (Berl) 2019 May;60(5):485-501. [CrossRef] [Medline]
    38. Klassifikationen, Terminologien und Standards im Gesundheitswesen. Bundesinstitut für Arzneimittel und Medizinprodukt.   URL: https://www.dimdi.de/dynamic/de/klassifikationen/ [accessed 2021-12-26]
    39. Instrumente zur medizinischen Kodierung. Bundesamt für Statistik.   URL: https:/​/www.​bfs.admin.ch/​bfs/​de/​home/​statistiken/​gesundheit/​nomenklaturen/​medkk/​instrumente-medizinische-kodierung.​html [accessed 2021-12-26]
    40. Rosa SE, Prowle J, Samoni S, Villa G, Ronco C. Acute kidney injury in patients with chronic kidney disease. In: Critical Care Nephrology (Third Edition). Amsterdam, Netherlands: Elsevier Inc; 2019.
    41. Venkatachalam MA, Griffin KA, Lan R, Geng H, Saikumar P, Bidani AK. Acute kidney injury: a springboard for progression in chronic kidney disease. Am J Physiol Renal Physiol 2010 May;298(5):F1078-F1094 [FREE Full text] [CrossRef] [Medline]
    42. Makris K, Spanou L. Acute kidney injury: diagnostic approaches and controversies. Clin Biochem Rev 2016 Dec;37(4):153-175 [FREE Full text] [Medline]
    43. Mehta R, Bihorac A, Selby NM, Quan H, Goldstein SL, Kellum JA, Acute Dialysis Quality Initiative (ADQI) Consensus Group. Establishing a continuum of acute kidney injury - tracing AKI using data source linkage and long-term follow-up: workgroup statements from the 15th ADQI consensus conference. Can J Kidney Health Dis 2016;3:13 [FREE Full text] [CrossRef] [Medline]
    44. Cooper DJ, Plewes K, Grigg MJ, Patel A, Rajahram GS, William T, et al. An evaluation of commonly used surrogate baseline creatinine values to classify AKI during acute infection. Kidney Int Rep 2021 Mar;6(3):645-656 [FREE Full text] [CrossRef] [Medline]

    ‎
    ACR: albumin creatinine ratio
    AKI: acute kidney injury
    CKD: chronic kidney disease
    CKD-EPI: Chronic Kidney Disease Epidemiology Collaboration
    eGFR: estimated glomerular filtration rate
    GFR: glomerular filtration rate
    ICD: International Classification of Diseases
    ICD-10-GM: International Statistical Classification of Diseases and Related Health Problems, 10th revision, German Modification
    KD: kidney disease
    KDIGO: Kidney Disease: Improving Global Outcomes
    NHS: National Health Service
    SCr: serum creatinine
    SwissDRG: Swiss Diagnosis Related Groups, Inpatient Tariff

    Edited by C Lovis; submitted 20.06.21; peer-reviewed by T Ntalindwa, X Cheng, D Sengupta; comments to author 31.07.21; revised version received 14.10.21; accepted 14.11.21; published 25.01.22

    Copyright

    ©Karen Triep, Alexander Benedikt Leichtle, Martin Meister, Georg Martin Fiedler, Olga Endrich. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 25.01.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.