This paper is in the following e-collection/theme issue:

Machine Learning (1348) Artificial Intelligence (1131) Imaging Informatics (175)

Published on in Vol 8, No 11 (2020): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/23472, first published .
Deep Learning–Based Detection of Early Renal Function Impairment Using Retinal Fundus Images: Model Development and Validation

Deep Learning–Based Detection of Early Renal Function Impairment Using Retinal Fundus Images: Model Development and Validation

Deep Learning–Based Detection of Early Renal Function Impairment Using Retinal Fundus Images: Model Development and Validation

Authors of this article:

Eugene Yu-Chuan Kang1, 2 Author Orcid Image ;   Yi-Ting Hsieh3 Author Orcid Image ;   Chien-Hung Li4 Author Orcid Image ;   Yi-Jin Huang4 Author Orcid Image ;   Chang-Fu Kuo2, 5 Author Orcid Image ;   Je-Ho Kang6 Author Orcid Image ;   Kuan-Jen Chen1, 2 Author Orcid Image ;   Chi-Chun Lai1, 2 Author Orcid Image ;   Wei-Chi Wu1, 2 Author Orcid Image ;   Yih-Shiou Hwang1, 2 Author Orcid Image
Article Authors Cited by (23) Tweetations (1) Metrics

    Original Paper

    1Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan

    2College of Medicine, Chang Gung University, Taoyuan, Taiwan

    3Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan

    4Acer Healthcare Incorporated, New Taipei, Taiwan

    5Center for Artificial Intelligence in Medicine, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan

    6Department of Nephrology, Yang Ming Hospital, Taoyuan, Taiwan

    Corresponding Author:

    Yih-Shiou Hwang, MD, PhD

    Department of Ophthalmology

    Chang Gung Memorial Hospital, Linkou Medical Center

    No. 5, Fu-Hsin Rd.

    Taoyuan, 333

    Taiwan

    Phone: 886 3 3281200 ext 8666

    Fax:886 3 3287798

    Email: yihshiou.hwang@gmail.com


    Background: Retinal imaging has been applied for detecting eye diseases and cardiovascular risks using deep learning–based methods. Furthermore, retinal microvascular and structural changes were found in renal function impairments. However, a deep learning–based method using retinal images for detecting early renal function impairment has not yet been well studied.

    Objective: This study aimed to develop and evaluate a deep learning model for detecting early renal function impairment using retinal fundus images.

    Methods: This retrospective study enrolled patients who underwent renal function tests with color fundus images captured at any time between January 1, 2001, and August 31, 2019. A deep learning model was constructed to detect impaired renal function from the images. Early renal function impairment was defined as estimated glomerular filtration rate <90 mL/min/1.73 m2. Model performance was evaluated with respect to the receiver operating characteristic curve and area under the curve (AUC).

    Results: In total, 25,706 retinal fundus images were obtained from 6212 patients for the study period. The images were divided at an 8:1:1 ratio. The training, validation, and testing data sets respectively contained 20,787, 2189, and 2730 images from 4970, 621, and 621 patients. There were 10,686 and 15,020 images determined to indicate normal and impaired renal function, respectively. The AUC of the model was 0.81 in the overall population. In subgroups stratified by serum hemoglobin A1c (HbA1c) level, the AUCs were 0.81, 0.84, 0.85, and 0.87 for the HbA1c levels of ≤6.5%, >6.5%, >7.5%, and >10%, respectively.

    Conclusions: The deep learning model in this study enables the detection of early renal function impairment using retinal fundus images. The model was more accurate for patients with elevated serum HbA1c levels.

    JMIR Med Inform 2020;8(11):e23472

    doi:10.2196/23472

    Keywords

    deep learning; renal function; retinal fundus image; diabetes; renal; kidney; retinal; eye; imaging; impairment; detection; development; validation; model 


    Background

    Chronic kidney disease (CKD) is defined as a gradual loss of renal function, and it can progress to an advanced stage, termed end-stage renal disease (ESRD). According to the 2016 annual report of the US Renal Data System [1], the incidence of treated ESRD increased gradually at the rate of 2%-4% from 2003 to 2016 in almost one-third of all countries [1]. Taiwan, in particular, had the highest incidence of treated ESRD (493 patients per million in the general population) and the highest prevalence of treated ESRD (3392 patients per million in the general population) among all countries worldwide [1]. According to Taiwan’s National Health Insurance 2018 report [2], CKD incurred the highest medical costs in the country, approximately US $1.7 billion. Therefore, progress is required in the prevention and screening of kidney disease in Taiwan. In all the etiologies of CKD, diabetes is a leading cause; it has been estimated that 1 in 4 adults with diabetes have impaired renal function [3]. Therefore, the monitoring of renal function is especially important for patients with diabetes; it is also crucial in countries where ESRD is prevalent.

    With the increasing sophistication of artificial intelligence, deep learning has been increasingly applied to various types of medical imaging analysis, especially ophthalmology imaging [4]. Among ophthalmology imaging techniques, retinal imaging has been used to establish deep learning models for detecting not only eye diseases (eg, diabetic retinopathy and glaucoma) [5,6] but also systemic cardiovascular risks [7]. The microvascular network in the retina can be easily observed; it is structurally and physiologically similar to the vascular structures of many other systems or organs and can be used in the evaluation of various disorders, including systemic hypertension, coronary artery disease, and central nervous disorders [8-10]. Studies have also demonstrated that changes in the retinal vasculature are associated with renal dysfunction and reduced estimated glomerular filtration rate (eGFR) [11,12].

    Objective

    Scholars have recommended applying artificial intelligence to the management and prevention of kidney disease [13]. However, few studies have developed deep learning–based methods for detecting early renal function impairment from retinal images. Therefore, we established a deep learning model to detect early renal function impairment from retinal fundus images. We also evaluated the performance of our model when applied to patients with diabetes.


    Study Population

    In this retrospective study, we included patients who underwent retinal fundus imaging examinations and laboratory tests at any time between January 1, 2001, and August 31, 2019, at Chang Gung Memorial Hospital (CGMH), Linkou Medical Center, Taoyuan, Taiwan. The retinal fundus images were taken with fundus cameras (Topcon Medical Systems, KOWA, and Digital Non-Mydriatic Retinal Camera, Canon). The laboratory tests conducted for serum creatinine and serum hemoglobin A1c (HbA1c) were respectively performed with a colorimetric method and high-performance liquid chromatography at the CGMH Department of Laboratory Medicine. Demographic data, including those on age and sex, were also retrieved from CGMH’s electronic medical record system. This study was approved by the CGMH Institutional Review Board (CGMH IRB No. 201901544B0), and the requirement for informed consent was waived because patient data were deidentified. The study was conducted in accordance with the Declaration of Helsinki.

    Data Management

    After the data were retrieved, retinal fundus images were linked to the corresponding renal functions, which were measured by eGFR. In our study, the eGFR was calculated using the Modification of Diet in Renal Disease (MDRD) equation, which includes the patient’s age, sex, and serum creatinine, as revised by Levey et al [14]. We defined early renal function impairment as eGFR <90 mL/min/1.73 m2, which was equal to or more severe than the mildly decreased glomerular filtration rate according to the definition published in the 2012 guidelines of “Kidney Disease: Improving Global Outcomes” [15]. We only included laboratory tests that had been conducted within 3 months before or after the corresponding retinal fundus images were captured. Patients without available serum creatinine results were excluded. We deidentified the data after the images and laboratory data were linked. Subsequently, we excluded retinal fundus images that had color filters, were merged, or were neither macula- nor disk-centered. For an image to be included, both the macula and disk were required to be visible. We also excluded poor-quality images, such as those that had a low resolution, were out of focus, had a large halo, or had a large shadow. Multimedia Appendix 1 presents some examples of the excluded images.

    Model Architecture

    The model architecture is illustrated in Figure 1. To reduce the variation of illumination and camera resolution between the different retinal images, all images were processed using the method proposed by Graham [16]. All images were resized to a resolution of 224 × 224 × 3 and were processed to reduce variance in illumination between images before running the algorithm. For the convolutional neural network (CNN), we selected VGG-19 formulated by the Visual Geometry Group [17]. We selected VGG-19 because it exhibited the best performance in our preliminary model training relative to ResNet, Inception V3, and Inception V4. Furthermore, in previous research, VGG-19 exhibited comparable performance to other deeper CNNs in medical imaging analysis in general and in ophthalmological imaging in particular [18]. After the CNN retrieved the image feature, a batch normalization layer was added to accelerate training, and the features were flattened to 1-dimensional vectors. Subsequently, we added 3 fully connected layers that had a nonlinear rectified linear unit (ReLU) activation function and 1 final output layer with the softmax activation function. The results were classified results into 2 classes—class 0 and 1, which represented normal and impaired renal function, respectively. The probability for each class was presented. As presented in Figure 1, the probability of disease was 0.76, and a saliency map was generated based on the features marked as determinative for the detection of renal function impairment.

    ‎
    Figure 1. Architecture of the model for detecting early renal function impairment from retinal fundus images. ReLU: rectified linear unit.
    View this figure

    Model Training and Performance

    The data sets of all patients were partitioned into nonoverlapping training, validation, and testing sets at an 8:1:1 ratio, and the images from each patient were linked to the corresponding renal function results. The model was trained, validated, and tested on the basis of the images. The model was trained on a workstation with an Intel Xeon Silver 4110 CPU at 2.10 GHz, a NVIDIA GeForce GTX 1080 Ti (with 11 GB of video memory) graphics card, and 125 GB of RAM. For this model, the learning rate and batch size were set as 0.000005 and 32, respectively. An Adam optimizer was used, and the model was trained up to 120 epochs. The model was established based on the achievement of maximum accuracy and minimum loss in the validation set. The learning curve of the model is presented in Multimedia Appendix 2. To analyze the model prediction, we generated saliency maps (Figure 1), which identified the region of the retinal fundus photo that contributed to the model’s determination of renal function impairment. We also classified the testing set according to the patient’s HbA1c levels. Furthermore, the model performance was evaluated at HbA1c levels of ≤6.5%, >6.5%, >7.5%, and >10.0% in the testing data set.

    Statistical Analysis

    For the demographic data, continuous variables were expressed in terms of the mean (SD). Chi-square tests and t tests were conducted for descriptive analyses of categorical (sex) and continuous (age and HbA1c) variables, respectively. To analyze the performance of our model, receiver operating characteristic (ROC) curves were plotted, and the area under the curve (AUC) for each ROC curve was calculated. AUC values of 0.7-0.8 and >0.8 indicated acceptable discrimination and excellent discrimination, respectively. An AUC value of 1 represented perfect discrimination, and AUC value of 0.5 represented no or random discrimination [19]. We also measured the sensitivity, specificity, positive predictive value (PPV), and accuracy of the model. Model performance was evaluated using the images in the testing set. Statistical significance was indicated if P<.05. Statistical analyses were conducted using SPSS (Version 23, IBM Corp).


    Demographic Characteristics

    In this study, we initially included 7167 patients with 51,666 retinal fundus images. We then excluded 13.32% (955/7167) patients and 50.24% (25,960/51,666) images after applying the exclusion criteria. The remaining 25,706 retinal fundus images from 6212 patients were included in the final analysis, and each patient may have a different number of images. The variance was 1 to 33 images per patient. The training, validation, and testing sets comprised 20,787, 2189, and 2730 images from 4970, 621, and 621 patients, respectively (Table 1).

    Table 1. Distribution of patients with clinical information in the training, validation, and testing groups.
    CharacteristicTotal (N=6212)Training (n=4970)Validation (n=621)Testing (n=621)
    Sex, n (%)

    		Male3363 (54.14)2689 (54.10)339 (54.6)335 (53.9)

    		Female2849 (45.86)2281 (45.90)282 (45.4)286 (46.1)
    Age (years), mean (SD)57.6 (16.6)58.7 (15.9)51.0 (19.1)51.6 (17.4)
    eGFRa (ml/min/1.73 m2), mean (SD)78.6 (32.6)77.8 (32.2)86.5 (34.1)80.4 (35.6)
    HbA1cb (%), mean (SD)7.6 (2.0)7.6 (1.9)7.6 (1.8)7.9 (2.1)

    aeGFR: estimated glomerular filtration rate.

    bHbA1c: hemoglobin A1c.

    Each patient was randomly assigned to a group, and all images from a patient belonged only to the group the patient was assigned to. With regard to demographic characteristics, 54.14% (3363/6212) of the patients were male, and the mean age of all patients was 57.6 (SD 16.6) years. As for clinical characteristics, the mean eGFR and serum HbA1c levels were 78.6 mL/min/1.73 m2 (SD 32.6) and 7.6% (SD 2.0%), respectively. Table 2 presents the clinical information for normal and impaired renal function (eGFR <90 mL/min/1.73 m2) in our study population.

    Table 2. Clinical information of patients with normal or impaired renal function (N=6212); all P values are <.001.
    CharacteristicNormal renal function (n=3108)Impaired renal function (n=3104)
    Sex, n (%)

    		Male1539 (49.52)1824 (58.76)

    		Female1569 (50.48)1280 (41.24)
    Age (years), mean (SD)47.2 (16.1)64.1 (13.1)
    HbA1ca (%), mean (SD)7.7 (2.1)7.5 (1.9)

    aHbA1c: hemoglobin A1c.

    Compared with patients with healthy renal function, patients with impaired renal function were more likely to be male (impaired vs healthy: 58.3% vs 49.1%; P<.001), older adults (64.1 years vs 47.2 years; P<.001), and with a lower serum HbA1c level (7.5% vs 7.7%; P<.001). Multimedia Appendix 3 shows the clinical information in patients with stratified HbA1c levels in the testing set.

    Model Performance

    The ROC curves obtained from tests of our model are presented in Figure 2. Model performance for subgroups stratified by serum HbA1c level was also tested. Model performance increased gradually with serum HbA1c level.

    ‎
    Figure 2. ROC curves for the model in detecting early renal function impairment in different groups of patients. ROC curves for (A) all patients (AUC = 0.81, sensitivity = 0.83, specificity = 0.62, PPV = 0.73, accuracy = 0.73); (B) patients with HbA1c ≤ 6.5% (AUC = 0.81, sensitivity = 0.84, specificity = 0.62, PPV = 0.77, accuracy = 0.75), (C) patients with HbA1c > 6.5% (AUC = 0.84, sensitivity = 0.89, specificity = 0.61, PPV = 0.77, accuracy = 0.77), (D) patients with HbA1c > 7.5% (AUC = 0.85, sensitivity = 0.89, specificity = 0.60, PPV = 0.82, accuracy = 0.79), and (E) patients with HbA1c > 10.0% (AUC = 0.87, sensitivity = 0.89, specificity = 0.61, PPV = 0.77, accuracy = 0.77). AUC: area under the curve; HbA1c: hemoglobin A1c; PPV: positive predictive value; ROC: receiver operating characteristic.
    View this figure

    Saliency Maps

    Representative saliency maps are presented in Figure 3, where the regions responsible for the prediction of impaired renal function are highlighted in the lighter color. In Figure 3, the retinal-vessel features are marked for a true-positive case with a relatively normal retinal fundus image. Common signs of retina abnormality, such as exudation, hemorrhage, and drusen, also played a role in the detection of renal function impairment.

    ‎
    Figure 3. Selected retinal fundus images and their corresponding saliency maps in true-negative and true-positive cases. (A) No renal function impairment detected. Patient’s eGFR = 102.6 mL/min/1.73 m2 and HbA1c = 13.4%. (B) Renal function impairment detected. Patient’s eGFR = 40.0 mL/min/1.73 m2 and HbA1c = 5.1%. (C) Renal function impairment detected. Patient’s eGFR = 50 mL/min/1.73 m2 and HbA1c = 6.5%. (D) Renal function impairment detected. Patient’s eGFR = 80.5 mL/min/1.73 m2 and HbA1c = 7.3%. (E) Renal function impairment detected. Patient’s eGFR = 67.7 ml/min/1.73 m2 and HbA1c = 8.9%. eGFR: estimated glomerular filtration rate; HbA1c: hemoglobin A1c.
    View this figure

    Main Findings

    In this study, we developed a deep learning model for detecting early renal function impairment from retinal fundus images. The AUC of the model was 0.81 for the detection of early renal function impairment in the general population, and the model performed better when applied to patients with diabetes or patients with elevated serum HbA1c levels.

    Importance of Renal Function Screening

    The 2016 annual report of the US Renal Data System [1] notes that ESRD is becoming increasingly prevalent in many countries, underscoring the increased burdens of CKD and ESRD on society. Taiwan has a high incidence and prevalence of CKD and ESRD, and the country bears significant health care burden associated with CKD and ESRD [1,2]. Thus, several studies in Taiwan have evaluated the etiology and screening of kidney diseases [20,21]. In Taiwan, CKD prevention has been hampered by low public awareness, infrequent eGFR measurements, and delayed referrals [22,23]. Although a study suggested the importance of comprehensive renal function screening in high-risk populations, such as patients with diabetes [15], evidence for the cost-effectiveness and benefits of routine screening for CKD remain inconclusive because commonly used tests with urine or blood are inconvenient and invasive [24].

    Deep Learning in Renal Function Using Ultrasonography

    Deep learning methods provide a potential solution to this problem. With the increasing sophistication of artificial intelligence, deep learning has been increasingly applied in various fields, including medicine [25]. The use of artificial intelligence for management of kidney disease has been recently proposed, and its potential has been well recognized by physicians [13]. Kuo et al [26] developed a deep learning model for predicting renal function by using kidney ultrasound images. Their model was more accurate (0.86) in detecting cases with eGFR <60 mL/min/1.73 m2 than the judgments of experienced nephrologists (0.60-0.80). Although our model had lower overall accuracy (0.73 for all patients and 0.79 for patients with HbA1c > 7.5%) relative to theirs, our model’s accuracy is still comparable with that of the judgments of experienced nephrologists employing ultrasound images. Moreover, our model could detect early renal function impairment with eGFR <90 mL/min/1.73 m2, a functionality that was not evaluated by Kuo et al [26].

    Deep Learning Using Retinal Fundus Images

    Retinal fundus imaging can be executed even by untrained medical staff and has high accessibility. Furthermore, a patient’s retinal fundus images can be captured in less than 10 minutes, and the patient can be promptly referred to a specialist if a problem is detected [27]. A previous review on deep learning in ophthalmology noted that retinal fundus images can be used to identify several eye diseases, including glaucoma, macular degeneration, refractive errors, and, most importantly, diabetic retinopathy [18]. Furthermore, systemic cardiovascular risks can also be determined from retinal images [7]. Those results suggest the potential of using retinal photography for large-scale disease screening.

    Using Retinal Fundus Images for Renal Function Prediction

    In our study, we developed a deep learning model to detect early renal function impairment. The model had excellent discrimination (AUC=0.81; excellent discrimination was defined as AUC >0.8) [19]. The saliency maps revealed that features in retinal vasculature and of hemorrhages and exudations were influential in the determination of impaired renal function. This finding is compatible with the findings of previous reports on specific retinal microvascular and structural changes in renal function impairment [11,28]. When applied to patients with diabetes, our model had a sensitivity as high as 0.89 but a specificity of only 0.60. We noted that our model produced several false positives for patients who shared some similar ophthalmic pathologies presenting on the fundus images. These pathologies included subretinal fluid, optic disc swelling caused by optic neuritis, and retinal scarring (Multimedia Appendix 4). However, no robust association between these pathologies and renal function is indicated in the literature. As noted in the saliency maps, the model identified retinal vessel characteristics and the presence of hemorrhage and exudation. Subretinal fluid and optic disc swelling may alter retinal vascular features and thus affect the model prediction. Ocular infection or inflammation was also presented with retinal vascular change, hemorrhage, exudation, and pigmented scars [29], which may be similar to the retinal presentation of impaired renal function. Therefore, these coexisting ocular pathologies may have reduced model specificity. For future studies on deep learning, we suggest the use of multimodal retinal images to predict renal function impairment; the analysis of multimodal retinal images has been reported to yield greater accuracy in diagnosing age-related macular degeneration [30].

    Comparison of Model Performance in Diabetes and Between the Previous Study

    Our model had a greater AUC and sensitivity for higher HbA1c levels (up to AUC=0.87 for HbA1c >10%). Some possible explanations for this performance include more profound microvascular damage in patients with worse glucose control and the coexistence of signs of diabetic retinopathy and diabetic nephropathy, which were noted to be significantly associated [31,32]. A deep learning algorithm was recently formulated by a research group at the Singapore National Eye Center (SNEC) [33]. Their algorithm was used to detect CKD with eGFR <60 mL/min/1.73 m2 by using both retinal images and risk factors, individually and in combination, in 3 population-based screening databases from Singapore and China [33]. Their image-based model had an AUC of 0.91 in their internal validation (Singapore Epidemiology of Eye Diseases database), AUCs of 0.73 and 0.84 in their external testing (Singapore Prospective Study Program and Beijing Eye Study, respectively), and an AUC of 0.89 when applied in patients with diabetes. The overall performance of our model (AUC=0.81) is in between the performance levels of their model in their internal validation and external testing. This difference in performance is attributable to differences in patient characteristics or model architecture. Our hospital is a referral medical center with comprehensive ophthalmology equipment for the management of advanced eye diseases [34]. Compared with population-based screening databases, our database featured more patients with pathologies on the retina or other parts of the eye, which may have increased the likelihood of model misdiagnosis [35]. In addition, the model was trained using images from 1 of 3 types of fundus cameras and 1 of 2 different image formats (JPEG or PNG). This variety likely affected the predictive performance of the model. Specifically, when our model was applied to the subgroup of patients with diabetes, its performance (AUC = 0.84 in HbA1c >6.5%, 0.85 in HbA1c >7.5%, and 0.87 in HbA1c >10.0%) was comparable to that of the SNEC model.

    Study Limitations

    Our study has some limitations. First, the results of the MDRD formula for calculating eGFR did not reflect definite renal function; variations related to ethnicity have been reported, and this measure was noted to be less accurate when applied to the Taiwanese population [21,36]. Second, as we aimed to detect early renal function impairment (ie, eGFR <90 mL/min/1.73 m2), we did not test the efficacy of our model in predicting advanced kidney diseases. Third, we discarded poor-quality fundus images before training the model. However, poor-quality images are encountered in clinical settings, and model performance may thus be affected by factors such as patient cooperation and medial opacities of the eye and small pupils [27]. Although retinal fundus imaging is a relatively accessible test, the feasibility of our model in real-world applications requires further investigation. Fourth, the model’s detection of renal function may be affected by signs from some ocular diseases that are related to neither systemic vascular function nor renal function. For example, certain retinal infections may alter the model’s prediction of renal function impairment; such infections are not associated with systemic vascular function but share a common feature, namely the presence of hemorrhages or exudates on the retina. By contrast, renal function impairment with nonvascular causes, such as urinary tract obstruction, may not present vasculature or retinal abnormality in fundus images during the early disease phase. In our study, selection bias may have occurred in the subpopulation with a referral medical center. This subpopulation has a higher proportion of patients with ocular diseases coexisting with other organic diseases. Fifth, we did not perform patient-matching between the training, validation, and testing groups. Thus, differences in clinical characteristics may have affected the learning and performance of the model. Finally, the function of this model lies in screening rather than diagnosis. A thorough kidney examination that includes ultrasonography and insulin clearance remains crucial.

    Conclusion

    In conclusion, our study formulated and evaluated a deep learning model for predicting early renal function impairment. Our model also performed better, as indicated by the increased AUC, when applied to patients with diabetes or patients with elevated serum HbA1c levels. Color fundus images are easy to obtain and can thus be feasibly applied to the detection of early renal function impairment, especially in patients with diabetes, in conjunction with our model.

    Acknowledgments

    The authors thank Acer Healthcare, Taiwan for providing technical support. The authors also thank Miranda Chun-Ya Kang and Wallace Academic Editing for English editing. This study was funded by research grants from the National Science Council, Taiwan (MOST 105-2314-B-182A-076 and MOST 106-2314-B-182A-045 -MY3), and Chang Gung Memorial Hospital, Taiwan (CMRPG3C0171). The founding organizations had no role in the interpretation of the study results.

    Authors' Contributions

    EYCK, CCL, WCW, and YSH contributed to the conception and design of the study. Data were collected by CFK, KJC, CCL, WCW, and YSH. Data analysis was conducted by CHL and YJH. YTH, JHK, WCW, and YSH contributed to data interpretation. EYCK wrote the manuscript.

    Conflicts of Interest

    CHL and YJH are employees of Acer Healthcare, Taiwan.

    ‎
    Multimedia Appendix 1

    Excluded retinal fundus images due to (a) the use of a color filter, (b) the image not being centered on the macula or disc, (c) blurriness, (d) the presence of glares, (e) poor light exposure, and (f) an invisible macula.

    PNG File , 718 KB
    ‎
    Multimedia Appendix 2

    Learning curves of the model, demonstrating the learning rate in the epochs versus (a) train loss and (b) accuracy. The epoch of 56 with the lowest validation loss was selected for testing.

    PNG File , 156 KB
    ‎
    Multimedia Appendix 3

    Clinical information of patients with normal or impaired renal function stratified by different HbA1c levels in the testing set.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 4

    Retinal fundus images from false-positive cases showing (a) a swollen optic disc due to idiopathic optic neuritis, (b) a chorioretinal scar caused by previous inflammation, and (c) subretinal fluid caused by retinal detachment.

    PNG File , 408 KB
    1. Saran R, Robinson B, Abbott KC, Agodoa LYC, Albertus P, Ayanian J, et al. US Renal Data System 2016 Annual Data Report: Epidemiology of Kidney Disease in the United States. Am J Kidney Dis 2017 Mar;69(3 Suppl 1):A7-A8 [FREE Full text] [CrossRef] [Medline]
    2. 2018 National Health Insurance Medical Cost Top 20. Taiwan National Health Insurance Administration, Ministry of Health and Welfare.   URL: https://www.nhi.gov.tw/Content_List.aspx?n=D529CAC4D8F8E77B&topn=23C660CAACAA159D [accessed 2020-08-02]
    3. Afkarian M, Zelnick LR, Hall YN, Heagerty PJ, Tuttle K, Weiss NS, et al. Clinical Manifestations of Kidney Disease Among US Adults With Diabetes, 1988-2014. JAMA 2016 Aug 09;316(6):602-610. [CrossRef] [Medline]
    4. Ting DSW, Pasquale LR, Peng L, Campbell JP, Lee AY, Raman R, et al. Artificial intelligence and deep learning in ophthalmology. Br J Ophthalmol 2019 Feb;103(2):167-175 [FREE Full text] [CrossRef] [Medline]
    5. Ting DSW, Cheung CY, Lim G, Tan GSW, Quang ND, Gan A, et al. Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes. JAMA 2017 Dec 12;318(22):2211-2223 [FREE Full text] [CrossRef] [Medline]
    6. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA 2016 Dec 13;316(22):2402-2410. [CrossRef] [Medline]
    7. Poplin R, Varadarajan AV, Blumer K, Liu Y, McConnell MV, Corrado GS, et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng 2018 Mar;2(3):158-164. [CrossRef] [Medline]
    8. London A, Benhar I, Schwartz M. The retina as a window to the brain-from eye research to CNS disorders. Nat Rev Neurol 2013 Jan;9(1):44-53. [CrossRef] [Medline]
    9. Tapp RJ, Owen CG, Barman SA, Welikala RA, Foster PJ, Whincup PH, et al. Associations of Retinal Microvascular Diameters and Tortuosity With Blood Pressure and Arterial Stiffness: United Kingdom Biobank. Hypertension 2019 Dec;74(6):1383-1390 [FREE Full text] [CrossRef] [Medline]
    10. Phan K, Mitchell P, Liew G, Plant AJ, Wang SB, Xu J, et al. Severity of coronary artery disease and retinal microvascular signs in patients with diagnosed versus undiagnosed diabetes: cross-sectional study. J Thorac Dis 2016 Jul;8(7):1532-1539 [FREE Full text] [CrossRef] [Medline]
    11. Lim LS, Cheung CY, Sabanayagam C, Lim SC, Tai ES, Huang L, et al. Structural changes in the retinal microvasculature and renal function. Invest Ophthalmol Vis Sci 2013 Apr 26;54(4):2970-2976. [CrossRef] [Medline]
    12. Ooi QL, Tow FKNH, Deva R, Alias MA, Kawasaki R, Wong TY, et al. The microvasculature in chronic kidney disease. Clin J Am Soc Nephrol 2011 Aug;6(8):1872-1878 [FREE Full text] [CrossRef] [Medline]
    13. Yuan Q, Zhang H, Deng T, Tang S, Yuan X, Tang W, et al. Role of Artificial Intelligence in Kidney Disease. Int J Med Sci 2020;17(7):970-984 [FREE Full text] [CrossRef] [Medline]
    14. Levey AS, Coresh J, Greene T, Stevens LA, Zhang YL, Hendriksen S, Chronic Kidney Disease Epidemiology Collaboration. Using standardized serum creatinine values in the modification of diet in renal disease study equation for estimating glomerular filtration rate. Ann Intern Med 2006 Aug 15;145(4):247-254. [CrossRef] [Medline]
    15. KDIGO 2012 clinical practice guideline for the evaluation and management of chronic kidney disease. Kidney International Supplements.   URL: https://kdigo.org/wp-content/uploads/2017/02/KDIGO_2012_CKD_GL.pdf [accessed 2020-08-02]
    16. Graham B. Kaggle Diabetic Retinopathy Detection Competition Report. 2015.   URL: http:/​/scholar.​google.com.tw/​scholar_url?url=https:/​/kaggle-forum-message-attachments.​storage.googleapis.com/​88655/​2795/​competitionreport.​pdf&hl=zh-TW&sa=X&scisig=AAGBfm0vGsKIa3EEhTDn8VZSmliV6_3Hsg&nossl=1&oi=scholarr [accessed 2020-08-02]
    17. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. ArXiv Preprint posted online on April 10, 2015 [FREE Full text]
    18. Ting DSW, Peng L, Varadarajan AV, Keane PA, Burlina PM, Chiang MF, et al. Deep learning in ophthalmology: The technical and clinical considerations. Prog Retin Eye Res 2019 Sep;72:100759. [CrossRef] [Medline]
    19. Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol 2010 Sep;5(9):1315-1316 [FREE Full text] [CrossRef] [Medline]
    20. Tsai M, Hsu C, Lin M, Yen M, Chen H, Chiu Y, et al. Incidence, Prevalence, and Duration of Chronic Kidney Disease in Taiwan: Results from a Community-Based Screening Program of 106,094 Individuals. Nephron 2018;140(3):175-184. [CrossRef] [Medline]
    21. Hwang S, Tsai J, Chen H. Epidemiology, impact and preventive care of chronic kidney disease in Taiwan. Nephrology (Carlton) 2010 Jun;15 Suppl 2:3-9. [CrossRef] [Medline]
    22. Wen CP, Cheng TYD, Tsai MK, Chang YC, Chan HT, Tsai SP, et al. All-cause mortality attributable to chronic kidney disease: a prospective cohort study based on 462 293 adults in Taiwan. Lancet 2008 Jun 28;371(9631):2173-2182. [CrossRef] [Medline]
    23. Lin M, Lee CT, Kuo M, Hwang S, Chen H, Chiu Y. Effects of physician's specialty on regular chronic kidney disease care in predialysis: A population-based cross-sectional study. Medicine (Baltimore) 2018 Jun;97(26):e11317 [FREE Full text] [CrossRef] [Medline]
    24. Moyer VA, U.S. Preventive Services Task Force. Screening for chronic kidney disease: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 2012 Oct 16;157(8):567-570 [FREE Full text] [CrossRef] [Medline]
    25. Amisha, Malik P, Pathania M, Rathaur VK. Overview of artificial intelligence in medicine. J Family Med Prim Care 2019 Jul;8(7):2328-2331 [FREE Full text] [CrossRef] [Medline]
    26. Kuo C, Chang C, Liu K, Lin W, Chiang H, Chung C, et al. Automation of the kidney function prediction and classification through ultrasound-based kidney imaging using deep learning. NPJ Digit Med 2019;2:29 [FREE Full text] [CrossRef] [Medline]
    27. Beede E, Baylor E, Hersch F, Iurchenko A, Wilcox L, Ruamviboonsuk P, et al. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. 2020 Presented at: CHI Conference on Human Factors in Computing Systems (CHI '20); April 25-30, 2020; Honolulu, HI   URL: https://doi.org/10.1145/3313831.3376718 [CrossRef]
    28. Deva R, Alias MA, Colville D, Tow FKNH, Ooi QL, Chew S, et al. Vision-threatening retinal abnormalities in chronic kidney disease stages 3 to 5. Clin J Am Soc Nephrol 2011 Aug;6(8):1866-1871 [FREE Full text] [CrossRef] [Medline]
    29. Sudharshan S, Ganesh SK, Biswas J. Current approach in the diagnosis and management of posterior uveitis. Indian J Ophthalmol 2010;58(1):29-43 [FREE Full text] [CrossRef] [Medline]
    30. Vaghefi E, Hill S, Kersten HM, Squirrell D. Multimodal Retinal Image Analysis via Deep Learning for the Diagnosis of Intermediate Dry Age-Related Macular Degeneration: A Feasibility Study. J Ophthalmol 2020;2020:7493419 [FREE Full text] [CrossRef] [Medline]
    31. Klein R, Zinman B, Gardiner R, Suissa S, Donnelly SM, Sinaiko AR, Renin-Angiotensin System Study. The relationship of diabetic retinopathy to preclinical diabetic glomerulopathy lesions in type 1 diabetic patients: the Renin-Angiotensin System Study. Diabetes 2005 Feb;54(2):527-533 [FREE Full text] [CrossRef] [Medline]
    32. Lee WJ, Sobrin L, Lee MJ, Kang MH, Seong M, Cho H. The relationship between diabetic retinopathy and diabetic nephropathy in a population-based study in Korea (KNHANES V-2, 3). Invest Ophthalmol Vis Sci 2014 Sep 09;55(10):6547-6553. [CrossRef] [Medline]
    33. Sabanayagam C, Xu D, Ting D, Nusinovici S, Banu R, Hamzah H, et al. A deep learning algorithm to detect chronic kidney disease from retinal photographs in community-based populations. The Lancet Digital Health 2020 Jun;2(6):e295-e302 [FREE Full text] [CrossRef]
    34. Kang EY, Tai W, Lin J, Huang C, Yeh P, Wu W, et al. Eye-related Emergency Department Visits with Ophthalmology Consultation in Taiwan: Visual Acuity as an Indicator of Ocular Emergency. Sci Rep 2020 Jan 22;10(1):982 [FREE Full text] [CrossRef] [Medline]
    35. Hsieh Y, Chuang L, Jiang Y, Chang T, Yang C, Yang C, et al. Application of deep learning image assessment software VeriSee™ for diabetic retinopathy screening. J Formos Med Assoc 2020 Apr 16 [FREE Full text] [CrossRef] [Medline]
    36. Chen L, Guh J, Wu K, Chen Y, Kuo M, Hwang S, et al. Modification of diet in renal disease (MDRD) study and CKD epidemiology collaboration (CKD-EPI) equations for Taiwanese adults. PLoS One 2014;9(6):e99645 [FREE Full text] [CrossRef] [Medline]

    ‎
    CGMH: Chang Gung Memorial Hospital
    CKD: chronic kidney disease
    eGFR: estimated glomerular filtration rate
    ESRD: end-stage renal disease
    HbA1c: hemoglobin A1c
    MDRD: Modification of Diet in Renal Disease
    CNN: convolutional neural network
    ReLU: rectified linear unit
    ROC: receiver operating characteristic
    AUC: area under the curve
    PPV: positive predictive values
    SNEC: Singapore National Eye Center

    Edited by G Eysenbach; submitted 13.08.20; peer-reviewed by YP Huang, G Lim; comments to author 29.08.20; revised version received 01.09.20; accepted 30.10.20; published 26.11.20

    Copyright

    ©Eugene Yu-Chuan Kang, Yi-Ting Hsieh, Chien-Hung Li, Yi-Jin Huang, Chang-Fu Kuo, Je-Ho Kang, Kuan-Jen Chen, Chi-Chun Lai, Wei-Chi Wu, Yih-Shiou Hwang. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 26.11.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.