Diagnosis of Chronic Kidney Disease Using Retinal Imaging and Urine Dipstick Data: Multimodal Deep Learning Approach

Youngmin Bhak   ^{1, 2 *} , BS ;   Yu Ho Lee   ^{3 *} , MD, PhD ;   Joonhyung Kim   ^{4 *} , MD, PhD ;   Kiwon Lee   ^{5 *} , MS ;   Daehwan Lee   ⁵ , BS ;   Eun Chan Jang   ^{6, 7} , MPH ;   Eunjeong Jang   ^{6, 7} , BS ;   Christopher Seungkyu Lee   ⁸ , MD, PhD ;   Eun Seok Kang   ⁹ , MD, PhD ;   Sehee Park   ^{10, 11} , MS ;   Hyun Wook Han   ^{6, 7, 12, 13} , MD, PhD ;   Sang Min Nam   ^{6, 7, 14} , MD, PhD

¹ Korean Genomics Center (KOGIC), Ulsan National Institute of Science and Technology (UNIST), Ulsan, Republic of Korea

² Department of Biomedical Engineering, College of Information and Biotechnology, Ulsan National Institute of Science and Technology (UNIST), Ulsan, Republic of Korea

³ Division of Nephrology, Department of Internal Medicine, CHA Bundang Medical Center, CHA University, Gyeonggi-do, Republic of Korea

⁴ Department of Ophthalmology, CHA Bundang Medical Center, CHA University, Gyeonggi-do, Republic of Korea

⁵ Spidercore Inc, Daejeon, Republic of Korea

⁶ Department of Biomedical Informatics, School of Medicine, CHA University, Seongnam, Republic of Korea

⁷ Institute for Biomedical Informatics, School of Medicine, CHA University, Seongnam, Republic of Korea

⁸ Department of Ophthalmology, Institute of Vision Research, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea

⁹ Division of Endocrinology and Metabolism, Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea

¹⁰ Department of ICT Safety, Graduate School of Chung-Ang University, Seoul, Republic of Korea

¹¹ IAEC Medical Service, Seoul, Republic of Korea

¹² Institute of Basic Medical Sciences, School of Medicine, CHA University, Gyeonggi-do, Republic of Korea

¹³ Healthcare Big Data Center, CHA Bundang Medical Center, Gyeonggi-do, Republic of Korea

¹⁴ Daechi Yonsei Eye Clinic, Seoul, Republic of Korea

*these authors contributed equally