Training a Deep Contextualized Language Model for International Classification of Diseases, 10th Revision Classification via Federated Learning: Model Development and Validation Study

Pei-Fu Chen   ^{1, 2 *} , MD ;   Tai-Liang He   ^{3 *} , MSc ;   Sheng-Che Lin   ³ , MSc ;   Yuan-Chia Chu   ^{4, 5, 6} , PhD ;   Chen-Tsung Kuo   ^{4, 5, 6} , PhD ;   Feipei Lai   ^{1, 3, 7} , PhD ;   Ssu-Ming Wang   ¹ , MSc ;   Wan-Xuan Zhu   ⁸ , BSc ;   Kuan-Chih Chen   ^{1, 9} , MSc, MD ;   Lu-Cheng Kuo   ¹⁰ , MSc, MD ;   Fang-Ming Hung   ^{11, 12} , MD ;   Yu-Cheng Lin   ^{13, 14} , MD, PhD ;   I-Chang Tsai   ¹⁵ , PhD ;   Chi-Hao Chiu   ¹⁶ , MS ;   Shu-Chih Chang   ¹⁷ , MA ;   Chi-Yu Yang   ^{18, 19} , MD

¹ Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei, Taiwan

² Department of Anesthesiology, Far Eastern Memorial Hospital, New Taipei City, Taiwan

³ Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan

⁴ Department of Information Management, Taipei Veterans General Hospital, Taipei City, Taiwan

⁵ Medical Artificial Intelligence Development Center, Taipei Veterans General Hospital, Taipei City, Taiwan

⁶ Department of Information Management, National Taipei University of Nursing and Health Sciences, Taipei City, Taiwan

⁷ Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan

⁸ Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan

⁹ Department of Internal Medicine, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁰ Department of Internal Medicine, National Taiwan University Hospital, National Taiwan University College of Medicine, Taipei, Taiwan

¹¹ Department of Medical Affairs, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹² Department of Surgical Intensive Care Unit, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹³ Department of Pediatrics, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁴ School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan

¹⁵ Artificial Intelligence Center, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁶ Section of Health Insurance, Department of Medical Affairs, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁷ Medical Records Department, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁸ Department of Information Technology, Far Eastern Memorial Hospital, New Taipei City, Taiwan

¹⁹ Section of Cardiovascular Medicine, Cardiovascular Center, Far Eastern Memorial Hospital, New Taipei City, Taiwan

*these authors contributed equally