Multimodal Multitask Learning for Predicting Depression Severity and Suicide Risk Using Pretrained Audio and Text Embeddings: Methodology Development and Application

Ya-Han Hu   ^{1, 2} , PhD ;   Ruei-Yan Wu   ^{1, 3} , PhD ;   Min-Yi Su   ¹ , MAS ;   I-Li Lin   ^{4 *} , MD ;   Cheng-Che Shen   ^{5, 6 *} , MD, PhD

¹ Department of Information Management, National Central University, Taoyuan City, Taiwan

² Asian Institute for Impact Measurement and Management, National Central University, Taoyuan City, Taiwan

³ Graduate School of Resources Management and Decision Science, Management College, National Defense University, Taipei City, Taiwan

⁴ Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi, Taiwan

⁵ Jianan Psychiatric Center, Tainan City, Taiwan

⁶ School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan

*these authors contributed equally