Data Set and Benchmark (MedGPTEval) to Evaluate Responses From Large Language Models in Medicine: Evaluation Development and Validation

Jie Xu   ¹ , DHM ;   Lu Lu   ¹ , MA ;   Xinwei Peng   ¹ , MM ;   Jiali Pang   ¹ , MS ;   Jinru Ding   ¹ , MEng ;   Lingrui Yang   ² , MSc ;   Huan Song   ^{3, 4} , PhD ;   Kang Li   ^{3, 4} , PhD ;   Xin Sun   ² , MD ;   Shaoting Zhang   ¹ , PhD

¹ Shanghai Artificial Intelligence Laboratory, OpenMedLab, Shanghai, China

² Clinical Research and Innovation Unit, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China

³ West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China

⁴ Med-X Center for Informatics, Sichuan University, Chengdu, China