TY  - JOUR
AU  - Van Mens, Kasper
AU  - Lokkerbol, Joran
AU  - Wijnen, Ben
AU  - Janssen, Richard
AU  - de Lange, Robert
AU  - Tiemens, Bea
PY  - 2023
DA  - 2023/8/23
TI  - Predicting Undesired Treatment Outcomes With Machine Learning in Mental Health Care: Multisite Study
JO  - JMIR Med Inform
SP  - e44322
VL  - 11
KW  - treatment outcomes
KW  - mental health
KW  - machine learning
KW  - treatment
KW  - model
KW  - Netherlands
KW  - data
KW  - risk
KW  - risk signaling
KW  - technology
KW  - clinical practice
KW  - model performance
AB  - Background: Predicting which treatment will work for which patient in mental health care remains a challenge. Objective: The aim of this multisite study was 2-fold: (1) to predict patients’ response to treatment in Dutch basic mental health care using commonly available data from routine care and (2) to compare the performance of these machine learning models across three different mental health care organizations in the Netherlands by using clinically interpretable models. Methods: Using anonymized data sets from three different mental health care organizations in the Netherlands (n=6452), we applied a least absolute shrinkage and selection operator regression 3 times to predict the treatment outcome. The algorithms were internally validated with cross-validation within each site and externally validated on the data from the other sites. Results: The performance of the algorithms, measured by the area under the curve of the internal validations as well as the corresponding external validations, ranged from 0.77 to 0.80. Conclusions: Machine learning models provide a robust and generalizable approach in automated risk signaling technology to identify cases at risk of poor treatment outcomes. The results of this study hold substantial implications for clinical practice by demonstrating that the performance of a model derived from one site is similar when applied to another site (ie, good external validation). 
SN  - 2291-9694
UR  - https://medinform.jmir.org/2023/1/e44322
UR  - https://doi.org/10.2196/44322
UR  - http://www.ncbi.nlm.nih.gov/pubmed/37623374
DO  - 10.2196/44322
ID  - info:doi/10.2196/44322
ER  -