Published on in Vol 9, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/26823, first published .
Predicting Biologic Therapy Outcome of Patients With Spondyloarthritis: Joint Models for Longitudinal and Survival Analysis

Predicting Biologic Therapy Outcome of Patients With Spondyloarthritis: Joint Models for Longitudinal and Survival Analysis

Predicting Biologic Therapy Outcome of Patients With Spondyloarthritis: Joint Models for Longitudinal and Survival Analysis

Original Paper

1Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal

2Instituto de Telecomunicações, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal

3Comprehensive Health Research Center, NOVA Medical School, NOVA University of Lisbon, Lisbon, Portugal

4EpiDoC Unit, The Chronic Diseases Research Centre, NOVA Medical School, NOVA University of Lisbon, Lisbon, Portugal

5Instituto de Engenharia de Sistemas e Computadores: Investigação e Desenvolvimento em Lisboa (INESC-ID), Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal

6Lisbon Unit for Learning and Intelligent Systems, Lisbon, Portugal

Corresponding Author:

Alexandra M Carvalho, PhD

Instituto de Telecomunicações

Instituto Superior Técnico

Universidade de Lisboa

Lisbon

Portugal

Phone: 351 218 418 454

Email: alexandra.carvalho@tecnico.ulisboa.pt


Background: Rheumatic diseases are one of the most common chronic diseases worldwide. Among them, spondyloarthritis (SpA) is a group of highly debilitating diseases, with an early onset age, which significantly impacts patients’ quality of life, health care systems, and society in general. Recent treatment options consist of using biologic therapies, and establishing the most beneficial option according to the patients’ characteristics is a challenge that needs to be overcome. Meanwhile, the emerging availability of electronic medical records has made necessary the development of methods that can extract insightful information while handling all the challenges of dealing with complex, real-world data.

Objective: The aim of this study was to achieve a better understanding of SpA patients’ therapy responses and identify the predictors that affect them, thereby enabling the prognosis of therapy success or failure.

Methods: A data mining approach based on joint models for the survival analysis of the biologic therapy failure is proposed, which considers the information of both baseline and time-varying variables extracted from the electronic medical records of SpA patients from the database, Reuma.pt.

Results: Our results show that being a male, starting biologic therapy at an older age, having a larger time interval between disease start and initiation of the first biologic drug, and being human leukocyte antigen (HLA)–B27 positive are indicators of a good prognosis for the biological drug survival; meanwhile, having disease onset or biologic therapy initiation occur in more recent years, a larger number of education years, and higher values of C-reactive protein or Bath Ankylosing Spondylitis Functional Index (BASFI) at baseline are all predictors of a greater risk of failure of the first biologic therapy.

Conclusions: Among this Portuguese subpopulation of SpA patients, those who were male, HLA-B27 positive, and with a later biologic therapy starting date or a larger time interval between disease start and initiation of the first biologic therapy showed longer therapy adherence. Joint models proved to be a valuable tool for the analysis of electronic medical records in the field of rheumatic diseases and may allow for the identification of potential predictors of biologic therapy failure.

JMIR Med Inform 2021;9(7):e26823

doi:10.2196/26823

Keywords



Motivation

Rheumatic diseases are chronic diseases that, being the leading cause of disability in developed countries, consume many health and social resources. Among these diseases, spondyloarthritis (SpA) is a group of several related disorders that can be highly debilitating and significantly impact patients' quality of life, health care systems, and society [1].

As there is no cure, treatment focuses on the relief of symptoms and the delay of the disease's progression. Biologic therapies are the most recent approach for treating these disorders, and their use is recommended when all other methods have failed. However, the therapy selection follows no specific criteria, and trying to establish which patients benefit the most from each drug is still a problem that needs to be solved [2].

A better understanding of therapy responses for these patients and identifying the predictors that affect these responses would allow for a prognosis of therapy success or failure and thus be highly valuable in conserving the resources and time of both patients and medical doctors. Moreover, this understanding could be used to aid medical experts in tailoring the treatment to the patient by using a more personalized approach.

Meanwhile, the emerging availability of electronic medical records has enabled the storage of great amounts of information that can be used to extract insightful knowledge. Data mining is a rapidly growing field that focuses on developing the techniques necessary for insightfully using this information.

The analysis of an outcome of interest is usually performed using survival analysis methods. such as the Kaplan-Meier estimator [3] and the Cox model [4]. Nevertheless, these methods are only able to deal with time-static variables. For dealing with time-varying variables, methods such as the extended Cox model [5] have been introduced. However, they are not appropriate for dealing with biomarkers [6,7].

Joint models have been presented in the literature as a useful approach for handling these types of analysis, having been used in a wide range of medical studies, including the most common disease areas of cancer and HIV and AIDS [8].

In the field of rheumatic diseases, these joint modeling and machine learning approaches were studied to evaluate the clinical impact on flare occurrence in patients undergoing biologic treatments for rheumatoid arthritis. Both models were proven to assist in decisions on biologic dose reduction with the potential to reduce the occurrence of flares significantly [9]. The development of juvenile dermatomyositis was also studied using longitudinal approaches, allowing for a better perception of longitudinal outcomes and a more accurate comprehension of predictors' effects [10].

However, the use of these methods has been less explored for other diseases in this field, such as SpA.

Our main goal was to propose a data mining approach based on joint models to infer relationships between time-to-event and longitudinal electronic medical record data, retrieved from the Rheumatic Disease Portuguese Register (Reuma.pt) [11]. We further aimed to study the predictors of failure of the first biologic therapy for patients with SpA and verify the applicability of joint models for the study of therapeutic response in rheumatic diseases.

Background

Spondyloarthritis

Spondyloarthritis is the name given to a family of inflammatory rheumatic diseases that share distinctive pathophysiologic, clinical, radiographic, and genetic features. This includes ankylosing spondylitis (AS)—the characteristic type of this group—psoriatic arthritis, reactive arthritis, enteropathic arthritis, and so called undifferentiated SpA.

AS is characterized by chronic inflammation predominantly affecting the axial skeleton. Although its pathogenesis is poorly understood, there is a strong association between AS and the human leukocyte antigen B27 (HLA-B27), and the typical age at onset of this condition is at the second or third decade of life [12].

The first population-based study on rheumatic diseases in Portugal, EpiReumaPt, reported the national health survey results in 2015, revealing a general SpA prevalence of 1.6% and a prevalence of 2.0% and 1.2% for women and men, respectively [1].

The socioeconomic impact can be rather high for these conditions. A recent study [13] revealed that AS has a total annual economic impact of €639 million (US $773 million) in Portugal. This value includes the disease-related costs for the patient and the national health system and the economic impact of the lost workdays.

Clinical monitoring of a disease is of extreme importance to understanding disease progression, better assessing patient response to treatment, and guiding therapeutic decisions.

Laboratory exams include erythrocyte sedimentation rate (ESR) and levels of C-reactive protein (CRP), which are markers of inflammation, and other laboratory data that are considered to show relevant alterations.

Functional ability can be evaluated using the Bath Ankylosing Spondylitis Functional Index (BASFI) [14] score, and activity disease can be evaluated using the Bath Ankylosing Disease Status in Ankylosing Spondylitis (BASDAI) score [15] or the more recently developed Ankylosing Spondylitis Disease Activity Score (ASDAS) [16]. The ASDAS has two different formulas, ASDAS-CRP (which uses the C-reactive protein) and ASDAS-ESR (which uses ESR), with ASDAS-CRP usually being the preferred system.

Treatment of SpA should be tailored to the patient, and patient signs, symptoms, and characteristics should be taken into account, with the most common goal being the attainment of a state of inactive disease.

Treatment options can include physical therapy, nonsteroidal anti-inflammatory drugs, disease-modifying antirheumatic drugs, and, if patients remain in a high disease activity state when trying the referred options, treatment with biologic agents, namely tumor necrosis factor inhibitors and interleukin-17 or interleukin-23 inhibitors.

Time-to-Event Analysis

Survival analysis, or time-to-event analysis, is the collection of statistical procedures for the analysis in which the outcome variable of interest is the time until an event occurs.

Let T denote a random, nonnegative, continuous variable representing the patient’s survival time and let t be an observed value of T.

The hazard function can be interpreted as the instantaneous potential per unit time for the event to occur, given that the individual has survived to time t. It is calculated as follows:

The main feature that distinguishes survival data from other types of data is the possible presence of censored survival times.

Considering a specific individual i, let Ti be the random variable representing its true survival time and Ci the potential censoring time. With consideration to right censoring, the censoring indicator variable, δi, is defined as δi = I(TiCi), where I (. ) is the indicator function.

The Cox proportional hazards model [4] allows us to estimate the hazard function and explore how the survival of a group of patients depends on the values of one or more explanatory variables.

Let x = (x1, x2, … , xk) be the values of the k explanatory variables of an individual and β = (β1, β2, …, βk) the vector of its correspondent unknown regression coefficients. The hazard function is given by the following:

h(t; x) = h0 (t)exp (βTx)

where h0 (t) is the baseline hazard function, representing the hazard for a patient when its vector of explanatory variables is equal to zero (x = 0).

It is possible to extend the previously presented Cox model for handling time-dependent variables [5]. This model is referred to as the extended Cox model. However, it is not theoretically appropriate to deal with biomarkers since it assumes that the time-dependent variables are predictable processes, measured without error and with a full path completely known.

Longitudinal Analysis

Longitudinal data can be defined as the data obtained from multiple measurements of individuals throughout time.

Linear mixed effects (LME) models are a common way of modeling this data. In an LME model, the individual’s response is assumed to follow a linear regression model where some of the regression parameters are population specific and others are patient specific. These are referred to as fixed effects and random effects, respectively [17].

Let Yi be the ni-dimensional response vector for subject i. In general, a linear mixed-effects model satisfies the following:

where β is a p-dimensional vector that contains the fixed effects; bi is the q-dimensional vector containing the random effects, and ϵi is a ni-dimensional vector of random errors; Xi and Zi are the (ni × p) and (ni × q) fixed-effects and random effects design matrices, respectively; D is a (q × q) positive-definite covariance matrix; and Σi is a (ni × ni) positive-definite covariance matrix that depends on i through its dimension ni. The εi is normally distributed with mean zero and covariance matrix D, and bi is normally distributed with mean zero and covariance matrix Σi. Both bi and εi are assumed to be independent of each other and of groups [17].

Joint Models for Longitudinal and Time-to-Event Data

The basic idea of joint models is to perform combined analysis, in which a relative risk model is estimated for the time-to-event outcome, taking into account the effect of the longitudinal data measurements—this is usually done by combining a survival model with a mixed-effects model [6].

The first step is modeling the continuous longitudinal outcomes with LME models. Let yk denote the (nki × 1) longitudinal response vector for the k-th outcome (k = 1, … , K) and the i-th subject that is composed by elements ykil,which represent the value of the k-th longitudinal outcome taken at time point tkil. Let bki be a vector of random effects and βk a vector of fixed effects. We have that the conditional expectation of yk given bki, ηki (t) is modeled through the LME model as follows:

where xki (t) and zki (t) are the design vectors for the random and fixed effects, respectively.

Let be the true event time for the i-th subject. We can now postulate the relative risk model for the survival process as follows:

where Mi (t) = {M1i (t), …, Mki (t)} and Mki(t) = {ηki (s), 0 ≤ s < t} denotes the history of the true unobserved longitudinal process up to time point t, h0(. ) denotes the baseline risk function, and wi(t) is a vector of exogenous covariates with a corresponding vector of regression coefficients γ. The fkl functions, parametrized by vector αkl, specify which components of each longitudinal outcome will be present in the relative risk model, allowing up to Lk functional forms for each of K longitudinal outcomes. The parameters contained in αkl quantify the effect of the correspondent underlying longitudinal outcome to the risk for an event.

One of the basic approaches for the functional form is to model the event's hazard as having an association only with the current value of the longitudinal outcome at the same time point. Considering a single outcome, this is given by f{α, wi(t), bi, Mi(t)} = αηi(t), where α is the strength of association parameter that indicates the change in the log hazard when there is a unit change in the patient’s longitudinal outcome value.

Estimation of joint models is performed by exploiting the full joint likelihood that is derived from the joint distribution of the longitudinal and survival outcomes. Methods for this estimation can follow, among others, a frequentist or a Bayesian paradigm [18,19].


SpA Patients on Biologic Therapies: Data Description and Preprocessing

The data used in this study were retrieved from Reuma.pt [11] on July 22, 2019. This register was developed by the Portuguese Society of Rheumatology, has been active since June 2008, and contains information retrieved on a routine basis of rheumatic patients in Portugal receiving biological therapies. Although Reuma.pt also contains patients with several rheumatic diseases, the focus of this work was on patients with SpA.

With the data extracted from this database, 4 different data sets, A, B, C and D, were obtained according to different strategies for handling the missing values. A set of different joint models was then fitted to all data sets, as well as the equivalent extended Cox models using R software (The R Foundation for Statistical Computing) [20], namely packages “JM” [18] and “Jmbayes” [19]. This resulted in a total of 49 joint models and 29 extended Cox models. All the steps of the data processing and modeling framework are described in detail in this section.

The Reuma.pt database contains information regarding patients and patient visits, including identification data, demographic data, previous medical history, comorbidities, laboratory results, past and current therapies, adverse events, and disease activity scores, among others.

The follow-up of patients through this registry enables the monitoring of treatment efficacy, safety, and comorbidities.

The goal of this work was to perform a survival analysis that takes into account both time-independent and time-dependent variables and understand how these impact the outcome of interest. Therefore, 3 types of variables were needed: time-independent (baseline) variables, time-dependent variables, and time-to-event variables. The latter type is not directly found in the database and therefore needed to be processed from the existing data.

Our event of interest was the failure of the first biological therapy for each patient, where failure was defined as the discontinuation of the biological therapy due to inefficacy (evaluated by ASDAS) or adverse events (such as infection or hypersensitivity).

In this context, the time-to-event variables indicated if the biologic therapy failed or if the patient was censored—henceforth referred to as the failure index. The time until the occurrence of either failure index is referred to as time to failure.

The data extracted from the database had to go through several preprocessing steps in order to reach a format compatible with the models to be fitted.

First, a set of variables to be considered was selected, with 3 main aspects being taken into account: level of missing values, relevance to the study, and variable equivalence. Variables with more than 60% of values missing were not considered nor were variables that were considered to be irrelevant for the goal of our study as determined according to the feedback given by medical specialists. Furthermore, some variables available in the raw data set were equivalent in the sense that they represented the same information.

After this set of assumptions and processing steps, we obtained our initial data set, which consisted of the following 3 variables:

  1. Time-to-event variables—time to failure and failure index;
  2. Time-independent variables—sex, marital status, year of diagnosis, age at diagnosis, year of disease beginning, age at disease beginning, year of start of the first biologic therapy, age at start of the first biologic therapy, years from diagnosis to start of the first biologic therapy, disease years until start of the first biologic therapy, HLA-B27, employment status before disease, employment status at baseline, years of education, smoking habits, alcohol consumption habits, weight, height, BMI, number of pathologies, biologic therapy, concomitant disease-modifying antirheumatic drug at baseline, concomitant corticoid at baseline, baseline CRP, baseline ESR, baseline BASDAI, baseline BASFI, and baseline ASDAS;
  3. Time-dependent variables—CRP, ESR, BASDAI, BASFI, and ASDAS.

The ASDAS we refer to here and henceforth is the one that incorporates the CRP value into its calculation and corresponds to the ASDAS-CRP.

A thorough inspection of all variables was made to identify any incomplete or incorrect values. Some examples of issues that arose were values with incorrect formats or incoherent with these variables’ possible range. If possible, by crossing information and with medical professionals’ help and consultation, the values were corrected, but whenever it was impossible to draw conclusions, the observations were eliminated.

In the presented initial data set, not all patients have every baseline variable available. This poses an issue and is a challenge that needs to be dealt with in most studies that use data from clinical settings. The issue arises because most methods of variable selection and statistical models cannot handle missing values. Therefore, to further proceed with our analysis, we needed to understand the different approaches that can be used to handle this problem according to our needs. Common approaches include performing complete-case analysis, removing individuals with incomplete data for a subset of covariates, and multiple imputation techniques.

We decided not to perform any imputation techniques, as the imputation of baseline variables could introduce a high bias in our models’ estimates.

On the other hand, there is always value in keeping the most amount of data as possible to avoid wasting relevant information.

As there was no obvious choice regarding which approach would be the most appropriate and to enable the drawing of valuable insights from the data, the decision to create 4 different data sets, according to different approaches, was made. Furthermore, this allowed us to study how the strategy for handling missing data and the resulting data differences can influence the modeling process and the subsequent results. The overall process for the creation of these data sets is depicted in Figure 1.

The first approach consisted of keeping only the patients for whom all baseline variables were available (ie, keeping only the complete cases).

The second approach was to consider only the variables with fewer than 40% of missing values and then keeping the complete cases of those variables. The percentage of 40% was chosen since it seemed to provide a good balance between the number of eliminated variables and the number of eliminated patients.

The third approach consisted of fitting a univariate Cox model for each initial baseline variable and then keeping only the statistically significant ones in those models,\ according to a 5% level. After that, the complete cases of those variables were once again kept.

The last approach was to keep only those variables that were considered clinically relevant by expert medical doctors’ knowledge and according to insight from literature research where predictors of biologic drug survival in SpA were studied [21-23].

The variables selected for consideration were sex, disease years to first biologic therapy, age at start of the first biologic therapy, education years, baseline CRP, baseline BASDAI, and baseline BASFI. Variables age at start of the first biologic therapy and baseline BASDAI were later dropped due to violation of the proportional hazards assumption.

Figure 1. Flowchart representing the overall approach for the preprocessing of the initial data into 4 new data sets: A, B, C, and D.
View this figure

Statistical Model Implementation

For the initial data set, both an overall survival curve and curves for survival according to the biologic therapy were fitted with the Kaplan-Meier estimator [3].

Regarding the 4 processed data sets, the same approach was used for all data sets, which proceeded as follows.

The first step in the analysis was to perform variable selection for the baseline covariates. This removed any unnecessary predictors that could have added noise to the estimations.

Five different methods were used to compare and study the variability of the obtained results. These were backward stepwise selection using Akaike information criterion (AIC), forward stepwise selection using AIC, best subset selection using a primal-dual active set approach, lasso regression, and the stepwise likelihood ratio variable selection strategy presented by Collett [24].

Despite this, the variables obtained from the stepwise likelihood ratio variable selection were the ones ultimately selected for the next steps of the analysis, namely for building the survival submodel.

This variable selection was not performed for data set D, as the medical experts selected the variables of interest for this specific case.

A Cox model for the survival submodel was then fitted using the selected baseline covariates, constituting the survival submodel.

For each of the time-dependent variables, 7 different LME models were fitted. The one with the better fit according to AIC and Bayesian information criterion was chosen as the time-dependent submodel.

The formulae of the different LME models fitted and the corresponding names are presented in Table 1.

Having both submodels, the same joint models were fitted with R packages “JM” [18] and “Jmbayes” [19]. The former estimates the model under a maximum likelihood approach and the latter under a Bayesian approach, more specifically, using Markov chain Monte Carlo algorithms.

The R package “Jmbayes” also enables the fitting of multivariate joint models. Considering that variables CPR and ESR are both measurements of inflammation and that ASDAS uses CRP and BASDAI elements in its composition, we chose not to fit together CRP with ESR or ASDAS with CRP and BASDAI. Thus, 2 different combinations of time-dependent variables were considered for the multivariate joint models: CRP, BASDAI, and BASFI; and BASFI and ASDAS.

The equivalent models, both univariate and multivariate, were also fitted with an extended Cox model, which enabled the comparison of both methods.

Should a case arise where the survival submodel contained any of the variables of baseline CRP, baseline ESR, baseline BASDAI, baseline BASFI, or baseline ASDAS, these baseline variables would be dropped when the correspondent time-dependent variable was present in the univariate joint model or extended Cox model. This would enable us to compare the effect of the variable in its baseline form with its time-dependent form. Similarly, if more than one of the 5 baseline variables were present in the survival submodel, a multivariate joint model or extended Cox model would also be fitted with those variables in the time-dependent form, and the baseline form would be dropped from the survival submodel.

The overall process for fitting the joint models and extended Cox models is schematically presented in Figure 2 and Figure 3, respectively, where it is also possible to observe the numbers given to the models that were fitted for every data set.

The exhaustive tests performed attempted to cover several types of strategies and models, and were aimed at identifying key covariates involved in the prognosis of the disease, particularly in the response to treatment. Indeed, the rationale for this approach was to comprehensively span the described methods due to the fact that this specific Reuma.pt data set did not contain any prior studies that focused on the identification of specific markers for the prognosis of the patient’s therapy response.

All the analysis was performed using R software [20], particularly, the “MASS” [25], “BeSS” [26], and “glmnet” [27] packages for the forward and backward stepwise variable selection, best subset selection, and lasso regression, respectively. Furthermore “car” [28] was used for multicollinearity testing; “survival” [29] for the Kaplan-Meier curves, Cox model, extended Cox model, and proportional hazards testing; “survminer” [30] for the plotting of survival curves; “nlme” [31] for fitting the linear mixed-effects models; and “JM” [18] and “Jmbayes” [19] for fitting the joint models.

Table 1. Time-dependent functions used given a time-varying variable y. NC represents natural cubic spline function; β, fixed effects, b, random effects; and t, time.
ModelTime-dependent functions
Linear and random interceptβ0 + β1tij + bi0 + εij
Linear and random slopeβ0 + β1tij + bi0 + bi0tij + εij
Cubic and random interceptβ0 + β1tij+ + bi0 + εij
Cubic and random slopeβ0 + β1tij+ + bi0 + bi1tij + εij
Spline and random interceptNC(tij, 2, (β0, β1, β2, β3)T, (bi0) +εij)
Spline and random slopeNC(tij, 2, (β0, β1, β2, β3)T, (bi0, bi1)Tij)
Spline and random splineNC(tij, 2, (β0, β1, β2, β3)T, (bi0, bi1, bi2, bi3)Tij)
Figure 2. Flowchart representing the overall approach for the data analysis using univariate and multivariate joint modeling. The variable selection step is not performed for data set D. ASDAS: Ankylosing Spondylitis Disease Activity Score; BASDAI: Bath Ankylosing Spondylitis Disease Activity Index; BASFI: Bath Ankylosing Spondylitis Functional Index; CRP: C-reactive protein; ESR: erythrocyte sedimentation rate. *This model is only fitted for data set D.
View this figure
Figure 3. Flowchart representing the overall approach for the data analysis using univariate and multivariate extended Cox modeling. The variable selection step is not performed for data set D. ASDAS: Ankylosing Spondylitis Disease Activity Score; BASDAI: Bath Ankylosing Spondylitis Disease Activity Index; BASFI: Bath Ankylosing Spondylitis Functional Index; CRP: C-reactive protein; ESR: erythrocyte sedimentation rate. *This model is only fitted for data set D.
View this figure

Ethics Approval and Consent To Participate

Reuma.pt was approved by the National Data Protection Board (Comissão Nacional de Protecção de Dados, Portugal) and by the Ethics Committee of Centro Hospitalar Lisboa Norte, Hospital de Santa Maria, Lisbon, Portugal. Patients signed Reuma. pt's informed and written consent.


Initial SpA Data Set

The survival probability curve, , of the first biologic therapy for the overall population from the initial data set obtained with the Kaplan-Meier estimator is presented in Figure 4, where vertical ticks along the curve indicate censored patients. We can observe that the slope of the curve is higher at the initial months, indicating that there are more failures closer to the beginning of the therapy.

A comparison of the survival probabilities between the different biologic therapies can be seen in Figure 5, where it is possible to observe a clear distinction between the different biologic drugs' curves. The P value of the log-rank test is also presented in the figure, indicating that the biologic drug curves differ significantly in survival at a 5% level.

A comparison of the survival probabilities between the different biologic therapies can be seen in Figure 5, where the survival curves for the different biologics were estimated using the Kaplan-Meier method. It is also possible to observe the P value of the log-rank test, whose null hypothesis is that all the groups have identical hazard functions. As this value is equal to .03, we can reject this hypothesis at a 5% level of significance.

The pairwise log-rank tests with corrections for multiple testing were also performed for all pairs of biologics to better compare the survival of the therapy between biologics. According to the tests, only 1 pair, etanercept and golimumab, had significantly different survival curves. An analysis of the curve indicates that golimumab conferred better survival than did etanercept at a 5% level of significance.

It should also be noted that in the Portuguese SpA subpopulation studied, there were some biologic drugs that had a very small number of observations. This difference in number of observations between different drugs could have also increased the difficulty in properly comparing the survival between them.

Figure 4. Kaplan-Meier estimation of the biologic therapy survival curve for the overall population of the initial data set with the 95% CI [5].
View this figure
Figure 5. Kaplan-Meier estimation of the biologic therapy survival curve by biologic drug for the initial data set and P value of the correspondent log-rank test with the 95% CI [5].
View this figure
Figure 6. Coefficient signs of the covariates present in the survival submodels fitted with a Cox regression for data sets A, B, C, and D. BASFI: Bath Ankylosing Spondylitis Functional Index; CRP, C-reactive protein: HLA-B27, human leukocyte antigen B27.
View this figure

Comparison of Results: Data Sets A, B, C, and D

The first main step of the modeling process consisted of selecting the baseline variables of interest.

The comparison of the selected variables only took data sets A, B, and C into consideration. The percentage of times a variable was selected for each data set, considering the 5 variable selection approaches tested, is presented in Table 2, along with the average number of times it was selected overall.

Although not all variables were present in every data set, the variability in the covariates selected for each set of data was still noticeable. This indicates that the initial process of handling the missing values and the initial selection of variables to be considered at this stage have a somewhat elevated influence on the results that are obtained later; in short, the results are sensitive to the parameter choice. This difference may be justified by the existence of different variables and even different patients even if many are common between data sets.

Only 1 variable was selected by all methods and for all data sets where it was considered: years of education. On average, the variables that were selected in at least more than 50% of the methods used for variable selection were year of disease onset, age at start of the first biologic therapy, baseline BASFI, and baseline ASDAS.

Table 3 shows the sign of the coefficient for each of the covariates that were included in the survival submodel for each data set. The sign of the respective coefficient indicates the effect of this covariate on the outcome of interest, which we took as the failure of the first biologic therapy. A positive sign indicates that the variable increases the risk of failure for higher values of that variable (for a continuous variable) or for that value in comparison to the reference level (for a categorical variable); a negative coefficient indicates the opposite: a decrease in the risk of failure.

Table 2. Percentage of times a variable was selected for each data set (A, B, C, D) and the average of those percentages across all data sets.
VariableData set (%)
ABCAverage
Sex02007
Marital status20N/AaN/A20
Year of diagnosis20402027
Age at diagnosis4040N/A40
Year of disease onset602010060
Age at disease onset2020N/A20
Year of start of the first biologic therapy40602040
Age at start of the first biologic therapy6040N/A50
Years from diagnosis to start of the first biologic therapy2020N/A20
Disease years until start of the first biologic therapy2020N/A20
HLA-B27b04010047
Employment status before disease4020N/A30
Employment status at baseline2020013
Years of education100100N/A100
Smoking40402033
Alcohol20402027
Weight40N/AN/A40
Height20N/A2020
BMI40N/AN/A40
Number of pathologies200N/A10
Biologic20202020
Concomitant DMARDc02007
Concomitant corticoid60202033
Baseline CRPd2002013
Baseline ESRe40204033
Baseline BASDAIf4006033
Baseline BASFIg801004073
Baseline ASDASh60406053

aN/A: not applicable.

bHLA-B27: human leukocyte antigen B27.

cDMARD: disease-modifying antirheumatic drug.

dCRP: C-reactive protein.

eESR: erythrocyte sedimentation rate.

fBASDAI: Bath Ankylosing Spondylitis Disease Activity Index.

gBASFI: Bath Ankylosing Spondylitis Functional Index.

hASDAS: Ankylosing Spondylitis Disease Activity Score.

Table 3. Coefficient signs of the covariates present in the survival submodels fitted with a Cox regression for data sets A, B, C, and D.
VariableData set
ABCD
Sex
Female (ref)
Male
Year of disease beginning+
Year of start of the first biologic therapy++
Age at start of the first biologic therapy
Disease years until start of the first biologic therapy
HLA-B27a
Years of education+++
Baseline CRPb+
Baseline BASFIc++++

aHLA-B27: human leukocyte antigen B27.

bCRP: C-reactive protein.

cBASFI: disease-modifying antirheumatic drug.

It can be noticed that the sign of the coefficient is coherent between the data sets for all variables even if the number of data sets where that variable is present differs.

According to the results obtained in the Cox regression, the factors that indicate a good prognosis for the biologic drug survival were being a male, starting the biologic therapy at an older age, having a larger time interval between disease start and initiation of the first biologic therapy, and being HLA-B27 positive. On the contrary, a disease onset or initiation of biologic therapy in more recent years, a higher number of years of education, and higher values of CRP or BASFI at baseline were all predictors of a greater risk of failure of the first biologic therapy.

Given the elevated number of models fitted and to aid in the drawing of comprehensive conclusions, Table 4 and Table 5 were created to depict the joint and extended Cox models, respectively. For each data set and for every variable present in the model, the tables show the percentage of models (relative to the total number of fitted models for each data set) in which the covariate was statistically significant, the percentage of models in which the variable had a positive regression coefficient, and the percentage of models in which the variable had a negative regression coefficient. Furthermore, the average of these percentages was calculated to obtain an overall view of the most common behavior of each variable as determined by information gathered from all data sets.

Table 4. Percentage of models in which a variable was statistically significant; percentage of models in which a variable had a positive coefficient sign; the percentage of models in which a variable had a negative coefficient sign for the covariates present in the joint models fitted for data sets A, B, C, and D; and the average of those percentages across all data sets.
VariableData set (%)Average (%)
ABCD
ssaposbnegcssposnegssposnegssposnegssposneg
Male (ref: female)N/AdN/AN/AN/AN/AN/AN/AN/AN/A0465404654
Year of disease onsetN/AN/AN/AN/AN/AN/A927525N/AN/AN/A927525
Year biologic therapy initiation823664836725N/AN/AN/AN/AN/AN/A835245
Age at start of the first biologic therapy820100N/AN/AN/AN/AN/AN/AN/AN/AN/A820100
Disease years until start of the first biologic therapyN/AN/AN/AN/AN/AN/AN/AN/AN/A150100150100
HLA-B27eN/AN/AN/AN/AN/AN/A830100N/AN/AN/A830100
Years of education8210001001000N/AN/AN/A851000911000
Baseline CRPfN/AN/AN/AN/AN/AN/AN/AN/AN/A441000441000
Baseline BASFIg50100075100025633750100050919
CRP671000100100010010001001000921000
ESRh501000100100010010001001000881000
BASDAIi10010001001000100100010010001001000
BASFI333366505050505050606040484852
ASDASj10010001001000100100010010001001000

ass: percentage of models in which variable is statistically significant.

bpos: percentage of models in which variable has positive coefficient.

cneg: percentage of models in which variable has negative coefficient.

dN/A: not applicable.

eHLA-B27: human leukocyte antigen B27.

fCRP: C-reactive protein.

gBASFI: Bath Ankylosing Spondylitis Functional Index.

hESR: erythrocyte sedimentation rate.

iBASDAI: Bath Ankylosing Spondylitis Disease Activity Index.

jASDAS: Ankylosing Spondylitis Disease Activity Score.

Table 5. Percentage of models in which a variable was statistically significant; percentage of models in which a variable had a positive coefficient sign; and percentage of models in which a variable had a negative coefficient sign for the covariates present in the extended Cox models fitted for data sets A, B, C, and D; and average of those percentages across all data sets.
VariableData setAverage
ABCD
ssaposbnegcssposnegssposnegssposnegssposneg
Male (ref: female)N/AdN/AN/AN/AN/AN/AN/AN/AN/A0257502575
Year of disease onsetN/AN/AN/AN/AN/AN/A1001000N/AN/AN/A1001000
Year of biologic therapy initiation10010001001000N/AN/AN/AN/AN/AN/A1001000
Age at start of the first biologic therapy860100N/AN/AN/AN/AN/AN/AN/AN/AN/A860100
Disease years until start of the first biologic therapyN/AN/AN/AN/AN/AN/AN/AN/AN/A0010000100
HLA-B27eN/AN/AN/AN/AN/AN/A860100N/AN/AN/A860100
Years of education10010001001000N/AN/AN/A751000921000
Baseline CRPfN/AN/AN/AN/AN/AN/AN/AN/AN/A408020408020
Baseline BASFIg50100050100005050501000388813
CRP01000501000010001001000381000
ESRh01000100100010010001001000751000
BASDAIi10010001001000100100010010001001000
BASFI3310006710003310001001000581000
ASDASj10010001001000100100010010001001000

ass: percentage of models in which variable is statistically significant.

bpos: percentage of models in which variable has positive coefficient.

cneg: percentage of models in which variable has negative coefficient.

dN/A: not applicable.

eHLA-B27: human leukocyte antigen B27.

fCRP: C-reactive protein.

gBASFI: Bath Ankylosing Spondylitis Functional Index.

hESR: erythrocyte sedimentation rate.

iBASDAI: Bath Ankylosing Spondylitis Disease Activity Index.

jASDAS: Ankylosing Spondylitis Disease Activity Score.

This consensus or ensemble approach was conducted to facilitate the identification of the most significant variables. The rationale is that if a feature always appears as significant, independently of the specific chosen model, then there is evidence that this feature is associated with the outcome.

Similar reasoning is applicable for identifying the covariates’ effect on the event of interest; that is, its positive or negative contribution for the risk of the therapy failure.

Focusing on the time-independent variables and starting with the covariate that represents male sex, we can see that this variable is not statistically significant in any joint or extended Cox model. This is coherent with what was observed in the Cox model, where sex was not a statistically significant predictor for our outcome. Regarding the effect of the variable on the event of interest, being male was more frequently a good predictor of biologic therapy survival than a bad predictor although this ratio was very small for the joint models.

The year of disease beginning was statistically significant for most models it was present in even if only 1 data set analyzed this variable. Its associated coefficient was positive for all the extended Cox models and for an average of 92% (12/13) of the joint models, which is consistent with the result obtained in the Cox models, indicating that patients with a more recent onset of disease have a higher risk of treatment failure.

The year of start of the first biologic therapy appears as a statistically significant predictor in most joint models and in all extended Cox models. For the majority of models, biologic therapy initiated in more recent years appeared to increase the risk of its failure.

The age at the start of the first biologic was statistically significant in most joint and extended Cox models, and older age at the time of therapy initiation was consistently a predictor of decreased risk of failure.

The year interval between disease beginning and start of the first biologic therapy was only statistically significant in a small percentage of joint models and showed no significance in any of the extended Cox models, echoing the results for the Cox model. The coefficient sign for this covariate was coherent among all models, indicating that a larger year interval reduces the chance of biologic therapy failure.

Being HLA-B27 positive was statistically significant as a predictor for biologic therapy failure in approximately 80% of all models and was consistently associated with a decreased risk of failure when in comparison with HLA-B27–negative patients.

The number of years of education showed statistical significance in roughly 90% of all joint and extended Cox models, and a higher number of education years increased the hazard of biologic therapy failure for all Cox, extended Cox, and joint models.

The value of CRP at baseline had an associated positive regression coefficient in all joint models and in 80% (4/5) of extended Cox models, indicating an increased risk of failure for higher CRP values, which was also verified in the Cox model. This covariate was not statistically significant in the Cox regression, but was significant in approximately 40% of the joint and extended Cox models.

The baseline BASFI was statistically significant in fewer than half of the joint and extended Cox models, even though it was always statistically significant in the survival submodels fitted with a Cox model. This variable appeared to be a predictor for increased risk of biologic therapy failure in most joint and extended Cox models, which is concordant with the Cox models' results.

Regarding the time-dependent variables, we noticed that, for the joint models, variables CRP, ESR, BASDAI, and ASDAS appeared to be statistically significant in most models. Furthermore, all were predictors of increased therapy failure for all the joint models that were fitted. Variable BASFI was only statistically significant in approximately half of the joint models, and the sign of its coefficient also varied considerably, not showing any clear tendency regarding the effect of this variable on the outcome.

In the extended Cox models, only variables BASDAI and ASDAS were statistically significant for all models. Variable ESR, BASFI, and CRP showed statistical significance in 75%, 58%, and 38% of the models, respectively. In all the models, all 5 time-varying covariates were predictors of increased risk of biologic failure.


Principal Results

Overall, the results obtained from the Cox models, extended Cox models, and joint models all indicated similar effects of the covariates on the treatment outcome.

The biomarkers that indicated a good prognosis for the biologic drug survival were being male, starting biologic therapy at an older age, having a larger time interval between disease onset and initiation of the first biologic drug, and being HLA-B27 positive.

Conversely, disease onset or initiation of biologic therapy in more recent years, a greater number of education years, and higher values of CRP or BASFI at baseline all appeared to be predictors of a greater risk of failure of the first biologic therapy.

Comparison With Prior Work

Male sex [22], HLA-B27–positive status [32], and longer disease duration [21] have been reported in the literature as being good predictors of biologic drug survival, which concurs with the results obtained in the Cox models of our study. On the other hand, older age at the start of the biologic therapy [32] has been reported to increase the risk of failure of the therapy, which is contrary to what was found in our data. We could interpret our result by speculating that older patients are more complacent due to the perceived efficacy of the therapy or because their symptoms are more intense than those of younger people and thus the relative improvement of symptoms is more noticeable, therefore increasing their satisfaction levels and decreasing the chances of therapy switch.

Regarding the predictors that were found to increase the risk of failure in our study, starting treatment in more recent years [33], and higher values of BASFI at baseline [21] were likewise found to be predictors of biologic drug discontinuation in research publications. A higher number of education years [23] was reported in one study as decreasing the risk of therapy failure, which differed from our results. Again, we could speculate and say that patients with a higher academic level are more comfortable with expressing their discontent with the lack of therapy response or that they are more aware of new therapeutic options and for that reason, request a switch of the therapy more often.

Higher values of CRP at baseline were found to increase [34] the hazard of biologic therapy failure in some publications but to have the opposite effect [23,33] in others.

Limitations

Some limitations of our study include the suboptimal fitting of the longitudinal variables. Therefore, the choice of the LME function for describing the biomarker trajectories and the different functional forms available that specify the association between the longitudinal biomarker and the hazard function of the event should be further explored.

Conclusions

Joint models are statistical models that can analyze both time-static and time-varying variables and therefore enable the inference of relationships between time-to-event and longitudinal data that are widely present in electronic medical records.

In this work, this modeling approach was selected to investigate biologic drug survival and its predictors for SpA patients in Portugal.

Furthermore, the insights obtained throughout the process that culminated in the fitting of these models are also highly valuable.

This study was the first to use the data of SpA patients from Reuma.pt in this capacity. The entire preprocessing work performed for enabling the use of Reuma.pt produced a data set that can be used by researchers who wish to investigate this group of diseases.

The variable selection process appears to be sensitive to this data preprocessing step depending on which variables and patients are described in the data set.

The tested methods for variable selection yielded quite different results for the same set of data. The process of selection of covariates should be analyzed carefully, as fully automated methods may not be the most appropriate ones for establishing which variables should be included in the statistical model. A wise approach consists of a balance between statistical significance and clinical significance, with the study's goal always being kept in mind.

We demonstrated that joint models, particularly the functions implemented in the R software packages “JM” and “Jmbayes,” can be successfully used for the simultaneous analysis of time-to-event and longitudinal data.

Health care providers use rheumatic disease progression measures computed from disease activity scores to shape treatment strategies and improve the quality of life of their patients [35]. However, targeted treatments that save patients from the potential side effects of high-cost, unsatisfactory treatments require the identification of biomarkers that can determine which patients can profit from a given therapy [36]. Computational methods using statistical and machine learning methods hold promise for the overall understanding of rheumatic diseases and can aid in formulating therapeutic strategies and predicting prognosis and outcome [37,38].

With this study, it was possible to identify the potential predictors of biologic therapy failure for this Portuguese population of SpA patients. This can aid the prognosis of these rheumatic diseases and potentially predict the most adequate treatment option according to the patient's characteristics.

Acknowledgments

This study was supported by the Portuguese Foundation for Science and Technology (Fundação para a Ciência e Tecnologia) through the Instituto de Telecomunicações (UIDB/50008/2020), INESC-ID (UIDB/50021/2020), and projects MATISSE (DSAIPA/DS/0026/2019) and PREDICT (PTDC/CCI-CIF/29877/2017). This work has received funding from the European Union's Horizon 2020 Research and Innovation Programme under grant agreement no. 951970 (OLISSIPO project). We also acknowledge Sociedade Portuguesa de Reumatologia and all Reuma.pt contributors.

Authors' Contributions

CB processed the data, performed the fitting of the models and computational experiments, and wrote the first draft of the manuscript (all authors made the required updates). AMR and HC provided the data, clinical insights, and interpretation. AMC and SV conceived the study, supervised the research, generated the final results, and wrote the manuscript. All authors contributed to the final draft, and read and approved the final version of the manuscript.

Conflicts of Interest

None declared.

  1. Branco JC, Rodrigues AM, Gouveia N, Eusébio M, Ramiro S, Machado PM, EpiReumaPt study group. Prevalence of rheumatic and musculoskeletal diseases and their impact on health-related quality of life, physical function and mental health in Portugal: results from EpiReumaPt- a national health survey. RMD Open 2016;2(1):e000166 [FREE Full text] [CrossRef] [Medline]
  2. Jones A, Ciurtin C, Ismajli M, Leandro M, Sengupta R, Machado PM. Biologics for treating axial spondyloarthritis. Expert Opin Biol Ther 2018 Jun;18(6):641-652. [CrossRef] [Medline]
  3. Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. Journal of the American Statistical Association 1958 Jun;53(282):457-481. [CrossRef]
  4. Cox DR. Regression models and life-tables. Journal of the Royal Statistical Society: Series B (Methodological) 2018 Dec 05;34(2):187-202. [CrossRef]
  5. Kalbfleisch J, Prentice, RL. The Statistical Analysis of Failure Time Data. In: 2nd edition. John Wiley & Sons. New York: John Wiley & Sons; 2011:978.
  6. Rizopoulos D. Joint Models for Longitudinal and Time-to-Event Data: With Applications in R. Boca Raton: CRC press; 2012.
  7. Rizopoulos D, Takkenberg JJM. EuroIntervention 2014 Jun;10(2):285-288 [FREE Full text] [CrossRef] [Medline]
  8. Sudell M, Kolamunnage-Dona R, Tudur-Smith C. Joint models for longitudinal and time-to-event data: a review of reporting quality with a view to meta-analysis. BMC Med Res Methodol 2016 Dec 05;16(1):168 [FREE Full text] [CrossRef] [Medline]
  9. Welsing P, Broeder A, Tekstra J. SAT0116 Dynamic prediction of flares in rheumatoid arthritis using joint modeling and machine learningimulation of clinical impact when used as decision aid in a disease activity guided dose reduction strategy. Annals of the Rheumatic Diseases 2019;78:1125-1126. [CrossRef]
  10. Lim LSH, Pullenayegum E, Moineddin R, Gladman DD, Silverman ED, Feldman BM. Pediatr Rheumatol Online J 2017 Mar 29;15(1):18 [FREE Full text] [CrossRef] [Medline]
  11. Canhão H, Faustino A, Martins F, Fonseca JE, Rheumatic Diseases Portuguese Register Board Coordination‚ Portuguese Society of Rheumatology. Reuma.pt - the rheumatic diseases Portuguese register. Acta Reumatol Port 2011;36(1):45-56 [FREE Full text] [Medline]
  12. Khan, MA. Ankylosing spondylitis. Oxford: Oxford University Press; 2009:9780195368079.
  13. Espondilite Anquilosante tem um impacto económico em Portugal de 639 milhões de euros por ano. Novartis.   URL: https:/​/www.​novartis.pt/​news/​media-releases/​espondilite-anquilosante-tem-um-impacto-economico-em-portugal-de-639-milhoes-de [accessed 2020-11-26]
  14. Calin A, Garrett S, Whitelock H, Kennedy LG, O'Hea J, Mallorie P, et al. A new approach to defining functional ability in ankylosing spondylitis: the development of the Bath Ankylosing Spondylitis Functional Index. J Rheumatol 1994 Dec;21(12):2281-2285. [Medline]
  15. Garrett S, Jenkinson T, Kennedy LG, Whitelock H, Gaisford P, Calin A. A new approach to defining disease status in ankylosing spondylitis: the Bath Ankylosing Spondylitis Disease Activity Index. J Rheumatol 1994 Dec;21(12):2286-2291. [Medline]
  16. Lukas C, Landewé R, Sieper J, Dougados M, Davis J, Braun J, Assessment of SpondyloArthritis International Society. Development of an ASAS-endorsed disease activity score (ASDAS) in patients with ankylosing spondylitis. Ann Rheum Dis 2009 Jan;68(1):18-24. [CrossRef] [Medline]
  17. Molenberghs G, Verbeke G. Linear Mixed Models for Longitudinal Data. New York: Springer; 2000.
  18. Rizopoulos D. JM: an R package for the joint modelling of longitudinal and time-to-event data. J. Stat. Soft 2010;35(9):1-33. [CrossRef]
  19. Rizopoulos D. The R package JMbayes for fitting joint models for longitudinal and time-to-event data using MCMC. J. Stat. Soft 2016;72(7):1-46. [CrossRef]
  20. R: a language and environment for statistical computing. R Core Team.   URL: http://softlibre.unizar.es/manuales/aplicaciones/r/fullrefman.pdf [accessed 2020-11-26]
  21. Glintborg B, Østergaard M, Krogh NS, Tarp U, Manilo N, Loft AGR, et al. Clinical response, drug survival and predictors thereof in 432 ankylosing spondylitis patients after switching tumour necrosis factor α inhibitor therapy: results from the Danish nationwide DANBIO registry. Ann Rheum Dis 2013 Jul;72(7):1149-1155. [CrossRef] [Medline]
  22. Flouri ID, Markatseli TE, Boki KA, Papadopoulos I, Skopouli FN, Voulgari PV, et al. Comparative analysis and predictors of 10-year tumor necrosis factor inhibitors drug survival in patients with spondyloarthritis: first-year response predicts longterm drug persistence. J Rheumatol 2018 Jun;45(6):785-794 [FREE Full text] [CrossRef] [Medline]
  23. Hebeisen M, Scherer A, Micheroli R, Nissen MJ, Tamborrini G, Möller B, et al. Comparison of drug survival on adalimumab, etanercept, golimumab and infliximab in patients with axial spondyloarthritis. PLoS One 2019;14(5):e0216746 [FREE Full text] [CrossRef] [Medline]
  24. Collett D. Variable selection procedures. In: Collett D, editor. Modeling Survival Data in Medical Research. Boca Raton: CRC press; 2015:252-272.
  25. Venables W, Ripley B. Modern Applied Statistics With S-PLUS. New York: Springer Science & Business Media; 2013.
  26. Wen C, Zhang A, Quan S, Wang X. BeSS: an R Package for best subset selection in linear, logistic and Cox proportional hazards models. J. Stat. Soft 2020;94(4):1-24. [CrossRef]
  27. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J. Stat. Soft 2010;33(1):1-22. [CrossRef]
  28. Fox J, Weisberg S. An R Companion to Applied Regression. eBook: Sage publications; 2018.
  29. Therneau T, Grambsch P. Modeling Survival Dataxtending the Cox model. New York: Springer Science & Business Media; 2013.
  30. Kassambara A, Kosinski M, Biecek P. survminer: drawing survival curves using 'ggplot2'. Datanovia. 2017.   URL: https://rpkgs.datanovia.com/survminer/ [accessed 2020-11-24]
  31. Pinheiro J, Bates D, DebRoy S. Package nlme: linear and nonlinear mixed effects models,. The R Project. 2017.   URL: https://cran.r-project.org/web/packages/nlme/nlme.pdf [accessed 2020-11-24]
  32. Maneiro JR, Souto A, Salgado E, Mera A, Gomez-Reino JJ. Predictors of response to TNF antagonists in patients with ankylosing spondylitis and psoriatic arthritis: systematic review and meta-analysis. RMD Open 2015;1(1):e000017 [FREE Full text] [CrossRef] [Medline]
  33. Sepriano A, Ramiro S, van der Heijde D, Ávila-Ribeiro P, Fonseca R, Borges J, et al. eEfect of comedication with conventional synthetic disease-modifying antirheumatic drugs on retention of tumor necrosis factor inhibitors in patients with spondyloarthritis: a prospective cohort study. Arthritis Rheumatol 2016 Nov;68(11):2671-2679 [FREE Full text] [CrossRef] [Medline]
  34. Glintborg B, Ostergaard M, Krogh NS, Dreyer L, Kristensen HL, Hetland ML. Predictors of treatment response and drug continuation in 842 patients with ankylosing spondylitis treated with anti-tumour necrosis factor: results from 8 years' surveillance in the Danish nationwide DANBIO registry. Ann Rheum Dis 2010 Nov;69(11):2002-2008. [CrossRef] [Medline]
  35. Farheen K, Agarwal SK. Assessment of disease activity and treatment outcomes in rheumatoid arthritis. J Manag Care Pharm 2011;17(9 Suppl B):S09-S13. [CrossRef] [Medline]
  36. Gavrilă BI, Ciofu C, Stoica V. Biomarkers in rheumatoid arthritis, what is new? J Med Life 2016;9(2):144-148 [FREE Full text] [Medline]
  37. Pandit A, Radstake TRDJ. Machine learning in rheumatology approaches the clinic. Nat Rev Rheumatol 2020 Feb;16(2):69-70. [CrossRef] [Medline]
  38. Jiang M, Li Y, Jiang C, Zhao L, Zhang X, Lipsky PE. Machine learning in rheumatic diseases. Clin Rev Allergy Immunol 2021 Feb;60(1):96-110. [CrossRef] [Medline]


AIC: Akaike information criterion
AS: ankylosing spondylitis
ASDAS: ankylosing spondylitis disease activity score
BASDAI: Bath Ankylosing Disease Status in Ankylosing Spondylitis
BASFI: Bath Ankylosing Spondylitis Functional Index
CRP: C-reactive protein
ESR: erythrocyte sedimentation rate
HLA: human leukocyte antigen
LME: linear mixed effects
SpA: spondyloarthritis


Edited by C Lovis; submitted 29.12.20; peer-reviewed by C Amado, S Kardes; comments to author 20.02.21; revised version received 13.04.21; accepted 23.04.21; published 30.07.21

Copyright

©Carolina Barata, Ana Maria Rodrigues, Helena Canhão, Susana Vinga, Alexandra M Carvalho. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 30.07.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.