Predictive modeling of ambulatory outcomes after spinal cord injury using machine learning

Study Design

Retrospective multi-site cohort study.

Objectives

To develop an accurate machine learning predictive model using predictor variables from the acute rehabilitation period to determine ambulatory status in spinal cord injury (SCI) one year post injury.

Setting

Model SCI System (SCIMS) database between January 2000 and May 2019.

Methods

Retrospective cohort study using data that were previously collected as part of the SCI Model System (SCIMS) database. A total of 4523 patients were analyzed comparing traditional models (van Middendorp and Hicks) compared to machine learning algorithms including Elastic Net Penalized Logistic Regression (ENPLR), Gradient Boosted Machine (GBM), and Artificial Neural Networks (ANN).

Results

Compared with GBM and ANN, ENPLR was determined to be the preferred model based on predictive accuracy metrics, calibration, and variable selection. The primary metric to judge discrimination was the area under the receiver operating characteristic curve (AUC). When compared to the van Middendorp all patients (0.916), ASIA A and D (0.951) and ASIA B and C (0.775) and Hicks all patients (0.89), ASIA A and D (0.934) and ASIA B and C (0.775), ENPLR demonstrated improved AUC for all patients (0.931), ASIA A and D (0.965) ASIA B and C (0.803).

Conclusions

Utilizing artificial intelligence and machine learning methods are feasible for accurately classifying outcomes in SCI and may provide improved sensitivity in identifying which individuals are less likely to ambulate and may benefit from augmentative strategies, such as neuromodulation. Future directions should include the use of additional variables to further refine these models.