The Accuracy of Machine Learning to Predict Cardiac Arrest: A Systematic Review

Sunday, 17 November 2019

Laura Marie Moffat, MSN
School of Nursing, Purdue University School of Nursing, West Lafayette, IN, USA

Abstract

Problem: Last year, patients at a 191-bed Midwest community hospital experienced 74 cardiac arrests. The majority occurring outside of the ICU, on units without advanced monitoring, where nurses care for five to seven patients, and most staff have less than two years experience. Recognition of a patient’s decline depends on nursing observation and clinical judgment on units with limited technology, medical resources, and low levels of clinical information to base critical decisions. Even with quick action, the average survival rate of an in-hospital cardiac arrest is less than 25 percent. The chance for a meaningful recovery is low; therefore, the best strategy is early recognition with proactive steps to halt their decline. The early recognition of patients most likely to experience a cardiac arrest in hospitalized adults, therefore, is a priority to nursing.

Purpose: The purpose of this systematic review was to assess the state of research to determine if machine learning models more accurately predict in-hospital cardiac arrest when compared to the modified early warning score.

Search Strategy: A review of the literature was conducted in January 2019. Databases searched included CINAHL, EBSCO, and PubMed. Inclusion criteria included machine learning principles applied to hospitalized adult patients experiencing cardiac arrest, from peer-reviewed articles, written in English, with full text available, within the last seven years. Exclusion criteria included those in the ambulatory setting, pediatric studies, and studies lacking machine learning models, studies failing to predict cardiac arrest, and studies failing to compare to the modified early warning score. Five studies were included for review.

Results of Literature Search: Five studies, one prospective, and four retrospectives were included in this review, ranging in level of evidence from II to III. These studies included over 500,000 patients from hospitals in the United States, South Korea, and Singapore. Outcomes were cardiac arrest, unexpected death, and ICU transfer. Machine learning applications included support vector machine, stacked ensemble, random forest, deep learning, gradient boosting machine, and neural network. Models were trained from routine demographics, biochemical, and physiological data then compared to the modified early warning score.

Synthesis of Evidence: All five studies showed the incidence of in-hospital cardiac arrest was more accurately predicted when machine learning models (AUROC 0.78-0.86) were utilized compared to the modified early warning score (AUROC 0.55-0.70). Major trends in the studies included the use of deep learning models for variable selection.

Implications for Practice: Machine learning has the potential to provide more accurate predictions in real-time, enabling a proactive approach to the patient who stands to benefit the most. While there is indication through this work that machine learning models should be available to all clinicians, there are notable gaps in the availability of this technology at the bedside. Further research is needed to ensure the translation of this novel technology to the clinical practice setting.