Skip to main content
Download PDF

Volume 19 Supplement 1

Selected articles from the International Conference on Intelligent Biology and Medicine (ICIBM) 2018: medical informatics and decision making

Early prediction of acute kidney injury following ICU admission using a multivariate panel of physiological measurements

BMC Medical Informatics and Decision Making volume 19, Article number: 16 (2019) Cite this article

Abstract

Background

The development of acute kidney injury (AKI) during an intensive care unit (ICU) admission is associated with increased morbidity and mortality.

Methods

Our objective was to develop and validate a data driven multivariable clinical predictive model for early detection of AKI among a large cohort of adult critical care patients. We utilized data form the Medical Information Mart for Intensive Care III (MIMIC-III) for all patients who had a creatinine measured for 3 days following ICU admission and excluded patients with pre-existing condition of Chronic Kidney Disease and Acute Kidney Injury on admission. Data extracted included patient age, gender, ethnicity, creatinine, other vital signs and lab values during the first day of ICU admission, whether the patient was mechanically ventilated during the first day of ICU admission, and the hourly rate of urine output during the first day of ICU admission.

Results

Utilizing the demographics, the clinical data and the laboratory test measurements from Day 1 of ICU admission, we accurately predicted max serum creatinine level during Day 2 and Day 3 with a root mean square error of 0.224 mg/dL. We demonstrated that using machine learning models (multivariate logistic regression, random forest and artificial neural networks) with demographics and physiologic features can predict AKI onset as defined by the current clinical guideline with a competitive AUC (mean AUC 0.783 by our all-feature, logistic-regression model), while previous models aimed at more specific patient cohorts.

Conclusions

Experimental results suggest that our model has the potential to assist clinicians in identifying patients at greater risk of new onset of AKI in critical care setting. Prospective trials with independent model training and external validation cohorts are needed to further evaluate the clinical utility of this approach and potentially instituting interventions to decrease the likelihood of developing AKI.

Background

Acute kidney injury (AKI) is commonly seen in adults in the intensive care unit (ICU). AKI is one of the major diagnoses among ICU patients and a leading factor associated with a prolonged hospital stay and with subsequent morbidity or early mortality post discharge [1,2,3,4]. Acute renal failure is a complex disorder that presents itself in a variety of settings with clinical manifestations ranging from a minimal elevation in serum creatinine to anuric renal failure [5]. Unfortunately, the main biomarker of AKI, serum creatinine (SCr), is a late marker of injury, which delays diagnosis and treatment [6].

Previous studies highlight the importance of early recognition of AKI, as well as the association of AKI with increased mortality in hospitalized patients. As electronic health records (EHRs) become more prevalent, the increasing availability of comprehensive clinical databases provides the possibility of developing predictive models using data collected from thousands of patient encounters [5]. Efficacy of interventions often depends on the interplay between early identification of deterioration, the timing of interventions, and choice of interventions (e.g. selection of appropriate fluid resuscitation strategy, use of vasopressors, and administration of renoprotective agents). Multiple patient and healthcare delivery related risk factors have been shown as predictors of AKI in specific patient cohorts [7, 8]. However, correlations between these diverse set of risk factors across heterogeneous patient cohorts are much less understood, but critical for producing effective diagnostic and treatment guidelines of AKI [2, 3], Such guidelines often need a panel of demographic, clinical physiologic, and radiologic features in order to stratify patient cohorts for targeted treatment.

Currently, there is no mutually accepted definition of acute kidney dysfunction. Varying terms, such as acute renal failure, renal insufficiency, kidney injury, and renal impairment, and multiple definitions (e.g. percent or absolute increments of creatinine, or decrements of urine output) have been used previously [9]. The term acute kidney injury has gained momentum as the best nomenclature to replace acute renal failure because the spectrum of AKI is broad and includes varying degrees of severity.

We used the definition of AKI as described in the Kidney Disease Improving Global Outcomes (KDIGO) [10], in order to standardize the published diagnostic criteria. The diagnostic criteria are defined as an acute increase in the absolute level of serum creatinine of more than 0.3 mg/dl or 50% higher change in serum creatinine (SCr) from baseline within a 48-h period or decreased glomerular filtration rate (GFR) to less than 0.5 ml/kg/hour for more than six hours [9, 10]. These criteria were based on accumulating evidence that even small alterations in SCr are associated with dire consequences.

Many factors including nephrotoxic medications, insufficient effective circulating fluid volume, and intrinsic renal disease can cause or contribute to AKI [11, 12]. AKI can be diagnosed using any of several sets of diagnostic and classification criteria [9, 11, 13]. These diagnostic criteria are all based, in large part, on the commonly measured serum/plasma biomarker creatinine, whereby defined increases in creatinine occurring within a specific period of time (e.g. 24, 48 or 168 h) will be diagnostic of AKI. Thus, an accurate creatinine forecast, as we plan to develop in this study, should in turn enable prediction of AKI risk. In this study, we focus on predicting AKI using first-day measurements of a multivariate panel of physiologic variables, in order to elucidate early, subclinical deterioration of patient’s physiologic baselines that are predictive of AKI.

Related work

Numerous previously published studies describe AKI prediction models using EHR data [14,15,16,17,18,19,20,21,22,23,24]. Most models had modest performance with area under the receiver operating curves (AUC) approximating 0.75. However, many studies focus on specific patient groups such as cardiac surgery patients, septic shock patients, and elderly patients, or focus on the validation of novel biomarkers. Less work has been performed for general intensive care populations despite the fact that ICU patients also have high risk of AKI. Many previous studies also have small patient population due to specific focus. In addition, there is still a gap between existing studies and the need to identify high-risk AKI patients as early as possible. The approaches and goals of this study differ from previously published reports in that it aims to address these questions by utilizing a large clinical database and building a predictive model that enables early AKI detection. Many prior AKI prediction models, while nonetheless clinically useful in many settings, i) rely on various static scoring algorithms, often including a limited set of features in part to facilitate human (offline) computation; ii) incorporate non-routine biomarkers (e.g. NGAL) in predictions; and/or iii) do not model temporal progression of clinical, laboratory and other predictive information, which has been shown to be effective for clinical predictive modeling [25]. As a result, many previously developed models are not optimally suited for clinical decision making that forecasts AKI in a general patient population. For example, a predictive model that incorporates a limited set of predictors and, in particular, a limited array of clinical interventions as predictors, could not identify the impact that changes in clinical care might have on AKI risk. Likewise, models that rely heavily on biomarkers that are not routinely tested would be unable to accurately screen for AKI risk in a general patient population. Our approach, in contrast, involves the careful modeling of a wide array of predictor data including clinical treatments and the temporal aggregation of predictor data. Including a wide array of predictors may permit the models to provide predictions that are more patient-specific and suitable for clinical scenario testing. In addition, our approach focuses on the early prediction of AKI on patients who do not meet AKI criteria on admission to the ICU, thus targeting a population that could benefit from early preventive strategies that can prevent the development of AKI or minimize its clinical impact. This is important, given that prior studies utilizing automated AKI detection (as opposed to prediction) show limited effectiveness of therapeutic interventions in patients already meeting AKI criteria [26]. We expect that the types of models we develop and validate in the context of this study will have wide-ranging clinical applications.

Our study builds on top of previous studies by integrating the previously identified risk factors for AKI in ICU patients described in the literature including hemodynamic instability, hypoxemia, anemia, inflammation, coagulopathy, liver failure, acidosis, renal/metabolic derangement, and demographics/admission characteristics. In the current study, we investigated the incidence of AKI and the risk factors associated with its development in an ICU population. Our objective was to develop a prediction model capable of discriminating adult patients at high risk of developing new AKI early in their admission to the ICU.

Methods

Dataset

This study was a retrospective analysis of critical care patients presenting to the ICU and captured in the Medical Information Mart for Intensive Care III (MIMIC-III). MIMIC-III captures de-identified health information for more than 46,000 patients admitted to the critical care units at Beth Israel Medical Center between 2001 and 2012.

We developed SQL scripts in order to query the MIMIC-III database for all patients who had a creatinine measured at 72 h following ICU admission [27]. We restricted our search to patients 18 years of age or older, and we excluded patients with the pre-existing condition of Chronic Kidney Disease (CKD), who have an estimated GFR (eGFR, MDRD) < 60 mL/min/1.73 m2 [28, 29]. Data extracted included patient age, gender, ethnicity, 72-h creatinine, vital signs and lab values during the first day of ICU admission, whether the patient was mechanically ventilated during the first day of ICU admission, and the hourly rate of urine output during the first day of ICU admission.

A total of 23,950 patients met the inclusion criteria for this study. Table 1 presents the predictor variables used in this study, along with their statistical characteristics such as mean and standard deviation. For predictor variables, we excluded those patients who have variables with values that are outside the measurable range (e.g., Glucose value being 999,999). The majority of the patient cohort was male (59.27%), white (72.07%) and the mean age was 60.89 years.

Table 1 Univariate Results for Predictors of Interest, N = 23,950
Full size table

Statistical analysis

Statistical analysis was performed using R Studio and Python [30, 31]. We ran univariate statistics for patient demographics and the predictors of interest. Univariate linear regression was performed using the maximum creatinine value during Day 2 and Day 3 as the outcome to assess the unadjusted relationship between the predictor of interest and the continuous outcome. Univariate logistic regression was performed using AKI versus no AKI as the outcome. According to KDIGO [10], AKI is defined as either of the following two conditions being met: 1) greater than or equal to 50% increase from the baseline creatinine value to the current creatinine value and 2) greater than or equal to 0.3 mg/dL change in creatinine from the baseline creatinine to the current creatinine value. The pre-ICU baseline creatinine value was defined according to the KDIGO definition by age, race/ethnicity, and gender [10]. We excluded anyone who had AKI on admission (Day 1) because we were interested in predicting new AKI while in the ICU. For AKI status on admission, we compared Day 1 maximum creatinine value (as current creatinine) with pre-ICU baseline. After excluding patients AKI on admission, we then determined the patients’ new AKI status by comparing Day 2 and Day 3 maximum creatinine (as current creatinine) with Day 1 minimum creatinine level.

Our dataset, like most clinical and laboratory datasets obtained in clinical practice, contained missing values, which represent tests not performed in our particular analysis. For example, the variables having a large proportion of missing values include minimum albumin level (74.1%), maximum bilirubin level (67.2%), maximum lactate level (55.8%), maximum c-reactive protein level (99.0%), maximum asparate aminotransferase level (66.8%), maximum pH level (36.6%), and minimum base excess level (64.8%).

Thus, our analysis relies on a two-staged procedure. In the first stage of this procedure, we removed the variables with missing values greater than 20% and we filled in the values for predictors (e.g. labs not performed or recorded) using Multivariate Imputation by Chained Equations (MICE) for those variables with less than 20% missing values. MICE estimates a conditional model for each variable to be imputed, with the other variables as possible predictors [32]. The term chained equation comes from the adoption of a Gibbs sampler, which is an iterative Markov Chain Monte Carlo (MCMC) algorithm for obtaining a sequence of observations that are approximated from a joint probability distribution. As MICE closely track the conditional interdependencies among variables, we expect MICE to produce more accurate imputation. Then, in the second stage, we use the measured and imputed values for these predictors plus age and gender to predict maximum creatinine results during Day 2 and Day 3. In this second stage, we predicted both numerical results for creatinine (linear regression) and whether creatinine increase would be classified as AKI (logistic regression). Although no creatinine results were actually missing from our dataset per the inclusion criteria, we assessed model performance and creatinine predictability by masking creatinine results from a test fold during five-fold cross validation and then compared predicted creatinine results to the masked (measured) values. The masked-measured values were treated as the “ground truth” in assessing model performance. The imputation stage was required because the prediction algorithms used in the second stage of our procedure could not directly accommodate missing data in predictors.

Many lab tests have results that closely follow a log-normal distribution. In linear regression analysis, minimizing the root-mean-square error is equivalent to the maximum likelihood estimation only under the assumption that the target variable adopts a normal distribution. Thus, we transformed creatinine values using a natural log transformation y =  ln (x), where y is the transformed creatinine value and x is the original creatinine value. The reportable range of creatinine is greater than or equal to 0.1, which guarantees that the log transformation will not produce minus infinity. We inverted this transformation on predicted values of log creatinine (predictions as described below) to calculate predicted values of creatinine in untransformed units.

When performing multivariable linear and logistic regression, all variables with unadjusted relationships with a p-value of greater than or equal to 0.05 were excluded from the initial model. Backward selection was used to develop models with all predictors significantly associated with the outcome at a p-value less than or equal to 0.05. One variable, with the highest p-value, was removed from the multivariable model at a time until all remaining variables were significantly associated with the outcome. For linear regression, regression coefficients, 95% confidence intervals, and p-values were calculated. For logistic regression, adjusted odds ratios, 95% confidence intervals, and p-values were calculated. A five-fold cross-validation was used to assess the performance of using the selected set or the entire set of variables to predict AKI related outcomes. For linear regression, the root mean square error values were calculated for all 10 runs of the cross-validation and averaged for both the final model developed with backward selection and the model with all predictors included. For logistic regression, the receiver operating characteristic (ROC) curves were developed for the final backward selection model and the model with all predictors of interest. The area under the curve (AUC) values were calculated for both models for all 10 runs and averaged for each model type. Performance metrics (accuracy, sensitivity, specificity, positive predictive value, and negative predictive value) were calculated for the backward selection model and model with all predictors of interest following cross-validation. In addition to logistic regression, we also used other machine learning models including random forests and multilayer perceptron (a type of artificial neural networks) to perform classification. We used the scikit-learn implementations of these machine learning models. For random forest classifier, we set the number of estimators to 100 and max number of tree features to square root of the number of total features. For the multilayer perceptron, we used the Adam solver [33]. As the class ratio is imbalanced, we set the class_weight parameter to “balanced” for logistic regression and random forest classifiers to down weight the more popular class. We also explored the imlearn package for multiple over sampling and under sampling methods including SMOTE [34], ADASYN [35], random under sampling, Tomek Link, and Neighborhood Cleaning Rule. For our task, we found that random under sampling to bring the positive and negative class numbers to comparable level is a simple yet effective method.

Results

Table 2 presents the bivariate associations between the linear outcome of interest (maximum creatinine during Day 2 and Day 3)/logistic outcome of interest (AKI) and the predictors. Of those included in the study, 3945 (16.5%) total patients had new AKI and 20,005 (83.5%) did not have new AKI according to our definition. In the unadjusted linear regression analyses, minimum diastolic blood pressure, maximum temperature, maximum heart rate, mean heart rate, maximum glucose level, and urine output were not significantly associated with the continuous creatinine outcome and left out of multivariable modeling (p > 0.05). In the unadjusted logistic analyses, maximum temperature, minimum international normalized ratio, minimum prothrombin time, maximum heart rate, mean heart rate, maximum glucose level, and urine output were not significantly associated with the dichotomous AKI outcome and left out of multivariable modeling (p > 0.05).

Table 2 Bivariate associations between linear outcome (maximum creatinine during Day 2 and Day 3) and binary outcome (AKI) and Predictors
Full size table

The multivariable linear regression model results are presented in Table 3. All predictors were significantly associated with maximum creatinine during Day 2 and Day 3. The multivariable logistic regression model results are presented in Table 4. All predictors were significantly associated with AKI. Comparing the two tables, most of the significant AKI predictors are similar to those found in the linear regression. These predictors are consistent with the known pathophysiology of AKI. Males, older patients, and African-Americans have higher incidence of AKI. Hypoxemia (low SpO2), mechanical ventilation, and coagulopathy (prolonged partial thromboplastin and prothrombin times) are also known risk factors of AKI and also might represent patients with higher severity of illness. Patients with less anemia (high hemoglobin) are probably less likely to have AKI due to the increased oxygen carrying capacity and the lower likelihood of requiring a blood transfusion, which is a known risk factor of AKI. The “protective” effect of high blood urea nitrogen level (and possibly high hemoglobin) probably represents patients with intravascular hypovolemia who are less likely to be diagnosed with AKI after the dilutional effect of fluid resuscitation. The elevated potassium and calcium levels likely represent early electrolyte disturbances in the setting of injured kidneys likely to meet AKI definition in the subsequent days. Finally, the elevated creatinine level, while not meeting AKI criteria in these patients given the exclusion criteria of the study, likely represents an early elevation indicative of injured kidneys in which the creatinine level hasn’t peaked yet. Note that the high bicarbonate level, which was not selected in the linear regression, but achieved a small significance level in the logistic regression, likely represents a surrogate of less acidosis, which is associated with higher severity of illness and is a risk factor of AKI.

Table 3 Multivariable linear regression results following backward selection
Full size table
Table 4 Multivariable logistic regression results following backward selection
Full size table

Due to the nature of random fold split in cross-validation, we ran both cross-validated linear regression and logistic regression 10 times with different random seeds to account for performance variability. Table 5 presents the regression results from the cross-validation for linear regression. Table 6 presents the classification results from the cross-validation using logistic regression, random forests, and multilayer perceptron. For linear regression, the backward selection model had the same root mean square error value than the model with all variables (0.224 vs. 0.224 mg/dL, respectively). In MIMIC-III dataset, the serum creatinine level is reported to 0.1 mg/dL, with a range 10 mg/dL. Thus, the root mean square error should be considered low both in absolute value and in percentage over range (2.2%). Although the RMSE is close to the 0.3 mg/dL change in the KDIGO AKI criteria, our logistic regression model designed to predict AKI categorical status achieved competitive performance. For logistic regression, the backward selection model had a lower area under the curve than the model with all variables (0.780 vs. 0.783, respectively). For random forests, the backward selection model had a lower area under the curve than the model with all variables (0.772 vs. 0.779, respectively), both lower than logistic regression. Multilayer perceptron gives the best performance with the backward selection model all variables models having AUCs of 0.792 and 0.796 respectively. Given that most previous models had modest AUCs around 0.75 (see Related Work section), our model gives a better performance than previous models when using all-variable models. In addition, our results generalize to much larger general adult critical care patient cohort. Table 7 presents the performance metrics for the logistic regression models. Across all machine learning algorithms and both backward selected and all-variable models, recall (sensitivity: 0.660–0.698) is favored over precision (positive predictive value: 0.337–0.357). This conforms to the clinical need in that given the relative low prevalence and high stake of AKI, one wants to catch as many AKI cases as possible and is willing to bear with false alarms.

Table 5 Linear regression results from the cross-validation
Full size table
Table 6 Machine learning results from the cross-validation
Full size table
Table 7 Other average performance metrics from the cross-validation
Full size table

Next, we more closely investigated the extent to which serum creatinine can be predicted. We examined scatter plots denoting the relationship between measured and predicted creatinine values, as shown in Fig. 1. Both models generated similar prediction plots. Note that predictions were most accurate toward the middle of the dynamic range of measured creatinine results, presumably due to “regression toward the mean.” Some of the numerical prediction error may thus be attributed to measured creatinine values toward the high end of the range with predicted values of creatinine that are considerably lower, but that are still within the reference range. Furthermore, the regression algorithms in general train to minimize error throughout the dynamic range, thus explaining the behavior in the plots. Figure 2 further plots the ROC curves (overlay of all 10 runs) for classifying AKI binary outcome with the logistic regression, random forest, and multilayer perceptron models using variables from backward selection and all variables. For logistic regression, the two models exhibited different classification performance, which is evident from similar AUCs and ROC curves. The backward selection model gives an averaged AUC of 0.780 comparable to previous systems and is insensitive to different cross validation random splits. The all-feature model gives a higher averaged AUC of 0.783. The fact that both the linear regression and the logistic regression backward selection models are not sensitive to cross validation splits likely suggests the robustness of the model and the predictability of both the numeric serum creatinine level and the binary AKI classification. Thus we chose the backward selection model when evaluating the individual factor association with the serum creatinine value and new AKI status as a conservative, but reliable way to derive clinical insights. On the other hand, the higher AUCs from all-feature model suggest the effectiveness and potential of an entirely data-driven approach over a more parsimonious model. The fact that all-feature model subjects to more randomness in the data likely calls for a more effective feature selection method that takes statistical stability into consideration.

Fig. 1
figure 1

Scatter plots comparing the measured and predicted creatinine values using linear regression models with a) backward selection variable model and b) all variables model after cross-validation. Note that the axes are on a logarithmic scale or plot log transformed data

Full size image
Fig. 2
figure 2

ROC curves for logistic regression, random forest, and multilayer perceptron models using a) backward selection model and b) all-feature model using cross-validation. We repeat the 5-fold cross validation 10 times, each time using stratified 5-fold split with different random initializations. We use different colors for ROC curves from different cross validations. Note that for both for both the all-variable and backward selection models, the model performance is insensitive to stratified 5-fold splits with different random initializations. Thus, the ROC curves are almost identical to each other

Full size image

Discussion

In our two-stage analysis, we have used MICE imputation to fill in missing values for each variable. This approach imputes missing values by the MICE algorithm [32, 36]. Theoretically, this method is only unbiased under the assumption that the data is missing-at-random. Real clinical practice surely violates this assumption since clinicians usually order tests given some expectations about the likely results. Nonetheless, our previous study shows that imputation bias due to not missing-at-random may have only minimal impact on patient outcome prediction [37]. In practice, it may be used as an effective way and baseline for comparing other multiple imputation methods due to its simple implementation [38]. We are also aware of the limitations of imputation for clinical data, as missingness may represent no indication for having the test performed. To this end, we will also investigate missingness patterns as predictors in future studies.

We recognize a number of additional limitations of our initial study. Our models were primarily based on demographic, vital signs, and laboratory data but did not factor in comorbid diagnoses. This is similar to other predictive scores of severely ill patients such as the MELD [39] and APACHE II [40] scoring systems, which are also based on well-defined structured laboratory or vital signs data. In the ICU setting, patients often suffer from multiple acute upon chronic conditions where the acute immediate condition may play a more important role than prior chronic conditions, hence the relatively larger impact of current laboratory tests or vital signs. However, future work will include comorbid diagnoses as factors in multivariate regression analyses. Conditions which affect the kidneys, such as diabetes, may be disproportionate in their effect, and will need to be accounted for in future work.

In this study, we also focused on predicting AKI using first-day measurements of a multivariate panel of physiologic variables but not medications and procedures, in order to elucidate early, subclinical deterioration of patients’ physiologic baselines that are predictive of AKI. We also focused on establishing the baseline of using physiologic variables to predict AKI with large cohort size but did not consider dynamic prediction window. The Kidney Disease Improving Global Outcomes (KDIGO) clinical practice guidelines examines serum creatinine change within 48 h [13]. We will examine in future studies the AKI prediction with physiologic and medication data and with dynamic prediction windows (e.g., using patient data up to Day n to predict AKI in Day n + 1 and Day n + 2). We also plan to explore the temporal changes of the model predictors to improve the prediction model performance.

In the backward linear and logistic regression models, predictors included did vary. Included in linear regression and not in logistic regression were the following variables: creatinine level minimum and international normalized ratio minimum. Ethnicity and systolic blood pressure minimum were the only variables included in logistic regression that was not included in linear regression. As it is uncommon for the linear regression model to use more predictors than the logistic regression model due to more detailed outcome prediction (numeric vs. binary label) by the former, we will use clinical content experts to suggest a pared down list of predictors or natural clinically relevant cutoff scores for variables, to see if these will improve model performance and relevance. When selecting the predictors, in addition to using the p-values as the sole criteria, we plan to integrate other factors such as effect size as additional criteria during predictor selection in the future.

Conclusions

We demonstrated the feasibility of developing a model for early prediction of AKI in the first 72 h following ICU admission in an adult patient population in critical care setting. Through cross-validation on linear regression and multiple machine learning models, we showed that comprehensive demographics and physiologic features can accurately predict max serum creatinine level during Day 2 and Day 3 with a root mean square error of 0.224 mg/dL. The same demographics and physiologic features can also predict new AKI onset as defined by the current clinical guideline with a competitive AUC (mean AUC 0.783 by our all-feature model), while previous models aimed at more specific patient cohorts. Our work suggests that prospective trials with independent model training and validation cohorts are needed to further evaluate the clinical utility of this approach for identifying at risk patients early in their hospital course and potentially instituting interventions to decrease the likelihood of developing AKI.

Abbreviations

AKI:

Acute kidney injury

AUC:

Area under the receiver operating curves

CKD:

Chronic Kidney Disease

eGFR:

estimated glomerular filtration rate

EHRs:

Electronic health records

ICU:

Intensive care unit

KDIGO:

Kidney Disease Improving Global Outcomes

MCMC:

Markov Chain Monte Carlo

MICE:

Multivariate Imputation by Chained Equations

MIMIC-III:

Medical Information Mart for Intensive Care III

NGAL:

Neutrophil gelatinase-associated lipocalin

RMSE:

Root-mean-square error

ROC:

Receiver operating characteristic

SCr:

Serum creatinine

References

  1. Ali T, Khan I, Simpson W, Prescott G, Townend J, Smith W, Macleod A. Incidence and outcomes in acute kidney injury: a comprehensive population-based study. J Am Soc Nephrol. 2007;18:1292–8.

    Article  CAS  Google Scholar 

  2. Kellum JA, Lameire N, Group KAGW. Diagnosis, evaluation, and management of acute kidney injury: a KDIGO summary (part 1). Crit Care. 2013;17:204.

    Article  Google Scholar 

  3. Lameire N, Kellum JA, Group KAGW. Contrast-induced acute kidney injury and renal support for acute kidney injury: a KDIGO summary (part 2). Crit Care. 2013;17:205.

    Article  Google Scholar 

  4. Thakar CV, Christianson A, Freyberg R, Almenoff P, Render ML. Incidence and outcomes of acute kidney injury in intensive care units: a veterans administration study. Crit Care Med. 2009;37:2552–8.

    Article  Google Scholar 

  5. Wang HE, Muntner P, Chertow GM, Warnock DG. Acute kidney injury and mortality in hospitalized patients. Am J Nephrol. 2012;35:349–55.

    Article  Google Scholar 

  6. de Geus HR, Betjes MG, Bakker J. Biomarkers for the prediction of acute kidney injury: a narrative review on current status and future challenges. Clin Kidney J. 2012;5:102–8.

    Article  Google Scholar 

  7. Plataki M, Kashani K, Cabello-Garza J, Maldonado F, Kashyap R, Kor DJ, Gajic O, Cartin-Ceba R. Predictors of acute kidney injury in septic shock patients: an observational cohort study. Clin J Am Soc Nephrol. 2011;6:1744–51.

    Article  Google Scholar 

  8. Prowle JR, Liu YL, Licari E, Bagshaw SM, Egi M, Haase M, Haase-Fielitz A, Kellum JA, Cruz D, Ronco C, et al. Oliguria as predictive biomarker of acute kidney injury in critically ill patients. Crit Care. 2011;15:R172.

    Article  Google Scholar 

  9. Mehta RL, Kellum JA, Shah SV, Molitoris BA, Ronco C, Warnock DG, Levin A, Network AKI. Acute kidney injury Network: report of an initiative to improve outcomes in acute kidney injury. Crit Care. 2007;11:R31.

    Article  Google Scholar 

  10. The Kidney Disease Improving Global Outcomes (KDIGO) Working Group: KDIGO Clinical Practice Guideline for Acute Kidney Injury. In Supplement 1. pp. 29–30: Kidney International; 2012:29–30.

  11. Bellomo R, Kellum JA, Ronco C. Acute kidney injury. Lancet. 2012;380:756–66.

    Article  Google Scholar 

  12. Chertow GM, Burdick E, Honour M, Bonventre JV, Bates DW. Acute kidney injury, mortality, length of stay, and costs in hospitalized patients. J Am Soc Nephrol. 2005;16:3365–70.

    Article  Google Scholar 

  13. The Kidney Disease Improving Global Outcomes (KDIGO) Working Group: Definition and classification of acute kidney injury. In Supplement 2. pp. 19–36: Kidney International:19–36.

  14. Kate RJ, Perez RM, Mazumdar D, Pasupathy KS, Nilakantan V. Prediction and detection models for acute kidney injury in hospitalized older adults. BMC Med Inform Decis Mak. 2016;16:39.

    Article  Google Scholar 

  15. Bedford M, Stevens P, Coulton S, Billings J, Farr M, Wheeler T, Kalli M, Mottishaw T, Farmer C. Development of risk models for the prediction of new or worsening acute kidney injury on or during hospital admission: a cohort and nested study. Southampton (UK): NIHR Journals Library; 2016.

    Google Scholar 

  16. Perazella MA. The urine sediment as a biomarker of kidney disease. Am J Kidney Dis. 2015;66:748–55.

    Article  CAS  Google Scholar 

  17. Kerr KF, Meisner A, Thiessen-Philbrook H, Coca SG, Parikh CR. Developing risk prediction models for kidney injury and assessing incremental value for novel biomarkers. Clin J Am Soc Nephrol. 2014;9:1488–96.

    Article  Google Scholar 

  18. Kim WH, Lee SM, Choi JW, Kim EH, Lee JH, Jung JW, Ahn JH, Sung KI, Kim CS, Cho HS. Simplified clinical risk score to predict acute kidney injury after aortic surgery. J Cardiothorac Vasc Anesth. 2013;27:1158–66.

    Article  Google Scholar 

  19. Kiers HD, van den Boogaard M, Schoenmakers MC, van der Hoeven JG, van Swieten HA, Heemskerk S, Pickkers P. Comparison and clinical suitability of eight prediction models for cardiac surgery-related acute kidney injury. Nephrol Dial Transplant. 2013;28:345–51.

    Article  Google Scholar 

  20. Ploug T, Holm S. Informed consent and routinisation. J Med Ethics. 2013;39:214–8.

    Article  Google Scholar 

  21. Zhou LZ, Yang XB, Guan Y, Xu X, Tan MT, Hou FF, Chen PY. Development and validation of a risk score for prediction of acute kidney injury in patients with acute decompensated heart failure: a prospective cohort study in China. J Am Heart Assoc. 2016;5:1–9.

  22. Wilson T, Quan S, Cheema K, Zarnke K, Quinn R, de Koning L, Dixon E, Pannu N, James MT. Risk prediction models for acute kidney injury following major noncardiac surgery: systematic review. Nephrol Dial Transplant. 2016;31:231–40.

    PubMed  Google Scholar 

  23. Sanchez-Pinto LN, Khemani RG. Development of a prediction model of early acute kidney injury in critically ill children using electronic health record data. Pediatr Crit Care Med. 2016;17:508–15.

    Article  Google Scholar 

  24. Li Y, Yao L, Mao C, Srivastava A, Jiang X, Luo Y. Early prediction of acute kidney injury in critical care setting using clinical notes. In: Bioinformatics and Biomedicine (BIBM), 2016 IEEE International Conference on. IEEE; 2018.

    Google Scholar 

  25. Luo Y, Xin Y, Joshi R, Celi L, Szolovits P. Predicting ICU mortality risk by grouping temporal trends from a multivariate panel of physiologic measurements. Paper presented at: proceedings of the 30th AAAI. Conference on artificial intelligence; 2016.

  26. Colpaert K, Hoste EA, Steurbaut K, Benoit D, Van Hoecke S, De Turck F, Decruyenaere J. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med. 2012;40:1164–70.

    Article  Google Scholar 

  27. Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035.

    Article  CAS  Google Scholar 

  28. Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF, Feldman HI, Kusek JW, Eggers P, Van Lente F, Greene T, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150:604–12.

    Article  Google Scholar 

  29. Stevens LA, Coresh J, Greene T, Levey AS. Assessing kidney function--measured and estimated glomerular filtration rate. N Engl J Med. 2006;354:2473–83.

    Article  CAS  Google Scholar 

  30. RStudio Team. RStudio: Integrated Development for R, version 1.1.423. Boston: RStudio, Inc.; 2015. [http://www.rstudio.com/].

  31. Python Software Foundation. Python Language Reference, version 2.7. [http://www.python.org].

  32. van Buuren S, Groothuis-Oudshoorn K: mice: Multivariate Imputation by Chained Equations in R. 2011 2011, 45:67.

  33. Kingma DP, Ba J. Adam: a method for stochastic optimization. In: arXiv preprint arXiv:14126980; 2014.

    Google Scholar 

  34. Chawla N, Bowyer K, Hall L, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.

    Article  Google Scholar 

  35. He H, Bai Y, Garcia E, Li S. ADASYN: adaptive synthetic sampling approach for imbalanced learning. In: 2008 international joint conference on neural networks; 2008.

    Google Scholar 

  36. Roderick JA. Little: Regression With Missing X's: A Review. J Am Stat Assoc. 1992;87:1227–37.

  37. Luo Y, Szolovits P, Dighe AS, Baron JM. Using machine learning to predict laboratory test results. Am J Clin Pathol. 2016;145:778–88.

    Article  Google Scholar 

  38. Luo Y, Szolovits P, Dighe AS, Baron JM. 3D-MICE: integration of cross-sectional and longitudinal imputation for multi-analyte longitudinal clinical data. J Am Med Inform Assoc. 2017;25:645–53.

    Article  Google Scholar 

  39. Wiesner R, Edwards E, Freeman R, Harper A, Kim R, Kamath P, Kremers W, Lake J, Howard T, Merion RM, et al. Model for end-stage liver disease (MELD) and allocation of donor livers. Gastroenterology. 2003;124:91–6.

    Article  Google Scholar 

  40. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13:818–29.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

This study was supported in part by grant R21LM012618–01 and grant UL1 TR001422 from NIH, and grant IIS-1417819 from NSF. Publication charges for this article have been funded by grant UL1 TR001422 from NIH and grant IIS-1417819 from NSF.

Availability of data and materials

The datasets generated and/or analyzed during the current study are available on the MIMIC-III critical care database at https://mimic.physionet.org/.

About this supplement

This article has been published as part of BMC Medical Informatics and Decision Making Volume 19 Supplement 1, 2019: Selected articles from the International Conference on Intelligent Biology and Medicine (ICIBM) 2018: medical informatics and decision making. The full contents of the supplement are available online at https://bmcmedinformdecismak.biomedcentral.com/articles/supplements/volume-19-supplement-1.

Author information

Authors and Affiliations

  1. Northwestern University, Evanston, IL, 60208, USA

    Lindsay P. Zimmerman, Paul A. Reyfman, Angela D. R. Smith, Zexian Zeng, Abel Kho, L. Nelson Sanchez-Pinto & Yuan Luo

Authors
  1. Lindsay P. Zimmerman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul A. Reyfman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Angela D. R. Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zexian Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Abel Kho
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. L. Nelson Sanchez-Pinto
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yuan Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LPZ analyzed and interpreted the data and was a major contributor in writing the manuscript. PAR helped to acquire the data from the MIMIC site, interpreted clinical findings, and helped to draft manuscript. ADRS helped to interpret findings and draft the manuscript. ZZ helped to analyze the data. AK helped to interpret the clinical findings and revised the manuscript for important intellectual content. LNSP helped to interpret the clinical findings and revised the manuscript for important intellectual content. YL originated the study, designed the project, assisted with data analysis, was involved in drafting the manuscript, and edited the manuscript for important intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yuan Luo.

Ethics declarations

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zimmerman, L.P., Reyfman, P.A., Smith, A.D.R. et al. Early prediction of acute kidney injury following ICU admission using a multivariate panel of physiological measurements. BMC Med Inform Decis Mak 19 (Suppl 1), 16 (2019). https://doi.org/10.1186/s12911-019-0733-z

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/s12911-019-0733-z

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us