Skip to main content
Download PDF

Patient centred variables with univariate associations with unplanned ICU admission: a systematic review

BMC Medical Informatics and Decision Making volume 19, Article number: 98 (2019) Cite this article

Abstract

Background

Multiple predictive scores using Electronic Patient Record data have been developed for hospitalised patients at risk of clinical deterioration. Methods used to select patient centred variables for inclusion in these scores varies. We performed a systematic review to describe univariate associations with unplanned Intensive Care Unit (ICU) admission with the aim of assisting model development for future scores that predict clinical deterioration.

Methods

Data sources were MEDLINE, EMBASE, CINAHL, CENTRAL and the Cochrane Database of Systematic Reviews. Included studies were published since 2000 describing an association between patient centred variables and unplanned ICU admission determined using univariate analysis. Two authors independently screened titles, abstracts and full texts against inclusion and exclusion criteria. DistillerSR (Evidence Partners, Canada, Ottawa, Ontario) software was used to manage the data and identify duplicate search results. All screening and data extraction forms were implemented within DistillerSR. Study quality was assessed using an adapted version of the Newcastle-Ottawa Scale. Variables were analysed for strength of association with unplanned ICU admission.

Results

The database search yielded 1520 unique studies; 1462 were removed after title and abstract review; 57 underwent full text screening; 16 studies were included. One hundred and eighty nine variables with an evaluated univariate association with unplanned ICU admission were described.

Discussion

Being male, increasing age, a history of congestive cardiac failure or diabetes, a diagnosis of hepatic disease or having abnormal vital signs were all strongly associated with ICU admission.

Conclusion

These findings will assist variable selection during the development of future models predicting unplanned ICU admission.

Trial registration

This study is a component of a larger body of work registered in the ISRCTN registry (ISRCTN12518261).

Peer Review reports

Background

In experimental settings, scores that predict risk for clinical deterioration in hospitalised patients have evolved from vital sign based Early Warning Scores (EWS) to systems that utilise the large amount of patient centred data in Electronic Patient Records (EPRs) [1,2,3,4]. These systems are not yet in widespread use, however they represent a first step towards automatically assimilating patient data to assist clinical decision making on high risk ward patients. Each of the current, published experimental models were derived and validated on large EPR linked databases that used Intensive Care Unit (ICU) admission as one of the outcome measures. This outcome measure is commonly used (along with death and cardiac arrest) as a surrogate for confirmed clinical deterioration.

These and other prognostic models use a variety of statistical methods but multivariate regression modelling and machine learning techniques are commonly used. These methods require patient centred ‘candidate’ variables (such as vital signs or laboratory results) to form the component parts of the model [5]. The process of selecting model candidate variables is important, however there is no consensus on how best to do this. Numerous methods have been used for multivariate logistic regression, including expert opinion, forward and backward stepwise selection and machine learning techniques [6]. A logical and often used first step is evaluating univariate associations, which enables the variables to be quantified in advance of their inclusion in the model [7]. This is helpful when using EPR data where there are large number of available candidate variables [8]. Regardless of the method, the goal is to include the optimal combination of variables that maximise predictive ability, whilst avoiding unnecessary complexity [6].

In this systematic review we provide a complete summary of patient centred variables with a univariate association with unplanned ICU admission. By providing these data, we hope to aid the development of EPR based models for the prediction of ICU admission (and therefore clinical deterioration). We anticipate these data will enhance data-driven improvements in the care of deteriorating ward patients.

Methods

Search and identification of studies

The study protocol has been published [9] and follows the Preferred Reporting of Observational Studies and Meta-Analysis (PRISMA) statement [10]. An experienced medical librarian helped devise the search strategy to maximise identification of relevant studies. Studies were identified by searching Medical Literature Analysis and Retrieval System Online (MEDLINE), Excerpta Medica database (EMBASE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane Database of Systematic Reviews and the Cochrane Central Register of controlled trials (CENTRAL). We included additional studies from the references of review articles, studies identified during screening, and from the authors’ personal libraries. We restricted the search to studies published since 2000. We did not apply any language restrictions. The search design is shown in the Additional file 1 (SDC-1).

Inclusion criteria

Included studies evaluated hospitalised, adult patients located in either the Emergency Department (ED), the general surgical or medical wards. Patients in specialist wards (such as obstetric or psychiatric) were eligible if they were evaluated as a part of the general patient population rather than disease specific sub groups of patients. Included studies required an analysis of at least two cohorts: one cohort of patients admitted to ICU (intervention) and one not admitted to ICU (control). Variables were eligible if they were patient centred and had been evaluated across both cohorts. Studies which described a univariate, statistical relationship between a patient centred variable (e.g. heart rate) and unplanned ICU admission were included. The described variables were single entities, as opposed to composites such as risk scores.

Exclusion criteria

Excluded studies did not evaluate unplanned ICU as an isolated outcome measure nor did they evaluate patients requiring ICU readmission. Additionally, studies that evaluated variables related to hospital processes or environmental risk alone (e.g. staff-to-nurse ratios), carried out multivariate analyses (without describing the univariate analyses that went into selecting variables for the model) or evaluated patient groups with a single diagnosis, were also excluded. (The studies excluded via this criterion are listed in Additional file 1 (SDC-2)). Patients admitted to ICU (or not) from high acuity areas such as HDU were excluded from the review as these hospital areas are often linked to ICUs and so are not always captured as admissions. Subgroups of illness acuity, such as needing an Rapid Response System (RRS) alert or being a high triage category, were not excluded. Finally, studies not published in peer-reviewed journals and those examining patients < 15 years old were excluded.

Study selection and data abstraction

Two authors (JM, TB) independently screened titles and abstracts of identified studies against the inclusion and exclusion criteria. (Fig. 1) They were not blinded to the journal titles or to the study authors or institutions. If there was disagreement or uncertainty regarding eligibility, the article was included in the next stage of screening. The full text was retrieved for all articles not excluded by the initial screening and re-assessed for eligibility as before. Disagreements about eligibility were resolved by discussion between the screening authors or a third party (a senior member of our research team, PW and DY). Two authors extracted independently data from the studies and supplementary material. Any uncertainties regarding data extraction were resolved by discussion amongst the study team. DistillerSR (Evidence Partners, Canada, Ottawa, Ontario) was used to manage the data and identify duplicate search results. All screening and data extraction forms were implemented within DistillerSR.

Fig. 1
figure 1

Flow diagram of the included and excluded studies

Full size image

Risk of Bias assessment

Two authors (JM, TB) independently assessed the risk of bias for included studies by using an adapted version of the Newcastle-Ottawa Scale (NOS) [11, 12]. The NOS is a scoring system designed to assess the quality of non-randomised studies in meta-analyses and systematic reviews [13]. We generated a score by assessing each study cohort for representativeness of the desired study population, the comparability of the cohorts being assessed, the size of the cohorts and correction for confounding. We adapted the NOS score to show bias in the types of studies included in this review (i.e. those showing univariate associations) whilst remaining faithful to the established NOS methodology. The details of the modified NOS scale are included in the Additional file 1 (SDC-3).

Data synthesis

We categorised patient-derived variables as comorbidities, demographics, laboratory tests, vital signs, diagnoses, medications and symptoms/signs, in general accordance with the categories used in the included studies. To synthesise and present the large number of variables included in the results in a logical way, we adopted the recently published method of Dettmer et al. (as adopted from Zaal et al.), who combined the quality of the studies investigating the variables in question (based on the NOS risk of bias assessment) with the number of times the variable was investigated [14, 15]. This semi-quantitative approach enable the assignation of a ‘weight of evidence’ to each variable (Table 1).

Table 1 Grading system for strength of evidence
Full size table

RESULTS

All included studies are shown in Table 2 [16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31], The database search yielded 1520 unique studies; 1462 were removed after title and abstract review; 57 underwent full text screening; sixteen studies were included in this review (Fig. 1). Summary details are shown in Table 2 with additional study data in the Additional file 1 (SDC-4). The mean study quality score was five and the mode was seven. We graded six studies high quality [18, 20, 21, 28,29,30], four moderate quality [16, 23,24,25] and six (low quality) [17, 19, 22, 26, 27, 31]. The results of the bias assessment for each study are shown in Table 2 and the Additional file 1 (SDC-5). The quality of the studies is also reflected in the weight of evidence for any particular variable.

Table 2 Details of included studies
Full size table

Quantised data were presented as independent variables. For example, arterial oxygen saturation was evaluated six times for ranges of < 80, < 95%, 80–89%, 90–94%, mean (%) and median (%) (in each study group) across four studies and thus included six times in the initial analysis, with each of these ranges being defined as a single variable [16, 18, 20, 22]. Likewise, ‘cardiovascular disorder’ was included 14 times across six studies, as either a comorbidity, diagnosis or symptom/sign [21, 26,27,28,29]. We recorded the statistical relationship between variables and unplanned ICU admission as p values, Odds Ratios (OR), Risk Ratios (RR) [28] or Incidence Rate Ratios (IRR) [21] (with 95% confidence intervals) and did not assign preference.

Five studies (31%) were case control studies and 11 (69%) were cohort studies. Eight (50%) were prospective and eight (50%) were retrospective. The number of participants in each study ranged between 95 in a prospective cohort study and 126,826 in a retrospective case control study. The number of patients admitted to ICU ranged between 15 and 5233, while in the control group they ranged between 80 and 125,244 (Table 2). Five studies (31%) evaluated patients in emergency departments (ED) and 11 studies (69%) evaluated patients treated on hospital wards. Of the studies examining ward patients, five evaluated patients admitted via ED, two evaluated patients who had an RRS review and four evaluated patients admitted via any source (SDC-6, Additional file 1). Escobar [20] studied patients in 20 centres, Schuetz [25] in three centres and Loekiko [24] in two centres. The remaining 13 studies were single centre (Table 1).

Across the 16 studies, 189 different patient-derived variables were assessed for univariate association with unplanned ICU admission. Of these, 53 were vital signs, 42 were comorbidities, 29 were diagnosis, 26 were demographics, 25 were laboratory results, 10 were symptoms/signs and 4 were medications. One hundred and twenty-eight variables had a statistically significant positive association, two had a negative association and 59 had no association with unplanned ICU admission. Information on effect size was described as ORs, RRs or IRRs where available and is shown in Additional file 1 (SCD-7).

The semi-quantitative analysis resulted in 110 variables after repeatedly measured variables were grouped together. These are shown in Table 3 and Additional file 1 (SDC-8). Overall there were 12 variables with a strong weight of evidence (one was negative), three with a moderate weight of evidence and 33 with a weak weight of evidence for an association with unplanned ICU admission. The remaining 62 variables showed an inconclusive weight of evidence.

Table 3 Patient centred variables associated with unplanned ICU admission
Full size table

Variables associated with unplanned ICU admission

Variables with a strong, moderate and negative weight of evidence for association with unplanned ICU admission are summarised in Table 3.

Comorbidities, demographics and diagnosis

A history of congestive heart failure and diabetes were the only comorbidities in this group. These had a significant result in two high-quality studies [21, 29] of the demographics, being male [20, 21, 27, 28] and an increasing age [16, 18, 20, 21, 27, 28] had a strong weight of evidence for association. Four studies showed a significant difference in mean or median age between ICU and control groups (higher in the ICU group) [18, 20, 21, 27] and three studies showed a significant OR or IRR for increased age quantiles with the oldest quantile being 75+ years of age [21, 28]. Hepatic disease was the only diagnosis strongly associated with unplanned ICU admission [28, 30].

Vital signs

All six vital signs had a strong association. Heart rate was studied 12 times across seven studies, 10 times as quantiles (seven times for tachycardia and three times for bradycardia) and twice as a comparison of means [16, 18, 20, 22, 27, 29, 30]. Seven of the tachycardia and one of the bradycardia quantiles (< 60 beats per minute) showed a positive association. Two high-quality studies also found a significant difference in mean heart rate (higher in the ICU group) [18, 20]. Elevated respiratory rate was evaluated eight times across six studies and had a strong weight of evidence [16, 20, 22, 27, 30]. Five of the six quantiles showed a significant result [16, 27, 30] and both high-quality studies examining mean respiratory rate showed a significant difference [18, 20]. The only non-significant result was a respiratory rate of > 20 breaths per minute in a low-quality study [22]. Systolic blood pressure (SBP) was evaluated seven times across five studies [16, 18, 20, 22, 27]. Two high-quality studies showed a significant reduction in mean blood pressure [18, 20] and one moderate-quality study showed a significant OR for a SBP of 80-89 mmHg versus 90 mmHg and above [16]. Diastolic blood pressure (DBP) and temperature were evaluated in the same two high-quality studies, both showing significant differences in mean (decreased for SBP and increased for temperature) [18, 20]. Both studies had very small variations, < 0.2oCand < 2 mmHg respectively. Arterial oxygen saturation was studied six times across four studies [16, 18, 20, 22]. Lower saturation quantiles (< 80%, 80–89% and 90–94%) and lower mean/median saturations were shown to be significant.

Variables moderately and weakly associated with unplanned ICU admission are summarised in Table 3 and Additional file 1 (SDC-8) respectively.

Discussion

Statement of findings

In this systematic review of 16 observational and cohort studies evaluating ED and ward patients, we found two comorbidities (congestive cardiac failure and diabetes), two demographics (increasing age and being male), one diagnosis (hepatic disease) and six vital signs (respiratory rate, heart rate, temperature, systolic and diastolic blood pressure and arterial oxygen saturations) with a strong univariate association with unplanned ICU admission. These findings support the consensus that abnormal vital signs have significant value when predicting unplanned ICU admission. The strength of association for a history of congestive cardiac failure and diabetes and a new diagnosis of hepatic disease may reflect the high burden of care required in this patient cohort up until the terminal phase of disease. Being older and male as a risk factor for ICU admission may reflect the general hospital population as a whole. Overall this review provides a thorough summary of the candidate variables available in EPRs (and elsewhere in the clinical record) that will assist researchers to develop and evaluate predictive models for patients at risk of unplanned ICU admission.

Clinical and research implications

Progressing from vital sign based, EWS systems to EPR based, risk model systems has incrementally improved performance, both in terms of correctly identified deteriorating ward patients (sensitivity) and the number of ‘false alarms’ generated for clinical staff (specificity and positive predictive value). These performance gains have been achieved via multivariate regression models and more recently machine learning processes [1, 32,33,34,35,36]. Regardless of the statistical approach, candidate variables should be selected in a methodologically robust way. In the published literature, univariate filter methods, that rank the strength of the statistical association, are among the most common [7, 8]. It is a popular approach because the univariate analysis provides a summary of the variables most likely to enhance model performance, does not involve significant computation, is relatively simple, not time consuming and produces an easily interpretable output. It does have weaknesses however, including the potential to miss variables that have no association with the outcome when evaluated in isolation but have an association when evaluated together with another variable (e.g. age).

Despite their performance advantage, as yet no EPR based hospital model has achieved widespread adoption. In contrast, 75% of UK National Health Service hospitals monitor ward patients using the National Early Warning Score (NEWS) [37, 38]. The success of NEWS, which is a simple aggregate score that uses the univariate associations of abnormal vital signs with adverse patient outcomes, highlights the importance of interpretability and generalisability in this research and clinical domain. Advanced scoring systems that rely on complex computational processes may be difficult to interpret (and trust) for clinical staff and therefore less likely to be adopted into general use. We hope the univariate associations described will provide a convenient and intuitive reference for clinicians and researchers alike to overcome such barriers to implementation.

Strengths and limitations

The association of the variables does not infer causality. The search strategy was thorough and in accordance with current methodological guidelines but studies may have been missed. Publication bias may have affected results. The methodology of the included studies was varied, making meta-analysis inappropriate. We excluded studies examining specific sub-populations of patients only (i.e. acute liver failure) meaning the variables summarised in this review are not applicable for risk models designed for specific disease sub-groups.

There is a lack of consensus on which outcome measures to use when assessing the performance of predictive models for clinical deterioration [18]. Each of cardiac arrest, in hospital death and unplanned ICU admissions represent different populations and will, therefore, have different variable associations. We selected unplanned ICU admission as an isolated outcome measure (and excluded in hospital death and cardiac arrest) in the knowledge this would reduce the number of eligible studies and therefore potential variables for inclusion in this review. We adopted this method because we aim to advance the study of models that predict clinical deterioration, specifically in those who will most benefit from an intervention such as an ICU admission. When predicting ICU admission, some authors published the univariate relationships from within their derivation databases before including them in the multivariate analysis [20]. However we are not aware of any who have based selection on associations evaluated in external databases.

We evaluated a heterogeneous study population by including ED, ward, post-Medical Emergency Team (MET) and non-post-MET patients. This was done because we wish to better understand associations with clinical deterioration, which may occur at any time-point during hospital admission. Namely, early deterioration, which may occur soon after discharge from ED to the ward, in which case patient centred ED data is important. Or late deterioration, when the patient has been on the ward for some days. Studies examining sub-populations of patients (i.e. where specifically designed predictive algorithms have the potential to be more accurate than when used in a general patient population) were excluded on the basis that as a first step, we wish to isolate variables that will contribute to a hospital wide EPR based risk score.

We have deliberately avoided describing multivariate studies because we do not wish describe the models themselves. There are multiple examples of high performing, multivariate clinical predictive models in the literature, whose variables will have quantifiable associations with unplanned ICU admission. However, it is impossible to exclude collinearity in these instances, making obsolete our objective to individually quantify these variable associations as potential “building blocks” for future models. As a consequence, multivariate analysis was excluded unless the univariate associations were described.

Conclusion

Having abnormal vital signs, being elderly, male, having a history of heart failure or diabetes and a diagnosis of liver failure are all strongly associated with unplanned ICU admission. This systematic review is the first to comprehensively collate the evidence on patient centred variables with univariate associations with ICU admission. These results may assist the development of predictive models for hospitalised patients at risk of needing escalations in care. There is a lack of high-quality data in this field and further work is required to isolate the patient centred variables most likely to enhance model performance when predicting unplanned ICU admission.

Abbreviations

CI:

Chief Investigator

CTRG:

Clinical Trials & Research Governance, University of Oxford

ED:

Emergency Department

EPR:

Electronic Patient Record

GCP:

Good Clinical Practice

ICU:

Intensive Care Unit

IRR:

Incidence Rate Ratios

NEWS:

National Early Warning Score

OR:

Odds Ratio

REC:

Research Ethics Committee

RR:

Risk Ratio

RRS:

Rapid Response System

References

  1. Kipnis P, Turk BJJ, Wulf DAA, et al. Development and validation of an electronic medical record-based alert score for detection of inpatient deterioration outside the ICU. J Biomed Inform. 2016;64:10–9. https://doi.org/10.1016/j.jbi.2016.09.013.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Bailey TCC, Chen Y, Mao Y, et al. A trial of a real-time alert for clinical deterioration in patients hospitalized on general medical wards. J Hosp Med. 2013;8(5):236–42. https://doi.org/10.1002/jhm.2009.

    Article  PubMed  Google Scholar 

  3. Kang M, Churpek MM, Zadravecz FJ, Twu NM, Adhikari R, Edelson DP. Real-time risk prediction on the wards: a feasibility study. C23 Sepsis Risk Recognit Resusc. 2015;(9):A3988–8. https://doi.org/10.1164/ajrccm-conference.2015.191.1_MeetingAbstracts.A3988.

  4. Alvarez CA, Clark CA, Zhang S, et al. Predicting out of intensive care unit cardiopulmonary arrest or death using electronic medical record data. BMC Med Inform Decis Mak. 2013;13:28.

    Article  Google Scholar 

  5. Steyerberg E, Moons KGM, van der Windt D, et al. Prognosis research strategy (PROGRESS) series 3: prognostic model research. PLoS Med. 2013;10(2):e1001381. https://doi.org/10.1371/jour-.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Sanchez-Pinto LN, Venable LR, Fahrenbach J, Churpek MM. Comparison of variable selection methods for clinical predictive modeling. Int J Med Inform. 2018;116(February):10–7. https://doi.org/10.1016/j.ijmedinf.2018.05.006.

    Article  PubMed  Google Scholar 

  7. Walter S, Tiemeier H. Variable selection: current practice in epidemiological studies. Eur J Epidemiol. 2009;24(12):733–6. https://doi.org/10.1007/s10654-009-9411-2.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bagherzadeh-Khiabani F, Ramezankhani A, Azizi F, Hadaegh F, Steyerberg EW, Khalili D. A tutorial on variable selection for clinical prediction models: feature selection methods in data mining could improve the results. J Clin Epidemiol. 2016;71:76–85. https://doi.org/10.1016/j.jclinepi.2015.10.002.

    Article  PubMed  Google Scholar 

  9. Malycha J, Bonnici T, Sebekova K, Petrinic T, Young D, Watkinson P. Variables associated with unplanned general adult ICU admission in hospitalised patients: protocol for a systematic review. Syst Rev. 2017;6(1):4–7. https://doi.org/10.1186/s13643-017-0456-0.

    Article  Google Scholar 

  10. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7). https://doi.org/10.1371/journal.pmed.1000097.

  11. Taggart DP, D’Amico R, Altman DG. Effect of arterial revascularisation on survival: a systematic review of studies comparing bilateral and single internal mammary arteries. Lancet. 2001;358(9285):870–5. https://doi.org/10.1016/S0140-6736(01)06069-X.

    Article  CAS  PubMed  Google Scholar 

  12. Duckitt K, Harrington D. Risk factors for pre-eclampsia at antenatal booking: systematic review of controlled studies. Br Med J. 2005;330(7491):565–7. https://doi.org/10.1136/bmj.38380.674340.E0.

    Article  Google Scholar 

  13. Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M et al. TN-OS (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Crick Cent 2015:2018. [cited 25 Apr 2016]. A from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Our Research.

  14. Dettmer MR, Damuth E, Zarbiv S, Mitchell JA, Bartock JL, Trzeciak S. Prognostic factors for long-term mortality in critically ill patients treated with prolonged mechanical ventilation: a systematic review. Crit Care Med. 2017;45(1):69–74. https://doi.org/10.1097/CCM.0000000000002022.

    Article  PubMed  Google Scholar 

  15. Zaal IJ, Devlin JW, Peelen LM, Slooter AJC. A systematic review of risk factors for delirium in the ICU*. Crit Care Med. 2015;43(1):40–7. https://doi.org/10.1097/CCM.0000000000000625.

    Article  PubMed  Google Scholar 

  16. Barfod C, Lauritzen MMP, Danker JK, et al. Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department - a prospective cohort study. Scand J Trauma Resusc Emerg Med. 2012;20(1):28. https://doi.org/10.1186/1757-7241-20-28.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Calzavacca P, Licari E, Tee A, Bellomo R. Point-of-care testing during medical emergency team activations: a pilot study. Resuscitation. 2012;83(9):1119–23. https://doi.org/10.1016/j.resuscitation.2012.02.012.

    Article  CAS  PubMed  Google Scholar 

  18. Churpek MM, Yuen TC, Edelson DP. Predicting clinical deterioration in the hospital: the impact of outcome selection. Resuscitation. 2013;84(5):564–8. https://doi.org/10.1016/j.resuscitation.2012.09.024.

    Article  PubMed  Google Scholar 

  19. Eick C, Rizas KD, Meyer-Zurn CS, et al. Autonomic nervous system activity as risk predictor in the medical emergency department: a prospective cohort study. Crit Care Med. 2015;43(5):1079–86. https://doi.org/10.1097/CCM.0000000000000922.

    Article  PubMed  Google Scholar 

  20. Escobar GJ, LaGuardia JC, Turk BJ, Ragins A, Kipnis P, Draper D. Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record. J Hosp Med. 2012;7(5):388–95. https://doi.org/10.1002/jhm.1929.

    Article  PubMed  Google Scholar 

  21. Frost SA, Alexandrou E, Bogdanovski T, Salamonson Y, Parr MJ, Hillman KM. Unplanned admission to intensive care after emergency hospitalisation: risk factors and development of a nomogram for individualising risk. Resuscitation. 2009;80(2):224–30.

    Article  Google Scholar 

  22. Hong W, Earnest A, Sultana P, Koh Z, Shahidah N, Ong MEH. How accurate are vital signs in predicting clinical outcomes in critically ill emergency department patients. Eur J Emerg Med. 2013;20(1):27–32. https://doi.org/10.1097/MEJ.0b013e32834fdcf3.

    Article  PubMed  Google Scholar 

  23. Hunziker S, Stevens J, Howell MD. Red cell distribution width and mortality in newly hospitalized patients. Am J Med. 2012;125(3):283–91. https://doi.org/10.1016/j.amjmed.2011.08.021.

    Article  PubMed  Google Scholar 

  24. Loekito E, Bailey J, Bellomo R, et al. Common laboratory tests predict imminent death in ward patients. Resuscitation. 2013;84(3):280–5. https://doi.org/10.1016/j.resuscitation.2012.07.025.

    Article  PubMed  Google Scholar 

  25. Schuetz P, Hausfater P, Amin D, et al. Biomarkers from distinct biological pathways improve early risk stratification in medical emergency patients: the multinational, prospective, observational TRIAGE study. Crit Care. 2015;19(1):377. https://doi.org/10.1186/s13054-015-1098-z.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Steiner D, Renetseder F, Kutz A, et al. Performance of the Manchester triage system in adult medical emergency patients: a prospective cohort study. J Emerg Med. 2016;50(4):678–89. https://doi.org/10.1016/j.jemermed.2015.09.008.

    Article  PubMed  Google Scholar 

  27. Sudarshan M, Feldman LS, St. Louis E, et al. Predictors of mortality and morbidity for acute care surgery patients. J Surg Res. 2015;193(2):868–73. https://doi.org/10.1016/j.jss.2014.09.007.

    Article  PubMed  Google Scholar 

  28. Tam V, Frost SAA, Hillman KMM, Salamonson Y. Using administrative data to develop a nomogram for individualising risk of unplanned admission to intensive care. Resuscitation. 2008;79(2):241–8. https://doi.org/10.1016/j.resuscitation.2008.06.023.

    Article  PubMed  Google Scholar 

  29. Tsai JCH, Cheng C-W, Weng S-J, Huang C-Y, Yen DH-T, Chen H-L. Comparison of risks factors for unplanned ICU transfer after ED admission in patients with infections and those without infections. ScientificWorldJournal. 2014;2014:102929.

    PubMed  PubMed Central  Google Scholar 

  30. Tsai JCH, Weng SJ, Huang CY, Yen DHT, Chen HL. Feasibility of using the predisposition, insult/infection, physiological response, and organ dysfunction concept of sepsis to predict the risk of deterioration and unplanned intensive care unit transfer after emergency department admission. J Chinese Med Assoc. 2014;77(3):133–41. https://doi.org/10.1016/j.jcma.2013.12.001.

    Article  Google Scholar 

  31. Wunderink RG, Diederich ER, Caramez MP, et al. Rapid response team-triggered procalcitonin measurement predicts infectious intensive care unit transfers. Crit Care Med. 2012;40(7):2090–5. https://doi.org/10.1097/CCM.0b013e31824fc027.

    Article  CAS  PubMed  Google Scholar 

  32. Churpek MM, Yuen TC, Park SY, Meltzer DO, Hall JB, Edelson DP. Derivation of a cardiac arrest prediction model using ward vital signs. Crit Care Med. 2012;40(7):2102–8. https://doi.org/10.1097/CCM.0b013e318250aa5a.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Loekito E, Bailey J, Bellomo R, et al. Common laboratory tests predict imminent medical emergency team calls, intensive care unit admission or death in emergency department patients. Emerg Med Australas. 2013;25(2):132–9.

    Article  Google Scholar 

  34. Stelfox HT, Bagshaw SM, Gao S. A retrospective cohort study of age-based differences in the care of hospitalized patients with sudden clinical deterioration. J Crit Care. 2015;30(5):1025–31. https://doi.org/10.1016/j.jcrc.2015.05.018.

    Article  PubMed  Google Scholar 

  35. Hackmann G, Chen M, Chipara O, et al. Toward a two-tier clinical warning system for hospitalized patients. AMIA Annu Symp proceedings AMIA Symp. 2011;2011:511–9. https://doi.org/10.7936/K70V8B1G.

    Article  Google Scholar 

  36. Churpek M, Yuen T, Park SED. Using electronic health record data to develop and validate a prediction model for adverse outcomes on the wards. Crit Care Med. 2015;42(4):841–8. https://doi.org/10.1097/CCM.0000000000000038.Using.

    Article  Google Scholar 

  37. Royal College of Physicians. National Early Warning Score (NEWS). Standardising the assessment of acute-illness severity in the NHS. Report of a working party. 2012.

    Google Scholar 

  38. Royal College of Physcians. National Early Warning Score (NEWS) 2: Standardising the assessment of acute-illness severity in the NHS. Updated report of a working party. London: RCP; 2017. https://doi.org/10.1097/CCM.0b013e3181928ce3.

    Book  Google Scholar 

Download references

Acknowledgements

JM would like to acknowledge the University of Adelaide, Department of Acute Medicine, who are administering his PhD.

Funding

This publication reports independent research supported by the Health Innovation Challenge Fund (HICF-R9–524; WT-103703/Z/14/Z), a parallel funding partnership between the Department of Health and Wellcome Trust. The views expressed in this publication are those of the author(s) and not necessarily those of the Department of Health or Wellcome Trust. The Wellcome Trust and the Department of Health did not play any role in the design of the study, interpretation of data or the writing of manuscript.

Availability of data and materials

The data generated and analysed during this study are publicly available on application to the corresponding author.

Author information

Authors and Affiliations

  1. Kadoorie Centre for Critical Care Research and Education, Nuffield Department of Clinical Neurosciences, University of Oxford, Level 3, John Radcliffe Hospital, Headley Way, Oxford, OX3 9DU, UK

    James Malycha, J. Duncan Young & Peter J. Watkinson

  2. Department of Critical Care, University College London Hospitals Foundation Trust, Maple Link Bridge, University College Hospital, 235 Euston Road, London, NW1 2BU, UK

    Timothy Bonnici

  3. Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Old Road Campus, Roosevelt Drive, Oxford, OX3 7DC, UK

    David A. Clifton

  4. Faculty of Health and Medical Science, University of Adelaide, North Terrace, AHMS Floor 8, Adelaide, 5000, Australia

    Guy Ludbrook

Authors
  1. James Malycha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Timothy Bonnici
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David A. Clifton
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guy Ludbrook
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. Duncan Young
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Peter J. Watkinson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JM, TB, PW and DY designed the study. JM and TB undertook the methodological planning. JM led the writing. GL and DC contributed to data interpretation. All authors commented on successive drafts and approved the final manuscript.

Corresponding author

Correspondence to James Malycha.

Ethics declarations

Ethics approval and consent to participate

This study was a secondary analysis of published material and did not require ethical approval.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Supplementary Digital Content. SDC-1 Systematic Review Search Design. SDC-2 Studies excluded because of a single or grouped diagnosis. SDC-3 Modified Newcastle-Ottawa Scale for assessment of study quality (adapted). SDC-4 Details (additional) of included studies. SDC-5 Bias scores. SDC-6 Patient populations of included studies. SDC-7 Patient derived variables examined for an association with unplanned ICU admission. In categories and then alphabetical order. SDC-8 Strength of evidence for individual variables (weak and inconclusive results) (DOCX 90 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Malycha, J., Bonnici, T., Clifton, D.A. et al. Patient centred variables with univariate associations with unplanned ICU admission: a systematic review. BMC Med Inform Decis Mak 19, 98 (2019). https://doi.org/10.1186/s12911-019-0820-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-019-0820-1

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us