Skip to main content

Environmental and clinical data utility in pediatric asthma exacerbation risk prediction models

Abstract

Background

Asthma exacerbations are triggered by a variety of clinical and environmental factors, but their relative impacts on exacerbation risk are unclear. There is a critical need to develop methods to identify children at high-risk for future exacerbation to allow targeted prevention measures. We sought to evaluate the utility of models using spatiotemporally resolved climatic data and individual electronic health records (EHR) in predicting pediatric asthma exacerbations.

Methods

We extracted retrospective EHR data for 5982 children with asthma who had an encounter within the Duke University Health System between January 1, 2014 and December 31, 2019. EHR data were linked to spatially resolved environmental data, and temporally resolved climate, pollution, allergen, and influenza case data. We used xgBoost to build predictive models of asthma exacerbation over 30–180 day time horizons, and evaluated the contributions of different data types to model performance.

Results

Models using readily available EHR data performed moderately well, as measured by the area under the receiver operating characteristic curve (AUC 0.730–0.742) over all three time horizons. Inclusion of spatial and temporal data did not significantly improve model performance. Generating a decision rule with a sensitivity of 70% produced a positive predictive value of 13.8% for 180 day outcomes but only 2.9% for 30 day outcomes.

Conclusions

EHR data-based models perform moderately wellover a 30–180 day time horizon to identify children who would benefit from asthma exacerbation prevention measures. Due to the low rate of exacerbations, longer-term models are likely to be most clinically useful.

Trial Registration: Not applicable.

Peer Review reports

Introduction

Asthma is a chronic airway disease that affects over five million children in the United States [1]. While asthma can often be well controlled via medical therapy, including through the use of regular controller medications such as inhaled corticosteroids, exacerbations requiring emergency treatment are common. Over half of all children with asthma experience an exacerbation each year, with one in six visiting an emergency department and one in 20 requiring hospitalization for an asthma exacerbation [2, 3]. Importantly, asthma exacerbations comprise the majority of asthma-related healthcare costs, and there is a significant need to better identify children at high-risk for future exacerbations to allow targeted preventive interventions.

Asthma exacerbations are known to be triggered by a variety of clinical, environmental, and seasonal exposures; however, the interplay of these factors and their impacts on the risk of exacerbation are not well understood [4]. For example, children with asthma and seasonal allergies may experience an increase in exacerbation risk when pollen counts are high, whereas children without seasonal allergies will not be affected. Similarly, air pollution may have a significant impact on children who live in neighborhoods that are close to highways. Efforts to prevent asthma exacerbations have focused on evidence-based efforts such as patient/family education, asthma action plans, identification and remediation of environmental triggers, identification and treatment of contributing comorbidities such as atopic disease and obesity, and methods to improve asthma controller medication adherence. Given the significant heterogeneity in asthma presentations and risk factors, it is difficult to identify patients who are at greatest risk of exacerbations and who may benefit most from targeted interventions [5]. Moreover, the contribution of different types of exposures in predicting future asthma exacerbations has not been well-studied.

Over the past decade, electronic health record (EHR) systems, which contain detailed patient-level clinical data, have allowed the development and implementation of automated clinical decision support (CDS) tools [6]. Such tools have the potential to assist in the identification of patients at highest risk of poor outcomes in a variety of disease states, including asthma. To date, development of asthma exacerbation risk prediction models has focused on healthcare utilization and clinical characteristics [4]; however, the numerous factors that can affect exacerbation risk are not captured by most EHR systems, including housing and neighborhood characteristics and changes in common contributing exposures such as weather, outdoor allergens, and respiratory infections. There is a critical need to evaluate how such contextualizing information could potentially improve asthma CDS tools. The goal of this study was to evaluate the contribution of forms of data that are not typically available within the EHR (i.e., spatially and temporally resolved environmental data) to the performance of asthma exacerbation prediction models. Herein, we combined clinical data from a cohort of children with asthma with spatial and temporal environmental data to assess how well these different data sources contributed to the performance of risk prediction models for asthma exacerbations over different time horizons.

Materials and methods

Study population

The study was conducted using retrospective data from Duke University Health System (DUHS). DUHS consists of one tertiary care and two community-based hospitals, and a network of primary care and specialty clinics that have utilized a single EHR system since 2014. DUHS is the primary provider in Durham County, North Carolina, and we have internally estimated that ~ 85 percent of children in Durham County receive healthcare through DUHS [7]. We abstracted clinical data through Duke’s EHR-based Clinical Research Datamart from January 1, 2014, to December 31, 2019 [8]. We identified children (age 5–18), living in Durham County with asthma. We used a previously validated definition that has a positive predictive value of 97% [9]. As previously described, we classified children as having asthma if they met one of the following sets of criteria: (1) two or more outpatient or emergency health care encounters associated with an International Classification of Diseases, Ninth/Tenth Revision (ICD-9/ICD-10) code for asthma (Additional file 1: Table S1) and an active prescription for one or more medications for asthma (Additional file 1: Table S2); (2) at least one hospital encounter associated with an ICD-9/ICD-10 for asthma and an active prescription for one of more medications for asthma; or (3) a problem list entry with an asthma-related ICD-9/ICD-10 code and an active prescription for one or more medications for asthma (Fig. 1). We identified 6395 children who met the study criteria for asthma; of these, 6163 were in the cohort for the full study period. Of these patients, 181 were missing either address or BMI data during the study period and were therefore excluded from further analysis.

Fig. 1
figure 1

Consolidated standards of reporting trials diagram

Patient person-time was calculated from time of positive asthma identification until censoring. Censoring was based on aging out of the cohort (≥ 18 years), an indicated address outside of Durham County, or at the last known encounter. Additionally, we applied a six-month burn-in and burn-out period to ensure data reliability, resulting in a total of five years of data (July 1, 2014 – June 30, 2019).

Outcome of interest

The primary outcome of interest was an asthma-related exacerbation, which was defined as any encounter with an asthma-related ICD9 or -10 code and a prescription for a systemic steroid (see Additional file 1: Table S2). We considered four different types of exacerbations based on severity (listed in decreasing severity): (1) inpatient encounters lasting more than 24 h, (2) emergency department and hospital encounters lasting less than 24 h, (3) urgent care visits, and (4) outpatient (including telephone-based) encounters.

Predictor variables

Clinical predictors were abstracted from EHR data and were updated on a person-month basis. We abstracted clinical and socio-demographic information on each child from the EHR, including sex, age, race, insurance type (public, private, self-pay), comorbidities (atopy, obesity), medication prescriptions. Each participant was categorized based on type of prescribed asthma controller plan (i.e., only rescue medications, only inhaled corticosteroids or only leukotriene receptor antagonists, or other controller medications). Patient service utilization history (including asthma-related encounters and encounters for other indications) was separated into three categories: ambulatory visits (i.e., any outpatient care, including specialist care and sick visits at both urgent care centers and primary care providers, regardless of associated diagnoses), emergency department encounters, and inpatient admissions. Well child visits were considered as a separate category, as prior work has demonstrated a beneficial effect of these visits among children with asthma [10].

Spatial data

Neighborhood-level environmental data were derived based on patient address. We used the latitude–longitude of patient time-resolved address to geocode each patient. We identified each child’s zip code of residence and linked data from the American Community Survey to calculate the Agency for Healthcare Research and Quality (AHRQ) socioeconomic status (SES) index, generating a score between 0 and 100, with higher scores indicative of greater deprivation [11]. We additionally calculated distance to major roadways with speed limits greater than 55 MPH as described previously, and distance to parks, and tree cover for the census block associated with each address [12]. Briefly, we used ArcGIS to calculate straight-line distance to roadways for each geocoded address within our dataset.

Temporal data

We downloaded daily climate data on daily average temperature, total precipitation, maximum wind speed from the National Centers for Ennvironmental Information (https://www.ncdc.noaa.gov/). Air quality data, including the maximum sulfur dioxide (SO2) reading and average particulate matter 2.5 (PM2.5) concentration were downloaded from the US Environmental Protection Agency (https://www.epa.gov/outdoor-air-quality-data/download-daily-data). Pollen counts for trees weeds and grasses were downloaded from the North Carolina Department of Environmental Quality Pollen Monitoring program (https://deq.nc.gov/about/divisions/air-quality/air-quality-monitoring/pollen-monitoring). Pollen data were log transformed to normalize the data, which is required for use in linear-based modeling methods such as LASSO. Pollen data were not available in winter months, as the local monitoring station does not take readings during this period due to the very low levels of pollen during winter; thus, these periods were imputed to have pollen counts of zero. We also calculated seasonal influenza burden by abstracting the daily number of influenza tests performed at the institution in that month. We also included index month from when the prediction would be made.

Data formatting

Our goal was to develop a CDS tool that identifies children on a monthly basis at greatest risk for asthma exacerbation. As such, we organized the data into patient month format, creating a row for each month a patient was eligible to be included in the study, and updating all time varying factors. Time varying factors included: address (using the last known value in the prior month); insurance (using the last known value in the prior month); number of healthcare encounters (outpatient, emergency, and inpatient), regardless of cause, in the previous 30 and 365 days; an indicator for whether a child had a well-child visit in the previous year; and the average of each of the temporal factors in the prior month. To build a predictive model, we generated three outcomes for each patient-month: whether a patient had an exacerbation in the forthcoming 30-, 90- and 180- days.

Statistical analysis

We divided the data at the patient level into training and testing sets in a 67%/33% ratio. We used LASSO, Random Forests, and xgBoost to build our predictive models. LASSO, or Least Absolute Shrinkage and Selection Operator, is a linear regression-based model that uses shrinkage and L1 regularization to produce sparse models. The glmnet package in R was used was used to create the LASSO models [13]. Random Forests is a tree-based machine learning algorithm that can handle disparate data types and model complex effects (i.e., non-linearities and interactions). The ranger package in R was used to create Random Forest models [14]. xgBoost, or Extreme Gradient Boosting, is a gradient-boosted decision tree machine learning library that utilizes iterative learning to optimize prediction. The gbm package in R was used to develop xgBoost models [15]. Training data were used to optimize each algorithm, and model tuning parameters were chosen via internal cross-validation. For LASSO, we optimized the lambda (shrinkage) parameter. For Random Forests we optimized the “mtry” (variable to select) parameter, fixing the algorithm at 4000 trees. For xgBoost, we set the number of splits at two and the learning rate at 0.01 and learned an early stopping rule for the number of trees. We initially built 15 different primary models, using three different time horizons with 5 different sets of predictors. We first used all of the predictor variables to train a model to predict 30-, 90-, and 180-day risk of exacerbation. Next, we separated the predictor variables based on whether they were clinical, neighborhood or environmental factors, fitting separate models for each predictor group (see Additional file 1: Table S3 for a description of the factors included in each model). Finally, we considered a simpler, parsimonious model that includes data readily available to both patients/families and clinicians: age, sex, race, presence of either atopy or obesity, and current medications. The ROCR package in R was used to evaluate model performance and to compare results across models [16]. We used the test data to calculate the area under the receiver operator characteristic (AUROC). We used the bootstrap, resampling at the patient level, to calculate 95% confidence intervals. We compared the performances of the different models by calculating the delta AUROC and a bootstrap for 95% confidence intervals. Finally, we assessed the impact of decision making by calculating the Precision-Recall Curve and evaluated the sensitivity and positive predictive value (PPV) at different cut-points. All analyses were performed in R 4.1.0 [17]. This work was approved by the Duke University Health System IRB.

Results

Patient characteristics

We identified 5982 children with a total of 17,907.56 patient-years (Fig. 1, Table 1). The patient population had slightly more male than female patients (56%). The majority of patients in the cohort were listed as non-Hispanic Black (58.1%); 12.4% of patients were of Hispanic ethnicity; 20.2% of patients were identified as non-Hispanic white, and 9.4% of patients were of unknown or other race/ethnicity. A majority of patients in the cohort had a history of atopy (62%) and allergic rhinitis (56%) (Table 1).

Table 1 Characteristics of the study population

There were 5045 exacerbations documented in our dataset, with an average of 0.27 exacerbations per patient year; 37% of patients had at least one asthma exacerbation during the study period. We evaluated the seasonal variability of asthma exacerbation incidence during the observation period (Fig. 2), and identified September as the month with the greatest average number of exacerbations, as has been documented previously [18].

Fig. 2
figure 2

Asthma exacerbation rates across the study period. A The number of asthma exacerbations per month during the study period. B The average number of asthma exacerbations observed in each calendar month during the study period

Performance of predictive models

We created person-month models using LASSO, Random Forest, and xgBoost models that used all available data (Table 2, “Overall”), including clinical, spatial, and temporal factors. The predicted event rate and AUC for the three time horizons (30-, 90-, and 180-days) are shown in Table 2. Model performance was better for near-term than for long-term outcomes for all modeling approaches. Performance of models developed using Gradient Boosting was nominally better than models using either LASSO or Random Forests. We evaluated the relative contributions of temporal, spatial, and clinical factors on model performance for predicting exacerbations. We found that clinical factors drove most of the model performance, regardless of modeling approach, with the temporal factors having reduced predictive value and spatial factors having minimal predictive value.

Table 2 AUC for predicting asthma exacerbation over different time horizons and variable sets using different modeling methods

Evaluation of the contribution of different types of data to model performance

To better understand the opportunity to create a model for which patients and/or their parents could readily provide the necessary information, we constructed a parsimonious model that uses basic demographics (age, race, ethnicity), comorbidities (atopy and obesity), and currently prescribed asthma medications. Below, we highlight the results of the xgBoost model, as its performance was nominally better than either Random Forest or LASSO. The parsimonious model (AUC = 0.664 for the 30-day time horizon) did not perform as well as the overall model (AUC = 0.761 for the 30-day time horizon) or the clinical factors-based model (AUC = 0.742 for the 30-day time horizon) (Table 2). When comparing the performance of the xgBoost model using all data elements to the one using only clinical data, we found the full model was nominally better for near term outcomes, and not any better for the longer 180-day outcome (Table 3). Conversely, when comparing the clinical model to the parsimonious model, we found that the performance of the clinical model was significantly better for all time horizons.

Table 3 Comparison of the overall, clinical, and parsimonious models created with different modeling methods

Assessment of overall model sensitivity and positive predictive value

Finally, we assessed the performance of a decision rule to guide clinical decision support using each of the models based on clinical factors (Fig. 3). For the 30-day time horizon, if we desire a sensitivity of ~ 70%, we would only have a PPV of ~ 2.9% using a xgBoost model. Conversely, if we used the 180-day time horizon, we would have a PPV of ~ 13.8%. Similarly, if we wanted a PPV of ~ 15% we would have a sensitivity of 66.2% from the 180-day time horizon, versus a sensitivity of 1.5% from the 30-day time horizon.

Fig. 3
figure 3

The relationship between the sensitivity and positive predictive value over three different time horizons. A Precision-Recall Curve was used to evaluate the sensitivity and positive predictive value (PPV) at different cut-points using a model based on clinical factors and patient characteristics (the “Clinical Factors” model)

Discussion

In this work we explored the potential for developing a clinical decision support tool to identify children at high risk of an asthma exacerbation over a 30-, 60, and 180-day period. We used data that are commonly captured within EHR systems and also included spatial and temporal environmental data that are publicly available and not routinely captured within EHRs. A model that included all predictor variables had moderate performance (AUC ~ 76%) over all three time horizons, though the PPV was greatest for the 180-day period. Notably, model performance was predominately driven by data captured in the EHR, including patient demographics and service utilization history. The inclusion of spatial and temporal factors did not significantly improve model performance.

Prior studies have attempted to identify clusters of factors that can predict risk of asthma exacerbation in children and adolescents. The strongest predictive factor previously identified is having had an asthma exacerbation in the previous year [19,20,21,22,23,24]. Similarly, we also found that models that incorporated past healthcare utilization were most predictive. Other studies have incorporated laboratory values, such as aeroallergen sensitization and eosinophil and IgE levels, to predict exacerbations, though we found that few children in our cohort had these measures available. The Seasonal Asthma Exacerbation Index (saEPI) used these variables along with lung function parameters and asthma medication information to predict which children were at risk of exacerbation during the fall peak, and this index was shown to reliably predict which children were unlikely to experience an exacerbation, but was less successful identifying children who were at risk of an exacerbation [25]. Similarly, a machine learning model that included 142 variables, including demographics, neighborhood characteristics, laboratory results, vital signs, diagnosis codes, medications, insurance, encounters, and past healthcare utilization, had a high negative predictive value for patients with asthma who would not have an emergency department visit or hospitalization in the following year; however, the PPV of the model was under 25% [26]. Other models have included additional types of data, including patient symptom reports and remote monitoring data. Finkelstein and Jeong used daily adult asthma patient reports of symptoms and medication use and tele-monitoring of in-home spirometry to predict asthma exacerbations within a 1-week window [27]. This approach resulted in a model with a strong PPV for acute exacerbations; however, the heavy reliance on patient-supplied data would likely be difficult to implement broadly and in younger patients.

We found that the inclusion of spatial and temporal information was of limited added value in predicting future asthma exacerbations. Previous work by us and others has shown minimal added predictive value of neighborhood information for risk prediction models [28, 29]. Moreover, while environmental factors can impact risk of asthma exacerbation [30, 31], the epidemiological literature has shown relatively weak and inconsistent effects [32,33,34]. Importantly, most studies to date, including ours, have not included indoor environmental exposures, which may influence risk of asthma exacerbation. Moreover, readily available measures of outdoor environmental exposures may not be sufficiently granular to be informative on an individual patient level. For example, the data used in our model is derived from a single sensor within Durham County; thus, these data may not have sufficient resolution to provide an accurate estimate of exposure for all patients.

This work also highlights the impact of considering the time horizon over which predictions are made. Most of the studies conducted testing predictive models based on multiple patient-level factors have focused on prediction of exacerbations 6 to12 months into the future [19,20,21,22,23,24, 26]. Our models had slightly better performance for near-term (30-days) versus longer-term (180 days) outcomes. These results are in alignment with previous work showing that the granular nature of EHR data are well suited for nearer-term prediction [35]. However, when, we considered the performance of a decision rule with specified risk levels, the longer-term model had more practical real-world performance based on positive predictive value. The improved performance over a longer time horizon is due to the meaningfully higher event rate of events during the 180-day time horizon (7.3% vs 1.5%). While this result is not surprising, it highlights the importance of considering event rates when translating a risk model into a decision support tool.

In considering how a CDS tool to identify children at risk of an asthma exacerbation could be implemented, it is important to consider the types of data that are required for the underlying model and the clinical goals of the tool. Our results demonstrate that a model using data that are commonly available in our EHR system performed as well a model that includes basic spatio-temporal environmental data. Second, our data suggest that a CDS tool focused on relatively short-term outcomes would be most likely to provide actionable results. Further, the time horizon in which the model performs best informs the types of interventions that would be directed by the CDS tool.

There are some limitations to this work. Mainly, this is a single center study, and the results may not be fully generalizable. Additionally, model performance may be influenced by study location, wherein locales with different types of spatio-temporal variability would yield different results. For example, Durham County has relatively few poor air quality days, leading to a model that is less reliant on air pollution data. In contrast, locations such as Los Angeles or Atlanta tend to have more days with poor air quality; thus, environmental data may be more important for predictive models for patients living in those regions. Moreover, the outdoor environmental data used for this study was derived from a single sensor site in central Durham County; thus, these data may lack sufficient granularity to detect differences in exposures across the study cohort. Finally, we were not able to account for all variables that may have a significant impact on the likelihood of asthma exacerbations, including medication refill data, indoor environmental and direct respiratory virus exposures. Future studies will be needed to evaluate the importance of variables that could not be included in the current study and to evaluate the transportability of the models developed in this study to patient populations from other health systems.

In conclusion, we developed multiple predictive models for pediatric asthma exacerbations that included data that are commonly available in EHR systems as well as contextualizing spatio-temporal data. We found that the inclusion of spatio-temporal data did not significantly increase the performance of a model that used EHR data. Importantly, while our models exhibited nominally better performance over a 30-day time horizon compared to longer time periods, the decision rule metrics—based on sensitivity and PPV—were better for longer term (i.e., 180 day) time horizons. These findings have important implications for the design and implementation of CDS tools to identify children who would benefit from interventions to prevent asthma exacerbations.

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available due to the need to protect patient privacy; however, de-identified analytic datasets are available from the corresponding author on reasonable request.

Abbreviations

HER:

Electronic health record

CDS:

Clinical decision support

AUC:

Area under the curve

References

  1. Centers for Disease Control and Prevention. Most Recent National Asthma Data. https://www.cdc.gov/asthma/most_recent_national_asthma_data.htm. Accessed 23 Jul 2021.

  2. Centers for Disease Control and Prevention, National Center for Environmental Health. AsthmaStats: Asthma Attacks among People with Current Asthma, 2014–2017.

  3. QuickStats:Percentage* of All Emergency Department (ED) Visits Made by Patients with Asthma, by Sex and Age Group—National Hospital Ambulatory Medical Care Survey, United States 2014–2015. MMWR Morb Mortal Wkly Rep. 2018;67:167.

  4. Hogan AH, Carroll CL, Iverson MG, Hollenbach JP, Philips K, Saar K, et al. Risk factors for pediatric asthma readmissions: a systematic review. J Pediatr. 2021;S0022–3476(21):00438–48.

    Google Scholar 

  5. Anise A, Hasnain-Wynia R. Patient-centered outcomes research to improve asthma outcomes. J Allergy Clin Immunol. 2016;138:1503–10.

    Article  Google Scholar 

  6. Goldstein BA, Navar AM, Pencina MJ, Ioannidis JPA. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc. 2017;24:198–208.

    Article  Google Scholar 

  7. Stolte A, Merli MG, Hurst JH, Liu Y, Wood CT, Goldstein BA. Using Electronic Health Records to understand the population of local children captured in a large health system in Durham County, NC, USA, and implications for population health research. Soc Sci Med. 2022;296: 114759.

    Article  Google Scholar 

  8. Hurst JH, Liu Y, Maxson PJ, Permar SR, Boulware LE, Goldstein BA. Development of an electronic health records datamart to support clinical and population health research. J Clin Transl Sci. 2020;5: e13.

    Article  Google Scholar 

  9. Tang M, Goldstein BA, He J, Hurst JH, Lang JE. Performance of a computable phenotype for pediatric asthma using the problem list. Ann Allergy Asthma Immunol. 2020;125:611-613.e1.

    Article  Google Scholar 

  10. Lang JE, Tang M, Zhao C, Hurst J, Wu A, Goldstein BA. Well-child care attendance and risk of asthma exacerbations. Pediatrics. 2020;146: e20201023.

    Article  Google Scholar 

  11. Bonito A, Bann C, Eicheldinger C, Carpenter L. Creation of new race-ethnicity codes and socioeconomic status (SES) indicators for medicare beneficiaries. http://www.ahrq.gov/research/findings/final-reports/medicareindicators/index.html. Accessed 9 Aug 2013.

  12. He J, Ghorveh MG, Hurst JH, Tang M, Alhanti B, Lang JE, et al. Evaluation of associations between asthma exacerbations and distance to roadways using geocoded electronic health records data. BMC Public Health. 2020;20:1626.

    Article  CAS  Google Scholar 

  13. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33:1–22.

    Article  Google Scholar 

  14. ranger: a fast implementation of random forests for high dimensional data in C++ and R | Journal of Statistical Software. https://www.jstatsoft.org/article/view/v077i01. Accessed 27 Feb 2022.

  15. Greenwell B, Boehmke B, Cunningham J. gbm: generalized boosted regression models. R package version. 2019;2(5).

  16. ROCR: visualizing classifier performance in R | Bioinformatics | Oxford Academic. https://academic.oup.com/bioinformatics/article/21/20/3940/202693. Accessed 27 Feb 2022.

  17. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org/.

  18. Cohen HA, Blau H, Hoshen M, Batat E, Balicer RD. Seasonality of asthma: a retrospective population study. Pediatrics. 2014;133:e923-932.

    Article  Google Scholar 

  19. Haselkorn T, Zeiger RS, Chipps BE, Mink DR, Szefler SJ, Simons ER, et al. Recent asthma exacerbations predict future exacerbations in children with severe or difficult-to-treat asthma. J Allergy Clin Immunolo. 2009;124:921–7.

    Article  Google Scholar 

  20. Wu AC, Tantisira K, Li L, Schuemann B, Weiss ST, Fuhlbrigge AL. Predictors of symptoms are different from predictors of severe exacerbations from asthma in children. Chest. 2011;140:100–7.

    Article  Google Scholar 

  21. Price DB, Rigazio A, Campbell JD, Bleecker ER, Corrigan CJ, Thomas M, et al. Blood eosinophil count and prospective annual asthma disease burden: a UK cohort study. Lancet Respir Med. 2015;3:849–58.

    Article  Google Scholar 

  22. Miller MK, Lee JH, Miller DP, Wenzel SE. Recent asthma exacerbations: a key predictor of future exacerbations. Respir Med. 2007;101:481–9.

    Article  Google Scholar 

  23. Covar RA, Szefler SJ, Zeiger RS, Sorkness CA, Moss M, Mauger DT, et al. Factors associated with asthma exacerbations during a long-term clinical trial of controller medications in children. J Allergy Clin Immunol. 2008;122:741-747.e4.

    Article  CAS  Google Scholar 

  24. Peters MC, Mauger D, Ross KR, Phillips B, Gaston B, Cardet JC, et al. Evidence for exacerbation-prone asthma and predictive biomarkers of exacerbation frequency. Am J Respir Crit Care Med. 2020;202:973–82.

    Article  CAS  Google Scholar 

  25. Hoch HE, Calatroni A, West JB, Liu AH, Gergen PJ, Gruchalla RS, et al. Can we predict fall asthma exacerbations? Validation of the seasonal asthma exacerbation index. J Allergy Clin Immunol. 2017;140:1130-1137.e5.

    Article  Google Scholar 

  26. Luo G, He S, Stone BL, Nkoy FL, Johnson MD. Developing a model to predict hospital encounters for asthma in asthmatic patients: secondary analysis. JMIR Med Inform. 2020;8: e16080.

    Article  Google Scholar 

  27. Finkelstein J, Jeong IC. Machine learning approaches to personalize early prediction of asthma exacerbations: personalized prediction of asthma exacerbation. Ann NY Acad Sci. 2017;1387:153–65.

    Article  Google Scholar 

  28. Bhavsar NA, Gao A, Phelan M, Pagidipati NJ, Goldstein BA. Value of neighborhood socioeconomic status in predicting risk of outcomes in studies that use electronic health record data. JAMA Netw Open. 2018;1: e182716.

    Article  Google Scholar 

  29. Schuler A, O’Súilleabháin L, Rinetti-Vargas G, Kipnis P, Barreda F, Liu VX, et al. Assessment of value of neighborhood socioeconomic status in models that use electronic health record data to predict health care use rates and mortality. JAMA Netw Open. 2020;3: e2017109.

    Article  Google Scholar 

  30. Stevens EL, Rosser F, Han Y-Y, Forno E, Acosta-Pérez E, Canino G, et al. Traffic-related air pollution, dust mite allergen, and childhood asthma in puerto ricans. Am J Respir Crit Care Med. 2020;202:144–6.

    Article  Google Scholar 

  31. Brandt SJ, Perez L, Künzli N, Lurmann F, McConnell R. Costs of childhood asthma due to traffic-related pollution in two California communities. Eur Respir J. 2012;40:363–70.

    Article  Google Scholar 

  32. Rodriguez-Villamizar LA, Berney C, Villa-Roel C, Ospina MB, Osornio-Vargas A, Rowe BH. The role of socioeconomic position as an effect-modifier of the association between outdoor air pollution and children’s asthma exacerbations: an equity-focused systematic review. Rev Environ Health. 2016;31:297–309.

    Article  Google Scholar 

  33. Zheng X, Ding H, Jiang L, Chen S, Zheng J, Qiu M, et al. Association between air pollutants and asthma emergency room visits and hospital admissions in time series studies: a systematic review and meta-analysis. PLoS ONE. 2015;10: e0138146.

    Article  Google Scholar 

  34. Witonsky J, Abraham R, Toh J, Desai T, Shum M, Rosenstreich D, et al. The association of environmental, meteorological, and pollen count variables with asthma-related emergency department visits and hospitalizations in the Bronx. J Asthma. 2019;56:927–37.

    Article  Google Scholar 

  35. Goldstein BA, Pencina MJ, Montez-Rath ME, Winkelmayer WC. Predicting mortality over different time horizons: which data elements are needed? J Am Med Inform Assoc. 2017;24:176–81.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This project was supported by the Translating Duke Health Children’s Health and Discovery Initiative and grants from the National Heart, Lung, and Blood Institute (5R21HL145415-02) and the National Center for Advancing Translational Sciences (UL1TR001117).

Author information

Authors and Affiliations

Authors

Contributions

JHH, CZ, HPH, MGG, JEL, and BAG conceptualized the study; JHH, CZ, MGG, and BAG developed the methodology; JHH, CZ, and BAG wrote the original draft of the manuscript; JHH, CZ, HPH, MGG, JEL, and BAG reviewed and edited the manuscript; JEL and BAG acquired funding for the study. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Benjamin A. Goldstein.

Ethics declarations

Ethics approval and consent to participate

Duke University Health System Internal Review Board and granted a waiver of Informed consent for a retrospective analysis of existing patient data. All experimental protocols were performed in accordance with relevant guidelines and regulations and approved by the Duke University Health System Internal Review Board.

Consent for publication

Not applicable.

Competing interests

JEL received consulting fees serving on the Regeneron Pediatric Asthma Field Advisory Board. JHH, CZ, HPH, MGG, and BAG do not have any competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

Diagnostic codes for asthma and atopic diseases. Table S2. Medication definitions. Table S3. Model Variables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hurst, J.H., Zhao, C., Hostetler, H.P. et al. Environmental and clinical data utility in pediatric asthma exacerbation risk prediction models. BMC Med Inform Decis Mak 22, 108 (2022). https://doi.org/10.1186/s12911-022-01847-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-022-01847-0

Keywords