- Research article
- Open Access
Predicting diabetes clinical outcomes using longitudinal risk factor trajectories
BMC Medical Informatics and Decision Making volume 20, Article number: 6 (2020)
The ubiquity of electronic health records (EHR) offers an opportunity to observe trajectories of laboratory results and vital signs over long periods of time. This study assessed the value of risk factor trajectories available in the electronic health record to predict incident type 2 diabetes.
Study design and methods
Analysis was based on a large 13-year retrospective cohort of 71,545 adult, non-diabetic patients with baseline in 2005 and median follow-up time of 8 years. The trajectories of fasting plasma glucose, lipids, BMI and blood pressure were computed over three time frames (2000–2001, 2002–2003, 2004) before baseline. A novel method, Cumulative Exposure (CE), was developed and evaluated using Cox proportional hazards regression to assess risk of incident type 2 diabetes. We used the Framingham Diabetes Risk Scoring (FDRS) Model as control.
The new model outperformed the FDRS Model (.802 vs .660; p-values <2e-16). Cumulative exposure measured over different periods showed that even short episodes of hyperglycemia increase the risk of developing diabetes. Returning to normoglycemia moderates the risk, but does not fully eliminate it. The longer an individual maintains glycemic control after a hyperglycemic episode, the lower the subsequent risk of diabetes.
Incorporating risk factor trajectories substantially increases the ability of clinical decision support risk models to predict onset of type 2 diabetes and provides information about how risk changes over time.
The early identification of individual risk for developing type 2 diabetes is essential for effective targeting of preventive measures. Early intervention through lifestyle change and/or metformin therapy have shown robust results in preventing or postponing the onset of diabetes [1, 2]. More precise identification of individual risk allows limited resources to be balanced against individual needs.
Diabetes risk scores, also known as diabetes indices or risk equations, are currently used to estimate individual risk for developing diabetes [3,4,5,6,7,8,9]. Besides estimating individual risk, these risk scores can also deepen our understanding of how diabetes develops, and inform us of interactions between a specific risk factor and subsequent development of complications. Many risk scores exist with the sole purpose of risk estimation [6, 7] and numerous diabetes models have been developed for the purpose of biomarker discovery, [10, 11] but very few, if any, models are able to simultaneously address both goals.
The Framingham diabetes score is a widely used model for estimating diabetes risk . In this score, weights are assigned to seven risk factors, and the weights of the risk factors that a patient presents with are summed. The Framingham score is a paper-and-pencil score,  which is easy to compute during a patient visit. The ease of computation, however, trades accuracy for simplicity, and hides the heterogeneity and the wide array of clinical risk factors  associated with diabetes. In response, a stream of increasingly accurate but increasingly complex risk models followed (see [5, 6, 9, 15] for systematic reviews), often relying on measurements related to nutrition, caloric intake and lifestyle, that are not commonly recorded in routine clinical practice. These scores (or rather equations) are highly multivariate, and are no longer computable with paper and pencil. The adoption of electronic health records (EHR) systems can, in theory, alleviate the problems stemming from running complex predictive models; however, the reliance of these diabetes scores on data elements not commonly available in the EHR system renders these models impractical. More importantly, the pursuit of increasingly marginal improvements in predictive accuracy and the lack of temporal frames limit our understanding of the disease and its progression.
We have previously shown that the order in which patients develop comorbidities is predictive of the risk of diabetes, even after adjusting for the severity of the comorbidities . In another study, Hulsegge et al. compared trajectories of laboratory results and vital signs between patients who developed diabetes and those who did not, over 21 years, taking a snapshot every 5 years. They showed that laboratory results can be different as many as 15–20 years before the diagnosis of diabetes, but they did not associate trajectories with risk of diabetes . None of the diabetes risk scores take patient trajectory into account.
In this paper, we develop a novel methodology, Cumulative Exposure, to associate trajectories of lab results observed at a finer granularity with incidence of type 2 diabetes. The model embraces both goals of risk score development: it offers state-of-the-art prediction accuracy using only data elements that we extracted from our EHR system and it simultaneously allows us to generate new hypothesis about the temporal aspect of diabetes.
Mayo Clinic provides primary care to residents of Olmsted County, Minnesota, and it has an integrated electronic health record system including diagnoses, medications, laboratory results and clinical notes. These records are part of the Rochester Epidemiology Project (REP), a comprehensive research data repository over several decades, approved for medical research. The resources available for the REP have been described elsewhere . The primary care clinics at Mayo Clinic provide routine health care similar to any primary care clinic elsewhere. The study was approved by Mayo Clinic IRB.
We used a retrospective cohort of de-identified data from 71,454 primary care patients at Mayo Clinic, Rochester, MN with research consent. The cohort consists of patients aged ≥18 at baseline on Jan. 1st, 2005, having at least one visit before and after baseline. These patients were followed until 2015 (median follow-up time is 8 years). We extracted diagnoses (ICD-9), laboratory results, vital signs, and medications longitudinally for three non-overlapping time periods: 2000–2001, 2002–2003 and the year of 2004. Patients with pre-existing diagnosis of diabetes at baseline (5891 patients), without fasting plasma glucose (FPG) measurements during any of the three time periods (32,852) and those with suspected diabetes (indicated by insulin or oral antidiabetic medication use or a single FPG > 125 mg/dl; 2427 patients) at any time before baseline were excluded. The final cohort consists of 30,284 patients. Table 1 contains a description of the cohort.
The predictor variables include age, gender, ICD-9 diagnoses categorized into four diabetes risk factors (hypertension, dyslipidemia, impaired fasting glucose, obesity) and medication use for the above categories rolled up to National Drug File Reference Terminology NDF-RT pharmaceutical subclasses at baseline, vital signs (BMI, systolic and diastolic blood pressure; SBP and DBP, respectively), and laboratory results (LDL, HDL, triglycerides, and fasting plasma glucose; FPG). Glucose values were used if they were fasting glucose value obtained during routine clinical care in the ambulatory setting. Glucose values done in the emergency department and hospital setting were excluded. Point-of-care glucose measurements, which usually use capillary whole-blood, were also excluded. All the laboratory tests were done by Mayo Clinic Laboratories which are fully certified by the College of American Pathology and the Clinical Laboratory Improvement Amendments. These data yield three sets of predictor variables. The first set is baseline, and it contains the latest measurements before baseline. The second set is extreme measurements, which contains the most extreme (minimum for HDL, maximum for the others) result over the 5-year period of 2000–2004. The third set is the proposed cumulative exposure. Through linear interpolation, a segment-wise linear curve of the lab results and vital signs were obtained, and the area under the curve was computed for three non-overlapping time periods: 2000–2001, 2002–2003, and 2004. If the curve could not be estimated via linear interpolation for a time period (e.g. there was no result before 2000 for the 2000–2001 time period), the cumulative exposure variable for that time period was marked missing. To complete the curve between the last measurement and Jan 1st, 2005, the last measurement was carried forward (the measurement was assumed to stay constant). The cumulative exposure can be interpreted as our best estimate of the average of the daily lab values of the patient for each time period.
The study endpoint was incident type 2 diabetes mellitus as defined by a first ICD-9 diagnosis code or a fasting glucose measurement in excess of 125 mg/dl.
Cox proportional hazards regression models were constructed with type 2 diabetes mellitus (T2DM) as the dependent variable using age, gender, and some of the above sets of clinical predictor variables. Specifically, four models were constructed:
Baseline using demographic information (age, gender) and the baseline predictors (latest lab results and vital signs before baseline);
Cumulative Exposure (CE) using demographics, baseline and the cumulative exposure variables;
Extreme values (EV) using demographics, baseline and the extreme measurements (most extreme lab results and vitals over 2000–2004); and
Extreme plus Cumulative (EV + CE) which uses all variable sets (demographics, most recent, extreme measurement, and cumulative exposure).
Laboratory results and vital signs completely missing throughout the years 2000–2005 were handled through mean imputation with the addition of missingness indicator variables. When results were missing for one of the three time periods, carry-forward imputation was used. Patients with missing fasting glucose measurements were discarded. Backwards elimination was used for variable selection.
The four models were compared to the Framingham Diabetes Risk Scoring Model (FDRSM) .
Model performance was evaluated using bootstrap estimation with 1000 replications and survival concordance as the evaluation metric measured on the out-of-bag samples. Survival concordance is the probability that for any pair of patients in which one patient remained free of progression to overt diabetes longer than the other, the one who developed diabetes earlier has higher predicted risk. Survival concordance is the C-statistic for censored data. We report the model performances as the median, upper and lower quartiles of the 1000 performance measurements. All models were evaluated on the same 1000 replications, so paired t-test was used for pairwise comparison of model performances.
Applying CE to study episodic prediabetic populations
We apply the Cumulative Exposure model to study the effect of episodic pre-diabetes on incident diabetes. By ‘episodic prediabetes’, we refer to a short (no more than 2–3 years long) episode of prediabetes (FPG between 100 and 125 mg/dl) where the patient returned to normoglycemia without pharmacological intervention. We study two subpopulations that differ in the duration of normoglycemia following the prediabetic episode and two kinds of controls: patients who did not return to normoglycemia (two subpopulations) and patients who did not develop prediabetes. Specifically, we have the following subpopulations:
patients who were prediabetic in 2000–2001 and returned to normoglycemia in 2002–2003 (‘pnn’);
patients who were prediabetic in 2002–2003 and returned to normoglycemia in 2004 (‘npn’);
patients who became prediabetic in 2004 (‘nnp’);
patients who were normoglycemic in 2001–2002 and developed prediabetes in 2002–2003 (‘npp’);
patients who did not developed prediabetes before 2005 (‘nnn’).
We fit the Baseline, the Cumulative Exposure, and the Extreme Value models to the entire population as described above. Missing value imputation was applied to the entire population before the subpopulations were created. We used these models to estimate the risk of developing overt diabetes in these specific subpopulations. We defined our risk as the per-patient expected number of diabetes incidents in each subpopulation during the 10 follow-up years (2005–2015) and we defined the error as the (signed) Martingale residual (difference between the per-patient estimated and observed number of diabetes incidents). We wish to know how diabetes risk varies across the subpopulations and how well the two models can estimate them.
We carried out a sensitivity analysis in patients with at least one FPG measurement in all three time periods (2000–2001; 2002–2003; and 2004) and at least five during follow-up to ascertain that our conclusions are not unduly impacted by the intermittent nature of the patient visits.
Baseline cohort characteristics
Table 1 shows the clinical characteristics of the cohort at baseline, 2005.
Performance of the predictive models
The performance of the new models, Baseline, Cumulative Exposure, Extreme Values and Extreme plus Cumulative Models, each outperformed the FDRS Model, with concordance of 0.767, 0.783, 0.802, 0.805 and 0.660 respectively, all p-values <2e-16 (Fig. 1). Among the four new models, only Baseline lacks the ability to take the patient’s past trajectory into account and accordingly has a substantially lower performance than the other models.
Table 2 shows the coefficients of the statistically significant laboratory results and vital signs after backwards elimination in each model. Each row within a model corresponds to a variable set and timeframe (baseline, extreme measurements, cumulative exposure over the three timeframes labeled as 2000-2001, 2002-2003 and 2004) and each column corresponds to a laboratory result or vital sign. Consider, for example, the effect of FPG (column ‘fasting’) in the Cumulative Exposure model. The Cumulative Exposure model is the second group from the top in Table 2 and has four rows (timeframes): 2000-2001, 2002-2003, 2004 and baseline. A unit increase in the cumulative exposure of FPG, which is essentially the estimated daily average FPG level, in the timeframe of 2000-2001 independently increases the relative hazard of diabetes by exp(.034)=1.04. Additionally, a unit increase in 2002-2003 further increases the relative hazard (independently of other timeframes) by exp(.035)=1.04 and the baseline measurement increases it further by exp(.041). The cumulative exposure to FPG in 2004 was not significant (because the most recent FPG is mostly the only measurement from 2004). The other lab results and vitals can be interpreted analogously.
Using the cumulative exposure model to study episodic pre-diabetic subpopulations
Table 3 presents a comparison of the five subpopulations in terms of their median lab results, vitals, age, follow-up time, and percentage of medication use. None of the patients in the cohort used anti-diabetic medications.
Table 4 summarizes the estimates from the Most Recent, the Cumulative Exposure, and the Extreme Value models for five subpopulations. The results from the Extreme Plus Cumulative model are very similar to the Extreme Value model, so we omitted them from Table 3. For each model, the estimated risk (Pred) and the estimation error (Error) are displayed. We will refer to each group by their row number.
Risk of diabetes in the five subpopulations
Patients who returned to normoglycemia after an episode of hyperglycemia (groups 1 and 2) had lower risk of progression to overt diabetes than patients who did not return to normoglycemia (groups 3 and 4): the adjusted risks in groups 1 and 2 were .087 and .103, as compared to groups 3 and 4, where it was .139 and .207 as estimated by the Cumulative Exposure model. Patients who returned to normoglycemia (groups 1 and 2) had higher adjusted risk of developing overt diabetes than patients who did not develop prediabetes (group 5): the adjusted risk of diabetes was .087 and .103 vs .051 by the Cumulative Exposure model. The risk estimates from the Baseline and the Extreme Value model show similar trends but with higher estimation errors.
In patients who returned to normoglycemia after an episode of documented fasting hyperglycemia, and patients who had an episode of hyperglycemia earlier (and hence remained normoglycemic longer) had a lower risk of progression to diabetes. The adjusted risk by the Cumulative Exposure model for patients who had their prediabetic episode in 2000–2001 was .087 vs .103 for those who had it in 2002–2003.
Accuracy of the estimation
The estimation error for the Cumulative Exposure model was 1.5 to 50 times lower than for the Baseline model: it was highest in group 3 with .057 vs .001 and lowest in group 2 with .026 vs .019. In the predominant group (group 5 with 14,387 patients), the CE model had less than half the error of the Baseline model (.007 vs .016). In all groups except group 3, the estimation error of CE was lower than 1%. In contrast, the Baseline model had estimation errors as high as 5.7% and had an estimation error less than 1% only in one subpopulation (group 1). The Extreme Value model had almost perfect estimate in group 5 (patients who did not develop prediabetes) with an estimation error less than one tenth of a percent, but it had higher estimation error than the Cumulative Exposure model in all other groups, and it even had higher estimation error than the Baseline model in the first three groups.
Results from the sensitivity analysis show similar tendencies as Table 4.
Predictive performance of the models
Our results showed that it is possible to build diabetes risk models with state of the art predictive performance using variables that are commonly available in the electronic health records. Among the four models we constructed, the Baseline model, which is built using diagnoses, medication prescriptions, lab results (lipids and FPG) and vitals (blood pressure and BMI) at baseline, and does not even take trajectories into account, achieved a survival concordance of .767 (±.006). This performance represents a 14% improvement over the performance of the Framingham score (.660 ± .006) and is highly comparable to the performance of state-of-the-art risk models published in a large validation study ; thus, the Baseline model can be considered a state-of-the-art model in its own right.
Taking historic information about laboratory results and vital sign into account significantly improves predictive accuracy. The simplest way to incorporate history is to compute the most extreme measurement during the period of 2000–2004. Adding these predictors to the Baseline model results in the Extreme Value model, which has almost 5% higher concordance than the Baseline model (.802 vs .767; p-value < 2.2e-16). Having one historic measurement in 2000–2004 and the most recent measurement for most patients forms a trajectory, albeit a very crude one. The results from the Extreme Value model show that incorporating any trajectory information is very beneficial; even this crude representation of a trajectory brought almost half as much improvement as adding all the predictors to the Framingham score that the Baseline model has.
Finally, the cumulative exposure variables refined the notion of trajectories, further improving the performance to .805 (±.005). This improvement is important because it represents a substantial difference in certain subpopulations. The key difference between the Extreme Model and the Cumulative Exposure model is granularity, which gives us two pieces of information: (i) the time frame in which the extreme value occurred, and (ii) whether or not the patient was normal in other time frames. The cumulative exposure model opens up a temporal dimension, allowing us to directly model situations where patients can have intermittent abnormal laboratory results, and are brought back under control through (say) lifestyle changes. The Cumulative Exposure achieved higher predictive ability to assess the risk of diabetes in patients who had prediabetes at some point in the past than the Baseline or the Extreme Values model.
Importance of incorporating trajectories
Not only does incorporating trajectories through the Cumulative Exposure variables improve predictive performance, it also improves our understanding of diabetes. While many of the metabolic risk factors of diabetes are well known, [14, 19] their temporal behavior is not.
We have demonstrated through the use of the cumulative exposure model that even episodic (short-term; no more than 2–3 years of) prediabetes increases the risk of developing overt diabetes, and that returning to normoglycemia mitigates this risk, but does not fully eliminate it. We could not find any evidence in the literature indicating whether or not returning to normoglycemia eliminates the increase in risk possibly caused by previous prediabetes, it is well understood that prediabetic patients face an increased risk of developing type 2 diabetes, and it is also known that sustained successful intervention either via lifestyle change or pharmacological intervention can delay the onset of diabetes by 4–5 years [1, 2].
Moreover, our results also suggest that the longer a patient remains normoglycemic after an episode of hyperglycemia, the lower the risk of developing diabetes. Our results suggest that temporarily returning to normoglycemia between two episodes of hyperglycemia has a positive effect on mitigating the risk of developing diabetes.
While we did not perform a subpopulation analysis specifically for obese patients, the coefficients of the Cumulative Exposure model suggest that an analogous relationship exists between BMI and obesity. Becoming obese even for a short period of time increases the patient’s risk of developing overt type 2 diabetes and losing weight thereafter mitigates this risk. Similar to prediabetes, the effect of previous short-term obesity is attenuated over time: the longer the patient has been non-obese, the lower the effect of any previous incidence of obesity. After 5 years, the effect of previous obesity appears to lose any significant effect. This observation requires a cautionary statement. When exactly the effect becomes insignificant depends on the sample size, thus the 5-year period we observed in our sample may be a statistical artifact, but the attenuation in the effect size is not. In other words, in a larger cohort, 2000–2001 BMI could have been statistically significant, but we expect its effect size to be smaller than the effect size in 2002–2003.
In the context of progression from diabetes to its complications, the concept of metabolic memory of glucose control has been proposed. Several studies have shown that better early glycemic control has enduring effect that persists over time . For example, in the Diabetes Control and Complications Trial (DCCT), patients with type 1 diabetes were randomized to intensive or standard insulin regimens to control their blood sugars . Because the group in the intensive arm achieved profound reductions in the rate of microvascular complications, the trial was stopped early and all patients were switched to intensive therapy. In a follow up trial with this same population (EDIC trial) it was found that those initially assigned to the intensive arm continued to have lower incidence of complications despite the fact that both groups had subsequently achieved similar glycemic control for several years after switching to the intensive therapy . In other words, initial better glucose control has sustained long-term benefits.
Our study presents a complementary but compatible viewpoint. We found that even short-term loss of control can result in long-term disadvantages. Exposure to hyperglycemia also has “memory”: elevated FPG in the past continues to increase risk of diabetes in the future despite having achieved similar control (returning to normoglycemia). However, our study also suggests that this memory fades over time. Returning to normoglycemia attenuates the negative effect of prior exposure. Our findings are compatible with previous findings in the sense that among patients with similar control (normoglycemic at baseline), achieving better control (return to normoglycemia earlier) has future benefits.
Although the UKPDS blood pressure control trial failed to demonstrate “memory” for blood pressure, we found that cumulative exposure to elevated blood pressure was significant for the most recent timeframe . This could be due to loss of power, since patients with missing blood pressure measurement during 2000–2004 were included, while patients with similarly missing glucose were excluded.
Our study cohort was defined so that patients have multiple FPG measurements; however, other laboratory results and vital signs could be missing. Specifically, there are 2200 patients who have no blood pressure measurements and 1600 patients who have no lipid measurements during the entire period of 2000–2004. The lack of statistical significance of lipid trajectories may be due to the lower statistical power of these variables. These results are only applicable to health care provided in the ambulatory care setting, specifically, primary care, and using fasting plasma glucose measurements.
This is a single center study, with limited racial variability; therefore, the effect of race could not be incorporated. Social history and family history was available only for a limited number of patients. The study was based on EHR data. As such, non-pharmacological interventions, such as lifestyle changes, were not consistently documented.
We have demonstrated that laboratory results and vital sign trajectories that can be extracted from EHR data provide better risk estimates than current models using baseline measurements. The metabolic memory of exposure to even mildly elevated glucose levels exists, but fades over time when glucose is under control. Incorporating these data into risk estimates provides better identification of individual risk, and allows for allocation of resources to be more precisely balanced against individual need.
Availability of data and materials
The data analyzed in this manuscript is patients’ health information coming from the Rochester Epidemiology Project (REP) at Mayo Clinic. This is patients’ private information and we are unable to share it publicly.
Body mass index
Continuous Exposure (model)
Diastolic Blood Pressure
Electronic Health Records
Extreme Value (model)
Framingham Diabetes Risk Score
Fasting Plasma Glucose
High Density Lipoprotein
Low Density Lipoprotein
Rochester Epidemiology Project
- SBP :
Systolic Blood Pressure
Type-2 Diabetes Mellitus
Abbasi A, Peelen LM, Corpeleijn E, Schouw YT, Stolk RP, Spijkerman AMW, A DL, Moons KGM, Navis G, Bakker SJL, Beulens JWJ. Prediction models for risk of developing type 2 diabetes: systematic literature search and independent external validation study. BMJ. 2012;345:e5900.
Ali A, Sahlqvist AS, Lotta L, Brosnan JM, Vollenweider P, Giabbanelli P, Nunez DJ, Waterworth D, Scott RA, Langanberg C, Wareham NJ. A Systematic Review of Biomarkers and Risk of Incident Type 2 Diabetes: An Overview of Epidemiological, Prediction and Aetiological Research Literature. Plos One. 2016;11(10).
Collins GS, Mallet S, Omar O, Yu LM. Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting. BMC Med. 2011;9:103.
The DCCT Research Group. Reliability and validity of a diabetes quality-of-life measure for the Diabetes Control and Complications Trial (DCCT). Diabetes Care. 1988;11:725–32.
Diabetes Prevention Program (DPP) Research Group. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002;346:393–403.
Writing team for the Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications Research Group. Sustained effect of intensive treatment of type 1 diabetes mellitus on development and progression of diabetic nephropathy: The Epidemiology of Diabetes Interventions and Complications (EDIC) study. JAMA. 2003;290(16):2159–67.
Ford ES. C. li and N. Sattar, metabolic syndrome and incident diabetes. Current state of the evidence. Diabetes Care. 2008;31(9):1898–904.
Holman RR, Paul SK, Bethel MA, Neil HA, Matthews DR. Long-term follow-up after tight control of blood pressure in type 2 diabetes. N Engl J Med. 2008;359:1565–76.
Hulsegge G, Spijkerman AMW, van der Schouw YT, Bakker SJL, Gansevoort RT, Smit HA, Verschuren WMM. Trajectories of metabolic risk factors and biochemical markers prior to the onset of type 2 diabetes: the population-based longitudinal Doetinchem study. Nutr Diabetes. 2017;7(5):e270. https://doi.org/10.1038/nutd.2017.23.
Jahani M And M. Madhavi. Comparison of predictive models for the early diagnosis of diabetes. Health Inform Res 2016; 22(2): 95–100.
Kahn HS, Cheng YJ, Thompson TJ, Imperatore G, Gregg EW. Two risk-scoring Systems for Predicting Incident Diabetes Mellitus in U.S. adults age 45 to 64 years. Ann Intern Med. 2009;150(11):741–51.
Kengne AP, Beulens JWJ, Peelen LM, et al. Non-invasive risk scores for prediction of type 2 diabetes (EPIC-InterAct): a validation of existing models. Lancet Diabetes Endocrinol. 2014;2(1):19–29.
Kolberg JA, Jørgensen T, Gerwien RW, Hamren S, McKenna MP, Moler E, Rowe MW, Urdea MS, Xu XM, Hansen T, Pedersen O, Borch-Johnsen K. Development of a type 2 diabetes risk model from a panel of serum biomarkers from the Inter99 cohort. Diabetes Care. 2009;32:1207–12.
Lees T, Nassif N, Simpson A, Shad-Kaneez F, Martiniello-Wilks R, Lin Y, Jones A, Qu X, Lal S. Recent advances in molecular biomarkers for diabetes mellitus: a systematic review. Biomarkers. 2017;22(7):604–13.
Lindström J, Louheranta A, Mannelin M, Rastas M, Salminen V, Eriksson J, Uusitupa M, Tuomilehto J. The Finnish Diabetes Prevention Study Group. The Finnish Diabetes Prevention Study (DPS) Lifestyle intervention and 3-year results on diet and physical activity. Diabetes Care. 2003;26(12):3230–6.
Lindström J. And J. Tuomilehto. The diabetes risk score. A practical tool to predict type 2 diabetes risk. Diabetes Care. 2003 Mar;26(3):725–31.
Misra A, Bloomgarden Z. Metabolic Memory: Evolving Concepts. Journal of Diabetes. 2018;10(3):186–7.
Noble D, Mathur R, Dent T, Meads C, Greenhalgh T. Risk models and scores for type 2 diabetes: systematic review. BMJ. 2011;343:d7163.
Oh W, Kim E, Castro MR, Caraballo PJ, Kumar V, Steinbach MS, Simon GJ. Diabetes trajectories and associated risk. BigData. 2016;4(1):25–30.
Schmidt MI, Duncan BB, Bang H, Pankow JS, Ballantyne CM, Golden SH, Folsom AR, Chambless LE. Identifying individuals at high risk for diabetes. The atherosclerosis risk in communities study. Diabetes Care. 2005;28(8):2013–8.
Turi KN, Buchner DM, Grigsby-Toussaint DS. Predicting Risk of Type 2 Diabetes by Using Data on Easy-to-Measure Risk Factors. Prev Chronic Dis. 2017;14:160244.
Wilson PW, Meigs JB, Sullivan L, Fox CS, Nathan DM, D’Agostino RB. Prediction of Incident Diabetes Mellitus in Middle-aged Adults: The Framingham offspring study. Arch Intern Med. 2007;167(10):1068–74.
St Sauver JL, B.R. Grossardt, B.P. Yawn, L.J. Melton 3rd, J.J. Pankratz, S.M. Brue and W.A. Rocca. Data Resource Profile: The Rochester Epidemiology Project (REP) medical records-linkage system. Int J Epidemiol. 2012;41(6):1614–24.
This work partially supported by NIH award LM011972, NSF awards IIS 1602394 and 1602198. The views expressed in this paper are those of the authors and do not necessarily reflect the view of the funding agencies. The funding agencies did not participate in the collection, analysis or interpretation of the data, nor did they influence the study design.
Ethics approval and consent to participate
This study utilizes pre-existing EHR data and was declared IRB-exempt by both the Mayo Clinic and University of Minnesota IRBs.
Consent for publication
Only EHRs with patient consent are used; the consent is given in writing (possibly electronically) and consent information is stored in the EHR system.
None of the authors have financial or non-financial competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Simon, G.J., Peterson, K.A., Castro, M.R. et al. Predicting diabetes clinical outcomes using longitudinal risk factor trajectories. BMC Med Inform Decis Mak 20, 6 (2020). https://doi.org/10.1186/s12911-019-1009-3
- Diabetes trajectories
- Risk assessment