Skip to main content

Use of large scale EHR data to evaluate A1c utilization among sickle cell disease patients



The glycated hemoglobin (A1c) test is not recommended for sickle cell disease (SCD) patients. We examine ordering patterns of diabetes-related tests for SCD patients to explore misutilization of tests among this underserved population.


We used de-identified electronic health record (EHR) data in the Cerner Health Facts™ (HF) data warehouse to evaluate the frequency of A1c and fructosamine tests during 2010 to 2016, for 37,151 SCD patients from 393 healthcare facilities across the United States. After excluding facilities with no A1c data, we defined three groups of facilities based on the prevalence of SCD patients with A1c test(s): adherent facilities (no SCD patients with A1c test(s)), minor non-adherent facilities, major non-adherent facilities.


We determined that 11% of SCD patients (3927 patients) treated at 393 facilities in the US received orders for at least one A1c test. Of the 3927 SCD patients with an A1c test, only 89 patients (2.3%) received an order for a fructosamine test. At the minor non-adherent facilities, 5% of the SCD patients received an A1c test while 58% of the SCD patients at the least adherent facilities had at least one A1c test. Overall, the percent of A1c tests ordered for SCD patients between 2010 and 2016 remained similar.


Inappropriate A1c test orders among a sickle cell population is a significant quality gap. Interventions to advance adoption of professional recommendations that advocate for alternate tests, such as fructosamine, can guide clinicians in test selection to reduce this quality gap are discussed. The informatics strategy used in this work can inform other largescale analyses of lab test utilization using de-identified EHR data.

Peer Review reports


Inappropriate test selection can lead to misdiagnosis, suboptimal treatment and unnecessary costs [1]. Patients with a genetic disease often require special considerations for test selection to screen and manage prevalent chronic diseases [2]. Sickle cell disease (SCD) is one of the most common severe monogenic hematological disorders worldwide [3]. SCD is a multi-system disease caused by mutations in the hemoglobin beta chain gene [4, 5]. In the US, SCD affects approximately 100,000 people, or one out of every 365 African-American births and one out of every 16,300 Hispanic-American births [6]. It has been estimated that 2.3% of the world’s population have sickle cell disorders [7]. In 2017, over 30 million people in the US (9.4%) and globally over 425 million individuals with type 2 diabetes mellitus [8, 9]. The standardized prevalence of type 2 diabetes mellitus among patients with SCD in the US showed a modest increase from 15.7% to 16.5% from 2009 to 2014 [10].

The glycated hemoglobin A1c test is the most commonly used laboratory test to assist in diagnosing and managing diabetes [11]. The A1c test measures glucose bound to the β-chain of the hemoglobin molecule [11]. In the presence of excess plasma glucose, the hemoglobin beta-chain becomes increasingly glycosylated, making A1c a useful index to monitor long term glycemic control in patients with diabetes mellitus [12]. The test measures the three-month average plasma glucose concentration, reflecting the average normal lifespan of red blood cells. A1c tests are not recommended for persons with SCD or other hemoglobinopathies and anemias in which the lifespan of red blood cells is shorter than the usual 110–120 days [13,14,15]. Three alternative tests provide accurate results when the red blood cell lifespan is shortened: fructosamine, glycated albumin, and 1,5 anhydroglucitol [16]. Of these, fructosamine has received considerable attention in the published literature [17,18,19]. The total concentration of fructosamine is predominantly a measure of glycated albumin and a minor contribution of other circulatory proteins such as glycated lipoproteins and glycated globulins [20]. The American Diabetes Association (ADA) advocates the use of alternative tests for patients with hemoglobinopathies because A1c testing can be unreliable [21]. This was also emphasized in guidance provided through a national information campaign of the National Institute of Diabetes and Digestive and Kidney Diseases in 2014 [22] and by the National Glycohemoglobin Standardization Program [23].

Adoption of the guidance to use an alternative test in lieu of A1c testing in SCD patients is poorly understood. Data derived from EHRs loaded into multi-institutional data warehouses provide a powerful resource for investigating these issues. These data warehouses provide a comprehensive and longitudinal collection of patient health care data and an emerging resource for health services analysis. Several studies have demonstrated that EHR systems can promote cost-effective and sustainable solutions for improving quality in medical care [24]. Multi-institutional data warehouses aggregating EHR data from multiple sites allow national level assessment, comparison of practices and analysis of outcomes across independent, non-affiliated, organizations to guide quality improvement initiatives and identify gaps [25]. One such data resource, Cerner Health Facts™ (HF), has been demonstrated to have frequency of diagnosis codes consistent with the HCUP National Inpatient Survey, indicating that multi-site EHR data warehouses can be representative of national trends [26].

We explore the trends in A1c testing among the SCD patient population in HF and evaluate whether facility characteristics affect these trends. The analysis also serves to establish a baseline that is important for assessing the effect of potential interventions to mitigate any quality gap.


Data source

This study used the de-identified HF data warehouse (Cerner Corporation, Kansas City, MO), which contains longitudinal patient data systematically extracted from the EHR at participating institutions and includes encounter data (emergency, outpatient, and inpatient), patient demographics (age, sex, and race), diagnoses and procedures, laboratory data, and facility characteristics. The HF release used for this work (2016) consisted of 386 million encounters, 4.3 billion lab results from 64 million patients, and other data from 863 US healthcare facilities. All admissions, inpatient medication orders and dispensing, laboratory orders, and specimens are date and time stamped, providing a temporal relationship between treatment patterns and clinical information. Consistent with HF policies, all data were de-identified in compliance with the Health Insurance Portability and Accountability Act (HIPAA) before being provided to the investigators. The facilities contributing data were each assigned a unique identification code. Longitudinal relationships between patient encounters within the same health system are preserved.

Study cohort

We conducted a retrospective analysis of patients with a diagnostic code for SCD, including its variations, such as sickle cell thalassemia, using the International Classification of Diseases, Ninth Revision and Tenth Revision, Clinical Modification codes (ICD-9-CM and ICD-10-CM). We excluded patients with a diagnostic code for sickle cell trait (ICD-9-CM: 282.5, ICD-10-CM: D57.3). The codes were selected based on clinical judgement and the Phenotype Knowledgebase (PheKB) [27]. PheKB standardizes machine-readable definitions of common diseases and provided a published algorithm to identify sickle cell disease cohort within EHRs using ICD-9-CM diagnosis codes. We accepted patients with a single encounter though other analyses have required two or more encounters with a SCD code [28]. The resulting definition groups (from ICD-9-CM codes) were combined with the appropriate ICD-10-CM codes to identify the sickle cell disease patient cohort (Table 1).

Table 1 The ICD-9 and ICD-10 CM codes used in this study to identify the Sickle cell population, grouped based on consensus definition from PheKB

HF data extraction from patients diagnosed with SCD

This sickle cell-patient cohort was analyzed for A1c and fructosamine encounters based on the criteria that included patients, each of whom had at least one A1c test order (identified by LOINC codes: 55454-3, 41995-2, 4548-4, 17855-8, 4549-2, 17856-6), fructosamine test order (identified by LOINC codes: 33805-3, 15069-8, 53550-0), glycated albumin (identified by LOINC code: 13873-5, 1758-2) and/or 1,5 anhydroglucitol (identified by LOINC code: 53835-5) after the first use of a diagnosis code for sickle cell disease. We did not attempt to identify the purpose for the order (i.e., screening, diagnosis, or management) because any use of A1c testing is contraindicated for the sickle cell cohort. A1c and fructosamine encounters before 2010 were excluded from the analysis because the HF data architecture was updated in 2008–2009.

Definitions and analysis of cohorts

An A1c encounter refers to a clinician interaction in which an A1c test is ordered. Testing trends are initially investigated by assessing the facility characteristics in the overall HF cohort and among three facility groups defined below to scan for facility level patterns that might corrrelate with test utilization. Patient characteristics within each facility cohort are assessed. If the date and time stamp of the A1c test were the same as that of the fructosamine test ordered for the specific patient, that A1c test was considered to be co-ordered with fructosamine.

We identified three facility groups (adherent, minor non-adherent and major non-adherent) from the study cohort based on the prevalence of the SCD patients having had A1c testing ordered. An adherent facility has documented evidence that they have patients with an SCD diagnosis code but not an associated A1c test code but also has data confirming that these facilities provide A1c testing to other patients. A non-adherent facility has at least one patient encounter with an SCD diagnosis code and at least one A1c test order for any SCD patient. We classified non-adherent institutions according to the percentage of SCD patients who received inappropriate A1c testing. We stratified the non-adherant institutions by quartile and focused our investigation on the first quartile (< 25th percent adherant) (NA-1) and the fourth quartile (> 75th percent non-adherant) (NA-4). We compared the three facility sub-cohorts (adherent, NA-1 and NA-4) to evaluate patterns related to test utilization at the facility and patient level.

Descriptive statistics were used to summarize the facilities and patients characteristics as mean (SD) or proportions. We used the R statistical software package (version 3.3.1) to perform Chi-square or Fisher’s exact test (sample size < 5) with the categorical data. Continuous data was evaluated using Student’s t-test (normally distributed) or the Mann–Whitney test.


Study population

The overall study cohort included 393 facilities (with 37,151 SCD patients) out of the 863 facilities that contributed data to HF (Fig. 1). Of the 393 facilities, 151 facilities (5039 patients) had no A1c test orders for patients classified as having SCD while the remaining 242 facilities (32,112 patients) had at least one A1c test order for an SCD patient. From the 151 facilities with no A1c encounters for SCD patients, 77 facilities (2518 patients) were excluded from the analysis because there was no record of an A1c encounter for any patient regardless of SCD diagnosis. The 77 facilities may not perform A1c tests in house or another factor may have limited the inclusion of that data in HF. The remaining 74 facilities (2521 SCD patients) which had no A1c encounters for SCD patients, but performed A1c testing for non-SCD patients, were categorized as “adherent” facilities. Facilities with one or more A1c tests for SCD patients (242 facilities; 32,112 SCD patients) were grouped into quartiles based on the proportion of SCD patients with A1c tests as described in the methods. The first quartile, termed minor non-adherent or NA-1, comprised 61 facilities (15,470 patients). The second and third quartiles comprised 121 facilities (15,866 patients) and are excluded from our analysis. The last quartile, NA-4, comprised 60 facilities (776 patients).

Fig. 1

Analysis plan and baseline measure of the utilization of A1c and fructosamine tests in the study cohort. HF data indicated that A1c and fructosamine test orders are not mutually exclusive because 89 patients had both tests ordered. Seventy-seven facilities were eliminated from the HF analysis because there was no evidence that A1c testing was offered within these settings to any patient

Overall HF cohort

We did not find encounters in HF for glycated albumin and 1,5 anhydroglucitol tests (LOINC Codes: 13873-5, 1758-2, CPT code: 82985) for SCD patients and focused on fructosamine as the primary alternative test to A1c in this study. Analyzing the HF SCD cohort for A1c and fructosamine orders indicated that 3927 patients (11% of the study cohort) had at least one A1c test and 134 patients had at least one fructosamine test (Fig. 1). There were only 28 facilities from the cohort with fructosamine encounters. One health system with two facilities contributed 76% of the total fructosamine test orders in the HF cohort. Out of 37,151 SCD patients in the cohort, 89 patients had both an A1c and fructosamine test while 3838 patients had only an A1c test and no fructosamine test, 45 patients had at least one fructosamine test and no A1c test and 33,179 patients had no A1c test ordered and no fructosamine test ordered (Fig. 1). Of the 89 patients who had both an A1c and fructosamine test, 12% of A1c tests (63 of 533 A1c tests) from 42 patients were ordered with the fructosamine test during the same encounter.

Facility characteristics

Facility level characteristics such as the average number of SCD patients in a facility, census region, size of the facility, teaching status, urban and acute care facilities were compared among the HF cohort and the three cohorts (adherent, NA-1 and NA-4) (Table 2). In the HF cohort, there were 134 facilities with a bed size of less than 5 (likely ambulatory), 105 facilities with a bed size between 5 and 100, 133 facilities with a bed size between 100 and 500, and 21 facilities with more than 500 beds. The NA-4 subcohort had more facilities with bed size less than 5 (27 facilities; 44%) compared to NA-1 subcohort (14 facilities; 23%). NA-1 facilities when compared to NA-4 facilities had a higher percentage of teaching facilities (28 facilities; 46% vs 13 facilities; 21%) and acute care facilities (51 facilities; 84% vs 41 facilities; 67%).

Table 2 Characteristics of Facilities, Serving Sickle Cell Disease (SCD) Patients, Cerner Health Facts™, 2010–2016

Adherent, NA-1 and NA-4 facility cohorts

Patient level characteristics such as percentage of A1c utilization, age, sex, race, and sickle cell diagnosis groups were compared among the baseline HF cohort and the three sub-cohorts (Adherent, NA-1 and NA-4) (Table 3). We observed that patients tended to be younger in the NA-1 than in NA-4 group (Mean age, 24.5 years vs 51.2 years).

Table 3 Characteristics of Sickle Cell Disease (SCD) patients, by facility, level of A1c testing, Cerner Health Facts™, 2010–2016

Only 5% of the SCD patients at the NA-1 facilities (841/15470 patients) received at least one A1c test, while 58% of the SCD patients in the NA-4 facilities (446/776 patients) had at least one A1c test (Fig. 2a). Evaluating the annual frequency of A1c encounters shows that the SCD patients with A1c tests at the NA-4 was consistently higher every year between 2010 and 2016 when compared to the NA-1 (Fig. 2b).

Fig. 2

a Sickle-cell patients with A1c encounters in the HF cohort, Minor non-adherent (NA-1) and Major non-adherent (NA-4) facilities. b Percentage of sickle cell patients with A1c encounters per year from 2010 to 2016 in HF, Minor non-adherent (NA-1) and Major non-adherent (NA-4) facilities


We report mis-utilization of A1c testing and apparent underutilization of fructosamine testing for the SCD population from diverse facilities (acute and non-acute, teaching and non-teaching, urban and rural, small ambulatory to large facilities) across the major census regions of the US. Among facilities with known A1c testing (316 facilities), fewer than 25% (74 Adherent facilities) demonstrated full adoption of the SCD testing guidelines, with the lack of adoption most notable among the facilities in the NA-4 subcohort (Fig. 1).

The data suggest lower compliance at ambulatory facilities (the category of facilities with 0–5 beds) and non-teaching facilities. One possibility for this observation is that providers in ambulatory facilities are more apt to order A1c for SCD patients because of greater familiarity with this test or less familiarity with treating patients with SCD. There may be a delay in awareness in non-teaching facilities about guidance from professional groups such as the Joint Commission about the limitations of A1c for the SCD population [29]. Providers may also order A1c tests because they are incented to attain goals through the Centers for Medicare and Medicaid Services Pay for Performance program [30]. As of 2021, these goals do not take into consideration those with SCD and other hemoglobinopathies. If this is a contributing factor to mis-utilization of A1c testing, these goals may need review and modification.

Based on the data, NA-1 facilities serve younger SCD patients and consist of a higher proportion of pediatric facilities than NA-4 where the A1c or fructosamine test is less likely to be ordered for monitoring chronic diabetic mellitus. The ADA Standards of Care use A1c values but the caveat about the use of A1c testing in people with hemoglobinopathies, independent of age group, is not emphasized [31].

Several possibilities exist for the overall low utilization of fructosamine. Because the majority of fructosamine tests identified were within a single health system, it is possible that HF did not receive fructosamine utilization data from all contributors, for example if they were sendout orders. Another explanation is that other tests may have been used, such as glucose screening and monitoring, in making diagnostic and treatment management decisions. This may be preferred because standardized cut-offs have not been established for fructosamine testing and must be determined and validated by each laboratory offering the test. The limitation of glucose screening is that it provides the status of glucose levels at the time of the test and not over a period of time. Additional studies are needed to review the use of glucose testing within a sickle cell populationWe noted co-ordering of A1c and fructosamine testing for sixty-three SCD patients, potentially suggesting an effort to gain greater familiarity with the fructosamine test or compliance with local guidelines. A follow up study to better understand why A1c is ordered may provide insights to changing clinician ordering behavior. Collectively this analysis shows that inappropriate A1c orders and underutilization of fructosamine test orders for SCD patients are quality gaps. From a public health perspective, this may translate to increased number of patients not receiving optimal care and requiring additional health resources. This suggests the need for a follow up study that examines the cost and burden of inappropriate A1c testing within the underserved SCD population.

Several interventions may be considered to address this quality gap. Potential interventions may include clinician education about the appropriate utilization of A1c and fructosamine testing, facilitated using professional guidance from National Institute of Diabetes and Digestive and Kidney Diseases and the Centers for Disease Control and Prevention [6, 22]. It is worth exploring the usefulness of integrating clinical decision support within EHRs to intercept A1c tests ordered for sickle cell patients and recommend more appropriate testing modalities. Other communication and education approaches (e.g., grand rounds, CME course offerings, communication campaign) targeted to reducing mis-utilization of A1c testing are also warranted.


This study has limitations. First, analyzing de-identified EHR data is challenging because there is no way to verify the accurate use of diagnostic codes (ICD-9-CM, ICD-10-CM) in HF [32, 33]. Variations exist in the coding and accuracy of both sickle cell disease overall and the specific sickle cell genotypes (e.g., HbSS, HbSC, sickle cell thalassemia) [34]. All variants were treated consistently in this analysis; the accuracy of the sickle cell genotype is unlikely to affect our analyses as any variant of sickle cell genotypes may influence the reliability of A1c analysis [35,36,37,38]. Previous assessment of the accuracy of SCD classifications based on diagnostic codes indicates that despite high sensitivity and predictive value positive, specificity might be lower when classification of SCD is based on a the ocurrence of at least one (as opposed to two or more) ICD codes for a patient [39]. We cannot rule out the possibility that some of our SCD cases were false-positive classifications but do not expect false-positives to alter our finding regarding mis-utilization of A1c testing in the sickle cell population. Additionally, as our analysis was focused on potential associations to the least and most adherent subcohort, we did not include the second and third quartile facilities (NA-1 nor NA-4) despite a significant number of patients. Another possible limitation is that some A1c tests may not be included in HF due to the absence of the Cerner laboratory module at some sites or the use of point-of-care A1c testing that does not populate the pathology database tables [40]. Also, the same concerns may apply to our observation of limited ordering of fructosamine and the absence of other alternative tests.


Analysis of data abstracted from HF provided evidence for mis-utilization of A1c and under-utilization of alternate testing in a sickle cell population across facilities. Quality improvement initiatives to improve compliance with professional guidance to promote the use of alternate tests, such as fructosamine, in a sickle cell population can support the accurate and timely the diagnosis and management of diabetes in the sickle cell population. This work serves as an important example of the value of aggregate EHR data in research that can inform care for underserved populations. The informatics strategy described can be applied to many other large scale questions related to laboratory test utilization.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.



Glycated Hemoglobin


Electronic Health Record


Health Facts


Minor non-adherent


Major non-adherent

ICD-9-CM and ICD-10-CM:

International Classification of Diseases, Ninth Revision and Tenth Revision, Clinical Modification codes


  1. 1.

    Baird G. The laboratory test utilization management toolbox. Biochem Medica. 2014;24(2):223–34.

    Article  Google Scholar 

  2. 2.

    Rubinstein M, Hirsch R, Bandyopadhyay K, Madison B, Taylor T, Ranne A, et al. Effectiveness of practices to support appropriate laboratory test utilizationa laboratory medicine best practices systematic review and meta-analysis. Am J Clin Pathol. 2018;149(3):197–221.

    Article  Google Scholar 

  3. 3.

    Rees DC, Williams TN, Gladwin MT. Sickle-cell disease. Lancet. 2010;376(9757):2018–31.

    CAS  Article  Google Scholar 

  4. 4.

    Hemoglobinopathies KE. Dtsch Ärztebl Int. 2011;108(31–32):532–40.

    Google Scholar 

  5. 5.

    Weatherall DJ, Clegg JB. Inherited haemoglobin disorders: an increasing global health problem. Bull World Health Organ. 2001;79(8):704–12.

    CAS  PubMed  PubMed Central  Google Scholar 

  6. 6.

    CDC. Data and Statistics | Sickle Cell Disease | NCBDDD | CDC. Centers for Disease Control and Prevention. 2016 [cited 2018 Feb 11].

  7. 7.

    Modell B, Darlison M. Global epidemiology of haemoglobin disorders and derived service indicators. Bull World Health Organ. 2008;86(6):480–7.

    Article  Google Scholar 

  8. 8.

    Centers for Disease Control and Prevention. National diabetes statistics report, 2017. Atlanta: Centers for Disease Control and Prevention. 2017.

  9. 9.

    Cho N, Shaw J, Karuranga S, Huang Y, da Rocha FJ, Ohlrogge A, et al. IDF Diabetes Atlas: global estimates of diabetes prevalence for 2017 and projections for 2045. Diabetes Res Clin Pract. 2018;138:271–81.

    CAS  Article  Google Scholar 

  10. 10.

    Zhou J, Han J, Nutescu EA, Galanter W, Walton SM, Gordeuk VR, et al. Type 2 diabetes mellitus in patients with sickle cell disease: a population-based longitudinal analysis of three cohorts. Blood. 2018;132:4817.

    Article  Google Scholar 

  11. 11.

    Rahbar S, Blumenfeld O, Ranney HM. Studies of an unusual hemoglobin in patients with diabetes mellitus. Biochem Biophys Res Commun. 1969;36(5):838–43.

    CAS  Article  Google Scholar 

  12. 12.

    Lenters-Westra E, Schindhelm RK, Bilo HJ, Slingerland RJ. Haemoglobin A1c: historical overview and current concepts. Diabetes Res Clin Pract. 2013;99(2):75–84.

    CAS  Article  Google Scholar 

  13. 13.

    Lippi G, Targher G. Glycated hemoglobin (HbA1c): old dogmas, a new perspective? Clin Chem Lab Med. 2010;48(5):609–14.

    CAS  PubMed  Google Scholar 

  14. 14.

    Lippi G, Targher G. A laboratory standpoint on the role of hemoglobin A1c for the diagnosis of diabetes in childhood: more doubts than certainties? Pediatr Diabetes. 2011;12(3 Pt 1):183–6.

    CAS  Article  Google Scholar 

  15. 15.

    Speeckaert M, Van Biesen W, Delanghe J, Slingerland R, Wiecek A, Heaf J, et al. Are there better alternatives than haemoglobin A1c to estimate glycaemic control in the chronic kidney disease population? Nephrol Dial Transpl Off Publ Eur Dial Transpl Assoc Eur Ren Assoc. 2014;29(12):2167–77.

    CAS  Google Scholar 

  16. 16.

    Beck R, Steffes M, Xing D, Ruedy K, Mauras N, Wilson DM, et al. The interrelationships of glycemic control measures: HbA1c, glycated albumin, fructosamine, 1,5-anhydroglucitrol, and continuous glucose monitoring. Pediatr Diabetes. 2011;12(8):690–5.

    CAS  Article  Google Scholar 

  17. 17.

    Juraschek SP, Steffes MW, Selvin E. Associations of alternative markers of glycemia with hemoglobin A(1c) and fasting glucose. Clin Chem. 2012;58(12):1648–55.

    CAS  Article  Google Scholar 

  18. 18.

    Malmström H, Walldius G, Grill V, Jungner I, Gudbjörnsdottir S, Hammar N. Fructosamine is a useful indicator of hyperglycaemia and glucose control in clinical and epidemiological studies: cross-sectional and longitudinal experience from the AMORIS cohort. PLoS ONE. 2014;9(10):e111463.

    Article  Google Scholar 

  19. 19.

    Selvin E, Rawlings AM, Grams M, Klein R, Sharrett AR, Steffes M, et al. Fructosamine and glycated albumin for risk stratification and prediction of incident diabetes and microvascular complications: a prospective cohort analysis of the Atherosclerosis Risk in Communities (ARIC) study. Lancet Diabetes Endocrinol. 2014;2(4):279–88.

    Article  Google Scholar 

  20. 20.

    Cohen RM, Holmes YR, Chenier TC, Joiner CH. Discordance between HbA1c and fructosamine: evidence for a glycosylation gap and its relation to diabetic nephropathy. Diabetes Care. 2003;26(1):163–7.

    CAS  Article  Google Scholar 

  21. 21.

    American Diabetes Association. Classification and diagnosis of diabetes: standards of medical care in diabetes—2020. Diabetes Care. 2020;43(Supplement 1):S14-31.

    Article  Google Scholar 

  22. 22.

    Sickle Cell Trait & Other Hemoglobinopathies & Diabetes (For Providers) | NIDDK [Internet]. National Institute of Diabetes and Digestive and Kidney Diseases. [cited 2018 Feb 16].

  23. 23.

    NGSP: Factors that interfere with HbA1c test results [Internet]. [cited 2017 May 24].

  24. 24.

    Boonstra A, Versluis A, Vos JFJ. Implementing electronic health records in hospitals: a systematic literature review. BMC Health Serv Res. 2014;14(1):370.

    Article  Google Scholar 

  25. 25.

    Hoerbst A, Ammenwerth E. Electronic health records. Methods Inf Med. 2010;49(04):320–36.

    CAS  Article  Google Scholar 

  26. 26.

    DeShazo JP, Hoffman MA. A comparison of a multistate inpatient EHR database to the HCUP Nationwide Inpatient Sample. BMC Health Serv Res. 2015;15:384.

    Article  Google Scholar 

  27. 27.

    Kirby JC, Speltz P, Rasmussen LV, Basford M, Gottesman O, Peissig PL, et al. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. J Am Med Inform Assoc JAMIA. 2016;23(6):1046–52.

    Article  Google Scholar 

  28. 28.

    Michalik DE, Taylor BW, Panepinto JA. Identification and validation of a sickle cell disease cohort within electronic health records. Acad Pediatr. 2017;17(3):283–7.

    Article  Google Scholar 

  29. 29.

    APPROVED: Revisions to advanced certification requirements for inpatient diabetes care [Internet]. Joint Commission. [cited 2019 Jan 21].

  30. 30.

    Diabetes: Hemoglobin A1c (HbA1c) Poor Control (> 9%) | eCQI Resource Center [Internet]. [cited 2021 Jun 14].

  31. 31.

    American Diabetes Association. 6. Glycemic targets: standards of medical care in diabetes—2021. Diabetes Care. 2021;44(Supplement 1):S73–84.

  32. 32.

    Quan H, Li B, Saunders LD, Parsons GA, Nilsson CI, Alibhai A, et al. Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Serv Res. 2008;43(4):1424–41.

    Article  Google Scholar 

  33. 33.

    O’Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res. 2005;40(52):1620–39.

    Article  Google Scholar 

  34. 34.

    Snyder AB, Lane PA, Zhou M, Paulukonis ST, Hulihan MM. The accuracy of hospital ICD-9-CM codes for determining Sickle Cell Disease genotype. J Rare Dis Res Treat. 2017;2(4):39–45.

    Article  Google Scholar 

  35. 35.

    Milner PF, Charache S. Life span of carbamylated red cells in sickle cell anemia. J Clin Invest. 1973;52(12):3161–71.

    CAS  Article  Google Scholar 

  36. 36.

    Bry L, Chen PC, Sacks DB. Effects of hemoglobin variants and chemically modified derivatives on assays for glycohemoglobin. Clin Chem. 2001;47(2):153–63.

    CAS  Article  Google Scholar 

  37. 37.

    Prindle KH, McCurdy PR. Red cell lifespan in hemoglobin C disorders (with special reference to hemoglobin C trait). Blood. 1970;36(1):14–9.

    Article  Google Scholar 

  38. 38.

    Bunyaratvej A, Sahaphong S, Bhamarapravati N, Wasi P. Quantitative changes of red blood cell shapes in relation to clinical features in β-thalassemia/HbE disease. Am J Clin Pathol. 1985;83(5):555–9.

    CAS  Article  Google Scholar 

  39. 39.

    Snyder AB, Zhou M, Theodore R, Quarmyne M-O, Eckman J, Lane PA. Improving an administrative case definition for longitudinal surveillance of sickle cell disease. Public Health Rep. 2019;134(3):274–81.

    Article  Google Scholar 

  40. 40.

    Glynn EF, Hoffman MA. Heterogeneity introduced by EHR system implementation in a de-identified data resource from 100 non-affiliated organizations. JAMIA Open. 2019;2(4):554–61.

    Article  Google Scholar 

Download references


We wish to acknowledge the contributions of Suman Sahil for early involvement in this project, Dr. Mary M. Hulihan, Division of Blood Disorders, and Dr. Pamela Allweiss, Division of Diabetes Translation, both from the Centers for Disease Control and Prevention as well as Robyn Johnson from Truman Medical Center, Shaun Ferguson and Jeremy Provance from University of Missouri-Kansas City for providing input during the formative stages of this project. Natalie Kane provided helpful editorial comments.


The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the CDC or the US Agency for Toxic Substances and Disease Registry. Use of trade names is for identification only and does not imply endorsement by the Public Health Service or by the Centers for Disease Control and Prevention.


This work was funded by CDC Cooperative Agreement NU47OE000105-01-01.

Author information




SS and AC analyzed the data regarding A1c orders for SCD patients. SS, MH and IL interpreted the data and were major contributors in writing the manuscript. KL has substantially revised the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Mark A. Hoffman.

Ethics declarations

Ethics approval and consent to participate

Not applicable as all data were de-identified in compliance with the Health Insurance Portability and Accountability Act (HIPAA).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sivasankar, S., Cheng, AL., Lubin, I.M. et al. Use of large scale EHR data to evaluate A1c utilization among sickle cell disease patients. BMC Med Inform Decis Mak 21, 268 (2021).

Download citation


  • Electronic health records
  • A1c
  • Sickle cell disease
  • Fructosamine