Preventing overuse of laboratory diagnostics: a case study into diagnosing anaemia in Dutch general practice
BMC Medical Informatics and Decision Making volume 20, Article number: 178 (2020)
More information is often thought to improve medical decision-making, which may lead to test overuse. This study assesses which out of 15 laboratory tests contribute to diagnosing the underlying cause of anaemia by general practitioners (GPs) and determines a potentially more efficient subset of tests for setting the correct diagnosis.
Logistic regression was performed to determine the impact of individual tests on the (correct) diagnosis. The statistically optimal test subset for diagnosing a (correct) underlying cause of anaemia by GPs was determined using data from a previous survey including cases of real-world anaemia patients.
Only 9 (60%) of the laboratory tests, and patient age, contributed significantly to the GPs’ ability to diagnose an underlying cause of anaemia (CRP, ESR, ferritin, folic acid, haemoglobin, leukocytes, eGFR/MDRD, reticulocytes and serum iron). Diagnosing the correct underlying cause may require just five (33%) tests (CRP, ferritin, folic acid, MCV and transferrin), and patient age.
In diagnosing the underlying cause of anaemia a subset of five tests has most added value. The real-world impact of using only this subset should be further investigated. As illustrated in this case study, a statistical approach to assessing the added value of tests may reduce test overuse.
In the last decades there has been a strong rise in the number of relatively cheap laboratory tests that are available as well as in the number of tests requested by physicians [1, 2]. These developments provide challenges to physicians with regard to determining which tests to order and how to interpret their combined results [3,4,5]. This issue is particularly relevant for general practitioners (GPs) as they order a large variety of laboratory tests during ~ 30% of all patient encounters [3, 4]. Although these challenges are partly unavoidable owing to the large variability of symptoms encountered within general practices , GPs may benefit from improved guidance as to which tests to order in which patients.
Besides the benefits of laboratory testing in terms of setting a diagnosis and deciding upon the best treatment strategy, these tests may offer wider benefits to patients, for example in terms of reducing diagnostic uncertainty or offering reassurance [6,7,8]. However, laboratory testing is (inevitably) also associated with patient discomfort, and a plethora of test results may divert the physician’s attention away from the clinically relevant information . In addition, it may lead to overdiagnosis, which may result in unnecessary, potentially harmful or costly downstream activities [10,11,12,13,14]. Indeed, previous studies suggest that, depending on the definition used, 30–70% of all laboratory tests may be considered potentially inappropriate [6, 15, 16]. In this study, ‘overutilization’ of tests is defined as performing tests that do not affect medical decision-making [16, 17].
To investigate the added diagnostic value of tests for decision-making, a case study of patients presenting with anaemia in general practice is used. Anaemia is a frequently encountered condition in general practice and is characterized by a low blood haemoglobin level. Its incidence increases with age, and it is associated with increased morbidity and mortality [18,19,20,21,22,23,24,25]. However, as anaemia is not considered a disease in itself but rather a sign of a range of underlying conditions, the underlying cause is often under-diagnosed [26, 27]. Besides an anamnesis and physical examination, (a range of) laboratory tests are essential in the diagnostic work-up [28, 29]. The Dutch College of General Practitioners (DCGP)-guideline provides a flowchart supporting GPs in deciding which tests to order based on patient’s symptoms, their medical history, and the clinical suspicion . The tests included in this flowchart include C-reactive protein (CRP), creatinine, erythrocyte sedimentation rate (ESR), ferritin, folic acid, haemoglobin, lactate dehydrogenase, leukocytes, mean corpuscular volume (MCV), reticulocytes, serum iron, thrombocytes, transferrin and vitamin B12. Besides these 14 tests, the patient’s renal function (i.e. the eGFR [or MDRD]) is calculated, serving as 15th test result.
Despite following the DCGP-guideline, the underlying cause of anaemia remains unknown in 52% of patients . Previous research indicated that immediately ordering all 15 tests in anaemia patients improves GPs’ ability to correctly diagnose the underlying cause and is cost-effective compared to letting GPs decide themselves which tests to order [31, 32]. It is however unknown whether all 15 tests individually contribute to the GP’s ability to (correctly) diagnose the underlying cause of anaemia. Therefore, the current study investigates to what extent each individual test (within the full set of 15 tests) adds value to this diagnostic process. In addition, the optimal subset of relevant tests will be determined from a statistical perspective.
The data used for this analysis were obtained from a previously conducted questionnaire, in which GPs were asked to determine the underlying cause in cases of real-world anaemia patients. In this section, an explanation of the questionnaire and the database used in this questionnaire will be provided. A more extensive description was published previously .
The cases used in this questionnaire were obtained from a prospective database including patients aged ≥50 years presenting with newly diagnosed anaemia in general practice (n = 2389). This database excluded patients with multiple underlying causes (n = 293) and contained information about patients’ age, gender, and the results of all abovementioned 15 tests. From this database, 201 cases were randomly selected to be used in the questionnaire. In this random selection, the actual prevalence of each of the underlying causes of anaemia was maintained . The characteristics of the 201 cases used in this questionnaire are presented in Table 1. In the questionnaire, GPs (n = 139) were presented with cases of anaemia patients. For each GP, six cases of anaemia patients were randomly drawn from the set of 201 cases. For each of these six cases, the GP was asked to establish the underlying cause based on the patient’s age, gender, and test results. In three out of these six cases, GPs were immediately provided with all 15 test results. In the other three cases, GPs were asked to decide for themselves which tests to perform. These questions were however excluded from the current analysis as this analysis only focused on the three cases in which the GP received the full set of 15 test results. The underlying causes to choose from were anaemia of chronic disease (ACD), iron deficiency anaemia (IDA) and renal anaemia (RA). In addition, GPs could choose the option ‘other’ in which they were asked to specify the expected underlying cause of anaemia, or they could indicate that they could not establish the underlying cause based on the information provided (classified as ‘unknown’). For each case, the correctness of this underlying cause was determined by comparing it with its (presumably) correct diagnosis as established by an expert panel, consisting of a GP, an internist and a clinical chemist .
Altogether, the questionnaire resulted in 378 anaemia cases in whom an underlying cause was diagnosed by a GP based on the full set of 15 test results. An overview of the entire process of case selection and presenting these to the GPs is shown in Fig. 1.
The data obtained from the 378 cases, including the results of the 15 test for each case, the underlying cause of anaemia as indicated by the GP, as well as the correct underlying cause according to the expert panel, were used as input for the current analysis. Data were analyzed using R (version 3.5.0) . The package mice (version 3.30) was used for single regression imputation of missing data for the ESR test (n = 20) .
As it was considered unlikely that other, less common, causes of anaemia can be diagnosed in general practice (based on the limited information provided) , this study specifically focused on correctly diagnosing IDA, ACD and RA. Therefore, the diagnoses ‘other’ and ‘unknown’ were considered as one category. For CRP and vitamin B12, the non-numerical values “smaller than 5 mg/L” (n = 109) and “smaller than 111 pmol/L” (n = 2) were replaced by the numerical values 4 mg/L and 110 pmol/L, respectively.
For patients with anaemia, the majority of the 15 tests analyzed in this study have one single cut-off value to indicate abnormal test results, for example a haemoglobin level < 8.5 mmol/L (i.e. < 13.7 g/dL) in male patients. These test results were therefore handled as binary variables (i.e. normal/abnormal). However, five tests (i.e. ferritin, leukocytes, MCV, thrombocytes and transferrin) can have a too low as well as a too high test result. As too low and too high values are often indicative of different underlying causes of anaemia, the numerical values of these five tests were converted to categorical results. A detailed overview of the cut-off values used (based on the DCGP-guideline ) is provided in Table S1 of Additional file 1.
The value of individual tests for (correctly) diagnosing an underlying cause of anaemia
The impact on the GPs’ ability to diagnose an underlying cause of anaemia was investigated in two ways: 1) for diagnosing an underlying cause of anaemia (regardless whether this diagnosis was correct), 2) for diagnosing the correct underlying cause of anaemia. For investigating the impact of an individual test result on GPs’ ability to diagnose an underlying cause, the impact of each of the 15 tests (within this complete set of tests) was assessed separately by fitting a multinomial logistic regression model (MLR) with a logistic link function, using the mlogit-package and nnet-package [35, 36]. In addition to the 15 test results, the patients’ age and gender were also considered as predictors in the fitting process. The MLR shows the impact of a one unit change in the predictor (for example a change in ESR from 35 to 36 mm/h) on the log odds of the GP diagnosing a specific cause of anaemia rather than diagnosing ‘unknown’. The goal of this analysis was to assess whether specific test outcomes may substantially affect the likelihood of diagnosing one specific underlying cause of anaemia, while not affecting the diagnosis of any of the other underlying causes. In other words, it is determined whether the GPs incorporate this test in their decision to diagnose a specific underlying cause of anaemia.
Subsequently, the added value of each test (within the complete set of tests) on the GP’s ability to diagnose the correct underlying cause was assessed by fitting a binomial logistic regression model (BLR). In contrast to the MLR, the BLR shows the impact of a one unit change in test result on the log odds of the GP diagnosing the correct rather than an incorrect underlying cause (for details see Additional file 1).
The combined value of tests for (correctly) diagnosing an underlying cause of anaemia
In current practice, many of the 15 tests are ordered simultaneously . However, an overlap may exist between the information they provide and hence their impact on the GP’s ability to (correctly) diagnose the underlying cause. Consequently, a subset of tests may actually suffice. Yet, this overlap cannot be captured using a single MLR or BLR model, because the added value of a test may depend on the availability of other test results. Therefore, this overlap was determined, and (largely) removed, by identifying the statistically most efficient test subset (i.e. best subset) using stepwise backward selection . This analysis was performed twice: with and without considering the correctness of the diagnosed underlying cause. The Akaike Information Criterion (AIC) was used as performance indicator to balance model complexity (i.e. number of predictors) and goodness-of-fit of the model . In this process, the initial set of 17 predictors (i.e. age, gender and 15 test results) was iteratively reduced by removing the predictor with the lowest impact on the ability of the GP to (correctly) diagnose the underlying cause of anaemia. During each iteration, the AIC was determined, with the subset model with the lowest AIC being the most favorable. This process was repeated until the AIC could not be decreased further (Fig. 2), indicating that reducing model complexity by removing one more predictor resulted in substantially worse performance.
Finally, several assumptions underlying the logistic regression model were tested, including testing for multicollinearity, perfect separation of predictors, and a Hausman-McFadden test (for details see Additional file 1).
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
As mentioned previously, the questionnaire resulted in 378 anaemia cases that were included in the current analysis. Of these cases, 117 (31.0%) were diagnosed as ACD, 76 (20.1%) as IDA, 50 (13.2%) as RA, 22 (5.8%) as ‘other’ and 113 (29.9%) as ‘unknown’. Comparing these diagnoses with the diagnoses by the expert panel indicated that 234 (61.9%) were correct, including 47 (61.8%) of the IDA diagnoses, 73 (62.4%) of the ACD diagnoses, 29 (58.0%) of the RA diagnoses, 17 (77.3%) of the ‘other underlying causes’ and 68 (60.2%) of the ‘unknown’.
These 378 cases were based on 201 cases of anaemia patients, indicating that some cases were answered multiple times (by different GPs). Of these 201 patients, 94 (47%) were male, 107 (53%) were female, and the mean age was 74.7 years (range: 50–102 years).
The value of individual tests for (correctly) diagnosing an underlying cause of anaemia
When considering the impact of individual test results within the complete set of tests, the MLR indicates that CRP, ESR, ferritin, folic acid, leukocytes, eGFR, reticulocytes and serum iron significantly impact the ability of the GP to diagnose an underlying cause of anaemia (instead of ‘unknown’), regardless whether this diagnosis is correct, as shown in Table 2. Each row in Table 2 indicates the effect of a change in the test result on the probability that the GP diagnoses a specific underlying cause, rather than diagnosing an ‘unknown’ cause. For the tests with numerical results (i.e. ESR, eGFR, folic acid, reticulocytes and serum iron), this ‘change’ implies a one unit shift in the test result, for example a shift in ESR from 36 to 35 mm/h. For the categorized test results, the table mentions the specific shift in the result category (i.e. from normal to abnormal for leukocytes, and a shift from low normal to either low, high normal, or to high, for ferritin). The results of the other seven tests (i.e. creatinine, CRP, haemoglobin, LDH, MCV, thrombocytes, transferrin and vitamin B12) do not significantly contribute to the ability of the GP to diagnose an underlying cause. In other words, the extent to which the GP considers this test result in diagnosing an underlying cause of anaemia is insufficient to have a statistically significant impact. As this analysis involves many different comparisons, only the significant outcomes are shown in this table.
Table 3 shows the results of the BLR, indicating the impact of a change in the result of the individual tests, within the complete set of tests, on the ability of the GP to diagnose the correct underlying cause of anaemia. Results indicate a statistically significant impact for a shift from a normal to a high MCV, as well as a shift from a low normal to a high normal ferritin level, and from a low normal to low ferritin level. For the other tests with categorical results (i.e. leukocytes, thrombocytes, and transferrin), as well as all tests with numerical results (i.e. creatinine, CRP, eGFR, ESR, folic acid, haemoglobin, LDH, serum iron and vitamin B12) no significant impact of a one unit change in a single test result on the ability of the GP to correctly diagnose the underlying cause of anaemia was found.
The combined value of tests for (correctly) diagnosing an underlying cause of anaemia
When considering the value of a combination of test results, the most efficient test subset for diagnosing an underlying cause as well as for diagnosing the correct underlying cause are shown (Table 4). For diagnosing an underlying cause, seven predictors were eliminated from the initial set of 17 predictors (i.e. age, gender and the 15 test results). The 10 remaining predictors include the patient characteristic ‘age’, and the tests CRP, ESR, ferritin, folic acid, haemoglobin, leukocytes, eGFR, reticulocytes and serum iron. For diagnosing the correct underlying cause, 11 predictors were eliminated. The six remaining predictors include the patient characteristic ‘age’ and the tests CRP, ferritin, folic acid, MCV and transferrin. For details see Tables S2 and S3 of Additional file 1.
All variance inflation factors determined were < 5 (Table S4 of Additional file 1), all maximum likelihood estimators converged, and the independence of irrelevant alternatives assumption was not rejected.
Of the 15 tests evaluated, only a subset impacts the GP’s ability to (correctly) diagnose an underlying cause of anaemia, from a statistical perspective. The statistically most efficient subset of predictors for diagnosing the correct underlying cause contains, besides a patient’s age, five tests: ferritin, CRP, MCV, transferrin and folic acid.
However, when considering predictors for diagnosing an underlying cause of anaemia, the statistically most efficient subset contains, besides a patient’s age, nine tests (i.e. CRP, ESR, ferritin, folic acid, haemoglobin, leukocytes, eGFR, reticulocytes and serum iron). For some of these tests, a strong relation may exist between the test outcome and the probability that the GP diagnoses a specific underlying cause, regardless of whether this underlying cause is correct. In other words, when tests contribute to diagnosing an underlying cause by the GP (as shown in Table 2), it implies that these tests are taken into account by the GP in their decision making process. However, this does not imply that the test also has a (statistically significant) impact on diagnosing the correct underlying cause (as shown in Table 3). For example, a high ESR is often, but not always, caused by ACD . Therefore, an elevated ESR test result might lead (too often) to this particular diagnosis, also if it is incorrect.
As shown in Table 4, the most efficient subset for diagnosing an underlying cause of anaemia includes the haemoglobin test, whereas the most efficient subset for diagnosing a correct underlying cause does not. This may be explained by the fact that a low haemoglobin level is a prerequisite for diagnosing anaemia without providing evidence on the underlying cause.
When considering the results of the BLR for individual tests, it is observed that only two of the statistically significant tests (i.e. ferritin and MCV) were found to also be part of the statistically most efficient subset, that is combination of tests, for diagnosing the correct underlying cause of anaemia. The other three tests in this subset (i.e. CRP, transferrin and folic acid) were not statistically significant when considered individually. This is most likely explained by the fact that these tests, in combination, are highly important for the GP to diagnose the correct underlying cause.
Besides the cases in whom the GPs and/or the expert panel were able to (correctly) diagnose an underlying cause of anaemia, an underlying cause could not be established in 113 out of 378 (i.e. 29.9%) of the cases by the GPs, and 63 out of 201 cases (i.e. 31.3%) by the expert panel, which is in line with literature [21, 39,40,41]. Further details on the suggested clinical management by the GPs (including medication prescriptions, referral to secondary care, etc.) was published previously .
As the analyses in this study are based on real-life patient data (in which the incidence of the underlying causes of anaemia mimics current practice) and because a representative sample of GPs responded to the survey [31, 32], the results likely provide a good representation of current practice. In addition, the incorporation of a patient’s age and gender as predictors further increases the reliability of the results, as these characteristics should be considered in a patient’s diagnostic work-up .
This study has certain limitations. First, although the GPs were provided with the patients’ age and gender, they should ideally also have been able to incorporate information about a patient’s anamnesis, medical history, physical examination, or the results of other diagnostic tests, in their diagnostic process . For example, aspects like a history of renal failure may be highly important for diagnosing RA. However, as such aspects are (partly) dependent on the GP’s perception and experience, these cannot be comprehensively captured in a database. As both the GPs and the expert panel established the underlying cause of anaemia based on the (limited) information presented in the questionnaire and by using the available guidelines , this lack of information was similar in both groups. As a consequence, the underlying causes diagnosed in the questionnaire may not fully resemble the diagnosis that would have been established in clinical practice, but this effect is likely similar for GPs and the expert panel. It is therefore expected that this limitation did not affect the added value of the 15 tests as reported in this study. In addition, as the expert panel (i.e. a GP, an internist and a clinical chemist) established the underlying cause based on their broad expertise across these three disciplines, and because they used the current clinical guidelines, it was assumed that this diagnosis was correct or at least the best diagnosis that could be established based on the information provided.
Second, the analysis only considers the impact of laboratory tests on the ability of GPs to (correctly) diagnose the underlying cause of anaemia, and does not account for other aspects of the value of testing (e.g. in terms of patient reassurance). Third, the impact of individual tests on setting a diagnosis or a correct diagnosis is expressed in terms of a one unit change in the result of a single test. The expected variability in test results should therefore be considered in relation to its unit of measurement. For example, the reticulocyte test result usually varies between 1 and 2% , indicating that a one unit (i.e. 1%) change leads to a very high regression coefficient compared to a one unit (i.e. 1 mm/h) change in ESR. The difference in the impact of these changes in clinical practice is however likely less pronounced. In addition, in the current analysis, all numerical test results were classified as either normal or abnormal. Consequently, the analysis could not account for the potential impact of test results that deviate strongly from their reference value, compared with test results that only show a minor deviation, on the (correctness) of the diagnosed underlying cause. Finally, tests were evaluated and selected based on their overall contribution to the GP’s ability to correctly diagnose the underlying cause of anaemia. Consequently, tests that may only be valuable for diagnosing a specific (less common) cause may not be identified as such in the current analysis, where added value is essentially assessed across all patients and all underlying causes. This may (for example) explain why an abnormal creatinine test result was not significantly associated with (correctly) diagnosing RA, as only 26 out of 201 cases (12.9%) involved RA patients.
Implications for practice
Annually, in the Netherlands, 57,000 patients are newly diagnosed with anaemia in general practice . Compared to immediately ordering the full set of 15 tests, test overuse may be reduced with 67% while the percentage of correct diagnoses is expected to be (almost) unaffected. In practice in the Netherlands, GPs may (initially) order any number of tests, and on average they order seven tests . Conversely, ordering just the five tests of the statistically most efficient subset, and ordering additional tests only when no clear underlying cause can be found based on this, could save up to two tests per patient (i.e. -29%) , while the percentage of patients with a correct diagnosis is expected to increase. Although cost savings in terms of preventing (unnecessary) laboratory tests are relatively small, the most efficient test subset may prevent unnecessary downstream diagnostic activities, thereby preventing unnecessary patient burden and reducing healthcare costs. However, decisions regarding which tests to perform in (suspected) anaemia patients are increasingly supported by clinical chemistry laboratories . As the protocols for this ‘reflex-testing’ differ between hospitals, the results of this study are likely also valuable for laboratories to establish a standardized, optimal subset of laboratory tests for reflex-testing. As the work-up of establishing the underlying cause in newly diagnosed anaemia patients differs (slightly) between countries, this may limit the generalizability of the results presented here. The concept of overuse of laboratory tests is, however, not limited to the Netherlands and also not limited to anaemia patients. This study can therefore be considered an example of how statistical analyses can contribute to defining a potentially more efficient subset of laboratory tests and thereby to prevent test overuse. It is therefore recommended to perform similar studies in other countries, disease areas or medical conditions, in order to safely decrease the number of tests performed.
Although current clinical guidelines recommend the use of an extensive set of laboratory tests to diagnose the underlying cause of anaemia, a subset of five tests has most added value from a statistical perspective. This subsets still provides a similar ability to the GP to (correctly) diagnose an underlying cause of anaemia. Consequently, a statistical approach to assessing the added value of tests may reduce test overuse. Whether such a subset of tests is acceptable and cost-effective in daily practice should be further investigated.
Availability of data and materials
The data that support the findings of this study are available from the corresponding author, upon reasonable request.
anaemia of chronic disease
binomial logistic regression
Dutch college of general practitioners
estimated glomerular filtration rate
erythrocyte sedimentation rate
iron deficiency anaemia
mean corpuscular volume
modification of diet in renal disease
multinomial logistic regression
O'Sullivan JW, Stevens S, Hobbs FDR, Salisbury C, Little P, Goldacre B, et al. Temporal trends in use of tests in UK primary care, 2000-15: retrospective analysis of 250 million tests. BMJ. 2018;363:k4666.
Jackson BR. Managing laboratory test use: principles and tools. Clin Lab Med. 2007;27(4):733–48 v.
Hickner J, Thompson PJ, Wilkinson T, Epner P, Sheehan M, Pollock AM, et al. Primary care physicians' challenges in ordering clinical laboratory tests and interpreting results. J Am Board of Family Med. 2014;27(2):268–74.
Cadogan SL, Browne JP, Bradley CP, Cahill MR. The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review. Implementation Sci. 2015;10:167.
Laposata M. Putting the patient first--using the expertise of laboratory professionals to produce rapid and accurate diagnoses. Lab Med. 2014;45(1):4–5.
van der Weijden T, van Bokhoven MA, Dinant GJ, van Hasselt CM, Grol RP. Understanding laboratory testing in diagnostic uncertainty: a qualitative study in general practice. Brit J General Practice. 2002;52(485):974–80.
Guthrie B. Why do general practitioners take blood? A cross-sectional study of use of blood tests in UK general practice. Eur J General Practice. 2009;7(4):138–60.
Bossuyt PM, Reitsma JB, Linnet K, Moons KG. Beyond diagnostic accuracy: the clinical utility of diagnostic tests. Clin Chem. 2012;58(12):1636–43.
Elnenaei MO, Campbell SG, Thoni AJ, Lou A, Crocker BD, Nassar BA. An effective utilization management strategy by dual approach of influencing physician ordering and gate keeping. Clin Biochem. 2016;49(3):208–12.
Hall SF, Webber C, Groome PA, Booth CM, Nguyen P, DeWit Y. Do doctors who order more routine medical tests diagnose more cancers? A population-based study from Ontario Canada. Cancer Med. 2019;8(2):850–9.
Sohlberg EM, Metzner TJ, Leppert JT. The harms of Overdiagnosis and overtreatment in patients with small renal masses: a mini-review. Eur Urol Focus. 2019;5(6):943–5.
Webber BJ, Burganowski RP, Colton L, Escobar JD, Pathak SR, Gambino-Shirley KJ. Lyme disease overdiagnosis in a large healthcare system: a population-based, retrospective study. Clin Microbiol Infection. 2019;25(10):1233–8.
Salerno S, Laghi A, Cantone MC, Sartori P, Pinto A, Frija G. Overdiagnosis and overimaging: an ethical issue for radiological protection. Radiol Med. 2019:124(8):714–20.
Vickers AJ. Redesigning prostate Cancer screening strategies to reduce Overdiagnosis. Clin Chem. 2019;65(1):39–41.
Zhi M, Ding EL, Theisen-Toupal J, Whelan J, Arnaout R. The landscape of inappropriate laboratory testing: a 15-year meta-analysis. PLoS One. 2013;8(11):e78962.
Cadamuro J, Gaksch M, Wiedemann H, Lippi G, von Meyer A, Pertersmann A, et al. Are laboratory tests always needed? Frequency and causes of laboratory overuse in a hospital setting. Clin Biochem. 2018;54:85–91.
Moons KG, de Groot JA, Linnet K, Reitsma JB, Bossuyt PM. Quantifying the added value of a diagnostic test or marker. Clin Chem. 2012;58(10):1408–17.
Riva E, Tettamanti M, Mosconi P, Apolone G, Gandini F, Nobili A, et al. Association of mild anemia with hospitalization and mortality in the elderly: the health and Anemia population-based study. Haematologica. 2009;94(1):22–8.
Lucca U, Tettamanti M, Mosconi P, Apolone G, Gandini F, Nobili A, et al. Association of mild anemia with cognitive, functional, mood and quality of life outcomes in the elderly: the "health and Anemia" study. PLoS One. 2008;3(4):e1920.
Smith RE Jr. The clinical and economic burden of anemia. Am J Managed Care. 2010;16(Suppl Issues):S59–66.
Shavelle RM, MacKenzie R, Paculdo DR. Anemia and mortality in older persons: does the type of anemia affect survival? Int J Hematol. 2012;95(3):248–56.
Zakai NA, Katz R, Hirsch C, Shlipak MG, Chaves PH, Newman AB, et al. A prospective study of anemia status, hemoglobin concentration, and mortality in an elderly cohort: the cardiovascular health study. Arch Intern Med. 2005;165(19):2214–20.
Steensma DP, Tefferi A. Anemia in the elderly: how should we define it, when does it matter, and what can be done? Mayo Clin Proc. 2007;82(8):958–66.
Culleton BF, Manns BJ, Zhang J, Tonelli M, Klarenbach S, Hemmelgarn BR. Impact of anemia on hospitalization and mortality in older adults. Blood. 2006;107(10):3841–6.
Penninx BW, Pahor M, Woodman RC, Guralnik JM. Anemia in old age is associated with increased mortality and hospitalization. J Gerontol A Biol Sci Med Sci. 2006;61(5):474–9.
Thomas DR. Anemia and quality of life: unrecognized and undertreated. J Gerontol A Biol Sci Med Sci. 2004;59(3):238–41.
Nissenson AR, Goodnough LT, Dubois RW. Anemia: not just an innocent bystander? Arch Intern Med. 2003;163(12):1400–4.
Van Wijk MAM, Mel M, Muller PA, et al. Nederlands Huisartsen Genootschap – Standaard Anemie (Revisie). Huisarts Wet. 2014;57(10):528–36.
Smith A. Guide to evaluation and treatment of anaemia in general practice. Drug Review Anaemia. 2012:25–42.
Oosterhuis WP, Van der Horst M, van Dongen K, Ulenkate HJLM, Volmer M, Wulkan RW. Prospective comparison of the flow chart for laboratory investigations for anaemia from the Dutch College of General Practitioners' guideline 'Anaemia' with a self-developed, substantive and logistical alternative flow chart'. Ned Tijdschr Geneeskd. 2007;151:2326–32.
Schop A, Kip MM, Stouten K, Dekker S, Riedl J, van Houten RJ, et al. The effectiveness of a routine versus an extensive laboratory analysis in the diagnosis of anaemia in general practice. Ann Clin Biochem. 2018;55(5):535–42.
Kip MM, Schop A, Stouten K, Dekker S, Dinant GJ, Koffijberg H, et al. Assessing the cost-effectiveness of a routine versus an extensive laboratory work-up in the diagnosis of anaemia in Dutch general practice. Ann Clin Biochem. 2018;55(6):630–8.
R Core Team. R: a languange and environment for statistical computing. Vienna: R Foundation for statistical Computing; 2019.
van Buuren S, Groothuis-Oudshoorn K. Mice: multivariate imputation by chained equations in R. J Stat Softw. 2011;45(3):1–67.
Croissant Y. mlogit: Multinomial Logit Models. R package version 1.1–0. https://CRAN.R-project.org/package=mlogit. 2020.
Venables WNR, B. D. Modern Applied Statistics with S. Fourth Edition. Springer, New York. ISBN 0–387–95457-0. 2002.
James G. An introduction to statistical learning: with applications in R; 2014.
Chaurasia A, Harel O. Using AIC in multiple linear regression framework with multiply imputed data. Health Serv Outcome Res Methodol. 2012;12(2–3):219–33.
Eisele L, Durig J, Broecker-Preuss M, Duhrsen U, Bokhof B, Erbel R, et al. Prevalence and incidence of anemia in the German Heinz Nixdorf recall study. Ann Hematol. 2013;92(6):731–7.
Patel KV. Epidemiology of anemia in older adults. Semin Hematol. 2008;45(4):210–7.
Ferrucci L, Semba RD, Guralnik JM, Ershler WB, Bandinelli S, Patel KV, et al. Proinflammatory state, hepcidin, and anemia in older persons. Blood. 2010;115(18):3810–6.
Stehouwer CDA. Interne Geneeskunde. 2010:248.
Verboeket - van de Venne WPHG, Oosterhuis WP, Kleinveld HA, Leers MPG. Anemieprotocollen voor de eerste lijn in Nederland. 63e Congres van de Nederlandse Vereniging voor Klinische Chemie en Laboratoriumgeneeskunde; Veldhoven: Ned Tijdschr Klin Chem Labgeneesk; 2010. p. 91–133.
This study was not funded.
Ethics approval and consent to participate
The database used in the analysis was approved by the internal ethics committee of the Albert Schweitzer Hospital. Approval for re-using the data from a previous study for the purpose of the current analysis was granted by the ethics committee of the faculty Behavioural, Management and Social Sciences of the University of Twente (approval number 18128).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This file contains the reference values of the 15 laboratory tests, extensive descriptions of the multinomial and the binomial logistic regression model, the assumptions that have been tested, as well as the detailed results of the multinomial logistic regression model, of the best subset selection and of the variance inflation factor.
About this article
Cite this article
Kip, M.M.A., Oonk, M.L.J., Levin, MD. et al. Preventing overuse of laboratory diagnostics: a case study into diagnosing anaemia in Dutch general practice. BMC Med Inform Decis Mak 20, 178 (2020). https://doi.org/10.1186/s12911-020-01198-8
- Data analysis, statistical
- Diagnoses and laboratory examinations
- General practice
- Optimal testing