Practice guidelines and clinical risk assessment models: is it time to reform?
BMC Medical Informatics and Decision Making volume 11, Article number: 63 (2011)
Clinical practice guidelines and Risk Assessment Models (RAMs) are some useful tools to bring medical evidences into our daily clinical practice. Despite the improvement over the time, they still have some shortcomings.
One of these shortcomings is the arbitrary cutoffs used in these tools to facilitate the decision making process. This problem is to some extent due to the "Black or White" approach of modern medicine in making the decisions, whilst in the real world and our daily practice we used mostly an uncertain approach, which is called recently as "Fuzzy" thinking approach.
The authors of this article believe that the fuzzy type of thinking may resolve the above mentioned shortcomings of clinical practice guideline or risk assessment models and they tried to discuss about this using an example about Venous Thromboembolism related guidelines and RAMs.
Clinical practice guidelines are useful decision support tools in the process of carrying medical evidences to the point of practice . An example for an important health system problem which experiences a gap between medical evidences and clinical practice is venous thromboembolism (VTE) .
Several practice guidelines have developed and focused on this topic, among which the most important one is the evidence-based VTE prevention practice guideline generated and updated by the American College of Chest Physicians (ACCP) . This guideline proposes clinical decision making regarding identification and screening of thromboprophylaxis according to the presence of risk factors in various patient groups. This method of risk evaluation, underestimates the risk of venous thromboembolism in some cases . However this guideline in a section mentioned the individual patient risk assessment and advocates for the use of clinical judgment in some specific circumstances .
Despite development of various Practice guidelines for prevention of Venous Thromboembolism (VTE), it remains underused in most countries [5, 6]. Improving clinician's compliance with the guidelines is a complex task and partly rest on improving thrombotic risk-assessment methods . There are several risk assessment tools for VTE prevention, from which the three most notable models were developed by Caprini, Cohen, and Kucher [4, 8, 9]. These models considered the individualized approach to the VTE risk determination in each patient . These risk assessment models (RAM) consist of a list of exposing risk factors (presenting illness or procedure) and predisposing risk factors (genetic and clinical characteristics), each with an assigned relative risk score [4, 10]. As stated in the 8th annual conference of ACCP and the earlier editions of the ACCP guideline, the VTE risk factors are generally cumulative [3, 11]. In another words, scores for each risk factor are summed to produce a cumulative score, and is used to classify a patient into one of the four risk categories and determine the onset, intensity, type, and duration of recommended prophylaxis .
The 8th ACCP conference on VTE prevention, allocated a section to the aforementioned risk assessment models  criticizing these models for being cumbersome, and not validated adequately. On the other hand several studies in the past few years have validated the Caprini risk assessment model and linked the score to the eventual development of clinically relevant VTE events up to 60 days post discharge [13–15]. While the original model put people in 4 groups, the validation studies have shown that for each increase in score, the incidence of VTE rises . At the same time, the important role of these models in developing a computerized decision making support systems for clinicians was discussed. Clinical informatics and electronic health records have the potential to ease application of risk assessment model .
Another major critique pointed out by the later edition of ACCP guideline regarding the risk assessment models, is the arbitrary cutoffs for age and duration of surgery . We are aimed in this article to suggest a way to address this critique of ACCP guideline to RAMs.
We (the authors) do not confine this shortcoming of RAMs (i.e arbitrary cutoffs) only to age or the duration of surgery as noted by the ACCP guideline. Many other risk factors such as Body Mass Index (BMI), history of major surgery, Stroke, multiple trauma, hip, pelvic and leg fractures in one month prior to hospitalization may have such problem in determining the total VTE risk of an individual.
An example may clarify the issue: a 61 years old man with a history of major surgery of cholecystectomy in the past year is admitted to your hospital with a progressive stroke. Also, another patient, a 74 years old woman with a history of Coronary Artery Bypass Graft (CABG) in the past year, is admitted with a mild Transient Ischemic Attack (TIA). The point score for both two patients using the Caprini Risk Assessment model is 8 and includes 1 for the history of major surgery, 2 for age, and 5 for stroke during the month prior to hospitalization for the first patient, and 2 for age, 4 for history of CABG, and at least 2 for admission with TIA for the second one. The patients acquired equal scores for their ages, but are 61 and 74 years old equal in predisposing VTE? According to the Caprini model, patients between 41-60 years old are assigned one score, and patients between 61-74 years old are assigned 2 score for VTE risk . What is the real difference between 59 and 61 years old, which 1 was assigned for one of them and 2 was assigned for the other? This problem is due to mentioned arbitrary cutoff points which were addressed in the 8th ACCP practice guideline too. How were these cutoff points determined? The cutoff points for age, length of surgery, and BMI were determined over the past 25 years and have solid bases in the literature [11, 16]. Also several studies have validated these data (cutoff points which were applied in risk assessment models) and confirmed the use of them to predict the 60 day clinically relevant VTE event [13–15].
Cutoff points are the corner stones and also the flaw of medical guidelines (even evidence-based guidelines). A patient with a body temperature more than 37.2°C axillary in the morning is considered as febrile, but is there a significant difference between 37.1 and 37.3°C, to consider one as febrile and the other one as afebrile? The complex mind of the human does not work like this (with a binary pattern) during its daily interpretations or decision makings.
The authors of this article believe that, this problem of risk assessment models (i.e. arbitrary cutoffs) can be corrected using fuzzy logic in decision making process.
Fuzzy logic which was first introduced by Lotfi A. Zadeh in 1965, transcends the "black and white" approach of the Aristotelian logic, and tries to capture the wide grey areas of imprecision in between . This logic provides a mathematical approach to interpret the grey zones of imprecision.
Considering the imprecise nature of the individual's personal and physical characteristics, Lotfi A. Zadeh anticipated that medicine probably would be the main domain for the application of his theory . But despite this prominent forecast, its progression in the field of medicine remained slow .
In recent years interesting proposals for the application of fuzzy logic in medical sciences have been appeared in the literature [20–22], and in this regard a special mention has to be made to the contributions coming from the group of Helgason, aiming for example to better individualize diagnostic process , or prescribing and dosing of particular medications at the bedside [24, 25].
A new approach to medicine which has had a rapid and continuing growth in the field is the practice of evidence-based medicine (EBM) . The ACCP guidelines for VTE prophylaxis were provided by this evidence-based approach. Some authors consider EBM and Fuzzy logic as two sides of a same coin. The authors of this article believe that fuzzy logic approach is not in contrast to the evidence-based medicine approach, but it is a complementary tool for a more realistic approach to the practice of evidence-based medicine. Fuzzy logic by capturing the grey zone in medical decision makings increases the reliability of risk assessment models. The probabilistic approach of the Fuzzy logic amplifies the applicability of electronic alerts and computerized decision-support systems.
Medical guidelines and risk assessment models capture clinical findings (history or physical examination) and para-clinical findings  in the process of determining medical decision. However, as was mentioned above, most of these findings in reality cannot project a binary (black or white) approach. Consider "Swollen legs" in a physical exam: In fuzzy manner of thinking, every body has "swollen legs" to some degree. This degree of membership is almost zero for normal and healthy people, and maybe near 1 for patients with 4+ pitting edema in legs.
ACCP guideline declared "there is little formal understanding of how the various risk factors interact in a quantitative manner to determine the position of each patient along a continuous spectrum of thromboembolic risk". Indeed, this is a particular case of fuzzy thinking model. In fuzzy manner of thinking, the risk of VTE rest on a continuum. The input from risk assessment models (or even practice guidelines) could be fuzzified for variables that are compatible with this way of thinking. In fuzzy logic, partial antecedents result in partial implications. As a consequence, the output of these risk assessment models will be a fuzzy variable with a degree of membership in each of two neighbor options. Then the outcome (output) of this system could be defuzzified to identify which option is more preferable.
By merging and concurrent use of these two approaches (EBM and Fuzzy logic) in the process of decision-making, fuzzy logic can yield its suitable place in the field of medicine, considering the rapidly progression of evidence-based medicine in this field.
It seems that lack of adequate validity studies, limited number of thromboprophylaxic options, or the complexity of using these risk assessment models for physicians is not enough to burying risk assessment models, and advocating for the simple approach (risk of each patient group) used by ACCP guideline. Fuzzy-based computerized decision support systems can resolve most of the ACCP guidelines shortcomings.
Patients with lower levels of VTE risk may be more affected by using the fuzzy manner of thinking, because among these patients, the application of fuzzy logic may alter the risk level and the options of thromboprophylaxis due to change in cumulative risk score.
The total risk score of patients with higher risk levels (risk score > 7 in Caprini model) may be decreased to some extent using the fuzzy approach, but the option of thromboprophylaxis is similar to when the fuzzy logic is not applied.
As discussed above, a reform in the field of risk assessment tools is needed to enhance their applicabilities in accordance with the expectations of clinicians, as the natural fuzzy thinking systems.
The application of Fuzzy thinking model in developing decision support systems can resolve most of the shortcomings of risk assessment models and practice guidelines.
Risk Assessment Model
American College of Chest Physicians
Body Mass Index
Transient Ischemic Attack
Coronary Artery Bypass Graft
Toussi M, Lamy JB, Le Toumelin P, Venot A: Using data mining techniques to explore physicians' therapeutic decisions when clinical guidelines do not provide recommendations: methods and example for type 2 diabetes. BMC Med Inform Decis Mak. 2009, 9: 28-10.1186/1472-6947-9-28.
Geerts WH, Pineo GF, Heit JA, Bergqvist D, Lassen MR, Colwell CW, Ray JG: Prevention of venous thromboembolism: the Seventh ACCP Conference on Antithrombotic and Thrombolytic Therapy. Chest. 2004, 126 (3 Suppl): 338S-400S.
Geerts WH, Bergqvist D, Pineo GF, Heit JA, Samama CM, Lassen MR, Colwell CW, American College of Chest P: Prevention of venous thromboembolism: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines (8th Edition). Chest. 2008, 133 (6 Suppl): 381S-453S. 10.1378/chest.08-0656.
Caprini JA: Thrombosis risk assessment as a guide to quality patient care. Dis Mon. 2005, 51 (2-3): 70-78. 10.1016/j.disamonth.2005.02.003.
Awidi A, Obeidat N, Magablah A, Bsoul N: Risk stratification for venous thromboembolism in hospitalized patients in a developing country: a prospective study. J Thromb Thrombolysis. 2009, 28 (3): 309-313. 10.1007/s11239-008-0291-1.
Rahimi-Rad MH, Moshiri Z: Thromboprophylaxis Practice in Teaching Hospital Settings. Tanaffos. 2006, 5 (2): 21-26.
Caprini JA, Hyers TM: Compliance with antithrombotic guidelines. Manag Care. 2006, 15 (9): 49-50. 53-60, 66.
Cohen A, Alikhan R, Arcelus J: A risk assessment model for identifying medical patients who should receive thromboprophylaxis [abstract]. J Thromb Haemost. 2003, 1 (Supp): OC437-
Kucher N, Koo S, Quiroz R: Electronic alerts to prevent venous thromboembolism among hospitalized patients. Journal of Vascular Surgery. 2005, 42 (1): 178-
Caprini JA, Arcelus JI, Reyna JJ: Effective risk stratification of surgical and nonsurgical patients for venous thromboembolic disease. Semin Hematol. 2001, 38 (2 Suppl 5): 12-19.
Anderson FA, Spencer FA: Risk factors for venous thromboembolism. Circulation. 2003, 107 (23 Suppl 1): I9-16.
Bahl V, Hu HM, Henke PK, Wakefield TW, Campbell DA, Caprini JA: A Validation Study of a Retrospective Venous Thromboembolism Risk Scoring Method. Ann Surg. 2009
Bahl V, Hu HM, Henke PK, Wakefield TW, Campbell DA, Caprini JA: A Validation Study of a Retrospective Venous Thromboembolism Risk Scoring Method. Ann Surg. 2010, 251 (2): 344-350. 10.1097/SLA.0b013e3181b7fca6.
Hatef DA, Kenkel JM, Nguyen MQ, Farkas JP, Abtahi F, Rohrich RJ, Brown SA: Thromboembolic risk assessment and the efficacy of enoxaparin prophylaxis in excisional body contouring surgery. Plast Reconstr Surg. 2008, 122 (1): 269-279. 10.1097/PRS.0b013e3181773d4a.
Seruya M, Venturi ML, Iorio ML, Davison SP: Efficacy and safety of venous thromboembolism prophylaxis in highest risk plastic surgery patients. Plast Reconstr Surg. 2008, 122 (6): 1701-1708. 10.1097/PRS.0b013e31818dbffd.
Nicolaides AN, Bergqvist D, Hull R: Prevention of venous thromboembolism - International Consensus Statement (Guidelines According to Scientific Evidence). Int Angiol. 1997, 16 (1): 3-38.
Torres A, Nieto JJ: Fuzzy logic in medicine and bioinformatics. J Biomed Biotechnol. 2006, 2006 (2): 1-7.
Zadeh L: Biological application of the theory of fuzzy sets and systems. Proc Int Symp Biocybernetics of the central nervous system: 1969; Boston. 1969, Little & Brown Co, 199-212.
Steimann F: Fuzzy set theory in medicine. Artif Intell Med. 1997, 11 (1): 1-7.
Grossi E: Medical concepts related to individual risk are better explained with "plausibility" rather than "probability". BMC Cardiovasc Disord. 2005, 5: 31-10.1186/1471-2261-5-31.
Massad E, Ortega NR, Struchiner CJ, Burattini MN: Fuzzy epidemics. Artif Intell Med. 2003, 29 (3): 241-259. 10.1016/S0933-3657(02)00070-2.
Pagliaro L: Probabilistic and fuzzy logic in the clinical diagnosis. Intern Emerg Med. 2007, 2 (2): 75-10.1007/s11739-007-0039-5. discussion 100 - 106.
Helgason CM, Jobe TH: Fuzzy logic and causal reasoning with an 'n' of 1 for diagnosis and treatment of the stroke patient. Expert Rev Neurother. 2004, 4 (2): 249-254. 10.1586/14737184.108.40.206.
Helgason CM: The application of fuzzy logic to the prescription of antithrombotic agents in the elderly. Drugs Aging. 2004, 21 (11): 731-736. 10.2165/00002512-200421110-00003.
Helgason CM, Jobe TH: Fuzzy logic and continuous cellular automata in warfarin dosing of stroke patients. Curr Treat Options Cardiovasc Med. 2005, 7 (3): 211-218. 10.1007/s11936-005-0049-4.
Straus SE, Richardson WS, Glasziou P, Haynes RB: Evidence-Based Medicine: How to Practice and Teach EBM. 2005, Philadelphia, USA: Elsevier, Churchill Livingstone, 3
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/11/63/prepub
The authors would like to thank Students' Research Committee of Urmia University of Medical Sciences for the grants provided for our study.
The authors declare that they have no competing interests.
NS developed the idea and design of the study, involved in developing the VTE electronic alert software, and helped in writing the manuscript. FG guided the project of developing the computational model for VTE risk assessment. MR contributed in the part related to VTE prophylaxis concept. BM participated in developing the fuzzy-based VTE electronic alert program (software programming), and SB involved in drafting the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Sepehrvand, N., Pakdel, F.G., Rahimi-Rad, M.H. et al. Practice guidelines and clinical risk assessment models: is it time to reform?. BMC Med Inform Decis Mak 11, 63 (2011). https://doi.org/10.1186/1472-6947-11-63
- Practice guidelines
- Risk assessment models
- Fuzzy Logic
- Venous Thromboembolism