How to translate therapeutic recommendations in clinical practice guidelines into rules for critiquing physician prescriptions? Methods and application to five guidelines
© Lamy et al; licensee BioMed Central Ltd. 2010
Received: 2 November 2009
Accepted: 28 May 2010
Published: 28 May 2010
Clinical practice guidelines give recommendations about what to do in various medical situations, including therapeutical recommendations for drug prescription. An effective way to computerize these recommendations is to design critiquing decision support systems, i.e. systems that criticize the physician's prescription when it does not conform to the guidelines. These systems are commonly based on a list of "if conditions then criticism" rules. However, writing these rules from the guidelines is not a trivial task. The objective of this article is to propose methods that (1) simplify the implementation of guidelines' therapeutical recommendations in critiquing systems by automatically translating structured therapeutical recommendations into a list of "if conditions then criticize" rules, and (2) can generate an appropriate textual label to explain to the physician why his/her prescription is not recommended.
We worked on the therapeutic recommendations in five clinical practice guidelines concerning chronic diseases related to the management of cardiovascular risk. We evaluated the system using a test base of more than 2000 cases.
Algorithms for automatically translating therapeutical recommendations into "if conditions then criticize" rules are presented. Eight generic recommendations are also proposed; they are guideline-independent, and can be used as default behaviour for handling various situations that are usually implicit in the guidelines, such as decreasing the dose of a poorly tolerated drug. Finally, we provide models and methods for generating a human-readable textual critique. The system was successfully evaluated on the test base.
We show that it is possible to criticize physicians' prescriptions starting from a structured clinical guideline, and to provide clear explanations. We are now planning a randomized clinical trial to evaluate the impact of the system on practices.
Clinical practice guidelines (CPGs) provide recommendations for the diagnosis and treatment of numerous diseases; they have been proved to be helpful for physicians . However, guidelines printed on paper are difficult to use efficiently during medical consultation  and guideline-based learning programmes are not sufficient . This has led to the development of decision support systems (DSSs) based on CPGs. Two reviews reveal that DSSs improved clinical practices in 64%  and 68%  of trials, and the use of a DSS was identified as one of the factors critical for success in improving healthcare for chronic disease [6, 7]. In particular, critiquing DSSs, requiring little or no intervention from the physician, provide criticism to the physician whenever his/her activity (e.g. drug prescriptions) is considered by the DSS as non-adequate in the light of current medical knowledge . Critiquing DSSs have been shown to have a greater impact than on-demand DSSs on practice [4, 9].
it requires both logical and medical expertise, and therefore it needs input from both physicians and computer scientists,
it requires to take into account medical knowledge that is implicit in the CPGs (e.g. CPGs do not explicitly state that it is possible to reduce the dose of a drug to lower the adverse effects it causes),
- 3.there is not one-to-one mapping between recommendations and criticisms; for instance the following recommendation "at the first stage of diabetes type 2, prescribe metformin as first-line treatment, and an alpha-glucosidase inhibitor (AGI) as second-line treatment" leads to three possible criticisms (see table 1):
if AGI is prescribed as first-line treatment: "AGI is a second-line treatment; metformin is recommended as first-line treatment",
if another drug is prescribed as first-line treatment: "other drugs are not recommended for the patient; metformin is recommended as first-line treatment",
if another drug is prescribed as second-line treatment: "other drugs are not recommended for the patient; metformin is recommended as first-line treatment and AGI as second-line".
Various possible situations for an example of therapeutical recommendation.
physician proposed metformin (first-line treatment)
physician proposed alpha-glucosidase inhibitors (AGI, second-line treatment)
physician proposed any other treatment
patient at the stage of first-line treatment
criticism: AGI should be prescribed only as second-line treatment. Guideline recommends metformin as first-line treatment.
criticism: Sulfonamides, glinides and glitazones are not recommended. Guideline recommends metformin as first-line treatment.
patient at the stage of second-line treatment
OK (e.g. with a different dose; preventing the represcription of ineffective or poorly tolerated treatments is the task of other recommendations)
criticism: Sulfonamides, glinides and glitazones are not recommended. Guideline recommends metformin as first-line treatment, and AGI as second-line.
Despite the two first criticisms lead to the same recommendation (prescribe metformin), the criticism displayed to the physician should not be the same, since the reasons and the explanations justifying the alert are different.
In ASTI 1 and ASTI 2 [16, 18], we proposed another approach for establishing critiquing DSSs that uses a structured model of the CPG therapeutical recommendations. The system first determines the set of drug prescriptions recommended for the patient, and then raises an alert if the physician's prescriptions are not in this set. During preliminary tests, this approach efficiently detected physician's prescriptions that did not conform to the CPG . However, it failed to generate a textual critique explaining to the physician why the drugs he/she prescribed did not conform, because (1) the first part of the reasoning process (determining the drugs recommended for the patient) does not take into account the physician's prescription, and (2) the knowledge model was limited to the representation of recommendations, which was insufficient to generate a meaningful critique (see difficulties 2 and 3 above). For instance, when applying the recommendation of the previous example to the prescription of an AGI for a patient as first-line treatment, the system deduces that the only recommended prescription is metformin. As the physician's prescription is different, a critique is generated. However, the textual critique is limited to "metformin is recommended as first-line treatment", without being able to state that "AGI is a second-line treatment" as above.
The objective of this article is to present and evaluate a drug prescription critiquing system that combines the two approaches presented above, and aims at (1) facilitating the creation of new knowledge bases, with a system designed to support the therapeutical recommendations of many, if not all, CPGs, and (2) being able to generate a clear and appropriate textual critique that explains to the physician why his/her prescriptions do not conform to the CPG. The knowledge base is composed of (a) specific recommendations that directly match the CPG recommendations, enriched with textual labels for generating the critiques, and (b) generic recommendations that model the implicit, CPG-independent, medical knowledge required for the critiquing process. This knowledge base is then automatically transformed into a set of executable "if conditions then criticism" rules. To show that it is easy to write knowledge bases and that the system is generic, we applied it to the therapeutic recommendations of five CPGs concerning chronic diseases related to cardiovascular risk.
The article first presents the ASTI project, as part of which this study was carried out. Then we present the methods for selecting the CPGs, designing the models, writing the algorithms, and evaluating the system. The results section describes the system by presenting the models, the algorithms for translating recommendations into "if conditions then criticism" rules, and the generic recommendations, and gives the results of the implementation of the five CPGs and the evaluation for these CPGs. Finally, we consider the value and the limitations of the DSS we have developed.
The ASTI project
We started with the ASTI 2 critiquing module, which provided a general architecture for the DSS. The ASTI 2 critiquing module is a rule-based system, with (a) a data-enriching component, which computes derived patient data from data available in the patient files, e.g. computing the Body Mass Index (BMI) from the height and the weight, (b) an inference engine, and (c) two knowledge bases implementing the French CPGs for hypertension  and type 2 diabetes .
We worked on five CPGs published by the French health authorities for hypertension , type 2 diabetes , tobacco addiction , dyslipaemia  and atrial fibrillation . These CPGs were chosen because they all relate to the cardiovascular risk and cover various aspects of the clinical care, e.g. the tobacco addiction CPG involves short-duration treatments whereas the other CPGs involve life-long treatments.
Modelling "if conditions then criticism" rules
"If conditions then criticism" rules are executed by the inference engine. Various elements were considered for rule conditions, inspired by the ASTI 2 critiquing module: (a) the patient's clinical condition (including current and past diseases and physiological states), (b) biological test results for the patient, and (c) the patient's therapeutic history (i.e. the list of past and current prescriptions), including treatment outcomes (i.e. treatment efficacies and drug tolerances). In the CPGs, clinical and biological conditions are relatively simple. Treatments expressed in CPGs are more complex, because many levels of granularity are used. We started from the ASTI 2 treatment model , and we extended this model to represent not only precise treatments, but also what we call hereafter treatment patterns of a lower granularity, such as "any bitherapy", "metformin in bitherapy" or "any past treatment including metformin with poor tolerance".
Modelling CPG recommendations
In the ASTI 3 critiquing module knowledge base, CPG recommendations are written manually from the guidelines; they aim at being easy to write and as close as possible to the CPG.
We extracted all therapeutic recommendations from the five CPGs, and for structuring them we designed a simple model inspired by the plan-based models in the literature. Each recommendation can lead to one or more criticisms. For instance, if we consider the recommendation "prescribe metformin as first-line treatment and alpha-glucosidase inhibitor (AGI) as second-line", there are two patient stages (patient requiring first-line treatment and patient requiring second-line treatment) and three treatments the physician can prescribe (metformin, AGI, and any other), and thus six possible situations, shown in table 1. Three of them lead to a criticism, all three criticisms being different. Therefore, we enriched the CPG recommendation model with attributes for modelling the textual criticisms.
Many guideline recommendations are complex and involve several lines of treatment. Recommendations with several lines of treatments could theorically be split in simpler recommendations, though it is not always desirable; for instance "prescribe metformin as first-line treatment" and "prescribe AGI as second-line treatment". However the second of these recommendations cannot be interpreted alone: "second-line treatment" is actually relative to the first recommendation and actually means "if metformin cannot be prescribed or was not satisfying". Therefore, we didn't try to split recommendations.
Writing generic recommendations
Pieces of medical knowledge that are both well-known by physicians and not specific to the disease addressed by the CPG are usually implicit in guidelines. For example, CPGs do not explicitly state that it is possible to reduce the dose of a drug to lower the adverse effects it causes. However, such medical knowledge is necessary for critiquing a prescription.
Consequently, we wrote generic recommendations for capturing this implicit knowledge. The criteria for a generic recommendation are the following: (a) it is independent of CPG, (b) it applies to at least three of the knowledge bases we developed for the five CPGs listed above, and (c) it is likely to apply to other CPGs. We required at least three occurrences (criterium b), because many recommendations are guideline-specific, even if they do not involve drugs or clinical contexts related to the guideline's disease, e.g. when a monotherapy has no effect at all, the guideline for arterial hypertension recommends to try another drug, but not to prescribe a bitherapy; however this recommendation is not found in the other guidelines, and therefore it cannot be considered as generic. By default, generic recommendations apply to all knowledge bases; for some of them it is possible to specify exceptions, e.g. lowering the dose of the bupropion is not possible, due to its narrow therapeutic range.
Designing algorithms for transforming recommendations into "if conditions then criticism" rules
The final step in building the ASTI 3 critiquing module was to design algorithms for automatically transforming both CPG and generic recommendations into "if conditions then criticism" rules. First, we did a preliminary feasibility study to ensure that such translation was possible. In this study, a set of "if conditions then criticism" rules equivalent to the recommendations for antihypertensive monotherapy were written manually. We chose antihypertensive monotherapy because it contains substantial complexity in a small subset of a CPG. Then, we wrote algorithms for automating the translation of recommendations into "if conditions then criticism" rules. One of the most complex types of recommendations follows the pattern "prescribe X as first-line treatment, Y as second-line treatment,..."; an example of such recommendations is given in table 1. We generalized this situation to N line of treatments.
Some of the generic recommendations are translated into "if conditions then criticism" rules that are totally independent from the content of the CPG (e.g. a rule critiquing the interruption of an effective and well-tolerated treatment). Some other generic recommendations lead to algorithms that generate one "if conditions then criticism" rule for each pharmaco-therapeutic class of drug or for each treatment recommended by the CPG (e.g. a rule critiquing the represcription of metformin if metformin has been poorly tolerated in the past). Finally, the remaining generic recommendations were taken into account when writing the various algorithms, but were not used to produce "if conditions then criticism" rules directly.
The complete list of algorithms is reported in the results section.
Software implementation methods
The ASTI 3 critiquing module was written using the Python programming language. The therapeutic history was coded using the ATC (Anatomical Therapeutic Chemical) drug classification.
Testing and evaluation methods
Three types of tests were performed to ensure the conformity of the DSS recommendations to the CPGs content. In all tests, we considered the guidelines as the "gold-standard", and thus we didn't investigate potential error in the guidelines.
First, a test base was written manually for each CPG. The test base was built by creating patient profiles that covered the various clinical situations and types of treatment. Then for each patient profile, we generated several test cases corresponding to the prescription of various treatments to that patient: one test case per treatments recommended by the CPG, and five test cases with randomly-generated non-recommended treatments, in order to verify that these non-recommended treatments are criticized as expected.
Second, for the diabetes type 2, tobacco addiction, dyslipaemia, atrial fibrillation and thrombo-embolic risk knowledge bases, a new quasi-exhaustive verification method was used ; this method considers the DSS as a black box, and tries to regenerate the CPG knowledge from the DSS. It consists in three steps: (1) Generating an almost exhaustive set of the possible DSS input vectors. This was achieved by considering a limited number of patient attributes (e.g. age, sex, current treatment,...) and a limited number of possible values for each attribute (e.g. 14, 18, 35, 75 years for age), and then generating all the possible combinations of attribute values. Finally, the DSS was run to determine the output for each input vector. (2) Extracting knowledge from the set of (input vector, output result) pairs. We used the C4.5 algorithm to generate a decision tree; pruning was disabled to keep 0% of error in the tree. (3) Comparing the decision tree generated with the original CPG, to check that the treatments recommended by the tree conform to the CPG, and that none of the recommendations included in the CPG are missing from the tree. This method was not applied to the hypertension knowledge base, because the number of possible input vectors was too high, and the decision tree would be far too big to be human-readable. Third, the knowledge bases were reviewed manually by a physician, who was asked to compare them to the content of the original CPGs. The physician was briefly introduced to the functioning of the ASTI 3 critiquing module. The recommendations in the knowledge bases were rephrased into an equivalent text in natural language, before being reviewed by the physician, e.g.: "if the treatment prescribed is a monotherapy and HbA1c ≤ 6.5%, then metformin should be prescribed as first-line treatment, and AGI as second-line treatment".
Description of the ASTI 3 critiquing module
The data enriching component is also in charge of computing various medical abstractions, such as relative posologies (i.e. has the drug dose been increased or lowered in the new prescription?). A few elements are required for critiquing the prescription, but are usually not present, or only in free text, in the EPR: drug tolerancies, treatment efficacy, and some clinical conditions (e.g. late discovery of diabetes type 2). For these elements, dialog boxes have been added to the EPR, for asking them to the physician. The values of these elements are then stored in the EPR for future uses.
In the following subsections, we describe the various parts of the critiquing module.
"If conditions then criticism" rule model and treatment pattern model
As stated in the introduction, "if conditions then criticism" rules are not supposed to be manually written, but automatically generated from a model of the CPG. Rule conditions can include clinical elements, represented by simple (attribute, operator, value) triplets (e.g. (age, inferior to, 75) or (diabetic, equal, yes)), and therapeutic elements, represented by treatment patterns. AND, OR and NOT logical operators can be used to combine several elements in conditions, and these operators can be nested.
The criticism part of the rules is simply represented by a textual label to be presented to the physician.
CPG recommendation model
In this model, "criticism label" attributes are used for modelling the textual criticisms shown to the physician, usually using excerpts of the CPG. For "one should prescribe" recommendations, the criticism label is split into three parts: (1) the explanation criticism label explains why a treatment of a given line should not be prescribed to a patient requiring a treatment of a lower line (e.g. a second-line treatment to a patient at the stage of first-line treatment), (2) the advice criticism label states the recommended treatments for patients require a treatment of a given line, and (3) the reference criticism label gives bibliographic references (e.g. the page number in the CPG). There are one advice and explanation criticism labels for each line of treatment in the recommendation. The criticism shown to the physician will be the concatenation of the explanation criticism label of the line of the treatment proposed by the physician, the advice criticism label of the line at which the patient is, and the reference criticism label.
In the example in table 1, there are 2 lines of treatment in the recommendation, thus line 3 is the "any other treatment" line (the last column). In the three criticisms, the first sentence is the explanation part and the second the advice part (the reference part is not shown). As a result of the model, advice criticism labels are the same in each line, and explanation criticism labels are the same in each column.
The generic recommendations and their use in the knowledge bases.
If the current treatment is effective, well-tolerated and recommended by the CPG, it should be continued
If the current treatment is ineffective, the dose can be increased
If the current treatment is too effective, the dose can be decreased
If a drug of the current treatment is poorly tolerated, the dose can be decreased
If a treatment was not effective in the recent past, it should not be prescribed again
If a drug was not tolerated in the past, it should not be prescribed again
If a treatment is both poorly tolerated and ineffective, apply the recommendations for poor tolerance
Two drugs of the same pharmaco-therapeutic class should not be prescribed in association
Algorithms for transforming recommendations into "if conditions then criticism" rules
For a "one should not prescribe" recommendation, the algorithm is trivial and generates one rule: "if (conditions) and (the treatment proposed by the physician is the treatment to not prescribe) then criticism".
For a "treatment of increasing power" recommendation with N power levels, the algorithm generates N - 1 rules: "if (conditions) and (the proposed treatment is a treatment of power level X) and (there is in the therapeutic history an ineffective treatment of power level Y > X) then criticism" (for 2 ≤ X ≤ N).
For a "one should prescribe" recommendation with N lines of treatments (line N + 1 being associated to any other treatment), the algorithm generates rules. We consider that the patient is at the stage of line X if and only if:
*when X = 1, "there is no ineffective or poorly tolerated treatment of any line in the therapeutic history",
*when 2 ≤ X ≤ N - 1, "(there is no ineffective or poorly tolerated treatment of line ≥ X in the therapeutic history) and (there is an ineffective or poorly tolerated treatment of line X - 1 in the therapeutic history)",
*when X = N, "there is an ineffective or poorly tolerated treatment of line N - 1 or N in the therapeutic history".
The rules are: "if (conditions) and (the patient is at the stage of line X) and (the proposed treatment is a treatment of line Y) and (the proposed treatment is not a treatment of line < Y) then criticism (explanation criticism label for line Y + advice criticism label for line X + reference criticism label)" (for 1 ≤ X ≤ N, for X + 1 ≤ Y ≤ N + 1).
Generic recommendation #1 leads to the rule: "if (the current treatment conforms to the guideline, and is effective and well-tolerated) and (the proposed treatment includes an INN change, a dose change or a form change) then criticism".
Dose-related generic recommendations (#2, 3 and 4) lead to three rules:
*"if (the current treatment is ineffective but well-tolerated) and (the proposed treatment is a dose reduction) then criticism"
*"if (the current treatment is poorly tolerated) and (the proposed treatment is a dose increase) then criticism"
*"if (the current treatment is too effective) and (the proposed treatment is a dose increase) then criticism". An example of a too-effective treatment is an antivitamin K anticoagulant drug, when the INR (International Normalized ratio) is higher than the therapeutical range, i.e. the anticoagulant effect is too important, and the drug dose should be reduced.
For generic recommendation #5, we consider that a past ineffective treatment should not be represcribed if it has been stopped in the past. This leads to one rule for each recommendable treatment T in the guideline: "if (the proposed treatment is a treatment T) and (the therapeutic history includes an ineffective treatment T within the last three years, which has not been followed by another treatment T) then criticism".
Similarly, for generic recommendation #6, we consider that a drug poorly tolerated in the past should not be represcribed if it has been stopped in the past. This leads to one rule for each pharmaco-therapeutic class C in the guideline: "if (the proposed treatment includes a drug of the pharmaco-therapeutic class C) and (the therapeutic history contains a past treatment including a poorly tolerated drug of the pharmaco-therapeutic class C, which was followed by a treatment that does not include a drug of the pharmaco-therapeutic class C) then criticism".
Generic recommendation #8 leads to one rule for each pharmaco-therapeutic class C in the guideline: "if (the proposed treatment includes two drugs of the pharmaco-therapeutic class C) then criticism".
Description of the knowledge bases
Characteristics of the knowledge bases.
Number of pharmaco-therapeutic drug classes
Number of recommended treatments
Number of "one should prescribe..." recommendations
Number of "one should not prescribe..." recommendations
Number of "treatments of increasing power..." recommendations
Total number of recommendations
Number of "if ... then criticism" rules
Number of treatment patterns
it executes the "if condition then criticism" rules for the treatment proposed by the physician; if one or more rules is triggered, the treatment does not conform to the knowledge base and an alert will be issued,
it generates a textual criticism by concatenating the textual criticisms of all triggered rules,
it generates a list of treatment suggestions, by executing the "if condition then criticism" rules for all recommendable treatments in the CPG, and retaining only the treatments that do not trigger any rule,
if the list of suggestions is empty, the rules are relaxed to accept a second-line treatment for a patient at the stage of first-line treatment (or a third-line treatment for a patient at the stage of second-line treatment, etc), and the inference engine restarts at step 1. If the list of suggestions is still empty, the rules can again be relaxed, to accept a third-line treatment for patient at the stage of first-line treatment, and so on. This situation occurs when a line of treatment cannot be prescribed, e.g. because all the recommended drugs are not tolerated by the patient; in that case, the usual prescribing behaviour is to prescribe a second-line (or third-line, etc) treatment. If the list of suggestions is empty when relaxing the rules to the maximum, then the CPG does not provide enough information for making a decision (e.g. all the possible treatments are contraindicated, poorly tolerated or ineffective).
Testing and evaluation results
We first tested the ASTI critiquing module using a test base involving 59 clinical cases and 652 test cases for hypertension, 56 and 877 for type 2 diabetes, 31 and 348 for tobacco addiction, 31 and 256 for dyslipaemia, 8 and 123 for atrial fibrillation and 17 and 136 for thrombo-embolic risk (totals: 202 and 2392). The clinical cases covered the various clinical situations encountered in the CPGs, and the various events that may be observed in therapeutic histories, such as poor drug tolerance. These tests were used during the development of the ASTI 3 critiquing module; at the end of the development, all tests were passed without error.
Second, we generated decision trees for the diabetes type 2, tobacco addiction, dyslipaemia, atrial fibrillation and thrombo-embolic risk knowledge bases. In these decision trees, each path is a patient profile (including both clinical elements and therapeutic elements, such as past treatment or drug intolerance) and leads to the list of treatments that are not critiqued when prescribed to this patient profile. We have already used such decision trees in a previous study, for type 2 diabetes ; an excerpt of a tree is shown in Additional file 3. The decision trees were reviewed by the DSS designers, and they helped to identify some errors in the knowledge bases. For instance, in the dyslipaemia knowledge base, a recommendation was stating that fibrates are less effective than statins; however this is only true when treating hypercholesterolaemia, but not other dyslipaemia such as hypertriglyceridaemia or hypoHDLaemia. We discovered the problem on the tree, and we modified the recommendation by adding hypercholesterolaemia to its condition.
Third, the six knowledge bases were reviewed by a physician. The format of the recommendations expressed in the knowledge bases was clear to the physician. For tobacco addiction, atrial fibrillation and thrombo-embolic risk, the physician found that the knowledge bases conformed to the content of the CPGs. For dyslipaemia, the physician found two errors, related to the use of fenofibrate + statin bitherapy and the definition of the high cardio-vascular risk for diabetic patients; these errors have now been corrected in the knowledge base. For diabetes type 2, the evaluation led to three modifications: a rule has been added for critiquing some sub-optimal bitherapies, and the two rules for insulinotherapies have been modified. For hypertension, the evaluation led to three modifications: quadritherapies and alpha-blocker/central antihypertensives have been allowed under certain circumstances, and diabetic patients with renal failure but without micro-albuminuria were not correctly dealt with. In addition, the physician successfully discovered some recommendations that were present in the CPGs, but that were knowingly not implemented in the knowledge bases, due to practical problems. For example, the tobacco addiction CPG does not recommend hypnosis therapy, however this was not computerized because hypnosis is not coded in the prescriptions of patients' electronic record.
We also measured the system response time for the test base. The system response time was short: about 200 milliseconds for initializing and loading a knowledge base, and then about 35 milliseconds for handling one case (measured on a Pentium 4 processor at 2 GHz with 512 Mb).
In this article, we have highlighted the importance of translating the recommendations found in CPGs into "if conditions then criticism" rules that can be used to criticize physicians' activities during his/her practice; we also describe algorithms to perform the translation automatically from a structured model of CPG recommendations. We propose eight generic recommendations, which are guideline-independent but apply in many situations. DSSs must take into account these generic recommendations, but as they are usually implicit in CPG writing them is not easy. Finally, we describe a method for generating an appropriate textual critique to show to the physician. This task is not trivial because, as CPGs usually do not contain information explaining why a treatment should not be prescribed to a given patient, the existent structured models of CPGs  do not represent this information. In this paper, we propose a model of CPG therapeutic recommendations that provides attributes for representing the various elements of the textual critique.
The algorithms we propose can translate all recommendations that fit the CPG recommendation model into "if conditions then criticism" rules, and this model was able to structure all therapeutic recommendations found in the five CPGs. Therefore, it is likely to be pertinent to most or even all situations frequently encountered in general practice. However, further evaluations should be performed to determine if this model can be used as-is for more complex or specific medical fields, such as oncology. In particular, we did not take treatment durations into account; however it would not be difficult to add a duration attribute to the treatment model.
In addition, CPGs also include recommendations for test ordering and diagnosis. Test ordering shares many features with drug prescription, and a method similar to the one we described could be used to criticize test ordering.
Some generic recommendations do not apply to all the five CPGs, and especially the tobacco addiction CPG. This is because tobacco addiction treatment is not a chronic treatment: after the patient has stopped smoking, the treatment can be discontinued. However, despite these exceptions, the generic recommendations we propose sound logical to physicians and we think they can apply in most situations. They can be considered as default behaviour, until the CPG explicitly states the contrary.
The textual critiques generated explain why the treatment proposed by the physician should not be prescribed, provides recommendations for the patients, and gives additional references. They are accompanied by a list of suggestion for treatments. This critique structure seems to cover both the information provided by the guideline and the information expected by the physicians.
Most of the critiquing DSSs published in the literature [9, 12, 14] are based on a list of manually written "if conditions then criticism" rules. As stated in the introduction, writing these knowledge bases is more complex than structuring the CPG and then automatically generating the "if conditions then criticism" rules, as we propose in this article. J. van der Lei et al.  expressed a similar opinion. To facilitate the creation of knowledge bases, they recommended separating medical knowledge, i.e. that found in the CPG, from the critiquing knowledge, i.e. how to perform a critique using the medical knowledge. In our architecture, the critiquing knowledge corresponds to the algorithms translating the structured model of the CPG recommendations into "if conditions then criticism" rules.
A.M. Albisser et al. [29, 31] proposed a critiquing DSS for insulino-dependent diabetes, based on a simulator. This simulator is able to predict how glycated hemoglobin and risk of hypoglycemia evolves when the various doses of insulin and oral antidiabetics are increased or decreased. Such simulators are promising, but this approach is disease-specific, since each disease would require a specific simulator.
P. Groot et al.  also proposed a critiquing system based on a CPG model; they used the Asbru format, along with model checking. They also highlighted the difficulty of building human readable critiques, but they only proposed a partial solution to this problem. Another example of critiquing system using recommendations as a knowledge base is the ISABEL system , which relies on a set of textbook and native language processing tools for producing reminders related to diagnosis.
Most of the efforts involved in designing the ASTI 3 critiquing module was spent on the design of the engine, including the models and the algorithms. Then, implementing the five CPGs was relatively easy, due to the simple CPG model, close to what is expressed in the guideline, and the generic recommendations, which provide default behaviours for frequent tasks such as dealing with doses. Finally, after the implementation of the diabetes type 2 CPG, we had to update the knowledge base to take into account recent developments in medical knowledge related to the use of glitazones. This update led to the modification of two rules in the knowledge base and has been performed in a few hours work. Most of this time was spent in updating the testing base and then testing the system, to ensure that nothing was broken. Consequently, we think that implementing and updating CPGs in the ASTI 3 critiquing module can be quick and practical. It would be interesting to carry out a more rigorous evaluation of the time required for implementing new CPGs, and for updating an already implemented CPG, and a more detailed assessment of any difficulties encountered.
The ASTI 3 critiquing module could be improved by adding support for the standard CPGs models published in the literature , such as Proforma , Prodigy  or GLIF . This could be achieved by designing an automatical tool to translate these models into the simple CPG recommendation model we have proposed.
Despite its simplicity, our model can represent general therapeutical structures similar to the ones used by the standard CGP models. For example, a plan-based recommendation composed of three plans: diet, monotherapy and bitherapy, with the monotherapy plan including metformin as first-line treatment and AGI as second-line treatment, can be represented in our model with nested "one should prescribe" recommendations. It would lead to the following recommendations: "one should prescribe a diet as first-line treatment, a monotherapy as second-line treatment and a bitherapy as third-line treatment" and "if the proposed treatment is a monotherapy, then one should prescribe metformin as first-line treatment and AGI as second-line treatment".
One of the difficulties that may arise during the design of such an automatic translation tool, is the generation of the textual critics that are displayed to the physicians (i.e. the "criticismLabel" attributes in figure 4). The standard CPG models usually include the text of the CPG, however, as said previously, this text expresses recommendations but not critics, and therefore it may not be appropriate for a critiquing system.
Our intention is now to improve the integration of the ASTI critiquing module in EPR, using more user-friendly dialog boxes and coding support tools, in order to make it usable in real clinical situations. In addition, we plan to integrate the critiquing module with various EPR software, including éO Généraliste but not limited to this particular software.
We have presented methods, including models and algorithms, for critiquing physicians' prescriptions, using a structured representation of the therapeutic parts of the clinical guidelines. Therefore, writing additional knowledge bases is straightforward, and is even facilitated by the use of generic recommendations, i.e. pre-defined recommendations that apply to almost any guidelines. We have also shown how to generate a textual critique that explains why a non-recommended treatment should not be prescribed. These methods have been successfully applied in the ASTI 3 critiquing module, a decision support system which implements five clinical guidelines related to cardiovascular risks. We are now planning to evaluate ASTI 3, including the critiquing module, in a randomized clinical trial, to determinate the impact of the system on medical practices and patient outcomes.
We thank the HAS (Haute Autorité de Santé, the French health authority) and the CNAM (Caisse Nationale d'Assurance Maladie, the French health insurance fund for employees) for funding the ASTI project. No funding sources was involved in the design of the system, the writing of the article or the decision to submit the manuscript.
- Grimshaw J, Russel I: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993, 342 (8883): 1317-22. 10.1016/0140-6736(93)92244-N.View ArticlePubMedGoogle Scholar
- Dufour J, Bouvenot J, Ambrosi P, Fieschi D, Fieschi M: Textual Guidelines versus Computable Guidelines: A Comparative Study in the Framework of the PRESGUID Project in Order to Appreciate the Impact of Guideline Format on Physician Compliance. Proc AMIA Symp. 2006, Washington, DC, 219-223.Google Scholar
- Perria C, Mandolini D, Guerrera C, Jefferson T, Billi P, Calzini V, Fiorillo A, Grasso G, Leotta S, Marrocco W, Suraci C, Pasquarella A: Implementing a guideline for the treatment of type 2 diabetics: results of a Cluster-Randomized Controlled Trial (C-RCT). BMC Health Services Research. 2007, 7: 79-10.1186/1472-6963-7-79.View ArticlePubMedPubMed CentralGoogle Scholar
- Garg A, Adhikari N, McDonald H, Rosas-Arellano M, Devereaux P, Beyene J, Sam J, Haynes R: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.View ArticlePubMedGoogle Scholar
- Kawamoto K, Houlihan C, Balas E, Lobach D: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330 (7494): 765-10.1136/bmj.38398.500764.8F.View ArticlePubMedPubMed CentralGoogle Scholar
- Green C, Fortin P, Maclure M, Macgregor A, Robinson S: Information system support as a critical success factor for chronic disease management: Necessary but not sufficient. Int J Med Inf. 2006, 75 (12): 818-828. 10.1016/j.ijmedinf.2006.05.042.View ArticleGoogle Scholar
- Sittig D, Krall M, Dykstra R, Russell A, Chin H: A survey of factors affecting clinician acceptance of clinical decision support. BMC Medical Informatics and Decision Making. 2006, 6: 6-10.1186/1472-6947-6-6.View ArticlePubMedPubMed CentralGoogle Scholar
- Sips R, Braun L, Roos N: Enabling protocol-based medical critiquing. Stud Health Technol Inform. 2006, 124: 471-476.PubMedGoogle Scholar
- Van Wyk J, van Wijk M, Sturkenboom M, Mosseveld M, Moorman P, van der Lei J: Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation. 2008, 117 (3): 371-378. 10.1161/CIRCULATIONAHA.107.697201.View ArticlePubMedGoogle Scholar
- Wanger P, Martin L: Algorithms for optimizing drug therapy. BMC Medical Informatics and Decision Making. 2004, 4: 10-10.1186/1472-6947-4-10.View ArticlePubMedPubMed CentralGoogle Scholar
- Kuilboer M, van Wijk M, Mosseveld M, van der Does E, de Jongste J, Overbeek S, Ponsioen B, van der Lei J: Computed critiquing integrated into daily clinical practice affects physicians' behavior--a randomized clinical trial with AsthmaCritic. Methods Inf Med. 2006, 45 (4): 447-454.PubMedGoogle Scholar
- Kuilboer M, van Wijk M, Mosseveld M, van der Lei J: AsthmaCritic: Issues in designing a noninquisitive critiquing system for daily practice. J Am Med Inform Assoc. 2003, 10 (5): 419-424. 10.1197/jamia.M1273.View ArticlePubMedPubMed CentralGoogle Scholar
- Martens J, van der Weijden T, Severens J, de Clercq P, de Bruijn D, Kester A, Winkens R: The effect of computer reminders on GPs' prescribing behaviour: a cluster-randomised trial. Int J Med Inf. 2007, 76 (S3): S403-S416. 10.1016/j.ijmedinf.2007.04.005.View ArticleGoogle Scholar
- Bindels R, de Clercq P, Winkens R, Hasman A: A test ordering system with automated reminders for primary care based on practice guidelines. Int J Med Inf. 2000, 58-59: 219-233. 10.1016/S1386-5056(00)00089-7.View ArticleGoogle Scholar
- Bindels R, Hasman A, van Wersch J, Talmon J, Winkens R: Evaluation of an automated test ordering and feedback system for general practitioners in daily practice. Int J Med Inf. 2004, 73 (9-10): 705-712. 10.1016/j.ijmedinf.2004.06.001.View ArticleGoogle Scholar
- Séroussi B, Bouaud J, Dreau H, Falcoff H, Riou C, Joubert M, Simon C, Simon G, Venot A: ASTI: a guideline-based drug-ordering system for primary care. Medinfo, the Netherlands. 2001, 10: 528-32.Google Scholar
- Ebrahiminia V, Riou C, Séroussi B, Bouaud J, Dubois S, Falcoff H, Venot A: Design of a decision support system for chronic diseases coupling generic therapeutic algorithms with guideline-based specific rules. Stud Health Technol Inform. 2006, 124: 483-488.PubMedGoogle Scholar
- Ebrahiminia V, Duclos C, Toussi M, Riou C, Cohen R, Venot A: Representing the patient's therapeutic history in medical records and in guideline recommendations for chronic diseases using a unique model. Stud Health Technol Inform. 2005, 116: 101-6.PubMedGoogle Scholar
- Lamy JB, Ellini A, Ebrahiminia V, Zucker JD, Falcoff H, Venot A: Use of the C4.5 machine learning algorithm to test a clinical guideline-based decision support system. Stud Health Technol Inform. 2008, 136: 223-228.PubMedPubMed CentralGoogle Scholar
- Bouaud J, Séroussi B, Falcoff H, Venot A: Complementarity of reminder-based and on-demand decision support according to clinical case complexity. Stud Health Technol Inform. 2005, 116: 1086-1091.Google Scholar
- Séroussi B, Bouaud J, Chatellier G: Guideline-based modeling of therapeutic strategies in the special case of chronic diseases. Int J Med Inf. 2005, 74 (2): 89-99. 10.1016/j.ijmedinf.2004.06.004.View ArticleGoogle Scholar
- HAS: Prise en charge des patients adultes atteints d'hypertension artérielle essentielle. 2005, [http://www.has-sante.fr/portail/display.jsp?id=c_269118]Google Scholar
- HAS: Traitement médicamenteux du diabète de type 2. 2006, [http://www.has-sante.fr/portail/display.jsp?id=c_459266]Google Scholar
- AFSSAPS: Les stratégies thérapeutiques médicamenteuses et non médicamenteuses de l'aide l'arrêt du tabac. 2003, [http://www.afssaps.fr/var/afssaps_site/storage/original/application/7ecb1be555cdbc6454c1e0caa3ccfea2.pdf]Google Scholar
- AFSSAPS: Prise en charge thérapeutique du patient dyslipidémique. 2005, [http://www.afssaps.fr/content/download/3967/39194/version/5/file/dysreco.pdf]Google Scholar
- HAS: Guide affection de longue durée - Fibrillation auriculaire. 2007, [http://www.has-sante.fr/portail/display.jsp?id=c_568389]Google Scholar
- De Clercq P, Blom J, Korsten H, Hasman A: Approaches for creating computer-interpretable guidelines that facilitate decision support. Artif Intell Med. 2004, 31: 1-27. 10.1016/j.artmed.2004.02.003.View ArticlePubMedGoogle Scholar
- Van der Lei J, Musen M: The separation of reviewing knowledge from medical knowledge. Methods Inf Med. 1995, 34 (1-2): 131-9.PubMedGoogle Scholar
- Albisser A, Alejandro R, Sperlich M, Ricordi C: Prescription checking device promises to resolve intractable hypoglycemia. Journal of diabetes science and technology. 2009, 3 (3): 524-532.View ArticlePubMedGoogle Scholar
- Albisser A, Alejandro R, Sperlich M, Ricordi C: Closing the circle of care with new firmware for diabetes: MyDiaBase + RxChecker. Journal of diabetes science and technology. 2009, 3 (3): 619-623.View ArticlePubMedPubMed CentralGoogle Scholar
- Albisser A: Technophobia, prescription checking and the future of diabetes management. Diabetologia. 2009, 52 (6): 1013-1018. 10.1007/s00125-009-1341-8.View ArticlePubMedGoogle Scholar
- Groot P, Hommersom A, Lucas P, Merk RJ, ten Teije A, van Harmelen F, Serban R: Using model checking for critiquing based on clinical guidelines. Artif Intell Med. 2009, 46: 19-36. 10.1016/j.artmed.2008.07.007.View ArticlePubMedGoogle Scholar
- Ramnarayan P, Roberts G, Coren M, Nanduri V, Tomlinson A, Taylor P, Wyatt J, Britto J: Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Medical Informatics and Decision Making. 2006, 6: 22-10.1186/1472-6947-6-22.View ArticlePubMedPubMed CentralGoogle Scholar
- Peleg M, Tu S, Bury J, Ciccarese P, Fox J, Greenes RA, Hall R, Johnson PD, Jones N, Kumar A, Miksch S, Quaglini S, Seyfang A, Shortliffe EH, Stefanelli M: Comparing computer-interpretable guideline models: a case-study approach. J Am Med Inform Assoc. 2003, 10: 52-68. 10.1197/jamia.M1135.View ArticlePubMedPubMed CentralGoogle Scholar
- Sutton D, Fox J: The Syntax and Semantics of the PROforma Guideline Modeling Language. J Am Med Inform Assoc. 2003, 10: 433-443. 10.1197/jamia.M1264.View ArticlePubMedPubMed CentralGoogle Scholar
- Purves I, Sugden B, Booth N, Sowerby M: The PRODIGY project - the interactive development of the release one model. Proc AMIA Symp. 1999Google Scholar
- Peleg M, Boxwala A, Tu S, Zeng Q, Ogunyemi O, Wang D, Patel V, Greenes R, Shortliffe E: The InterMed approach to sharable Computer-Interpretable Guidelines: a review. J Am Med Inform Assoc. 2004, 11: 1-10. 10.1197/jamia.M1399.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/10/31/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.