A Decision Aid for COPD patients considering inhaled steroid therapy: development and before and after pilot testing
© Akl et al; licensee BioMed Central Ltd. 2007
Received: 09 February 2007
Accepted: 15 May 2007
Published: 15 May 2007
Decision aids (DA) are tools designed to help patients make specific and deliberative choices among disease management options. DAs can improve the quality of decision-making and reduce decisional conflict. An area not covered by a DA is the decision of a patient with chronic obstructive pulmonary disease (COPD) to use inhaled steroids which requires balancing the benefits and downsides of therapy.
We developed a DA for COPD patients considering inhaled steroid therapy using the Ottawa Decision Support Framework, the best available evidence for using inhaled steroid in COPD and the expected utility model. The development process involved patients, pulmonologists, DA developers and decision making experts. We pilot tested the DA with 8 COPD patients who completed an evaluation questionnaire, a knowledge scale, and a validated decisional conflict scale.
The DA is a computer-based interactive tool incorporating four different decision making models. In the first part, the DA provides information about COPD as a disease, the different treatment options, and the benefits and downsides of using inhaled steroids. In the second part, it coaches the patient in the decision making process through clarifying values and preferences. Patients evaluated 10 out of 13 items of the DA positively and showed significant improvement on both the knowledge scale (p = 0.008) and the decisional conflict scale (p = 0.008).
We have developed a computer-based interactive DA for COPD patients considering inhaled steroids serving as a model for other DAs in COPD, in particular related to inhaled therapies. Future research should assess the DA effectiveness.
Increasingly, patients want to become actively involved in medical decision-making . Active patient involvement can improve outcomes including quality of life and can possibly reduce health care expenditures [2–4]. However, therapy and screening decisions are complicated for several reasons. First, there is often no single 'best' choice because people vary in the values or personal importance that they place on the benefits and harms of different treatment or screening options. Second, the evidence needed to trade off benefits and downsides (harm, burden and cost) of options may be of low quality. Third, clinicians have little knowledge about the best ways to present evidence and to involve patients in the decision making process. Individual practice circumstances further complicate evidence based decision making.
Because of the existing evidence that active patient involvement can improve outcomes [2–4] and in order to help people make wise choices among options [5, 6] investigators and clinicians have developed decision aids (DAs). DAs are decision support tools that provide patients with detailed and specific information on options and outcomes, help them clarify their values, and guide them through the decision making process . DAs are superior to usual care interventions in improving knowledge and realistic expectations of the benefits and harms of options; reducing passivity in decision making; and lowering decisional conflict due to feeling uninformed . Additionally, they assist patients with chronic diseases in feeling better socially supported and potentially improving their behavioral and clinical outcomes .
Chronic Obstructive Pulmonary Disease (COPD) is a major cause of chronic morbidity and mortality throughout the world . In the US alone, COPD affected an estimated 11 million adults in 2002, and was the fourth leading cause of death in 2004 . The 2004 US expenditures for health and lost productivity due to COPD were estimated at $37.2 billions . Further increases in COPD prevalence and mortality will occur in the coming decades .
Inhaled steroids, one of therapeutic options for COPD, reduce the number of acute exacerbations in COPD patients [12, 13] and have a small beneficial effect on their health related quality of life (HRQL), but have a number of side effects including oropharyngeal candidiasis and skin bruising . They also pose the additional burden of using an inhaler. Asking COPD patients to decide about starting inhaled steroids implies a decision making process trying to balance the benefits and harms by including their personal values. Although we did not identify any study about the difficulties with making such a decision, we had noted difficulties in the course of our clinical practice and when speaking to colleagues. In this paper we describe the development and pilot testing of a decision aid for COPD patients considering inhaled steroids therapy that can serve as a model for other decisions aids in COPD.
Development of the Decision Aid
The development of the COPD DA consisted of five steps:
(1) Structural development: the structure of the DA follows the Ottawa Decision Support Framework (DSF)  and is based on the Ottawa Personal Decision Guide (OPDG) . The framework is an evidence-based, practical, mid-range theory for guiding patients making health or social decisions. Mid-range theories are moderately abstract and inclusive theories that address specific phenomena and are composed of concepts and propositions that are measurable . The framework supports decision making through providing information about the disease, its treatment alternatives and the associated outcomes; through clarifying values; and finally through augmenting skills in decision making. The Ottawa Personal Decision Guide (OPDG) is a generic decision aid designed for any health-related and/or social decision. It helps people assess their decision making needs, plan the next steps, and track their progress in decision making. However, it does not include standardized guidance about how to include an interactive computer based interface, which was one of the aims of our project. Furthermore, opposed to the generic features of the OPDG we aimed to include different decision making models in the aid. The latter was another of our specific aims for this decision aid and the intended decision making process.
(2) Information compilation: we derived the information about the outcomes of inhaled steroids treatment in COPD patients from the most recent systematic review of the medical literature about the topic , and from several of the original studies included in the review. Beneficial outcomes include a reduction in the rate of exacerbations (RR = 0.70; 95% CI: 0.58 to 0.84: from 0.8 to 0.56 exacerbation per year)  and a deceleration in the rate of decline in health status . Harms include increases in the rates of oropharyngeal candidiasis (RR = 2.1; from 0.8% to 1.7% per year), skin bruising (RR = 2.1; from 1.0% to 2.1% per year) and dysphonia (RR = 2.0; from 1.7% to 3.3% per year) as well as the burden of using the drug. We also included a statement about the uncertainty of the effect of inhaled steroids on mortality, cataract and bone fractures .
(3) Platform design: two professional web designers experienced health related websites developed the platform of the DA using Macromedia Dreamweaver 2002 software. They developed it as a CD-ROM version and then made it available on the World Wide Web.
(4) Experts' feedback: we consulted pulmonologists, medical decision making experts (Drs. Amiram Gafni and Cathy Charles, McMaster University, Hamilton, Canada) and a DA expert (Dr. Annette O'Connor, University at Ottawa, Canada). We used their in-depth feedback to improve different aspects of the DA. These improvements related to the structure of the decision aid and the integration of different decision making models.
(5) Patients' feedback: we conducted detailed interviews with 7 COPD patients. Each patient reviewed the DA, answered specific questions and provided general comments. After each interview, we made modifications based on the patient feedback. Modifications were mainly related to the use of lay terms, the form of presentation of the statistical presentation, and the amount of information.
Pilot testing of the Decision Aid
Eight additional COPD patients used the DA as if they were to make a real life decision about the use of inhaled steroids. These participants completed 3 instruments: (1) an evaluation questionnaire; (2) a knowledge scale (before and after use); and (3) a validated decisional conflict scale (before and after use) . The evaluation questionnaire addressed 13 features of the DA that participants rated on 5-point Likert scales (1 for lowest value, 3 for neutral value and 5 for highest value). The knowledge scale consisted of 10 questions we developed specifically about the use of inhaled steroids in COPD patients [see Additional file 1]. We kept track of the required time and the need for assistance in using the DA. The State University of New York at Buffalo and the Buffalo Veterans Affairs Medical Center institutional review boards (IRB) approved this study and all participants provided informed consent.
For the 5 point Likert scale questions, we used a one sample t-test to compare the mean response to 3 (neutral value). For the knowledge and decisional conflict scales, we used a paired t-test to compare the pre and post intervention mean scores. We used SPSS, version 11.0 (SPSS, Inc., Chicago, Illinois) and considered p < 0.01 (two-sided) as statistically significant.
The decision Aid 
Decision making models
The user can access the first page of any section from any page of the DA, and all pages of a particular section from any page of that section. Additional features include hyperlinks to references and definitions of technical words that pop-up in small-size windows. The navigation thus permits access to medical information when needed at any step of the DA.
Pilot testing of the Decision Aid
Baseline characteristics of pilot testing patients
Respondents (N= 8)
Less than high school
Results of the pilot testing
Perceived required time
Amount of information
Statistical information clarity
Concept of values explanation
Comfortable using the Aid
Decision Aid helpfulness
Knowledge scale Pre *
Knowledge scale Post
Decisional Conflict scale Pre §
Decisional Conflict scale Post
Number of minutes to complete the DA mean (sd)
Need for assistance to use the DA n (%)
We have developed a DA for COPD patients considering inhaled steroid therapy. The DA is a computer-based interactive tool structured following the Ottawa Decision Support Framework and integrating four decision-making models (the paternalistic model, the informed decision making model, the physician as an agent model and the shared decision making model). In practice, patients could briefly review the DA with the health care provider at the time of the medical encounter and then complete a detailed review on their own. The most efficient way of completing the decision aid is thus one that does not require presence of a health care provider. COPD patients evaluated positively most of the features of the DA, and showed significant improvement on both the knowledge and the decisional conflict scales.
The DA has several strengths. First, it meets 14 of the 23 quality criteria for "content" and 15 of the 19 quality criteria for "development process" recently proposed by the International Patient Decision Aid Standards (IPDAS) Collaboration . Second, we used a rigorous evidence-based approach to gather and summarize the evidence provided in the decision aid. Third, we have integrated into the decision aid several decision making models to respond to different decision making preferences. We know of no other decision support tool that provides this flexibility, which responds to the variability in decision-making style preferences among patients . Fourth, we assessed patient values using a quantitative method. Fifth, the computer-based format offers the advantages of ease of access, convenience, and ease of update.
The decision aid has some limitations. First, we have not evaluated yet the effectiveness of the DA in terms of the impact on the decision processes or decision quality. While the pilot testing in 8 patients provided us with important information, it is insufficient for claiming its widespread use. Second, the computer-based format of the DA might not be ideal for older patients. However, the proportion of COPD patients who are computer literate should be on the rise. Third, the DA does not individualize the risk of developing specific outcomes as in other DAs . We would integrate such function when the necessary statistical prediction models become available.
Other DA developers have also described the challenge of how to communicate risk to patients [24, 26]. While the literature suggests that different presentation formats lead to different decisions , we do not know which format promotes decisions most consistent with patient values and preferences. An international series of randomized trials (Health Information Project: Presentation Online or HIPPO) are currently underway to try to answer that question .
Wilson et al. developed a DA to assist patients with COPD in advance planning for life-threatening exacerbations of their disease . For patients participating in an evaluation study of the decision aid, the burden of treatment (mechanical ventilation in that case) was also an important consideration in making the decision. In addition, about a quarter of patients in that study did not completely comprehend the DA suggesting that this relatively older population might find it challenging to use decision support tools.
This DA may benefit patients with a baseline uncertainty about their choice, similarly to findings in studies of other DAs . Patients who have strong prior preference may still benefit from the medical information the DA provides. The DA will also benefit patients who want to be involved in decision making given patients vary in their preferences for such involvement .
We are planning to conduct a pragmatic clinical trial evaluating the impact of the decision aid on decision processes and decision quality . In that trial we intend to compare different formats of the DA (computer based, paper based) in order to identify the most cost effective option . The DA presents an opportunity to study different ways of presenting information and of eliciting values and evaluate their effect on the decision making process comparatively. It can also serve as a template for the development of other DAs related to emerging COPD treatments that involve a benefit risk tradeoff (e.g. protease inhibitors).
The Decision Aid for making decisions about using inhaled steroids in COPD (DA) is not a substitute for medical advice, examination, diagnosis treatment or judgment of a physician or health care professional. If you have any concerns about your health, talk to a doctor. Also, do not disregard or delay seeking medical advice because of something you read on the DA. The information found on the DA is to be used solely for informational purposes. Additionally, in spite of our best efforts, the information in the DA may become out of date over time. The DA team accepts no liability for the accuracy or completeness or use of, nor any liability to update, the information or materials provided in the DA.
Decision aid (DA)
Chronic Obstructive Pulmonary Disease (COPD)
Health related quality of life (HRQL)
Ottawa Decision Support Framework (DSF)
International Patient Decision Aid Standards (IPDAS) Collaboration
The work was perfomed at the State University of New York at Buffalo and the Buffalo Veterans Affairs Medical Center. We would like to thank Ms. Jenny Luk and Mr. Thomas Kappus for developing the platform of the DA . We would like to thank Drs. Amiram Gafni, Cathy Charles, and Annette O'Connor for their valuable feedback during the development of the decision aid. The Graduate Medical Education office of the State University of New York at Buffalo funded this study through an EBM/QI award. Investigators received salary support from institutional sources. This work was supported (in part) by the Office of Research and Development, Medical Research Service, Department of Veterans Affairs.
- Deyo RA: A key medical decision maker: the patient. BMJ. 2001, 323 (7311): 466-467. 10.1136/bmj.323.7311.466.PubMed CentralView ArticlePubMed
- Szabo E, Moody H, Hamilton T, Ang C, Kovithavongs C, Kjellstrand C: Choice of treatment improves quality of life. A study on patients undergoing dialysis. Archives of Internal Medicine. 1997, 157 (12): 1352-1356. 10.1001/archinte.157.12.1352.View ArticlePubMed
- Kaplan SH, Greenfield S, Ware JE: Assessing the effects of physician-patient interactions on the outcomes of chronic disease.[erratum appears in Med Care 1989 Jul;27(7):679]. Medical Care. 1989, 27 (3 Suppl): S110-27. 10.1097/00005650-198903001-00010.View ArticlePubMed
- Stewart MA: Effective physician-patient communication and health outcomes: a review.[comment]. CMAJ Canadian Medical Association Journal. 1995, 152 (9): 1423-1433.PubMed CentralPubMed
- Levine MN, Gafni A, Markham B, MacFarlane D: A bedside decision instrument to elicit a patient's preference concerning adjuvant chemotherapy for breast cancer.[comment]. Annals of Internal Medicine. 1992, 117 (1): 53-58.View ArticlePubMed
- O'Connor AM: Consumer/patient decision support in the new millennium: where should our research take us?. Canadian Journal of Nursing Research. 1997, 29 (3): 7-19.PubMed
- O'Connor AM, Stacey D, Entwistle V, Llewellyn-Thomas H, Rovner D, Holmes-Rovner M, Tait V, Tetroe J, Fiset V, Barry M, Jones J: Decision aids for people facing health treatment or screening decisions. Cochrane Database of Systematic Reviews. 2006, 4:
- Murray E, Burns J, See Tai S, Lai R, Nazareth I: Interactive Health Communication Applications for people with chronic disease. Cochrane Database of Systematic Reviews. 2006, 4:
- World Health Organization: The world health report 2003. Shaping the future. 2003, Geneva, Switzerland
- 2004 NHLBI Morbidity and Mortality Chartbook. 2004, Bethesda, Maryland , The National Heart, Lung, and Blood Institute
- Murray CJ, Lopez AD: Evidence-based health policy--lessons from the Global Burden of Disease Study.[comment]. Science. 1996, 274 (5288): 740-743. 10.1126/science.274.5288.740.View ArticlePubMed
- Alsaeedi A, Sin DD, McAlister FA: The effects of inhaled corticosteroids in chronic obstructive pulmonary disease: a systematic review of randomized placebo-controlled trials. The American Journal of Medicine. 2002, 113 (1): 59-65. 10.1016/S0002-9343(02)01143-9.View ArticlePubMed
- Stanbrook MB, Juurlink DN: A preliminary meta-analysis of long-term inhaled steroids for stable chronic obstructive pulmonary disease. Eur Respir J. 2001, 18 Suppl 33: 486S-
- O'Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, McPherson R, Bunn H, Graham I, Drake E: A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation.[see comment]. Patient Education & Counseling. 1998, 33 (3): 267-279. 10.1016/S0738-3991(98)00026-3.View Article
- The Ottawa Personal Decision Guide (OPDG). [http://decisionaid.ohri.ca/docs/OPDG/OPDG.pdf]
- Meleis AI: Theoretical Nursing: Development and Progress . 1997, Philadelphia , Lippincott, 3rd ed
- Spencer S, Calverley PMA, Sherwood Burge P, Jones PW: Health Status Deterioration in Patients with Chronic Obstructive Pulmonary Disease. Am J Respir Crit Care Med. 2001, 163 (1): 122-128.View ArticlePubMed
- Jones A, Fay JK, Burr M, Stone M, Hood K, Roberts G: Inhaled corticosteroid effects on bone metabolism in asthma and mild chronic obstructive pulmonary disease [Systematic Review]. Cochrane Database of Systematic Reviews. 2006, 1:
- O'Connor AM: Validation of a decisional conflict scale. Medical Decision Making. 1995, 15 (1): 25-30. 10.1177/0272989X9501500105.View ArticlePubMed
- Decision Aid for COPD patients considering inhaled steroid therapy. [http://www.predictonline.com/copd]
- Charles C, Gafni A, Whelan T: Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). Social Science & Medicine. 1997, 44 (5): 681-692. 10.1016/S0277-9536(96)00221-3.View Article
- Gafni A, Charles C, Whelan T: The physician-patient encounter: the physician as a perfect agent for the patient versus the informed treatment decision-making model.[see comment]. Social Science & Medicine. 1998, 47 (3): 347-354. 10.1016/S0277-9536(98)00091-4.View Article
- Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T, The International Patient Decision Aids Standards C: Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. 2006, 333 (7565): 417-
- Feldman-Stewart D, Brundage MD: Challenges for designing and implementing decision aids. Patient Education and Counseling. 2004, 54 (3): 265-273. 10.1016/j.pec.2003.09.007.View ArticlePubMed
- Colombet I, Dart T, Leneveut L, Zunino S, Menard J, Chatellier G, for the EsPe RG: A computer decision aid for medical prevention: a pilot qualitative study of the Personalized Estimate of Risks (EsPeR) system. 2003, 3 (1): 13-
- Fortin J, Hirota L, Bond B, O'Connor A, Col N: Identifying patient preferences for communicating risk estimates: A descriptive pilot study. BMC Medical Informatics and Decision Making. 2001, 1 (1): 2-10.1186/1472-6947-1-2.PubMed CentralView ArticlePubMed
- Trevena LJ, Davey HM, Barratt A, Phyllis B, Caldwell P: A systematic review on communicating with patients about evidence. Journal of Evaluation in Clinical Practice. 2006, 12 (1): 13-23. 10.1111/j.1365-2753.2005.00596.x.View ArticlePubMed
- Montori VM, Carling C, Schünemann HJ, Herrin J, Dyrnes JA, Treweek S, Kristoffersen DT, Akl EA, Guyatt GH, Dvereaux PJ, Oxman AD: We need more evidence of effectiveness about ways to communicate risk to patients - a proposal. BMJ. 2003
- Wilson KG, Aaron SD, Vandemheen KL, Hebert PC, McKim DA, Fiset V, Graham ID, Sevigny E, O'Connor AM: Evaluation of a decision aid for making choices about intubation and mechanical ventilation in chronic obstructive pulmonary disease. Patient Education & Counseling. 2005, 57 (1): 88-95. 10.1016/j.pec.2004.04.004.View Article
- Goel V, Sawka CA, Thiel EC, Gort EH, O'Connor AM: Randomized trial of a patient decision aid for choice of surgical treatment for breast cancer. Medical Decision Making. 2001, 21 (1): 1-6.View ArticlePubMed
- Brundage MD, Feldman-Stewart D, Cosby R, Gregg R, Dixon P, Yousse Y, Davies D, Mackillop WJ: Phase I study of a decision aid for patients with locally advanced non-small-cell lung cancer. Journal of Clinical Oncology. 2001, 19 (5): 1326-1335.PubMed
- O'Cathain A, Thomas KJ: Evaluating decision aids--where next?. Health Expectations. 2004, 7 (2): 98-103. 10.1111/j.1369-7625.2004.00258.x.View ArticlePubMed
- Liu J, Wyatt J, Altman D: Decision tools in health care: focus on the problem, not the solution. BMC Medical Informatics and Decision Making. 2006, 6 (1): 4-10.1186/1472-6947-6-4.PubMed CentralView ArticlePubMed
- Thomas Kappus: Cherry Web Design. [http://www.cherryweb.com/]
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/7/12/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.