This article has Open Peer Review reports available.
Impact of a decision aid on reducing uncertainty: pilot study of women in their 40s and screening mammography
© Scariati et al. 2015
Received: 22 January 2015
Accepted: 14 October 2015
Published: 10 November 2015
In 2009 the United States Preventive Services Task Force updated its breast cancer screening guidelines to recommend that average-risk women obtain a screening mammogram every two years starting at age 50 instead of annually starting at age 40. Inconsistencies in data regarding the benefit versus risk of routine screening for women less than 50-years-of-age led to a second recommendation – that women in their forties engage in a shared decision making process with their provider to make an individualized choice about screening mammography that was right for them. In response, a web-based interactive mammography screening decision aid was developed and evaluated.
The decision aid was developed using an agile, iterative process. It was further honed based on feedback from clinical and technical subject matter experts. A convenience sample of 51 age- and risk-appropriate women was recruited to pilot the aid. Pre-post decisional conflict and screening choice was assessed.
Women reported a significant reduction in overall decisional conflict after using the decision aid (Z = -5.3, p < 0.001). These participants also reported statistically significant reductions in each of the decisional conflict subscales: feeling uncertain (Z = -4.7, p < 0.001), feeling uninformed (Z = -5.2, p < 0.001), feeling unclear about values (Z = -5.0, p < 0.001), and feeling unsupported (Z = -4.0, p < 0.001). However, a woman’s intention to obtain a screening mammogram in the next 1-2 years was not significantly changed (Wilcoxon signed-rank Z = -1.508, p = 0.132).
This mammography screening decision aid brings value to patient care not by impacting what a woman chooses but by lending clarity to why or how she chooses it.
Concern and disagreement was voiced when the United States Preventive Services Task Force (USPSTF) updated its breast cancer screening guidelines in November 2009 [1–6]. The guidelines transitioned from recommending that average-risk women obtain a screening mammogram yearly starting at age 40 to now undergoing screening every two years starting at age 50 [7, 8]. In the absence of data to support the benefit versus harm of routine screening, average-risk women in their 40s were advised to engage in an individual shared decision making process with their provider to determine if screening was right for them [7, 8].
Shared decision making is a process where the patient and clinician share information with each other, assess evidence and values, and mutually agree upon a course of action. The goal is to create the activated patient - a patient who is well-informed about the benefits and harms of a particular issue and feels comfortable that her choice reflects the appropriate combination of clinical input, evidence and personal values [9, 10]. Shared decision making is ideal when the tradeoff between benefits and harms is either unclear or unknown.
A recently updated Cochrane review on decision making concluded that decision aids are better than usual care interventions in providing patients with knowledge and reducing conflict about making a decision . Patients have a more realistic expectation of benefits and harms as well as the values surrounding them. They also activate undecided or passive patients to make a decision. For example, exposure to these tools resulted in patients choosing more conservative surgery options and reduced prostate specific antigen (PSA) screening .
There are a wide variety of decision making resources that can be used to facilitate a shared decision making process. At one end of the spectrum, a decision aid can be a simple, patient-focused brochure that explains the benefits and harms of a specific procedure. On the other end of the spectrum, it can be a web-based, interactive tool that engages the patient to respond to specific questions while providing targeted information and feedback based on probabilistic models [12–14]. In this project the goal was development and evaluation of a web-based decision aid that helped average-risk women in their 40s understand, rank and sort their values regarding screening mammography. At the end of this process the woman was presented with a summary document intended to facilitate a shared decision making conversation between her and her provider.
This manuscript explores the decision aid development process, refinement through iterative feedback, and performance in a pilot cohort. The aims of this pilot study were 1) to explore the impact of a web-based patient decision aid on a woman’s decisional conflict about the screening mammography decision, and 2) to explore their values related to screening mammography through an explicit values-clarification exercise included in a patient decision aid.
Breast cancer is the most common cancer diagnosed in women and the second leading cause of cancer death . There is no effective way to prevent breast cancer which is why the appropriate application of screening mammography is critical. The benefits of having a screening mammogram must outweigh the harms of not having the test or of having a test result that is falsely positive. This is known as net benefit. Conflicting data about whether average-risk women in their 40s experience a net benefit from routine screening mammograms led the USPSTF to recommend that they engage in an individualized shared decision making process. The goal was to empower these women to make a screening decision that is right for them.
Decision aid description
The values clarification section was comprised of two exercises. First, the woman was asked to slide an indicator box on a series of scale bars (see Additional file 1) to reflect the importance of ten factors on her decision to having a screening mammogram: avoiding false positives, avoiding false negatives, peace of mind, catching cancer early, overdiagnosis, stress & fear, time & access, embarrassment & pain, radiation exposure and cost. The factors chosen for assessment reflected major concerns raised in the biomedical literature and vetted with subject matter experts, described in the Decision Aid Development section. The women could not add additional factors.
The goal was for the woman to interpret the information presented in light of her personal values and circumstances. For example, one questions asked was “Which is more important to you, having a positive test when cancer is present or avoiding a positive test when cancer is not present?” The far left hand side of the scale bar was labeled “Having a Positive Test When Cancer is Present” while the far right hand side of the scale was labeled “Avoiding a Positive Test When There is No Cancer”. The woman then moved the indicator box on the scale bar to the point that reflected her balance point in considering the risks versus benefits of these two possible outcomes.
Decision aid development
Several resources were leveraged for developing and refining the screening mammography decision aid throughout 2010 and into the first half of 2011. An extensive review of the biomedical literature was step one. This was used to determine the initial scope and content of the aid [7, 8, 17–19]. Several rounds of internal testing were conducted with informatics graduate students to assess the technical aspects and usability of the decision aid. Healthcare professional and graduate students also provided feedback on content, comprehensibility, length and adherence to privacy and security standards.
Before testing with patients, five subject matter experts from the USPSTF, National Cancer Institute (NCI), the Agency for Healthcare Research (AHRQ), the American Cancer Society (ACS) and the American College of Obstetricians and Gynecologists (ACOG) and five clinical experts in women’s health were interviewed for face validity and on their impression of and experience using the decision aid. The semi-structured interview questions probed issues such as whether the message for an ineligible (above-average-risk) woman was sensitive and encouraged her to follow-up with her own healthcare provider. The experts also identified ways to make the content and output useful for discussions with the woman’s healthcare provider.
This solicited feedback from subject matter and clinical experts during development was an unusual but valuable step in shaping this decision aid. It was key in honing tool content as well as raising and exploring unforeseen issues. Furthermore, it allowed for a better understanding of how to handle the epidemiologic divide that prevents the experts from agreeing on a single breast cancer screening recommendation.
Recommendations included replacing terms like “false negatives” with plain language such as, “results that say you don’t have cancer when you actually do.” Many experts also recommended enhancing decision tree diagrams with flash animations or explanatory text, and providing the user with hyperlinks to definitions of more complex words or potentially confusing concepts. Revisions were made to the decision aid to incorporate these suggestions.
The decision aid was password protected and accessible through web browsers including Mozilla Firefox and Microsoft Internet Explorer.
Ethics and consent
This study was approved by the OHSU Research Integrity Office (eIRB #7118). All enrolled women completed informed consent. For confidentiality reasons, only the group results are presented and no additional supplementary data are available to researchers.
Protocol and participants
In August 2011 social media (i.e., Facebook) and interpersonal networking (i.e., friend-to-friend) was leveraged to recruit women for this pilot project. Sixty-four women indicated their desire to participate in the pilot by sending an email to the research team. In response, each woman was provided with a username, password and detailed instructions for accessing the aid. Subject eligibility was determined through a computerized risk assessment algorithm (described below). Six women were ineligible due to age or were above-average breast cancer risk; five enrolled but did not log into the tool; and two logged into the tool but did not complete the entire process. The remaining 51 age-risk appropriate women test piloted the decision aid. They received a $15.00 Starbuck’s Card eGift by email as a token of appreciation.
Women accessed the risk assessment on a personal computer through the Internet with a username and password. Once in the website, each woman engaged in a series of risk stratification questions aimed at identifying and restricting women with an increased risk of developing breast from engaging with the decision aid . This algorithm included personal and family history of breast or ovarian cancer, genetic markers for breast cancer, current breast symptoms, or a prior history of radiation. Women with an above-average risk of developing breast cancer were directed to appropriate screening and follow-up in accordance with best practices. Average-risk women then moved on to use the decision aid.
Measures and analyses
Modified low-literacy decision conflict scale
Participants answered Yes, Unsure, or No to each of the following questions:
1. Do you know what mammography screening options are available to you?
2. Do you know the benefits of each option?
3. Are you clear about which benefits matter most to you?
4. Do you know the risks and side effects of each option?
5. Are you clear about which risks and side effects matter most to you?
6. Do you have enough support from others to make a choice?
7. Are you choosing without pressure from others?
8. Do you have enough advice to make a choice?
9. Are you clear about the best choice for you?
10. Do you feel sure about what to choose?
To further measure the specific impact of the decision aid on each woman’s decision making process, scores from the four subscales and summary scale of the low-literacy version of the DCS were calculated . For each of ten statements, e.g., “Do you know what your options are for breast cancer screening?”, the patient responds with “Yes” (zero points), “No” (four points), or “Unsure” (two points). The mean score of the questions was determined for each subscale (feeling uninformed; feeling uncertain, having unclear values; feeling unsupported) and multiplied by 25. The mean score of all questions was also determined and multiplied by 25 to create a summary score. Summary scores of zero suggest an overall good decision process (no decisional conflict); scores of 100 suggest a poor decision process (extremely high decisional conflict). Improvement was measured by reduction in scores. This instrument was completed by all participants prior to engaging with the content of the decision aid and after completing their interaction with it. This facilitated discrimination between patients who make decisions and patients who delay making decisions because of uncertainty [24, 25].
Sample size justification
Decisional conflict was the primary outcome assessed in this pilot study, and as such we looked to prior experimental studies to guide our plans regarding sample size. A similar pre-post study design, which evaluated a breast cancer prevention decision aid combined with counseling, enrolled 17 higher-risk women . That study reported a reduction in overall decisional conflict, but the reductions were not statistically significant (p > 0.05) in any of the subscales, possibly due to the study’s limited sample size. The decision aid in our present study was designed for average-risk women, and it was not clear to us whether our study’s participants would have similar baseline levels of decisional conflict to those observed by Stacey  among higher-risk women. As such, we took a conservative approach and planned to recruit 50 women to participate in this pilot study.
Statistical analyses were carried out using IBM SPSS Statistics 19 (IBM Corporation, Somers, NY, USA) between September 30 and November 1, 2011. Descriptive statistics were calculated for all variables of interest. Continuous measures were summarized using means and standard deviations. Categorical measures were summarized using counts and percentages. The two main outcomes of interest, intention to obtain a screening mammogram and decisional conflict, were measured in a pre-post fashion. Because these variables were not normally distributed, a Wilcoxon signed-rank test was used to assess significance. A significance level of 0.05 was used unless multiple comparisons were indicated. In the latter case a significance level of 0.01 or appropriate correction (i.e., Bonferroni) was used.
Demographic characteristics of pilot study participants (n = 51)
More than 1
10 K - <25 K
25 K - < 50 K
50 K - < 100 K
100 K or more
Prior False Positive Screen
When asked whether they planned to have a mammogram in the next 1-2 years, 42 women (82 %) said yes, 4 (8 %) were undecided and 5 (10 %) said no. At baseline, 13 women (25 %) experienced no decisional conflict (scored 0 for overall decisional conflict) and 6 (12 %) had some decisional conflict with scores between 1 and 25. Scores below 25 are associated with making decisions (O’Connor, decisional conflict manual, 2010). Ten women (21 %) had overall decisional conflict scores between 26 and 50; 14 (27 %) had had scores between 51 and 75; and 8 (16 %) had scores above 75. This suggests that the majority of women had scores over the threshold for making decisions and were likely to delay the decision .
Also at baseline, 45 women (88 %) indicated a belief that women in their 40s benefit from screening mammography and that the choice to have a screening mammogram should be something that they themselves decide (63 %) or a decision that is made together with their healthcare provider (37 %). No member of this cohort felt that a healthcare provider should make this decision for them or expressed uncertainty about who should make this choice.
Decisional conflict scale pre- and post-scores
Z = -5.3, p < 0.001
Z = -4.7, p < 0.001
Z = -5.2, p < 0.001
Z = -5.0, p < 0.001
Z = -4.0, p < 0.001
This pilot study of a breast cancer screening decision aid with a convenience sample of 51 age- and risk-appropriate women offers two main contributions. First, it demonstrates that decisional conflict about screening mammography may be significantly impacted by the use of a decision aid. Women in this pilot study felt more certain, better informed and better supported, and they demonstrated increased clarity of values in their decision making process. This finding is tempered by lack of a control condition and the fact that these women had no change in the intention to obtain a routine screening mammogram. This latter finding, while interesting, is not all together unexpected. Most (88 %) of the women in this sample held the baseline belief that women in their 40s benefit from screening mammography; 74 % had a prior mammogram; and 82 % planned to have a mammogram within the next year. This seems to reflect long-standing cultural and peer norms which one wouldn’t expect to shift readily or easily.
This absence of a change in intention to obtain a routine screening mammogram also raises the question of the clinical impact and value of this decision aid. Here we must be clear that the shared decision making process itself, initiated through this decision aid and independent of the final choice(s) made, has significant clinical value that should not be marginalized. This includes the benefits of patient engagement and satisfaction; standardization of best practice messaging; more realistic expectations of risks and harms; as well as a more efficient use of the clinician’s time.
The second contribution is the use of a values clarification technique involving rating the importance of selected factors that might impact the screening decision and then ranking those factors. More than 80 % of the women in this study ranked peace of mind and detecting a cancer early as the “most important” factors to consider when making a decision about screening mammography. This was followed by “most important” concerns around avoiding false negatives (41 %), avoiding false positive (31 %) and overdiagnosis (26 %). This seemed indicative of an understanding of these more nuanced terms as well as the risk-benefit associated with screening mammography. Less than 5 % of the women ranked cost as a “most important” factor. This may reflect the high income level of the group or the expanding knowledge that free screening mammography is readily available.
This pilot study contains limitations that can be lifted with future research. First, the decision aid was tested with a convenience sample of women who were predominantly white, well-educated and highly resourced. These women were not representative of the general population, and the findings from this study cannot be generalized. Second, the aid was available only in format requiring internet access. Users of iPads and smart phones were also excluded, though it should be noted that use of such devices was less common at the time the study was conducted than today. Finally, the aid may have been too long. During usability testing it took approximately 35 min to get through the entire decision aid.
The limitations identified in this pilot are now being addressed through a follow-on study funded by the McKesson Foundation’s Mobilizing For Health Grant Program. The decision aid has been redesigned as an app on a mobile device. The target audience for the app is low-income, average-risk women in their forties, who are not regularly screening and who seek care in rural clinics. As with this pilot, the women enrolled in the follow-on study also undergo a breast cancer risk assessment to confirm eligibility. Above-average-risk women are then given resources to help them obtain timely and appropriate follow-up screening, and average-risk women are invited to engage with the decision aid and make an informed choice based on their own preferences or priorities.
This breast cancer screening decision aid brought value to patient care not by impacting what a woman chose, but by impacting why or how she chose it. There are several ways to decrease conflict, including becoming informed about choices for screening; feeling supported in the screening decision; knowing personal priorities around the decision; and feeling certain about the decision. The decision aid described in this pilot study addressed all of these aspects of the decision making process.
A project of this magnitude doesn’t come to life without the passionate support and hard work of many people. With her statistical prowess and critical thinking, Jayashree Kalpathy-Cramer, PhD, MS shaped this project into so much more than it would have been otherwise. Heidi Nelson, MD, MPH was gracious in keeping the team updated on ongoing developments in the breast cancer screening evidence base. Patty Carney, who joined later in the project, offered her expertise on breast cancer screening and scholarly communication. Finally, none of this work would have been possible without the generous government funding provided by the National Library of Medicine training fellowship, Biomedical Informatics Research Training at Oregon Health & Science University, 5T15 LM007088 and funding provided by the McKesson Foundation Mobilizing for Health Grant Program.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Murphy AM. Mammography screening for breast cancer: a view from 2 worlds (Editorial). JAMA. 2010;303:166–7.View ArticlePubMedGoogle Scholar
- Woolf SH. The 2009 breast cancer screening recommendation of the US Preventive Services Task Force (Editorial). JAMA. 2010;303:162–3.View ArticlePubMedGoogle Scholar
- DeAngelis CD, Fontanarosa PB. U.S. Preventive Services Task Force and breast cancer screening (Editorial). JAMA. 2010;303:172–3.View ArticlePubMedGoogle Scholar
- Keen JD. Promoting screening mammography: insight or uptake? J Am Board Fam Med. 2010;23:775–82.View ArticlePubMedGoogle Scholar
- Hirsch BR, Lyman GH. Breast cancer screening with mammography. Curr Oncol Rep. 2011;13:63–70.View ArticlePubMedGoogle Scholar
- American Cancer Society. American Cancer Society responds to changes to USPSTF mammography guidelines. 2009. [Press release]. http://pressroom.cancer.org/index.php?s=43&item=201 (Accessed June 20, 2012).Google Scholar
- U.S. Preventive Services Task Force (USPSTF). Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2009;151:716–6.View ArticleGoogle Scholar
- Nelson HD, Tyne K, Bougatsos C, Chan BK, Humphrey L. Screening for breast cancer: an update for the U.S. Preventive Services Task Force. Ann Intern Med. 2009;151:727–37.View ArticlePubMedPubMed CentralGoogle Scholar
- Frosch DL, Elwyn G. I believe, therefore I do (Editorial). J Gen Intern Med. 2010;26:2–4.View ArticlePubMed CentralGoogle Scholar
- Kiviniemi MT, Hay JL. Awareness of the 2009 US preventive services task force guidelines in women ages 40–49 and 50. BMC Public Health. 2012;12:899.View ArticlePubMedPubMed CentralGoogle Scholar
- Stacey D, Légaré F, Col NF, Bennett CL, Barry MJ, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2014. doi:10.1002/14651858.CD001431.pub4.Google Scholar
- Elwyn G, O'Connor AM, Bennett C, Newcombe RG, Politi M, Durand MA, et al. Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument. PLoS ONE. 2009;4:e4705. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2649534. Accessed January 21, 2015.View ArticlePubMedPubMed CentralGoogle Scholar
- Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med. 2010;51:214–21.View ArticlePubMedPubMed CentralGoogle Scholar
- Joseph-Williams N, Evans R, Edwards A, Newcombe RG, Wright P, Grol R, et al. Supporting informed decision making online in 20 min: an observational web-log study of a PSA test decision aid. J Med Internet Res. 2010;12:e15.View ArticlePubMedPubMed CentralGoogle Scholar
- American Cancer Society. Breast cancer facts & figures. 2013. http://www.cancer.org/acs/groups/content/@epidemiologysurveilance/documents/document/acspc-030975.pdf. Accessed January 21, 2015.Google Scholar
- International Patient Decision Aids Standards (IPDAS) Collaboration [Document on the internet], http://ipdas.ohri.ca/IPDAS_checklist.pdf. Accessed January 21, 2015.
- Qaseem A, Snow V, Sherif K, Aronson M, Weiss KB, Owens DK. Screening mammography for women 40 to 49 years of age: a clinical practice guideline from the American College of Physicians. Ann Intern Med. 2007;146:511–5.View ArticlePubMedGoogle Scholar
- Armstrong K, Moye E, Williams S, Berlin JA, Reynolds EE. Screening mammography in women 40 to 49 years of age: a systematic review for the American College of Physicians. Ann Intern Med. 2007;146:516–26.View ArticlePubMedGoogle Scholar
- Amir E, Freedman OC, Seruga B, Evans D. Assessing women at high risk of breast cancer: a review of risk assessment models. J Natl Cancer Inst. 2010;102(10):680–91.View ArticlePubMedGoogle Scholar
- Scariati P. Making choices about breast cancer screening: a decision aid for women between the ages of 38 and 48. Oregon: OHSU; 2011. Unpublished master’s thesis.Google Scholar
- O'Connor AM. Validation of a decisional conflict scale. Med Decis Making. 1995;15:25–30.View ArticlePubMedGoogle Scholar
- Linder SK, Swank PR, Vernon SW, Mullen PD, Morgan RO, Volk RJ. Validity of a low literacy version of the decisional conflict scale. Patient Educ Couns. 2011;85:521–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Kryworuchko J, Stacey D, Bennett C, Graham ID. Appraisal of primary outcome measures used in trials of patient decision support. Patient Educ Couns. 2008;73:497–503.View ArticlePubMedGoogle Scholar
- O’Connor A. User manual—Decisional Conflict Scale (ten item question format) [document on the internet]. Ottawa: Ottawa Hospital Research Institute, 1993. updated 2010. http://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Decisional_Conflict.pdf. Accessed January 21, 2015.
- O’Connor A. User manual – Decision self-efficacy scale [document on the internet]. Ottawa: Ottawa hospital Research Institute, 1995a. http://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Decision_SelfEfficacy.pdf . Accessed January 21, 2015.
- Stacey C, O’Connor A, DeGrasse C, Verna S. Development and evaluation of a breast cancer prevention decision aid for higher risk women. Health Expect. 2003;6:3–18.View ArticlePubMedPubMed CentralGoogle Scholar