- Open Access
“Many miles to go …”: a systematic review of the implementation of patient decision support interventions into routine clinical practice
BMC Medical Informatics and Decision Makingvolume 13, Article number: S14 (2013)
Two decades of research has established the positive effect of using patient-targeted decision support interventions: patients gain knowledge, greater understanding of probabilities and increased confidence in decisions. Yet, despite their efficacy, the effectiveness of these decision support interventions in routine practice has yet to be established; widespread adoption has not occurred. The aim of this review was to search for and analyze the findings of published peer-reviewed studies that investigated the success levels of strategies or methods where attempts were made to implement patient-targeted decision support interventions into routine clinical settings.
An electronic search strategy was devised and adapted for the following databases: ASSIA, CINAHL, Embase, HMIC, Medline, Medline-in-process, OpenSIGLE, PsycINFO, Scopus, Social Services Abstracts, and the Web of Science. In addition, we used snowballing techniques. Studies were included after dual independent assessment.
After assessment, 5322 abstracts yielded 51 articles for consideration. After examining full-texts, 17 studies were included and subjected to data extraction. The approach used in all studies was one where clinicians and their staff used a referral model, asking eligible patients to use decision support. The results point to significant challenges to the implementation of patient decision support using this model, including indifference on the part of health care professionals. This indifference stemmed from a reported lack of confidence in the content of decision support interventions and concern about disruption to established workflows, ultimately contributing to organizational inertia regarding their adoption.
It seems too early to make firm recommendations about how best to implement patient decision support into routine practice because approaches that use a ‘referral model’ consistently report difficulties. We sense that the underlying issues that militate against the use of patient decision support and, more generally, limit the adoption of shared decision making, are under-investigated and under-specified. Future reports from implementation studies could be improved by following guidelines, for example the SQUIRE proposals, and by adopting methods that would be able to go beyond the ‘barriers’ and ‘facilitators’ approach to understand more about the nature of professional and organizational resistance to these tools. The lack of incentives that reward the use of these interventions needs to be considered as a significant impediment.
The difficulty of translating knowledge into practice is well established and is a familiar phenomenon to researchers who promote the adoption of patient decision support interventions (DESIs) [1, 2]. Two decades of research has established the positive effect of using these interventions; patients gain knowledge, better understanding of probabilities and increased confidence in decisions .
The policy context has gradually become much more supportive in recent years. In the US, the 2010 Affordable Care Act (US)  was explicit about the promotion of shared decision making (SDM) and the use of DESIs. Some states have passed legislation supporting their use . Similarly in the UK, SDM has been at the center of policy developments  and investments have been made in the development of online DESIs . Canada is supporting province-wide work in the use of DESIs in Saskatchewan . Many other countries are alert to the benefits and are considering policy developments in this area .
Yet, despite these policy developments and the existence of over 80 randomized controlled trials (RCTs) that have demonstrated the efficacy of these interventions , their adoption into mainstream clinical practice has yet to be established, and their impact when used in routine workflows requires evaluation. There are reports of early implementation efforts in the field but many are not yet published in the peer-reviewed literature . For over a decade, the Dartmouth-Hitchcock Medical Center in New Hampshire, has routinely provided many patients with DESIs (DVDs and booklets) through their Center for Shared Decision Making , and Group Health in Seattle has reported organization-wide adoption of DESIs for selected conditions [12, 13]. However, these well-known settings remain isolated examples of adoption. Though there are many who develop and evaluate these tools in academic settings, no studies of sustained wide-scale adoption have been reported.
In 2006, Gravel described clinicians’ reluctance to use patient DESIs because they did not believe that they were applicable to their patients and clinical situations . Légaré examined 6764 titles and abstracts and analyzed five RCTs , concluding that the promotion of SDM may depend on training health care professionals and the adoption of patient targeted DESIs . A conceptual analysis using the normalization process model highlighted some of the intra-organizational issues that might underlie the difficulties that are being experienced .
The stimulus for this review arose from work being undertaken by the International Patient Decision Aid Standards (IPDAS) Collaboration, which has produced a checklist  and an instrument to assess the quality of these interventions . The IPDAS Collaboration initiated a review of its quality dimensions in 2010. As part of this work, we wanted to know whether we could identify evidence to inform recommendations about how best to implement patient DESIs into practice. We wanted to reflect the increasing emphasis being given to delivery research encompassing implementation or improvement science . Pronovost highlights an issue that is becoming of central importance for policy makers – to examine why interventions that have positive effects for patients under controlled conditions do not become established in routine settings . To address this gap in knowledge, the aim of this review was to search for and analyze studies that investigated the success levels of strategies or methods where attempts were made to implement patient-targeted DESIs into routine clinical settings.
We undertook a systematic review using the following definitions and approach to search, selection, and data processing.
Definition of implementation
This review is focused on work designed to implement patient DESIs into routine clinical settings. We adopted the following definitions: “… implementation is the constellation of processes intended to get an intervention into use within an organization”  and “… implementation is the critical gateway between an organisational decision to adopt an intervention and the routine use of that intervention, i.e., the transition period in which targeted stakeholders become increasingly skillful, consistent and committed in their use of an intervention” . We are aware that the nature of patient DESIs can vary . We focus on the following types of DESIs in this review: 1) brief tools designed for use in synchronous encounters (face-to-face or mediated by other means) and 2) more extensive tools (booklet, video, DVD, or websites) that clinicians recommend patients to use, either before or after clinical encounters.
An electronic strategy was devised in collaboration with an information scientist (MM) and adapted for the following databases (1947- 24 January 2012): ASSIA, CINAHL, Embase, HMIC, Medline, Medline-in-process, OpenSIGLE, PsycINFO, Scopus, Social Services Abstracts, and the ISI Web of Science (Science Citation Index Expanded, Social Science Citation Index, and ISI Proceedings); see the Additional file 1, Appendix 1. Specific author searches were performed on the following researchers: M. Holmes-Rovner, K. R. Sepucha, J. Belkora, D. Frosch and D. Stacey. In addition, we used a range of “snowballing” techniques to increase the sensitivity of the search, including reference list follow up, contact with subject experts, and searching the content tables of relevant journals. We used Google Scholar and also searched the King’s Fund website. Articles included in a review of strategies to implement SDM were also considered . Research colleagues were alerted to the review using two electronic networks, e.g., the SDM listserve (n = 470), and the SDM Facebook group members (n = 346).
Inclusion and exclusion criteria
Studies published in peer-reviewed journals were considered if they reported on the use of methods to promote the use of patient DESIs in routine practice. Studies were included if they assessed barriers to implementation and/or investigated the process of introducing organizations to the potential use of these interventions. RCTs that studied implementation strategies were included, provided their outcome measurements included assessments of whether these interventions became integrated into routines, at the system level or equivalent. All health care settings and all patient groups were considered, including systems where patients were directed to access DESIs by contacting a telephone call-center or using the web. No date or language restrictions were used. Studies were excluded if they did not attempt to implement DESIs in routine practice, if their sole aim was to measure the effect of DESIs at the patient level, or if they evaluated more general interventions to “activate” patients.
Study identification, data extraction, and analysis
Search outputs were merged and duplicates were removed. Titles and abstracts were assessed independently by two reviewers and disagreement was resolved by discussion. Data extraction forms were piloted and adapted. Data from each publication were extracted, even if articles reported the same study. The following fields were used: study identifiers, study type (RCT, quasi-experimental, observational, quality improvement report, case study report, other), intervention or implementation strategy, research method, country and study setting, underpinning implementation conceptual framework, health care delivery funding model (general taxation, voluntary or private insurance, other), groups described (implementation group, professional group, patient group), study purpose, duration, funder, incentives for patients or professionals, organizational level (microsystem or team, department, institution), DESI type, point at which the DESI is introduced to the patient (e.g., before, during, or after the clinical encounter), method of distribution. Data were also extracted on implementation outcomes, including the number of patients who were eligible, referred to or provided with DESIs, used DESIs and were seen by a health professional after using DESIs. Finally, data about outcomes related to professionals and systems, e.g., views, barriers, and facilitators were extracted. Independent data extractions, completed by IS and CT, were compared and discussed. Disagreements resolved by discussion with GE. Each study was summarized, and a descriptive synthesis of the results was produced. Our stated goal was to provide a narrative review and we therefore did not set out to formally assess study quality.
Assessment of implementation level
Each study was assessed independently by GE and IS and categorized according to the intervention described and the level of implementation achieved, using an adapted model of implementation; see Table 1[21, 22]. Disagreements were resolved by discussion.
Databases searches in July 2011 and January 2012 generated 4911 abstracts. Four hundred and eleven (411) additional abstracts were identified using other sources. After removing duplicates, 2848 abstracts remained. Examining Légaré’s review of interventions to implement SDM  did not lead to further study inclusion. After independent review by IS, CT, and GE, 51 studies were retained for further discussion by two raters (IS and GE). After examining full-text articles, 17 were retained for data extraction; see the flow diagram in Figure 1. A total of 34 studies were excluded at this stage. Further details of the studies excluded are provided in Table 2.
Overview of studies
The studies are summarized in Additional files 2 and 3, Tables S1 and S2. The majority of studies included used mixed methods (n = 11). Three studies used qualitative methods [23–25], and three relied on quantitative methods [26–28]. Eleven studies were based in the US and two in the UK [23, 29]. Four studies were based in call-centers (three in Canada [27, 30, 31] and one in Australia ). Implementation was studied in both primary and secondary care settings, often involving multiple professions. Decision support for “screening” tests was mostly based in primary care or in internal medicine organizations. Clinical topics were varied, with several studies on breast and prostate cancer. Notwithstanding their common focus, there was significant diversity in both approach and evaluation. Eight of the 17 studies had been supported by the Informed Medical Decisions Foundation (IMDF).
Of the 17 studies, few describe an explicit implementation framework as the basis of their evaluations. Stacey cites the Ottawa model of research use in four similar studies [27, 30–32], a model based on knowledge translation . Roger’s “theory of innovation diffusion” is cited by Feibelman . Holmes-Rovner  and Belkora  use a logic model as the basis for their evaluations.
Of the 17 studies, six were based on recruiting organizations at an institutional level and eight at a team or department level. Evaluation was often based on counts of the number of DESIs given to patients and counts of patient use based on follow-up surveys. Studies in nurse-led call-centers used training events and simulated patient callers to assess professional willingness to use patient DESIs.
Almost all of the studies used a “referral” model of DESI implementation, where patients were either sent the DESI by mail and asked to view it, or were directed to use the DESI (at home or in clinic) by either the clinician or another member of the clinical team. Most studies reported difficulties in operationalizing the referral model. One study compared different methods of delivering DESIs to patients eligible for a preventive-type decision (e.g., colorectal cancer screening) . The authors found that systematic automated delivery was most efficient in reaching the greatest number of eligible patients, although it led to 20% of patients being inappropriately offered the intervention . Irrespective of delivery mode, the patient viewing rate was estimated to be 25% of those sent out . Belkora’s approach of getting pre-medical students to coach patients to list questions and use DESIs ahead of clinical encounters is a variant of the referral method, and relies on the identification of eligible patients ahead of encounters with clinicians [36, 37]. All methods required organizational commitment. Only one study reported implementation costs, using estimates of the staff time used to identify patients .
The existence of barriers
The dominant theme in a majority of the studies was the existence of barriers to efficient delivery and, therefore, implementation. Stacey , Feibelman , and Frosch  reported professionals’ attitudes and their call for more training in how to use decision support and undertake SDM [27, 30–32]. There are also reports that clinicians may not trust or agree with the content of DESIs [23, 34, 38]. Some professionals were reported to hold the view that patients did not want decisional responsibility when facing difficult diagnoses  and that DESIs were in “competition” with other information designed for patients, suggesting that the intended aim of the DESIs, (i.e., to support patients in engaging in decisions), was not always understood [23, 31, 34].
Studies also reported that clinicians did not view the task of referring patients to use DESIs as part of their role, often citing competing demands and time pressure as the main reason why they could not incorporate this task into their usual practice [23, 24, 26, 31, 34, 36–40]. As Bracket reports, when clinicians were responsible for identifying patients, distribution of DESIs failed because they were “distracted by other duties” . Frosch  and Uy  describe two such studies, characterized essentially by implementation failure, particularly in organizations where team work was poor. One study illustrated this disinterest by using a modest financial incentive to encourage DESI distribution to patients; although effective while in operation, this strategy had no lasting impact as distribution ceased completely once the incentive ceiling had been met .
The studies demonstrate significant gaps between those patients who were deemed eligible, those who are successfully provided with the tools, and those who made use of them [26, 28, 34, 38–40]. Patient-level measures were, for the most part, not reported and were not the focus of this review.
To overcome the problem of competing demands and low prioritization, system-based approaches were tested and found to be more successful [26, 28, 36, 37]. However, system-based approaches rely on clinical problems where patients can be identified ahead of visits to the clinic. In situations where patients can potentially be identified ahead of clinic visits, logistical problems were reported. Mailing DESIs to patients will only be effective if patients use them. Brackett reported viewing rates of 25% , and, in a referral model, Uy reports 37% . Inviting patients to view the DESIs in-clinic prior to a visit requires space, equipment, and a well-organized scheduling system. All require organizational commitment. Call-center settings also report organizational tension, notably a concern that call-handling efficiency might be disrupted by the adoption of decision support protocols .
Some studies report factors that facilitated the use of DESIs. The provision of training and skills development for providers [30, 31, 35], and the identification of a clinical champion, especially in a leadership position, were important positive factors [25, 40]. However, the most often cited predictor of success was the introduction of a system where eligible patients were systematically identified [26, 40], or supported to use DESIs ahead of relevant clinical consultations [36, 37]. In other words, methods of distribution that did not to rely on clinicians to initiate access to these tools proved to be the most effective by far.
Levels of implementation achieved
The levels of DESI adoption achieved were generally framed by the studies as being “less than expected”. However, the studies did not explicitly report whether or not sustained use of DESIs had been achieved, although testing “feasibility” was often the primary aim and reported early stages in learning about the potential use of these tools. Nevertheless, the implicit goal in most studies was to encourage the adoption of patient DESIs and so it remains of interest to assess the outcomes using an implementation model; see Table 1. We do acknowledge that lack of detail and data made it difficult to assess the “degree of implementation” achieved; see Additional file 3, Table S2.
Judged against the implementation model, 10 of the 17 studies were categorized as achieving “insight” (see Additional file 3, Table S2), four achieved a level of “change” [26, 28, 34, 36], and none of the studies indicated that organizations had been able to achieve “maintenance” levels, where DESIs were in sustained use. This may be due to the barriers identified in the studies, which contributed to recruitment patterns that showed low interest in participation and in less-than-anticipated distribution of these interventions to patients.
Despite the increasing interest in moving patient decision support interventions from the world of randomized trials to that of routine settings, this review points to major implementation challenges. There are data indicating consistent positive patient outcomes, such as gain in knowledge, reported in efficacy trials . However, despite these results, there is scarcely any evidence of sustainable adoption at organizational levels. The studies reported here paint a picture of professional indifference and organizational inertia, and where other priorities take precedence. Many of the barriers are similar to those encountered in other attempts to improve practice performance, where other competing priorities take precedence and where uncertainty about the added value of the proposed intervention favors the status quo . Note that the organizations in these studies were willing volunteers and so implementation might be even more difficult in other settings. Although many countries are considering SDM in their policy developments, most of the implementation work to date has been located in North America. Ten studies were based in the US and three in Canada, illustrating the limited spread to areas beyond North America . The majority of the work was conducted with limited resources in comparison to research funded by mainstream sources, such as the National Institutes for Health, and so in appraising these studies we need to recognize the constraints imposed by these limitations.
The studies do, however, reveal issues that are specific to the challenge of implementing patient DESIs. Reliance on clinicians to refer patients to these tools leads to limited utilization, and so using system-based approaches, where feasible, may help reach more patients. Unfortunately, system approaches rely on identifying eligible patients ahead of visits and this task is only possible for a limited number of conditions. Even when this is feasible, logistical and infrastructure challenges still impede integration into practice. When patients present with undifferentiated problems, identifying their decision support needs ahead of a visit may be impossible. This issue limits the scope for studies that adopt a referral model; most are based on clinical issues where prior identification is possible, e.g., invitations for screening and prevention. Yet, even in secondary care where it is often possible to predict the clinical decisions that will be needed, the process of ensuring patients use DESIs ahead of encounters is a challenge because the windows of opportunity are often short. Ultimately, the studies indicate that this degree of capital and logistical infrastructure is challenging to initiate and maintain and will require sustained investment [24, 28, 34, 36, 37, 40]. These issues also make the limits of system-based approaches apparent and highlight the fact that referral by clinicians at the point of care will continue to be necessary for many clinical issues for which decision support is available.
All the included studies use a “referral model” of DESI dissemination whereby practitioners or their support staff identified patients eligible for decision support. The referral model proposes that these tools are “adjuncts” that support SDM, when used ahead of visits, or shortly afterwards . However, the concept that these tools are positively viewed as “adjuncts” by clinicians does not seem to be supported in practice. Many of the studies report that professionals distrust the content of the tools, question their evidence-base, believe that they do not reflect “local” data, think that patients will decline to take part in decisions and, critically, that offering options is not what they would advocate from a “best practice” perspective. These findings suggest that the reluctance to prioritize the use of DESIs might lie deeper than a general resistance to change. The referral model might be based on assumptions about their contribution that is not shared by front-line clinicians , a suggestion we discuss further below. An alternative model where SDM is initiated by the practitioner in the space of clinical encounters, using briefer DESIs to catalyze dialogue about options, which in turn lead to the use of more extensive tools , does not seem to have been extensively investigated, although a few trials exist [45, 46].
Although many barriers to implementation were described (Additional file 3, Table S2), these were seldom examined in depth, with the exception of three studies that employed qualitative interviews [23, 34, 25]. Additional insights might have been gained if more studies had explored the views of professionals regarding the use of DESIs and specifically about their impact on practice workflows.
Strengths and weaknesses of the study method
The search strategy was developed in consultation with an information scientist and piloted before application to multiple electronic databases. We may have reported work as three separate studies [27, 30, 31] which should be viewed as a single study, but we did so because different methods were reported. We deliberately excluded work from conference proceedings and non-peer reviewed material and did not contact authors of included studies. The review does not attempt to pool the data from the studies nor assess their quality: the methods and results were too heterogeneous. The study team was experienced in the field and was familiar with the evidence-base. Dual independent review was accomplished at key stages of the review process. There was low inter-rater agreement on the first round of assessing implementation levels achievement and this required attention in a second round. The results were seldom organized in a way that assisted this assessment: more work is required to set clear criteria for assessing implementation attainment levels.
Relation to other literature
The challenge of implementing patient DESIs is already well documented [1, 2] and we also know that practitioners do not achieve SDM . However, we must be careful not to equate the successful introduction of DESIs into clinical pathways as automatically leading to SDM. For instance, Frosch found that the use of a prostate specific antigen DESI ahead of a clinical encounter led to less SDM if a patient was not in favor of screening . While we can be confident that these interventions have positive results at the patient level , we do not as yet fully understand their impact on clinician-patient dialogue. Other models where practitioners might use brief tools and take more responsibility for initiating the process of SDM face-to-face with patients deserve further investigation.
More use could have been made of developments in the evaluation of complex interventions , implementation, and evaluation studies . Realist evaluations provide a way to study why interventions that have good effect in some settings fail when attempts are made to introduce them in other clinical settings: context matters . Many opportunities exist to bring these worlds of inquiry to bear on how best to implement patient DESIs. Damschroder et al. provided a consolidated framework for advancing implementation science : a synthesis of 19 models that describes five domains, namely, intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Future studies should consider the reported utility of these conceptual frameworks to guide implementation.
The goal for this review was to make recommendations about how best to implement patient DESIs into practice. Having reviewed the existing studies, it seems too early for such recommendations. Perhaps the effort to implement was done too soon, ahead of any work done to achieve levels 1 and 2 of Grol’s model [21, 22] – “orientation” and “insight” – in the recruited organizations. Without these first steps, it is unlikely that level 3, “acceptance”, would have occurred, and so the motivation to use patient DESIs might have been absent. Although it would not be difficult for us to suggest general principles of successful adoption , we feel that it might be more helpful to emphasize that the specific underlying issues that militate against the use of patient DESIs and, more generally, limit the adoption of SDM, are under-investigated and under-specified.
However, we do have two substantive research recommendations. It would be helpful to have a framework for reporting these studies, based on the SQUIRE guidelines , adapted to cover the reporting of the patient identification processes, the numbers of patients eligible for specific DESIs (initial denominator), the inevitable attrition in numbers along the delivery pathway, the delivery mechanism, the evaluation of use by the patient and the impact on decision outcomes (process and quality). In addition, approaches not previously used in this field should be considered as a means to investigate and measure the challenges of implementing new delivery-systems . For instance, methods such as cognitive task analysis, ethnography and action research, tools to assess the “adaptive reserve’” of teams  or their “readiness for change” , are approaches that would pay more attention to the role of the participants in shaping and using the technologies , and how they fit into the demands of other technologies, such as the electronic medical record and demands for performance metrics. Amidst all of this will be the need to monitor which professional and team-related behaviors will be rewarded as health systems increasingly seek to ensure patients experience better quality of care . As a final comment, we need to acknowledge that all the existing studies operated in a policy context where no rewards or incentives existed to promote the use of patient decision support and were being done in parallel in a period where considerable resources were being invested in the adoption of electronic health care records. Paraphrasing Robert Frost, there are many miles to go before we sleep.
Gravel K, Légaré F, Graham I: Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals’ perceptions. Implement Sci. 2006, 1: 16-10.1186/1748-5908-1-16.
Légaré F, Ratté S, Stacey D, Kryworuchko J, Gravel K, Graham ID, Turcotte S: Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010, CD006732-
Stacey D, Bennett C, Barry M, Col N, Eden K, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Légaré F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011, CD001431-
Senate and House of Representatives: Patient Protection and Affordable Care Act. HR 3590. 2010, Washington
Washington State Legislature: Washington State Legislature. RCW 41.05.033 Shared Decision-making Demonstration Project — Preference-sensitive Care. 2007
Department of Health: Equity and Excellence: Liberating the NHS. 2010, London
Elwyn G, Coulter A, Laitner S, Walker E, Watson P, Thomson R: Implementing shared decision making in the NHS. BMJ. 2010, 341: c5146-10.1136/bmj.c5146.
Légaré F, Stacey D, Forest P-G, Coutu M-F: Moving SDM forward in Canada: milestones, public involvement, and barriers that remain. Z Evid Fortbild Qual. 2011, 105: 245-253. 10.1016/j.zefq.2011.04.011.
Härter M, van der Weijden T, Elwyn G: Policy and practice developments in the implementation of shared decision making: an international perspective. Z Evid Fortbild Qual. 2011, 105: 229-33. 10.1016/j.zefq.2011.04.018.
Informed Medical Decisions Foundation: Research and Implementation Report. 2011, Boston, Massachusetts
The Dartmouth Institute: Improving Value-Based Care and Outcomes of Clinical Populations in an Electronic Health Record System Environment. Technical Report. 2011, Hanover, New Hampshire
Hsu C, Liss D, Westbroo E, Arterburn D: Incorporating patient decision aids into standard clinical practice in an integrated delivery system. Med Decis Making. 2012, 33: 85-97.
Helping you make health care decisions anytime, anywhere. [https://www1.ghc.org/html/public/features/20120101-armstrong.html]
Elwyn G, Légaré F, Van Der Weijden T, Edwards A, May C, van Der Weijden T: Arduous implementation: does the Normalisation Process Model explain why it’s so difficult to embed decision support technologies for patients in routine clinical practice. Implement Sci. 2008, 3: 57-10.1186/1748-5908-3-57.
Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T: Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006, 333: 417-23. 10.1136/bmj.38926.629329.AE.
Elwyn G, O’Connor AM, Bennett C, Newcombe RG, Politi M, Durand MA, Drake E, Joseph-Willams N, Khangura S, Anton Saarimaki A, Stephanie Sivell S, Stiel M, Bernstein SJ, Col N, Coulter A, Eden K, Härter M, Holmes Rovner M, Moumjid N, Stacey D, Thomson R, Whelan T, van der Weijden T, Edward A, O’Connor A, Bennett C, Newcombe R, Politi M, Durand MM, Drake E, et al: Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). PLoS One. 2009, 4: e4705-10.1371/journal.pone.0004705.
Pronovost PJ, Goeschel CA: Time to take health delivery research seriously. J Am Med Assoc. 2011, 306: 310-311. 10.1001/jama.2011.1015.
Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL: A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 14: 117-23.
Klein K, Sorra J: The challenge of innovation implementation. Acad Manage Rev. 1996, 21: 1055-1080.
Elwyn G, Frosch D, Volandes AE, Edwards A, Montori VM: Investing in Deliberation: A Definition and Classification of Decision Support Interventions for People Facing Difficult Health Decisions. Med Decis Making. 2010, 30: 701-11. 10.1177/0272989X10386231.
Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180 (6 Suppl): S57-60.
Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.
Stapleton H, Kirkham M, Thomas G: Qualitative study of evidence based leaflets in maternity care. BMJ. 2002, 324: 639-642. 10.1136/bmj.324.7338.639.
Frosch DL, Singer KJ, Timmermans S: Conducting implementation research in community-based primary care: a qualitative study on integrating patient decision support interventions for cancer screening into routine practice. Health Expect. 2011, 14 (Suppl 1): 73-84.
Uy V, May SG, Tietbohl C, Frosch DL: Barriers and facilitators to routine distribution of patient decision support interventions: a preliminary study in community-based primary care settings. Health Expect. 2012, 1-12. Epub ahead of print
Brackett C, Kearing S, Cochran N, Tosteson A, Blair Brooks W: Strategies for distributing cancer screening decision aids in primary care. Patient Educ Couns. 2010, 78: 155-16.
Stacey D, O’Connor AM, Graham ID, Pomey MP: Randomized controlled trial of the effectiveness of an intervention to implement evidence-based patient decision support in a nursing call centre. J Telemed Telecare. 2006, 12: 410-415. 10.1258/135763306779378663.
Miller KM, Brenner A, Griffith JM, Pignone MP, Lewis CL: Promoting decision aid use in primary care using a staff member for delivery. Patient Educ Couns. 2011, 86: 189-94.
Garden J: Implementing an informed decision making programme for urology patients. J Commun Healthc. 2008, 1: 297-310. 10.1179/cih.2008.1.3.297.
Stacey D, Graham I, O’Connor A, Pomey M: Barriers and facilitators influencing call center nurses’ decision support for callers facing values-sensitive decisions: a mixed methods study. Worldv Evid-Based Nu. 2005, 2: 184-195. 10.1111/j.1741-6787.2005.00035.x.
Stacey D, Pomey M, O’Connor A, Graham I: Adoption and sustainability of decision support for patients facing health decisions: an implementation case study in nursing. Implement Sci. 2006, 1: 17-10.1186/1748-5908-1-17.
Stacey D, Chambers SK, Jacobsen MJ, Dunn J: Professionals providing decision support for callers: an implementation study. Oncol Nurs Forum. 2008, 35: 961-969. 10.1188/08.ONF.961-969.
Graham ID, Logan J, O’Connor A, Weeks KE, Aaron S, Cranney A, Dales R, Elmslie T, Hebert P, Jolly E, Laupacis A, Mitchell S, Tugwell P: A qualitative study of physicians’ perceptions of three decision aids. Patient Educ Couns. 2003, 2055: 1-5.
Feibelmann S, Yang TS, Uzogara EE, Sepucha K: What does it take to have sustained use of decision aids? A programme evaluation for the Breast Cancer Initiative. Health Expect. 2011, 14 (Suppl 1): 85-95.
Holmes-Rovner M, Kelly-Blake K, Dwamena F, Dontje K, Henry RC, Olomu A, Rovner DR, Rothert ML: Shared Decision Making Guidance Reminders in Practice (SDM-GRIP). Patient Educ Couns. 2011, 85: 219-24. 10.1016/j.pec.2010.12.028.
Belkora JK, Teng A, Volz S, Loth MK, Esserman LJ: Expanding the reach of decision and communication aids in a breast care center: A quality improvement study. Patient Educ Couns. 2011, 83: 234-239. 10.1016/j.pec.2010.07.003.
Belkora JK, Loth MK, Volz S, Rugo HS: Implementing decision and communication aids to facilitate patient-centered care in breast cancer: a case study. Patient Educ Couns. 2009, 77: 360-8. 10.1016/j.pec.2009.09.012.
Holmes-Rovner MV, Valade D, Orlowski C, Draus C, Nabozny-Valerio B, Keiser S: Implementing shared decision-making in routine practice: barriers and opportunities. Health Expect. 2000, 3: 182-191. 10.1046/j.1369-6513.2000.00093.x.
Silvia K, Ozanne E, Sepucha K: Implementing breast cancer decision aids in community sites: barriers and resources. Health Expect. 2008, 11: 46-53. 10.1111/j.1369-7625.2007.00477.x.
Silvia KA, Sepucha KR: Decision aids in routine practice: lessons from the breast cancer initiative. Health Expect. 2006, 9: 255-264. 10.1111/j.1369-7625.2006.00393.x.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don’t physicians follow clinical practice guidelines? A framework for improvement. J Am Med Assoc. 1999, 282: 1458-65. 10.1001/jama.282.15.1458.
O’Connor A, Wennberg JE, Legare F, Llewellyn-Thomas HA, Moulton BW, Sepucha KR, Sodano AG, King JS, O’Connor AM: Toward the “tipping point”: decision aids and informed patient choice. Health Affair. 2007, 26: 716-25. 10.1377/hlthaff.26.3.716.
Caldon L, Collins K, Reed M, Sivell S, Austoker J, Clements A, Patnick J, Elwyn G, BresDex Group: Clinicians’ concerns about decision support interventions for patients facing breast cancer surgery options: understanding the challenge of implementing shared decision-making. Health Expect. 2010, 14: 133-146.
Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, Cording E, Tomson D, Dodd C, Rollnick S, Edwards A, Barry M: Shared decision making: a model for clinical practice. J Gen Intern Med. 2012, 27: 1361-1367. 10.1007/s11606-012-2077-6.
Edwards A, Elwyn G, Hood K, Atwell C, Robling M, Houston H, Kinnersley P, Russell I: Patient-based outcome results from a cluster randomized trial of shared decision making skill development and use of risk communication aids in general practice. Fam Pract. 2004, 21: 347-54. 10.1093/fampra/cmh402.
Mann DM, Ponieman D, Montori VM, Arciniega J, McGinn T: The Statin Choice decision aid in primary care: a randomized trial. Patient Educ Couns. 2010, 80: 138-40. 10.1016/j.pec.2009.10.008.
Couët N, Desroches S, Robitaille H, Vaillancourt H, Turcotte S, Elwyn G, Légaré F: Using OPTION to assess the level to which health professionals involve patients in decision-making: A systematic review. Health Expect. 2012, Epub
Frosch DL, Legare F, Mangione CM: Using decision aids in community-based primary care: An evaluation with ethnically diverse patients. Patient Educ Couns. 2008, 73 (3): 490-496. 10.1016/j.pec.2008.07.040.
Campbell N, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth A: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334: 455-459. 10.1136/bmj.39108.379965.BE.
Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50.
Pawson R, Tilley N: Realistic Evaluation. 1997, London: Sage Publications
Greenhalgh T, Robert G, Macfarlance F, Bate P, Kyriadkidou O, T G, G R, F M, P B, O K: Diffusion of innovations in service organizations: systematic review and recommendations. Millbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.
Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney SE: Publication guidelines for quality improvement studies in health care: evolution of the SQUIRE project. BMJ. 2009, 338: a3152-10.1136/bmj.a3152.
Alexander JA, Hearld LR: Methods and metrics challenges of delivery-system research. Implement Sci. 2012, 7: 15-10.1186/1748-5908-7-15.
Nutting PA, Crabtree BF, Miller WL, Stange KC, Stewart E, Jaén C: Transforming physician practices to patient-centered medical homes: lessons from the national demonstration project. Health Affair. 2011, 30: 439-45. 10.1377/hlthaff.2010.0159.
Weiner BJ, Amick H, Lee S-YD: Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008, 65: 379-436. 10.1177/1077558708317802.
Greenhalgh T, Wieringa S: Is it time to drop the “knowledge translation” metaphor? A critical literature review. J Roy Soc Med. 2011, 104: 501-9. 10.1258/jrsm.2011.110285.
National Institute for Health and Clinical Excellence: Quality Standard for Patient Experience in Adult NHS Services. 2012, 2012, [http://Www.nice.org.uk/guidance/qualitystandards/patientexperience/Home.jsp]
Belkora JK, Loth MK, Chen DF, Chen JY, Volz S, Esserman LJ: Monitoring the implementation of Consultation Planning, Recording, and Summarizing in a breast care center. Patient Educ Couns. 2008, 73: 536-43. 10.1016/j.pec.2008.07.037.
Kotecha JA, Birtwhistle RV: Use of electronic medical records. Can Fam Physician. 2009, 55: 899-
Bhavnani V, Fisher B: Patient factors in the implementation of decision aids in general practice: a qualitative study. Health Expect. 2010, 13: 45-54. 10.1111/j.1369-7625.2009.00556.x.
Charles C, Gafni A, Whelan T: Self-reported use of shared decision-making among breast cancer specialists and perceived barriers and facilitators to implementing this approach. Health Expect. 2004, 7: 338-348. 10.1111/j.1369-7625.2004.00299.x.
Doran D, Carryer J, Paterson J, Goering P, Nagle L, Kushniruk A, Bajnok I, Clark C, Srivastava R: Integrating evidence-based interventions into client care plans. St Heal T. 2009, 143: 9-13.
Frosch DL, Mangione CM, Légaré F: Using decision aids in community-based primary care: a theory-driven evaluation with ethnically diverse patients. Patient Educ Couns. 2008, 73: 490-496. 10.1016/j.pec.2008.07.040.
Graham ID, Logan J, Bennett CL, Presseau J, O’Connor AM, Mitchell SL, Tetroe JM, Cranney A, Hebert P, Aaron SD: Physicians’ intentions and use of three patient decision aids. BMC Med Inform Decis. 2007, 7: 20-10.1186/1472-6947-7-20.
Hamann J, Cohen R, Leucht S, Busch R, Kissling W: Shared decision making and long-term outcome in schizophrenia treatment. J Clin Psychiat. 2007, 68: 992-997. 10.4088/JCP.v68n0703.
Lewis CL, Brenner AT, Griffith JM, Pignone MP: The uptake and effect of a mailed multi-modal colon cancer screening intervention: a pilot controlled trial. Implement Sci. 2008, 3: 32-10.1186/1748-5908-3-32.
Ossebaard HC, van Gemert-Pijnen JEWC, Sorbi MJ, Seydel ER: A study of a Dutch online decision aid for parents of children with ADHD. J Telemed Telecare. 2009, 16: 15-19.
Stacey D, Higuchi KAS, Menard P, Davies B, Graham ID, O’Connor AM: Integrating patient decision support in an undergraduate nursing curriculum: An implementation project. Int J Nurs Educ Scholarsh. 2009, 6: 10-11.
Stacey D, O’Connor AM, DeGrasse C, Verma S: Development and evaluation of a breast cancer prevention decision aid for higher-risk women. Health Expect. 2003, 6: 3-18. 10.1046/j.1369-6513.2003.00195.x.
Thistlethwaite J, Heal C, Tie RN, Evans R: Shared decision making between registrars and patients - Web based decision aids. Aust Fam Physician. 2007, 36: 670-672.
Towle A, Godolphin W, Grams G, LaMarre A: Putting informed and shared decision making into practice. Health Expect. 2006, 9: 321-332. 10.1111/j.1369-7625.2006.00404.x.
Watson DB, Thomson RG, Murtagh MJ: Professional centred shared decision making: patient decision aids in practice in primary care. BMC Health Serv Res. 2008, 8: 5-10.1186/1472-6963-8-5.
Hirsch O, Keller H, Krones T, Donner-Banzhoff N: Acceptance of shared decision making with reference to an electronic library of decision aids (arriba-lib) and its association to decision making in patients. An evaluation study. Implement Sci. 2011, 6: 70-10.1186/1748-5908-6-70.
Billings J: Promoting the dissemination of decision aids: an odyssey in a dysfunctional health care financing system. Health Affair. 2004, VAR128-VAR132. Suppl Web
Demilew J: Integrating MIDIRS “Informed Choice” leaflets into a maternity service. Informed Choice in Maternity Care. Edited by: Kirkahm M. 2004, Basingstoke: Palgrave Macmillan
Holmes-Rovner M, Gruman J, Rovner DR: Shared decision-making in the US--research & development outpaces delivery. Z Arztl Fortbild Qualitatssich. 2007, 101: 254-258. 10.1016/j.zgesun.2007.02.028.
Lenert L: Transforming healthcare through patient empowerment. St Heal T. 2010, 153: 159-75.
Lewis CL, Pignone MP, Lewis CL, Pignone MP: Promoting informed decision-making in a primary care practice by implementing decision aids. N C Med J. 2009, 70: 136-139.
Légaré F: Establishing patient decision aids in primary care: update on the knowledge base. 2008, 102: 427-430.
McCaffery K, Irwig L, Bossuyt P: Patient decision aids to support clinical decision making: evaluating the decision or the outcomes of the decision. Med Decis Making. 2007, 27: 619-625. 10.1177/0272989X07306787.
O’Connor A, Graham I, Visser A: Implementing shared decision making in diverse health care systems: the role of patient decision aids. Patient Educ Couns. 2005, 57: 247-249. 10.1016/j.pec.2005.04.010.
Pignone MP, Lewis CL: Using Quality Improvement Techniques to Increase Colon Cancer Screening. Am J Med. 2009, 122: 419-420. 10.1016/j.amjmed.2008.10.029.
Scott GC, Lenert LA: Extending contemporary decision support system designs to patient-oriented systems. Proc AMIA Symp. 1998, 376-380.
Sepucha K, Mulley AG: A perspective on the patient’s role in treatment decisions. Med Care Res Rev. 2009, 66 (1, Suppl): 53S-74S.
Sepucha K, Mulley A: Extending decision support: preparation and implementation. Patient Educ Couns. 2003, 50: 269-271. 10.1016/S0738-3991(03)00048-X.
Simmons M, Hetrick S, Jorm A: Shared decision-making: benefits, barriers and current opportunities for application. Australas Psychiatry. 2010, 18: 394-7. 10.3109/10398562.2010.499944.
Wen KY, Gustafson DH, Hawkins RP, Brennan PF, Dinauer S, Johnson PR, Siegler T, Wen KY, Gustafson DH, Hawkins RP, Brennan PF, Dinauer S, Johnson PR, Siegler T: Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model. 2010, 17: 707-713.
Wirrmann E, Askham J: Implementing Patient Decision Aids in Urology. 2006, Oxford
Vandemheen KL, Aaron SD, Poirier C, Tullis E, O’Connor A: Development of a decision aid for adult cystic fibrosis patients considering referral for lung transplantation. Prog Transplant. 2010, 20: 81-7.
We thank Alice Andrews and Dawn Carey of The Dartmouth Center for Health Care Delivery Science (TDC) for their comments on a draft of this manuscript, Aileen Lem also from TDC for her work proofing and organizing references, and Professors Hilary Llewellyn-Thomas and Robert Volk, IPDAS Update Coordinators, for their guidance.
No direct funding was received from any source to support this review.
Publication of this supplement was partially funded by an unrestricted grant from the Informed Medical Decisions Foundation. The remaining funding came from Trudy van der Weijden; the Department of Medical Psychology, Hamburg (Isabelle Scholl); and the Dartmouth Center for Health Care Delivery Science (Glyn Elwyn). Administrative and editorial support for this supplement was also provided by The University of Texas MD Anderson Cancer Center.
This article has been published as part of BMC Medical Informatics and Decision Making Volume 13 Supplement 2, 2013: The International Patient Decision Aid Standards (IPDAS) Collaboration’s Quality Dimensions: Theoretical Rationales, Current Evidence, and Emerging Issues. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcmedinformdecismak/supplements/13/S2.
The Informed Medical Decisions Foundation (IMDF) is a not-for-profit (501(c)(3)) private foundation that develops content for patient decision support tools and has a royalty arrangement with a for-profit company, Health Dialog. The tools are used as part of the services Health Dialog provides to consumers through health care organizations and employers. Glyn Elwyn, Carmen Lewis, and Dominick Frosch have received research funding from IMDF. Glyn Elwyn and Dominick Frosch have received travel support and honoraria from IMDF, and Richard Wexler receives salary as a Director from IMDF. Isabelle Scholl, Caroline Tietbohl, Mala Mann, Adrian Edwards, Catharine Clay, France Légaré, and Trudy van der Weijden declare that they have no competing interests.
GE and DF designed the review with support from MM, and IS; and AE. GE, DF, IS, CT, and MM were responsible for the search, selection and extraction processes. All other authors contributed to the review protocol and the coordination of the work. All authors read, contributed equally to, and approved the final manuscript.