Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Ready for SDM: evaluating a train-the-trainer program to facilitate implementation of SDM training in Norway

BMC Medical Informatics and Decision Making volume 21, Article number: 140 (2021) Cite this article

Abstract

Background

Healthcare providers need training to implement shared decision making (SDM). In Norway, we developed “Ready for SDM”, a comprehensive SDM curriculum tailored to various healthcare providers, settings, and competence levels, including a course targeting interprofessional healthcare teams. The overall aim was to evaluate a train-the-trainer (TTT) program for healthcare providers wanting to offer this course within their hospital trust.

Methods

Our observational descriptive design was informed by Kirkpatrick´s Model of Educational Outcomes. The South-Eastern Regional Health Authority invited healthcare providers from all health trusts in its jurisdiction to attend. The TTT consisted of a one-day basic course with lectures on SDM, exercises and group reflections followed by a two-day advanced course including an SDM observer training. Immediately after each of the two courses, reaction and learning (Kirkpatrick levels 1 and 2) were assessed using a self-administered questionnaire. After the advanced course, observer skills were operationalized as accuracy of the participants’ assessment of a consultation compared to an expert assessment. Within three months post-training, we measured number of trainings conducted and number of healthcare providers trained (Kirkpatrick level 3) using an online survey. Qualitative and quantitative descriptive analysis were performed.

Results

Twenty-one out of 24 (basic) and 19 out of 22 (advanced) healthcare providers in 9 health trusts consented to participate. The basic course was evaluated as highly acceptable, the advanced course as complex and challenging. Participants identified a need for more training in pedagogical skills and support for planning implementation of SDM-training. Participants achieved high knowledge scores and were positive about being an SDM trainer. Observer skills regarding patient involvement in decision-making were excellent (mean of weighted t = .80). After three months, 67% of TTT participants had conducted more than two trainings each and trained a total of 458 healthcare providers.

Conclusion

Findings suggest that the TTT is a feasible approach for supporting large-scale training in SDM. Our study informed us about how to improve the advanced course. Further research shall investigate the efficacy of the training in the context of a comprehensive multifaceted strategy for implementing SDM in clinical practice.

Trial registration: Retrospectively registered at ISRCTN (99432465) March 25, 2020.

Peer Review reports

Background

Patient participation in healthcare decisions is an essential element of evidence-based medicine and patient-centered care [1]. Despite strong international advocacy for SDM and increasing implementation efforts, it has not yet been routinely adopted in clinical practice [2, 3]. Numerous interventions exist to support patients and clinicians in the process of making decisions using the best available evidence and the patient’s informed preferences [4]. Many involve interventions targeting patients, such as patient decision aids and decision coaching, and interventions targeting healthcare providers (HCPs) to increase patient involvement, such as training programs. Evidence on the efficacy of SDM training programs, however, is poor. This applies with regard to a lack of transparency in the reporting of training methods used, heterogeneity across descriptions of SDM training programs, and a lack of training programs which are rigorously evaluated [5, 6].

In Norway, there is growing interest in implementing SDM. The Norwegian Ministry of Health has published a series of documents indicating the need for more SDM [7,8,9,10]. The latest contribution is the National Health and Hospital Plan 2020–2023 [10], which considers SDM as a key goal and best practice for making healthcare decisions. Several university health and social education programs, including medical specialization programs, have recently been given specific SDM learning objectives [11, 12]. In Norway, the meta curriculum “Ready for SDM” (in Norwegian, Klar for Samvalg) is recommended as one strategy to support implementation of SDM.  The meta-curriculum consists of several SDM training modules using both classroom and online format—and guidance for tailoring SDM training to the different contexts and needs of HCPs. The curriculum is based on MAPPIN´SDM (Multifocal Approach to the Sharing in SDM) as its underpinning concept of SDM quality [13, 14]. MAPPIN´SDM is an inventory hosting several instruments to assess patient involvement and a research approach to compare and integrate varying perspectives on the quality of decision-making communication. MAPPIN´SDM defines the chronological steps of an SDM approach and provides detailed descriptions of several levels of performance for each quality indicator [15, 16]. MAPPIN’SDM is founded on the criteria of evidence-based patient information [15, 16] and, in a recent systematic review comparing measurement instruments, has been found to most comprehensively cover the essential elements of SDM [17]. Using a generic pedagogic approach [18], the Ready for SDM meta-curriculum also relies on a set of “active components” used to change behaviour of HCPs, so-called behaviour change techniques (BCTs) [19]. BCTs are observable and replicable and can be used individually or in combination with other BCTs from a comprehensive taxonomy of 93 techniques [19]. This evidence-based taxonomy is supposed to support creation of theory-informed implementation interventions [19] and may improve the evidence on SDM-trainings by aiding in transparent reporting of interventions [20].

The individual training modules within our meta-curriculum Ready for SDM currently present in different stages of evaluation [18, 21,22,23,24].

One module of our meta-curriculum, Ready for SDM INTERPROF, is using an interprofessional approach to facilitate translation of SDM into practice by improving knowledge and attitudes and thereby, changing the culture of communication in health care environments. This interactive 2-h classroom educational module has passed extensive qualitative evaluation [18] and in a cluster randomized study proved efficacious regarding knowledge gain and acquisition of communication competencies [25]. It is currently in frequent demand by hospital trusts, is recommended by the Ministry of Health, and may soon play an important role in Norwegian national strategies to implement SDM in health care [18, 25]. However, to scale up SDM activities in hospitals, transition to disseminating interprofessional SDM training through a train-the-trainer program (TTT) is required. Such an approach needs to ensure fidelity of the intervention as originally designed.

The overarching goal of this study was to scale up SDM training for health professionals in Norwegian hospital trusts by evaluating a train-the-trainer program. Specifically, we aimed to evaluate the extent to which our TTT program gives HCPs, as ambassadors, the skills and confidence to provide the Ready for SDM INTERPROF module for groups of HCPs in their respective practice environments.

Methods

Study design

We pretested the TTT in a group of HCPs using an observational descriptive design with evaluation based on the Kirkpatrick model [27]. Kirkpatrick’s model of outcomes for evaluating educational interventions consists of four levels: Level 1 assesses immediate response; Level 2 assesses learning effects such as knowledge, skills, and attitudes; Level 3 assesses behavioural change due to the training, and Level 4 assesses the efficacy of the training. Evaluation in the current study refers to levels 1–3.

To describe the TTT intervention, we used the Template for Intervention Description and Replication (TIDieR) checklist [28], increasingly used to describe complex interventions [29, 30].

Intervention description

Rationale

The goal of the TTT program was to prepare HCPs to provide the Ready for SDM-INTERPROF module to their colleagues. Besides handing over the necessary learning materials and presentation slides, TTT trainers teach participants how to implement the 2-h curriculum themselves. Participants also become introduced to the underpinning concept of quality, MAPPIN’SDM, and learn to apply the corresponding quality criteria to appraisal of communication.

As one piece of a more comprehensive implementation approach of SDM in Norway, the TTT was developed in accord with the Knowledge-to-Action framework (KTA) [31]. The framework guides implementation endeavors via seven abstract steps (Table 1). The current study contributes to covering each of the KTA steps. In addition, it refers to many specific interventions completing the overarching approach of the South-Eastern Health Region (see Table 1).

Table 1 Knowledge-to-Action plan for Ready for SDM INTERPROF
Full size table

Description of the SDM intervention to be passed on: ready for SDM INTERPROF

The Ready for SDM INTERPROF [18] is a two-hour group-based interprofessional module, training HCPs‘ SDM knowledge and skills aiming at facilitating a culture change in HCP-patient communication. It was developed following the assumption that to work as a convincing communication approach, patient involvement needs to be reflected by shared attitudes amongst clinical teams. SDM skills do therefore not necessarily refer to decision-making consultations only, but also to all communication pieces involved in providing information and preparing patients for taking an active role on their own account. Using a lecture and interactive methods the INTERPROF module addresses the particular learning goals: To gain knowledge on background and rationale of SDM and risk communication, skills to structure an SDM process using “6 steps to SDM” and develop self-appraisal skills using quality criteria from the MAPPIN’SDM [18, 25].

Development of the train-the-trainer curriculum

The main learning objective of the TTT course is to build competence and confidence among participants who will provide the Ready for SDM INTERPROF module to further groups of HCPs. The TTT curriculum was developed by an expert panel consisting of a patient representative, a web editor and communication specialist, and researchers with clinical, educational and leadership expertise.

Using “blended learning” and adult learning approaches [32] as well as strategies from the Ready for SDM meta-curriculum [18, 21], the TTT includes presentations, group discussions, exercises, interactive observation and demonstration. Pedagogic methods were selected that were appropriate for bigger groups and still keeping focus on interactivity in the learning. The course was designed to help trainers address known barriers to SDM (such as the belief that HCPs are already doing SDM, or that their patients don’t want to share decisions) and also to help them identify others [19, 20]. Allocating our methods in the taxonomy and considering use of additional BCTs helped us refining the curriculum and to make it traceable for other educators and researchers (Table 2) [19, 20]. For example, one BCT used to address the barrier that HCPs already do SDM is “use of a credible source,” i.e. presenting evidence on average level of patient involvement. Beyond the use of specific BCTs and their operationalization, when a barrier was mentioned during the training, it was met using a generic sequence: First it was rephrased a couple of times to enable other participants to recognize its relevance to their own situation. Then trainers affirmed the barrier mentioned by the trainee before specific information and arguments were provided to address the barrier (Table 2).

Table 2 Barriers to implementation of SDM and BCTs used to address them in the TTT training
Full size table

To make delivery of the INTERPROF training as easy as possible, we developed several materials to share them with the participants both during the TTT and afterwards, including key SDM articles, useful links, the six steps to SDM pocket reminder cards, brochures and posters (samvalg.no), the INTERPROF presentation slides with explanatory texts (PowerPoint), the MAPPIN´SDM observer manual [33], several training videos demonstrating SDM consultations and several exercises including the use of barrier cards (Table 3). Those who complete the course qualify as “SDM ambassadors” and receive access to the log in page of the online platform hosting an even larger variety of materials and information (klarforsamvalg.no) [34].

Table 3 Learning objectives and content of the TTT training
Full size table

In an effort to achieve a balance between encouraging individual tailoring of the training while ensuring that SDM learning objectives are still met (fidelity), the curriculum prioritizes finding common ground in the concept of quality (MAPPIN’SDM). Special emphasis is, therefore, given to training in appraisal of the quality and extent of patient involvement in consultations. Observation- and appraisal exercises are used to teach participants to applying the criteria of the MAPPIN’SDM observer scales [13, 14].

Each single component of the TTT course (basic and advanced) had already been tested, either in other modules of the meta-curriculum or with the target group for the TTT, when we piloted the basic course with 40 HCPs in the South-Eastern Health Region. The piloting was followed by a four-hour focus group with about half of them. Based on their feedback and on experiences with single components of the TTT program, a three-day in-person workshop was considered as an appropriate format and time frame for achieving the learning objectives.

Description of the TTT

The basic course and the advanced course were organized as separate sessions to accommodate work schedules. Participants could sign up for the basic course and later decide to continue with the advanced course. Participation in the advanced course required completion of the basic course at any earlier date. However, both parts need to be completed to become an “SDM ambassador,” i.e. qualified to deliver the SDM INTERPROF training module.

Basis course Day 1

The first day (6 h) consists of an introduction (Table 3) and several exercises and group reflections, including on barriers to implementing SDM perceived by the trainers or the trainees and BCTs that could be used to overcome them (Table 2). Participants are introduced to the SDM-INTERPROF module and encouraged to particularly focus on the use of pedagogic methods within the training. After demonstration of the two-hour SDM INTERPROF module, the challenges of teaching it are discussed in depth. By attending the first day, participants are supposed to achieve similar knowledge about SDM as attendants of the INTERPROF module.

Advanced course Day 2–3

The second (6 h) and third day (6 h) consist of exercises in applying quality criteria through an in-depth analysis of patient involvement in decision-making. Videos of clinical consultations in several different domains are observed, analysed, and rated using the MAPPIN’SDM criteria, and then discussed at a group level. Alternating with sequences of the observer training are short lectures on SDM topics such as evidence-based patient information (EBPI) including risk communication or the stage of evaluation of the various modules of the Ready for SDM meta-curriculum as well as several exercises from the curriculum which participants will use in their training.

After the course, the participants receive a certificate of completion and are invited to join the quality collaborative of certified SDM ambassadors in the region. Ambassadors are introduced to the online platform [34] through which they can seek additional learning resources, improve existing resources, add BCTs, or suggest new resources which will pass thorough an appraisal process before approval by the originators (SK, JK) and being made accessible to the entire network.

Setting and participants

The study was conducted in the largest of Norway’s four regional health authorities which serves a population of 2.9 million people and has 11 health trusts. Recruitment was pursued through the Deputy CEO, the Chief Medical Officer and announcements posted on the South-Eastern Regional Health Authority’s website. Eligible applicants were either responsible for implementation of SDM in their local institutions or showed an interest in the course. The aim was to recruit a minimum of two HCPs from each health trust and to ensure the number of participants was under 25. Twenty-five is sufficient for conducting the intervention in a meaningful manner. Cohort A refers to trainers attending the basic course and cohort B to trainers participating in the advanced course. Some members of cohort B had pursued the basic course earlier, while others were also represented in cohort A, i.e. had moved directly from basic to advanced. Studying the same group through both parts of the TTT module instead of a composite sample would have been preferable but was not possible (see Fig. 1) for logistical reasons.

Fig. 1
figure 1

Recruitment of TTT participants

Full size image

Procedures

The intervention was delivered by SK and JK. SK is a registered nurse with a master’s degree in Health and Empowerment and is a PhD student focused on SDM training, as well as a special advisor for SDM at the South-Eastern Norway Regional Health Authority. JK is a psychologist, professor and communications researcher at the Oslo Metropolitan University. Both trainers have extensive experience in conducting SDM trainings.

Both parts of the TTT were held at the South-Eastern Norway Regional Health Authority meeting centre in Oslo in September 2019. Participants’ respective hospital trusts paid for their transportation costs and they attended within working hours.

Informed consent was signed in the context of the training session before handing out the questionnaires. Three months after the intervention, an online survey sent by email asked participants how many trainings they had offered and to how many HCPs. After one week, an email reminder was sent out. A follow up workshop was planned with the participants after six months for evaluation purposes and to accompany the HCP in their implementation efforts.

Outcome measures

Cohort A was given a self-administered paper questionnaire before they left the basic course on Day 1, and Cohort B were given a self-administered paper questionnaire before leaving the advanced course at the end of Day 3. Cohort B then completed outcome measures at 3-months follow up (Table 5). Demographic characteristics were collected. Outcomes were related to the three Kirkpatrick levels of reactions, learning, and behaviour. Nine items evaluated reaction outcomes (Kirkpatrick level 1—engagement, relevance and satisfaction). Twenty-nine items evaluated learning outcomes (Kirkpatrick level 2—knowledge, attitude, skills, confidence, commitment) (Table 5) [27]. Twelve of the items used 4-point Likert scales (1 = strongly disagree, 4 = strongly agree). Five items on knowledge were assessed using multiple choice (definition of SDM, indications and contra-indications, prerequisites for informed choice, reliable sources of information about effects of medical interventions) [18]. These items have been piloted and are in use for certifying graduates of an SDM e-tutorial [35]. They have also been used as one of two endpoints in the corresponding cluster randomized trial, evaluating the INTERPROF module [24]. By measuring SDM related knowledge of participants the current study intended to assure that attendees of the TTT would acquire knowledge not inferior to the attendees of the INTERPROF training. Level 2 skills outcomes were additionally measured at the end of Day 3 when participants were asked to assess patient involvement in decision-making within a test video of a consultation, using the observer-based instrument MAPPIN-Odyad [15, 16]. The latter assesses the dyad's (HCP and patient as a unit) compliance with 11 quality criteria of patient involvement in a decision-making consultation [15, 16]. The criteria are rated from ‘0′ (not observed) to ‘4′ (observed to an excellent standard) [15, 16]. Finally, for the behaviour outcomes (Level 3), three months after the TTT-courses, an online survey was sent to all those who completed both courses to assess the number of SDM trainings carried out and the number of HCPs trained. Additionally, open-ended questions were used to collect implementation outcomes such as relevance (applicability), satisfaction (need for revision) and barriers to conducting the trainings (Table 5).

Statistical analyses

Data administration

All quantitative data were entered into SPSS version 22.0 (IBM corporation, USA). The qualitative data from items using open-ended questions were entered into NVivo version 11 (QSR International, Melbourne, Australia).

Analysis of quantitative data

Data from the post intervention paper questionnaire were calculated using frequencies and either reported as percentages of the answer categories (Engagement, Relevance, Satisfaction, Knowledge, Attitude, Confidence, Commitment, Age interval, Years of clinical practice) or, if continuously scaled, averaged and reported as mean scores (Knowledge). Levels of knowledge after the basic course were compared with knowledge levels in the intervention group of the corresponding RCT evaluating the INTERPROF module and tested for noninferiority using a one-sided t-test [24]. Missing values were reported separately.

Analysis of qualitative data

Data collected using open-ended questions were analysed based on principles of qualitative content analysis as described by Hsieh and Shannon [36]. Data extraction and analysis were undertaken by two independently working researchers using the following steps: (a) reading the answers multiple times to establish a sense of the data as a whole, and to identify meaningful units; (b) categorizing units based on a priori defined main themes (Kirkpatrick’s levels) and subcategories; and (c) resolving disagreements through discussion at each step described above.

Analysis of observer skills

Accuracy of participants’ appraisals of SDM behaviours, collected with the MAPPIN´SDM dyad observer scale, was determined by calculating the extent to which ratings agreed with a reference standard. The reference standard was a rating established by experts in MAPPIN’SDM before the study started. Agreement was expressed using the weighted t coefficient [37], a Cohens kappa, modified according to Maxwell [38] that uses theoretical assumptions rather than empirical frequencies to estimate the expected marginal distributions. Agreements were downgraded from full agreement (= 1), over almost (1 Likert step = 0.75), moderate (2 Likert steps = 0.25), low (3 Likert steps = 0.1) to no agreement (4 Likert steps = 0). Coefficients are considered moderate between 0.40 and 0.60, strong higher than 0.60, and excellent higher than 0.80 [39].

Results

Results of the study are reported following Kirkpatrick’s first three evaluation levels.

Characteristics of training participants

Nine of the 11 hospital trusts sent participants to the TTT course. Six of them sent more than one participant. Written informed consent was provided by 21 of 24 participants in Cohort A and 19 of 22 in Cohort B (Table 4).

Table 4 Characteristics of participants in a train-the-trainer program for SDM
Full size table

Level 1: reaction

Engagement

The TTT program was evaluated as interesting by 95% of participants (19 of 20) after the basic course and by 74% (14 of 19) after the advanced course. After the basic course, participants said technical problems may have interfered with learning. The wish for less ambitious materials and for a gold standard SDM video were expressed after the advanced course (Table 5).

Table 5 Overview over the entire evaluation plan and corresponding results
Full size table

Relevance

After the basic course, 90.5% of participants (19 of 21) considered the course helpful for their job and 68% (13 of 19) after the advanced course. After the basic course 86% (18 of 21) said that they learned how they could apply their new skills and 63% (12 of 19) after the advanced course.

Three months after the course, participants said they had a better understanding of the difference between SDM and other communication concepts, of the six steps to SDM, of SDM as part of a broader communication approach, and of how to recognize the SDM steps (through having watched and analysed the SDM consultation videos).

Satisfaction

Most TTT participants (95%) (20 of 21) would recommend the basic course to colleagues, while 56% would recommend the advanced course (11 of 19).

Suggestions for improving the 3-day TTT

Respondents suggested: (1) More practice in how to perform the training, (2) more focus on embedding SDM within the local hospital trusts, and (3) strategic work regarding SDM implementation. Additionally, participants desired more time for in-depth analyses and discussion of clinical consultations. They were also confused between communication campaigns such as Choosing Wisely [43], Four Habits [44, 45] and Ready for SDM. They also requested theoretical and pedagogical background and exercises on how to assemble an SDM course tailored to local needs.

Level 2: learning

Knowledge

95% (20 of 21) of the TTT participants considered the concept of SDM and 84% (16 of 19) the Patient involvement in decision-making indicators understandable.

Knowledge levels acquired during TTT were not inferior to knowledge acquired by course participants in the RCT, both for each single item on the knowledge test and for the mean score (mean training group RCT = 2.9, (range 0–5), SD = 1.40, TTT = 4.28, (range 0–5), SD = 0.72; p < 0.001).

Attitudes

After the basic and the advanced courses, all participants held positive attitudes towards SDM in general and towards training HCPs in SDM. Additionally, all participants considered it valuable to use videos of clinical consultations in combination with quality criteria for SDM in the training.

Skills

After the three-day TTT, skills in observing and assessing communication quality in terms of MAPPIN-Odyad were excellent. According to weighted t, participants’ assessment of SDM behaviour presented in the test video agreed to a high extent with the reference standard (mean of weighted t = 0.80, N = 19).

Confidence

After finishing the TTT, participants felt confident to handle typical questions about and barriers to SDM (86%, 18/21) and to convey the meaning of SDM to others (81%, 17/21). However, self-confidence after the course was lower with regard to assessing patient involvement in making decisions using the quality criteria of the MAPPIN’SDM (68%, 13/19), to justifying and communicating their appraisal to others (53% / 9 of 17) and to conduct the 2-h SDM training with a group of HCPs (53% /10 of 19).

Commitment

Forty-two percent of the participants (8/19) left the course with concrete plans to conduct 2-h SDM trainings within the next six months.

Other feedback on learning

The participants wanted more interprofessional examples, more self-study, and more time for going through the teaching materials. They asked for more exercises in assembling components of the SDM INTERPROF curriculum to tailor the SDM training to their target audiences, more practical training and experience, more guidance from the course developers, and more training materials such as the clinical videos on the online platform klarforsamvalg.no [34].

Level 3: Behaviour

Realization of SDM training

Three months after TTT, 85% (11/13) of the participants still available for evaluation had been given a dedicated task from their leaders at the hospital trust to deliver SDM trainings, of whom 69% (9) had carried out SDM trainings and 62% (8) more than two trainings. In total, 458 HCPs had received training up to this point (Table 5).

Implementation issues

Barriers to conducting SDM trainings reported immediately after training were largely similar to barriers reported three months later. These were lack of time, limited access to clinicians for training, insufficient support from leaders, the complexity of the training, and insufficient self-confidence. Participants wanted more training in giving information about SDM and in providing video supported skills-training. Some trainers struggled (4/11) to adapt the training to the local culture and to their own needs and situation. Six of 11 (64%) survey respondents considered it easy to organize their SDM training programs using the material available on the platform.

Discussion and conclusion

Discussion

The current study evaluated a TTT for HCPs to prepare them to conduct a 2-h SDM INTERPROF training previously proven feasible and efficacious for changing SDM-related competencies [18, 24]. The TTT program uses a “blended learning” approach [40] that combines didactic and interactive techniques and learning materials.

While the one-day basic course was positively evaluated by the participants, the three-day advanced course received a more variable response (e.g., acceptability) and self-assessed outcomes (e.g., confidence). On the other hand, most participants were committed to conducting training sessions in the future and 69% did so. Almost two-thirds of those completing the advanced course carried out more than two trainings each within three months, and 458 HCPs were trained in total. In terms of their ability to observe behaviour regarding patient involvement and perform reliable quality appraisal of SDM participants scored well. Also, knowledge gained was high (range: 71–100%), and even superior to knowledge levels acquired by a comparable group of participants in the RCT (range: 41%-83%) [24] (Table 5).

Our study has several key limitations. As many outcomes were self-reported, our findings might be biased due to social desirability. This risk, however, mainly applies to participants’ assessments of relevance, satisfaction and subjective knowledge, while other outcomes, like numbers of provided training sessions, are unlikely to be overestimated. Our evaluation is also lacking continuity with regard to ambassadors and feedback provided by them, because it was based on a composite assessment of two cohorts moving separately through the two parts of the curriculum. In the absence of closed groups passing the entire program, we had to choose this proceeding to ensure data collection in a limited time frame. About half of the participants, however, did indeed continue from the basic to the advanced course in our investigation window and were therefore present in both cohorts. We do not see any reason to believe that heterogeneity between the cohorts caused undesirable variance. As the current study was not designed to answer questions about efficacy in terms of patient-relevant outcomes the fourth Kirkpatrick level has not been addressed. However, evaluations covering the entire spectrum are rare. Assessing the program’s impact on patient involvement in decision-making will be of particular importance in the broader context of the literature on SDM trainings [41] and TTT in general [42,43,44,45].

Evaluating trainers’ (ambassadors) learning outcomes and behaviours (rather than the trainee/patient variables) is a unique [40] although reasonable strategy, as suggested by a recent review [42] and the Kirkpatrick Model [27]. As part of the development process [24], this approach may lead to a better understanding about the best way to support trainers in training others, and a better understanding of the development of trainers’ learning abilities and behaviour over time [41]. Our recruitment strategy resulted in a mix of participants who had been sent by their hospital trusts and participants who came of their own volition. While the latter group could have caused selection bias, interestingly, we observed that participants commissioned by their leaders and those motivated by interest only were equally as likely to perform further trainings. Finally, the three-month follow up may have been too soon. We chose this time frame because of how long it takes to plan and hold meetings in the context of the Norwegian specialist health care. Moreover, we assumed that participants would not retain their new skills unless they put them to use, and hoped the three-month evaluation would motivate them to quickly apply their knowledge and skills [27]. We also assumed participants who started training HCPs soon after the TTT would be more likely to continue later on.

We learned from the current study that we have still not found the best blend of learning techniques, particularly for the advanced course focusing on SDM observer skills. This challenge is found elsewhere in the literature on dissemination strategies for TTT programs [40]. A systematic review of 18 TTT programs for health and social care professionals is inconclusive regarding the optimal blend, but in general recommends variation between didactics and interactive teaching methods. Our findings reveal the need to further analyse barriers and include further BCTs, for example, offering exercises on preparing, tailoring and piloting SDM lectures and providing feedback before the trainers conduct them in their hospital trust. Putting the original course into practice without any variation is an illusion but participants did not feel adequately equipped to tailor the course to their context. Future TTTs could identify key SDM concepts that require fidelity but also support and encourage participants to reflect on and adapt the training to their own context and develop their own style of training. Their confidence in giving the course could be increased by strengthening their teaching skills, practicing individual and group work, providing a simpler version of the MAPPIN’SDM materials (coding scheme and manual) and revising the webpage that houses the teaching materials. In addition, participants expressed frustration regarding the observer training. Having in mind the excellent accuracy findings, we do however think, that providing more immediate feedback on their observer skills (BCT: Feedback on behaviour (2.2))’ could have improved their motivation and self-efficacy.

The Ready for SDM program is innovative in at least four respects: Firstly, it is the first and only evaluated SDM training program in Norway [5, 6]. Secondly, it is based on a meta-curriculum which provides a variety of training components tailored to various contexts and HCPs. Thirdly, to the best of our knowledge, the Ready for SDM program is the first of its kind to provide evaluated TTT methods. There is only one other evaluated TTT program in the field of SDM [46], but none in Norway [5, 41, 42]. Fourthly, in order to resolve the challenge of maintaining training quality when passing it along, Ready for SDM certifies trainers in an SDM training quality collaborative [47]. This growing network meets both in workshops and on the online platform that stores the training materials. Using a feedback-driven continuous learning system, Ready for SDM enables members to participate in program revisions and further development and limiting the proliferation of training programs that do not meet quality standards. Feedback-driven continuous learning systems are well-known in developmental evaluation research [48, 49], and are assumed to give trainers enough flexibility to develop further skills and a sense of ownership of the methods they are supposed to apply. Other studies are needed to evaluate whether this approach also has an impact on sustainability.

Since our study, most SDM trainers in the quality network have continued to spread knowledge and a positive attitude towards SDM while delivering the SDM INTERPROF trainings within the South-Eastern Health Region. The program now needs to be considered in the context of a broader research agenda for the Ready for SDM meta-curriculum and the even broader agenda of a national implementation plan for the Norwegian health care system. Through the architecture of the feedback-driven continuous learning system of the meta-curriculum and its evaluation concept, Ready for SDM is resolving the challenges reported in the literature [5, 6, 50] such as lack of transparency regarding content and methods, inappropriateness of evaluation methods and the fact that most programs are targeting only doctors. It is also working towards a regional consensus on what constitutes fidelity, i.e. which elements of training content are essential and which can be tailored or replaced. While the curriculum is still under development and rigorous proof of efficacy and effectiveness of all modules will need more time. Ready for SDM offers a comprehensive implementation approach that includes all players in the processes of health communication and decision-making. This approach is based on evidence suggesting that a combination of strategies targeting patients, HCPs and structural changes to promote patient involvement [3, 4, 51,52,53,54] will be most effective.

Conclusion

Our study showed that training SDM ambassadors to provide the SDM INTERPROF module helped scale up SDM training activities in the hospital trusts. The TTT improved knowledge and produced excellent observer skills in assessing patient involvement in decisions. However, some trainers felt insufficiently confident to perform further trainings and to convey the concept of quality of patient involvement in decision-making to other HCPs. Ambassadors provided rich feedback which will inform the revision of the TTT program. Further research is required regarding efficacy of the TTT in the context of a comprehensive multifaceted strategy for implementing SDM in clinical practice countrywide.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

TTT:

Train-the-trainer

SDM:

Shared decision-making

HCP:

Health-care provider

BCTs:

Behaviour change techniques

MAPPIN’SDM:

Multifocal approach to sharing in shared decision making

KTA:

Knowledge-to-action framework

EBPI:

Evidence-based patient information

References

  1. Hoffmann TC, Montori VM, Del Mar C. The connection between evidence-based medicine and shared decision making (Report). JAMA J Am Med Assoc. 2014;312(13):1295.

    Article  CAS  Google Scholar 

  2. Härter M, Moumjid N, Cornuz J, Elwyn G, van der Weijden T. Shared decision making in 2017: international accomplishments in policy, research and implementation. Zeitschrift fur Evidenz Fortbildung und Qualitat im Gesundheitswesen. 2017;123:1–5.

    Google Scholar 

  3. Coulter A. National strategies for implementing shared decision making. BertelsmanStiftung. 2017.

  4. Légaré F, Adekpedjou R, Stacey D, Turcotte S, Kryworuchko J, Graham ID, et al. Interventions for increasing the use of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2018. https://doi.org/10.1002/14651858.CD006732.pub4.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Diouf NT, Menear M, Robitaille H, Painchaud Guerard G, Legare F. Training health professionals in shared decision making: update of an international environmental scan. Patient Educ Couns. 2016;99:1753–8.

    Article  Google Scholar 

  6. Legare F, Politi MC, Drolet R, Desroches S, Stacey D, Bekker H. Training health professionals in shared decision-making: an international environmental scan. Patient Educ Couns. 2012;88(2):159–69.

    Article  Google Scholar 

  7. Ministry of Health and Care Services. White Paper on Medicinal Products—Correct use—better health (Legemiddelmeldingen — Riktig bruk – bedre helse). Oslo: 2015.

  8. Ministry of Health and Care Services. Meld. St. 7—National Health and Hospital Plan. Oslo: 2020–2023. 2019.

  9. Ministry of Health and Care Services. National strategy to increase health literacy in the population. Oslo: 2019–2023. 2019.

  10. Ministry of Health and Care Services. Quality and patient safety 2016. Meld. St. 6 (2017–2018). Oslo: 2017–2018.

  11. Kunnskapsdepartementet. Nye retningslinjer for helse- og sosialfagutdanningene regjeringen.no2019 [updated 09.05.2019. Available from: https://www.regjeringen.no/no/tema/utdanning/hoyere-utdanning/utvikling-av-nasjonale-retningslinjer-for-helse--og-sosialfagutdanningene/nyhetssaker/nasjonale-retningslinjer-for-fase-1-er-vedtatt/id2632780/. Accessed 11 Mar 2021.

  12. Helsedirektoratet. Spesialistutdanning for leger del 1-3 Felles kompetansemoduler (FKM). 2018.

  13. Kasper J, Hoffmann F, Heesen C, Köpke S, Geiger F. MAPPIN’SDM—the multifocal approach to sharing in shared decision making (MAPPIN’SDM). PLoS ONE. 2012;7(4):e34849.

    Article  CAS  Google Scholar 

  14. Kienlin S, Kristiansen M, Ofstad E, Liethmann K, Geiger F, Joranger P, et al. Validation of the Norwegian version of MAPPIN’SDM, an observation-based instrument to measure shared decision-making in clinical encounters. Patient Educ Couns. 2017;100(3):534–41.

    Article  Google Scholar 

  15. Bunge M, Mühlhauser I, Steckelberg A. What constitutes evidence-based patient information? Overview of discussed criteria. Patient Educ Counsel. 2010;78:316–28.

    Article  Google Scholar 

  16. Lühnen J, Albrecht M, Mühlhauser I, Steckelberg A. Leitlinie evidenzbasierte Gesundheitsinformation. Hamburg; 2017.

  17. Bouniols N, Leclere B, Moret L. Evaluating the quality of shared decision making during the patient-carer encounter: a systematic review of tools. BMC Res Notes. 2016;9:382.

    Article  Google Scholar 

  18. Kienlin S, Nytrøen K, Stacey D, Kasper J. Ready for shared decision making: Pretesting a training module for health professionals on sharing decisions with their patients. J Eval Clin Pract 2020;n/a(Special Issue Shared decision making).

  19. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behaviour change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behaviour change interventions. Ann Behav Med. 2013;46(1):81–95.

    Article  Google Scholar 

  20. Agbadjé TT, lidor HlnE, Perin MS, Adékpedjou R, Légaré F. Taxonomy of behavior change techniques in shared decision making: a secondary analysis of a systematic review. 2020.

  21. Geiger F, Liethmann K, Reitz D, Galalae R, Kasper J. Efficacy of the doktormitSDM training module in supporting shared decision making—results from a multicenter double-blind randomized controlled trial. Patient Educ Couns. 2017;100(12):2331–8.

    Article  Google Scholar 

  22. Kasper J, Liethmann K, Heesen C, Reissmann DR, Geiger F. Training doctors briefly and in situ to involve their patients in making medical decisions—preliminary testing of a newly developed module. Health Expect. 2017;20(6):1254–63.

    Article  Google Scholar 

  23. Kienlin S, Nytroen K, Kasper J, Stacey D. Shared decision-making supported by decision coaches—evaluation of a training module. Oral presentation on OCHER; Oslo 2019. https://ocher.no/wp-content/uploads/2019/10/Program-9th-OCHER-2020-final-Oct-7-2019.pdf . Accessed 11 Mar 2021.

  24. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  Google Scholar 

  25. Kienlin S, Kasper J, Liethmann K, Grafe A, Stacey D, Nytrøen K. Evaluation of an interprofessional training module in Shared Decision Making (Ready for SDM): a cluster randomized controlled trial. Oral presentation on the 10th International Shared Decision Making conference; Quebec, Canada2019. Abstract number 233, page 93; https://fourwaves-sots.s3.amazonaws.com/static/media/uploads/2019/06/28/isdm2019-oralsessionsbooklet-2019-06-28.pdf. Accessed 11 Mar 2021.

  26. Kasper J, Lager AR, Rumpsfeld M, Kienlin S, Smestad KH, Brathen T, et al. Status report from Norway: Implementation of patient involvement in Norwegian health care. Zeitschrift fur Evidenz Fortbildung und Qualitat im Gesundheitswesen. 2017;123–124:75–80.

    Article  Google Scholar 

  27. Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s four levels of training evaluation. Alexandria: ATD Press; 2016. p. 256.

    Google Scholar 

  28. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ Br Med J. 2014;348:g1687.

    Article  Google Scholar 

  29. Sakzewski L, Reedman S, Hoffmann T. Do we really know what they were testing? Incomplete reporting of interventions in randomised trials of upper limb therapies in unilateral cerebral palsy. Res Dev Disabil. 2016;59:417–27.

    Article  Google Scholar 

  30. McMahon NE, Holland E-J, Miller C, Patel K, Connell LA. Activities to support the implementation of complex interventions as part of routine care: a review of the quality of reporting in cluster randomised controlled trials. BMJ Open. 2015;5(10):e008251.

    Article  Google Scholar 

  31. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.

    Article  Google Scholar 

  32. Knowles M. Andragogikk: en kommende praksis for voksenopplæring. In: Berri S, editor. I Illeris K. Tekster om voksenlæring. Danmark: Roskilde Univeritetsforlag; 2005. p. 59–72.

    Google Scholar 

  33. Kasper J, Liethmann K. Manual for training and coding: MAPPIN’SDMrevised: Multifocal approach to the “sharing” in SDM. Hamburg: Institut für Kommunikation in der Medizin; 2013.

    Google Scholar 

  34. Kienlin S. Klar for samvalg: Helse Sør-Øst RHF; 2021 [Available from: https://samvalg.no. Accessed 11 Mar 2021.

  35. Geiger F, Liethmann K, Scholz KN, Grafe A, Kienlin SJK. Efficacy of a web-based training module for physicians to facilitate shared decision making—a randomized controlled trial. In: Poster at the 9th international shared decision making conference; Lyon, France 2017.

  36. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.

    Article  Google Scholar 

  37. Wirtz M, Caspar F. Beurteilerübereinstimmung und Beurteilerreliabilität. Methoden zur Bestimmung und Verbesserung der Zuverlässigkeit von Einschätzungen mittels Kategoriensystemen und Ratingskalen. Göttingen: Hogrefe; 2002.

  38. Maxwell AE. Coefficients of agreement between observers and their interpretation. Br J Psychiatry. 1977;130(1):79–83.

    Article  CAS  Google Scholar 

  39. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159.

    Article  CAS  Google Scholar 

  40. Pearce J, Mann MK, Jones C, Van Buschbach S, Olff M, Bisson JI. The most effective way of delivering a Train-the-Trainers program: a systematic review. J Contin Educ Health Prof. 2012;32(3):215–26.

    Article  Google Scholar 

  41. Müller E, Diesing A, Rosahl A, Scholl I, Härter M, Buchholz A. Evaluation of a shared decision-making communication skills training for physicians treating patients with asthma: a mixed methods study using simulated patients. BMC Health Serv Res. 2019;19(1):612.

    Article  Google Scholar 

  42. Poitras M-E, Bélanger E T, Vaillancourt V, Kienlin S, Korner M, Godbout I, et al. Interventions to improve trainers’ learning and behaviours for educating healthcare professionals using train the trainer method: a systematic review and meta-analysis. Journal of continuing education in health professions. J Contin Educ Health Prof 2021.

  43. Foundation A. Choosing Wisely 2012. Available from: https://www.choosingwisely.org/our-mission/.

  44. Frankel RM, Stein T. Getting the most out of the clinical encounter: the four habits model. J Med Pract Manag. 2001;16(4):184–91.

    CAS  Google Scholar 

  45. Fossli Jensen B, Gulbrandsen P, Dahl FA, Krupat E, Frankel RM, Finset A. Effectiveness of a short course in clinical communication skills for hospital doctors: results of a crossover randomized controlled trial (ISRCTN22153332). Patient Educ Couns. 2011;84(2):163–9.

    Article  Google Scholar 

  46. Körner M, Ehrhardt H, Steger AK, Bengel J. Interprofessional SDM train-the-trainer program “Fit for SDM”: provider satisfaction and impact on participation. Patient Educ Couns. 2012;89(1):122–8.

    Article  Google Scholar 

  47. Bakke T, Udness E, I. H. Quality collaboratives as a tool in quality improvement—a summary of research and experiences. Oslo: Norwegian Knowledge Centre for the Health Services; 2011.

  48. Patton MQ. Developmental evaluation—applying complexity concepts to enhance innovation and use. New York: Guilford Publications; 2010.

    Google Scholar 

  49. Leonard SN, Fitzgerald RN, Riordan G. Using developmental evaluation as a design thinking tool for curriculum innovation in professional higher education. High Educ Res Dev. 2016;35(2):309–21.

    Article  Google Scholar 

  50. Legare F. Inventory of Shared Decision Making Programs for Healthcare Professionals: Université Laval; 2020. Available from: http://www.decision.chaire.fmed.ulaval.ca/inventaire-formation-en. Accessed 11 Mar 2021.

  51. Boland L, Graham ID, Legare F, Lewis K, Jull J, Shephard A, et al. Barriers and facilitators of pediatric shared decision-making: a systematic review. Implem Sci. 2019;14(1):7.

    Article  Google Scholar 

  52. Legare F, Ratte S, Gravel K, Graham ID. Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals’ perceptions. Patient Educ Couns. 2008;73(3):526–35.

    Article  Google Scholar 

  53. Scholl I, LaRussa A, Hahlweg P, Kobrin S, Elwyn G. Organizational- and system-level characteristics that influence implementation of shared decision-making and strategies to address them - a scoping review. Implem Sci. 2018;13(1):40.

    Article  Google Scholar 

  54. Shaw B, Cheater F, Baker R, Gillies C, Hearnshaw H, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2005;3:Cd05470.

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge all the participants of TTT course, who have become SDM-ambassadors in their hospital trusts. We also thank our expert user panel, Rune Kløvtveit, Anette Strømsbo Gjørv, Håvard Dahl, Tore Neset, and Mirjam Smedsrød for the help and support in conducting the TTT course and in providing feedback. Last but not least, without the health professionals who willingly provided their videos of consultations for use within Ready for SDM trainings, this study would not have been possible.

Funding

The project was funded by the Northern Norway Regional Health Authority (Decision Aid factory HST1246-15) and the South-Eastern Norway Regional Health Authority. The study was undertaken as part of the project “Klar for Samvalg” (Ready for SDM), a program to develop and evaluate a comprehensive curriculum for training health care providers in shared decision-making. None of the funding bodies participated in the design of the study; in the collection, analysis, and interpretation of the data; or in the writing of the manuscript.

Author information

Authors and Affiliations

  1. Department of Health and Caring Sciences, Faculty of Health Sciences, University of Tromsø, Postbox 6050, Langnes, Norway

    Simone Kienlin & Jürgen Kasper

  2. Division of Internal Medicine, University Hospital of North Norway, Postbox 100, 9038, Tromsø, Norway

    Simone Kienlin

  3. Department of Medicine and Healthcare, The South-Eastern Norway Regional Health Authority, Postbox 404, 2303, Hamar, Norway

    Simone Kienlin

  4. Department of Family Medicine and Emergency Medicine/School of Nursing, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Canada

    Marie-Eve Poitras

  5. School of Nursing, University of Ottawa, 451 Smyth Road, Ottawa, ON, K1H 8M5, Canada

    Dawn Stacey

  6. Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, K1H 8L6, Canada

    Dawn Stacey

  7. Faculty of Medicine, University of Oslo, Blindern, Postbox 1072, 0316, Oslo, Norway

    Kari Nytrøen

  8. Department of Nursing and Health Promotion, Faculty of Health Sciences, OsloMet Metropolitan University, Pilestredet 46, 0167, Oslo, Norway

    Jürgen Kasper

Authors
  1. Simone Kienlin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marie-Eve Poitras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dawn Stacey
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kari Nytrøen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jürgen Kasper
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SK and JK developed the training and conducted the TTT program. All authors contributed to designing the study. SK and JK analysed the data. SK drafted the manuscript in collaboration with coauthors (MP, KN, DS, JK) and was responsible for the overall management of the study. All authors critically revised the manuscript, and read and approved its final version.

Corresponding author

Correspondence to Simone Kienlin.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the ethics committee at the South-Eastern Norway Regional Health Authority (19/00754). All participants signed a written informed consent form prior to their enrollment.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Five-item knowledge test.

Additional file 2.

TIDieR checklist.

Additional file 3.

MAPPIN'SDM coding sheet.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kienlin, S., Poitras, ME., Stacey, D. et al. Ready for SDM: evaluating a train-the-trainer program to facilitate implementation of SDM training in Norway. BMC Med Inform Decis Mak 21, 140 (2021). https://doi.org/10.1186/s12911-021-01494-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-021-01494-x

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us