Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

User-centered and theory-based design of a professional training program on shared decision-making with older adults living with neurocognitive disorders: a mixed-methods study

BMC Medical Informatics and Decision Making volume 21, Article number: 59 (2021) Cite this article

Abstract

Background

We know little about the best approaches to design training for healthcare professionals. We thus studied how user-centered and theory-based design contribute to the development of a distance learning program for professionals, to increase their shared decision-making (SDM) with older adults living with neurocognitive disorders and their caregivers.

Methods

In this mixed-methods study, healthcare professionals who worked in family medicine clinics and homecare services evaluated a training program in a user-centered approach with several iterative phases of quantitative and qualitative evaluation, each followed by modifications. The program comprised an e-learning activity and five evidence summaries. A subsample assessed the e-learning activity during semi-structured think-aloud sessions. A second subsample assessed the evidence summaries they received by email. All participants completed a theory-based questionnaire to assess their intention to adopt SDM. Descriptive statistical analyses and qualitative thematic analyses were integrated at each round to prioritize training improvements with regard to the determinants most likely to influence participants’ intention.

Results

Of 106 participants, 98 completed their evaluations of either the e-learning activity or evidence summary (93%). The professions most represented were physicians (60%) and nurses (15%). Professionals valued the e-learning component to gain knowledge on the theory and practice of SDM, and the evidence summaries to apply the knowledge gained through the e-learning activity to diverse clinical contexts. The iterative design process allowed addressing most weaknesses reported. Participants’ intentions to adopt SDM and to use the summaries were high at baseline and remained positive as the rounds progressed. Attitude and social influence significantly influenced participants' intention to use the evidence summaries (P < 0.0001). Despite strong intention and the tailoring of tools to users, certain factors external to the training program can still influence the effective use of these tools and the adoption of SDM in practice.

Conclusions

A theory-based and user-centered design approach for continuing professional development interventions on SDM with older adults living with neurocognitive disorders and their caregivers appeared useful to identify the most important determinants of learners’ intentions to use SDM in their practice, and validate our initial interpretations of learners’ assessments during the subsequent evaluation round.

Peer Review reports

Background

Neurocognitive disorders require making several difficult decisions to ensure older adults remain independent as long as possible, while maintaining their well-being and safety [1]. These decisions may cover daily life management (e.g. being home alone, day care, transportation, home book- keeping), arranging healthcare and support (e.g. diagnosis, medications, home care, domestic help, and respite care), community life (e.g. visiting family, moving house), and representing the person with dementia (e.g. advanced decisions about the end-of-life) [1]. Decisions made by older adults with neurocognitive disorders and their caregivers are generally not only based on clinical information, but also on social considerations (e.g. financial insecurity, availability of community-based organizations, social networks), requiring professionals to expand their knowledge and scope of practice beyond the boundaries of their professions [1, 2]. Since several acceptable alternatives exist for most of these decisions, the priorities of the older adults and those of their family/friend caregivers should guide decision making, together with the scientific evidence on the benefits and harms of the available options [3]. Shared decision-making (SDM) is an ideal approach for supporting older adults and their significant others in making these decisions collaboratively with the interprofessional healthcare team, as SDM is typically used in the context of uncertainty when the person’s preferences are central to the decision [4]. SDM is an approach where clinicians and patients share the best available evidence when faced with the task of making decisions, and where patients are supported to consider options, to achieve informed preferences [5]. Primary healthcare professionals (HCPs) should be trained in SDM and have access to patient decision aids tailored to the needs of older adults living with neurocognitive disorders and their caregivers, as these professionals play a central role in the care and services provided to community-based older adults living with neurocognitive disorders [6,7,8].

Although SDM can improve the quality of life of patients with neurocognitive disorders and their caregivers [9], decision-making in this context can be challenging. The disabling and neurodegenerative nature of neurocognitive disorders may challenge decision-making by limiting communication with the person as the disease progresses [10,11,12]. Consequently, neurocognitive disorders are a major risk factor for exclusion from decision-making [11]. Some studies have described the issues and requirements involved with implementing SDM with this population [1, 2, 13,14,15,16,17], but as yet, there have been no studies on the essential characteristics of a training program in SDM for HCPs in caring for older adults with neurocognitive disorders.

Initiatives aimed at increasing the use of SDM by HCPs may comprise training programs, leaflets, financial incentives or email reminders; however evidence remains scarce on their effectiveness to change professional behaviour and improve patient/caregiver participation in decision-making [18, 19]. This project focuses on two strategies to facilitate the implementation of professional training programs in SDM. Firstly, these programs should consider the logistical challenges of attending educational meetings for HCPs, especially those who work in remote areas [20]. In this project, we thus propose a distance training program that is accessible to all professionals, even those living away from the larger centres where continuing professional development activities generally take place. Secondly, we propose using user-centered design to tailor a professional training program to the actual needs and barriers faced by HCPs, as this is a promising approach to ensure that training on SDM leads to actual behaviour change [21, 22]. Indeed, evidence from systematic reviews shows that continuing professional development programs built on well-conducted needs assessments are effective in changing clinicians' behaviours [23]. Training needs assessments have traditionally been achieved through practice audits, questionnaires, environmental scans, or interviews, but the value of user-centered design to this end remains unexplored. User-centered design, which includes design thinking, consists of involving target users in several iterative rounds of evaluations and modifications, to tailor the design of a product to a given task and to the user’s experience [24,25,26,27]. In the field of healthcare, preliminary evidence suggests that user-centered design may enhance the implementation in practice of evidence-based information [26, 28, 29] and patient decision aids [30,31,32,33].

In this research project, we studied how user-centered design and theory contribute to the development of a distance learning program to support HCPs in implementing SDM with older adults living with neurocognitive disorders and their family/friend caregivers. More specifically, the investigation was guided by the following overarching research question: What are the features of the training program and design strategies that may increase HCPs’ intention to adopt SDM in this clinical context?

Theoretical framework

SDM requires the adoption of a diverse set of behaviours by HCPs [34, 35]. This project was thus based on the integrated framework proposed by Godin and al, according to which a behaviour may be predicted by a person’s intention (motivation) to adopt it (Fig. 1) [36]. A person’s intention may, in turn, be predicted by several determinants, including belief about consequences (the perceived advantage or disadvantage of adopting a behaviour), social influence (the perceived social pressure to adopt a behaviour), and beliefs about capabilities (perceived ease or difficulty of adopting a behaviour) [36]. In addition, intention can also be determined by habits/past behaviours and other social and emotional factors, namely moral norms (the feeling of being obliged to adopt a behaviour) and role/identity (beliefs that a person of similar age, sex, or social position should adopt a behaviour) [36]. We then added to this general model the Technology Acceptance Model (TAM-2), which identifies usefulness and ease of use as two specific determinants which could predict users’ intention to use new information technology/information systems [37]. Despite the fact that these two domains are similar to, respectively, the Beliefs about Consequences and Beliefs about Capabilities domains described in the integrated framework, we added them to draw more attention to acceptance (usability and acceptability) of the two studied learning components [38], and thus complement the integrated framework, which is focused on motivation. Use of both the TAM-2 and integrated framework constructs allowed evaluating two dimensions of intention, namely motivation (integrated framework) and acceptance (TAM-2).

Fig. 1
figure 1

Theoretical model framing the current research

Full size image

Methods

Study design and approach

This was a convergent, parallel, mixed-method study in which three HCP subsamples participated in the tailoring of a professional training program. A first subsample helped tailor the first component of the program (the e-learning activity), whereas the second and third helped tailor the second component (a series of five evidence summaries). We used user-centered design approaches for tailoring each component, by improving user experience of the prototypes during several iterative evaluations that each comprised both quantitative and qualitative data collection [39].

Professional training program on shared decision making

Details on the training program are reported elsewhere [40]. Briefly, the training program included two modalities: (1) a self-directed e-learning activity on SDM, and (2) five evidence summaries, decision boxes (DBs), to support decision-making at the point of care with older adults living with neurocognitive disorders and their caregivers. The self-directed e-learning activity covered the use of patient decision aids to implement SDM. It lasted about one hour, could be completed in several sittings, and was not specific to any clinical area. It was interactive and used narrated slides, videos, and interactive exercises. It also offered an asynchronous forum to discuss any question with an experienced moderator.

The second modality of the training program consisted of a series of five evidence summaries describing the options available to older adults living with neurocognitive disorders who face five important and frequent decisions that we identified in a previous study [41]. These decisions were: (#1) choosing a support option to decrease caregiver burden; (#2) choosing a non-pharmacological treatment to manage agitation, aggression, or psychotic symptoms; (#3) deciding whether or not to stop driving following diagnosis; and (#4) choosing an option to improve quality of life; and (#5) deciding whether or not to prepare a power of attorney (called a “protection mandate” in Quebec, Canada) covering health, property, and financial matters;. The evidence summaries followed the decision box (DB) template, which aims to provide stakeholders with evidence in a format that supports them in SDM [42, 43]. Biefly, these summaries met several of the standards set by the International Patient Decision Aids Collaboration [44]: (1) they described the health condition for which a decision is required; (2) they explicitly stated the decision to be taken into consideration; (3) they described all the options available for this decision; and (4) they described the positive and negative characteristics of each option. Their content was developed from rapid reviews and then revised by clinical experts, as described earlier [45]. The studied summaries are available at www.decisionbox.ulaval.ca/en/ (Series on Older Adults – Problems with Thinking or Memory).

Population and recruitment strategy

We recruited convenience samples of HCPs from any profession (e.g., family physicians, nurses, and social workers) who practiced in family medicine clinics or homecare services in the province of Quebec, Canada. Of the primary care settings invited to participate in the project (46 clinics and 8 homecare services), 20 agreed to participate (16 clinics, 4 homecare services). Figure 2a, b describe the sample distribution for each training component. We carried three or four evaluations/tailoring rounds, with at least five HCPs during each round. These numbers respect human factors validation testing [46].

Fig. 2
figure 2

User-centered design process to tailor the training program to user needs. DB #1 = Choosing a support option to decrease caregiver burden; DB #2 = Choosing a non-pharmacological treatment to manage agitation, aggression, or psychotic symptoms; DB #3 = Deciding whether or not to stop driving following diagnosis; DB #4 = Choosing an option to improve quality of life; DB #5 = Deciding whether or not to prepare a power of attorney; HCP = HCP; v = version

Full size image

Design process of the e-learning activity

E-learning activity evaluations

At study entry, all study participants completed a questionnaire on their sociodemographic and professional characteristics. The study participants assigned to evaluate the e-learning activity also completed a questionnaire before and after exposure to the activity, to assess: (1) their preferred role in decision-making using the Control Preferences Scale [47, 48]; (2) their perception of the usefulness and ease of use of the program based on TAM-2 [49]; (3) their level of intention to adopt SDM, and the factors influencing that intention using the CPD-REACTION instrument [50]. To allow calculating means for each of the studied factors, we added three items to the original CDP-REACTION instrument, giving it three items per domain.

These participants also assessed the e-learning activity during a semi-structured think-aloud session that was screen-captured and audio-recorded using Flashback (Blueberry Software). One of two trained moderators (DC, YT) conducted these sessions. After each section of the training, the moderator asked participants about their perceptions on the content and learning strategies used, and recorded any usability issues. At the end of the session, the moderator also asked participants to comment on the main benefits and inconveniences of SDM, which allowed us to describe the factors influencing participants’ beliefs about the consequences of using SDM, one of the components of the theoretical framework guiding this work (Fig. 1).

E-learning activity tailoring

Inspired by Susan Michie’s mapping approach, we modified the e-learning activity by adding/enhancing behaviour-change techniques targeting the factors likely to limit the adoption of SDM at each round [51, 52]. To this end, we initially imported the transcripts of the think-aloud sessions as source documents using NVivo coding software (QSR International, version 12). Two researchers (DC, AMCG) conducted a deductive/inductive thematic qualitative analysis of the factors likely to limit adoption of SDM [53]. More specifically, we initially used the theoretical domains framing the questionnaire as themes, and then added new themes as needed. We identified the weaknesses and strengths of the e-learning activity within each theme. We interpreted qualitative and quantitative data together and, following this analysis, the coders (DC, AMCG), moderators (DC, YT), principal investigators (AMCG, FL), and a human factors expert co-investigator (HOW) discussed the functionality of the tutorial and modifications to improve functionality and modify the program accordingly.

Design process of the decision boxes (DBs)

Decision boxes evaluations

The study participants assigned to evaluate the DBs received emails with a link to access a web-based questionnaire to evaluate each DB, at a rate of one per week for five weeks. The DBs were also available on a website. The questionnaire served to (1) explain the purpose of the DB; (2) allow participants to access the DB under evaluation by clicking on a link; and (3) ask a series of questions about what they thought of the DB.

Congruent with the theoretical approach adopted, we used two questionnaires to assess the psychological construct ‘intention’ and its potential determinants. We used the CPD-REACTION questionnaire, which is based on the integrated framework described above and was created as a routine assessment of the impact of continuing professional education on practice [50]. We also assessed the usefulness and ease of use of the DBs, based on the TAM-2 [49]. For each of the CPD-REACTION and TAM-2 items described above, participants rated their perceptions using Likert items ranging from 1–7 (with 1 being the lowest). If ratings fell below four for any item, we then asked the HCPs to explain the reason for their rating in an open-text field, to allow us to understand the barriers they perceived to adopting SDM. At the end of the questionnaire, an open-text field also invited participants to include any additional feedback on the DB.

We sent two weekly reminders to participants who had not completed their evaluations.

Decision boxes tailoring

After each round, we used descriptive statistics to summarize participant ratings. We also imported the qualitative comments made in the open-text fields of the questionnaire into a specialized software program (NVivo), and two researchers (MAL, AMCG) analyzed them using a thematic deductive/inductive qualitative analysis approach [53]. We initially used the theoretical domains framing the questionnaire as themes, then added subthemes as needed [53]. We identified the weaknesses and strengths of the DBs within each of the theoretical domains, then broke them down further into emerging themes, to describe the weakness or strength. We resolved any disagreement by consensus between the two researchers.

An interdisciplinary expert panel subsequently met to review the qualitative and quantitative findings, and identified strategies to improve the DB, so as to limit the identified weaknesses. The panel consisted of a graphic designer (JB), a human factors engineer (HOW), an epidemiologist (MAL), and four knowledge-translation researchers (AMCG, HOW, MAL, DC). The experts started by prioritizing each of the problems uncovered. Then, we determined the most appropriate solutions by considering the magnitude, frequency, and severity of these problems, and modified the DBs so that HCPs could explain the pros and cons of health options, as understood from the DBs, to patients and their caregivers.

We used the same evaluation/tailoring process again in two more rounds, with new participants each time.

Final quantitative analyses

We used descriptive statistical analyses to summarize participants’ characteristics, their interest in each DB topic, their level of intention, and the potential predicting determinants of their intention. We used SAS (Version 9.4, copyright 2002–2012, SAS Institute Inc.) to conduct these descriptive statistics, and a significance level of 0.05.

Integration of quantitative and qualitative findings

After the entire series of evaluation/tailoring rounds, we integrated the quantitative and qualitative findings to generate conclusions on the factors influencing intention, and on the changes in users’ intention as the rounds progressed.

Results

Study population

One hundred and six HCPs from 20 clinics and homecare services located in 13 cities, agreed to participate in this study. A first cohort of 16 HCPs was assigned to help design the e-learning activity, a second cohort of 36 different HCPs helped design the DBs in a three-round evaluation process, and a third cohort of 54 helped design the DBs by providing comments in a fourth evaluation round. These cohorts are represented in Fig. 3.

Fig. 3
figure 3

Description of participants’ samples in each of the three sub-studies. DB = decision box

Full size image

In the three cohorts, 78% of participants were women, 60% were physicians, and 57% had fewer than 20 years of practice (Table 1).

Table 1 Characteristics of study participants
Full size table

Tailoring of the training program

The data that was used to tailor the training program is presented in this section and summarized in the Fig. 4. In the following two subsections, we successively report participants' perceptions of the e-learning activity and decision boxes, and the strategies used to solve the problems discovered during the evaluation. In the third subsection, we present how participants' perceptions of SDM supported the tailoring of the training program.

Fig. 4
figure 4

HCPs’ experiences of the training program

Full size image

Tailoring of the e-learning activity based on user experiences

Participants expressed their appreciation of the content and design of the e-learning activity on numerous occasions, and in every section (Table 2). They especially liked the narrated slides, the quiz that informed them of actual patient numeracy levels, and the film depicting a simulated patient encounter during which SDM is implemented.

Table 2 Strengths of e-learning component of the program
Full size table

User-centered design initially allowed discovering several weaknesses of the e-learning activity. The approach then made it possible to remedy these weaknesses and then evaluate the impact of the changes made during the next evaluation round. For example, participants mentioned several elements lacking clarity, either in terms of the training component or the content (Table 3). We therefore systematically corrected the most specific issues (e.g. an acronym is undefined, a source is not cited) and they were not mentioned again by the participants in the following rounds. However, for the more general elements lacking clarity (e.g. the availability and content of the DBs, the main principles of SDM), we added an introductory video after Round #2. In Round #3, participants all mentioned appreciating this introductory video.

Table 3 Weaknesses of e-learning component of the program
Full size table

Several other types of issues were corrected systematically, such as usability issues, or features perceived as irrelevant or less valuable such as the videos with avatars, the introduction, or the training module explaining the evaluation of evidence quality. We either removed these elements, or made them optional for people interested in learning more.

We received several comments on the inapplicability of some of the examples across professions. Therefore, in the final version we diversified the professions displayed in the examples offered.

The activity required participants to extract the benefits and harms of patient decision aids from a scientific abstract of the Cochrane systematic review on their impact. Participants found the exercise difficult. We chose to try to improve the format of the exercise first, to make it easier. We therefore simplified the text of the abstract as much as possible, added pictograms and smiley faces to help identify the benefits and harms, and translated it into French, to further understanding of the information. We received no further negative comments from participants on this exercise thereafter.

Tailoring of the decision boxes based on user experiences

Participants reported general interest in the topics covered in the decision boxes (DBs), with an overall mean interest of 80% (± SD 11%). The DB perceived as least interesting concerned the power of attorney (67% ± SD 29%), and the one perceived as most interesting covered non-pharmacological treatment to manage agitation, aggression, or psychotic symptoms (88% ± SD 11%). Participants mentioned that they liked the visual design of the DBs, because it facilitates their use in practice, especially the tabular format presenting risks and benefits/harms (Table 4). Several participants also expressed their satisfaction with the informational content of the DBs, especially the information about the options. Some mentioned that the DBs helped make them aware of the options, or found that the options were relevant. One person appreciated the fact that the DB was available to support older adults in realizing, on their own, that their driving might be dangerous. They thought this might help maintain their relationship with patients.

Table 4 HCPs’ perceptions of the strengths of the Decision Boxes
Full size table

The limitations reported by study participants on the decision boxes allowed enhancing them to improve user experiences. Some of the modifications made were quite extensive. For example, several participants reported lower beliefs about their capabilities to use the DB to explain the pros and cons of health options to patients, because of the lack of accessibility to the services described in the DB (Table 5). We judged this a critical flaw, as if it remained unresolved, HCPs would not use the DB and adopt SDM. Therefore, to resolve this aspect, we added a section with a list of contact information for professional and community services available to implement the options offered in the DB, such as massage therapy, music therapy, and physical activity. Another critical flaw was that several participants perceived that they might not have enough time to use the DB. We therefore added some content describing the situations where SDM should be prioritized. We also added information about the possibility to delay decision-making to a subsequent consultation, and thus limit the time needed to go through the complete SDM process.

Table 5 HCPs’ perceptions of the weaknesses of the Decision Boxes by theoretical domain.
Full size table

In some cases, we chose not to attempt to resolve the issues raised. For example, some participants felt the statistics were too hard for patients and their family caregivers to understand. Since probabilities in numerical formats are required to understand risks, we chose not to change the risks presentation in the DBs. Instead, we modified the e-learning activity by adding a module describing best practices to communicate risks to people with lower numeracy skills.

Similarly to the e-learning activity, many of the participants’ comments were specific and easily addressed. For example, participants mentioned that the information was too dense, the terminology challenging, or some usability issues. We therefore adjusted the content of the DBs to reduce their length and complexity, and thereby limit the time needed to understand them, without compromising their meaning. We kept the use of jargon to a minimum, and added a glossary where we were unable to find simplified terminology. We also synthesized the scientific information on the pros and cons of the options in summary tables where possible. When there were more than two options for a given clinical situation, we added a table setting out the potential options for the decision at hand on the first page, including the estimates of the probabilities of impacts for each option, as well as the corresponding page detailing the impacts.

A few physicians reported that the topic covered by DB #5 (Power of Attorney) was irrelevant to their professional role. In an earlier Delphi study [41], we identified a need in primary care practices for decision support regarding this topic. We consequently attempted to improve DB #5 by making some of the legal aspects of the power of attorney easier to understand so that HCPs, especially physicians, can take ownership of the content and become more comfortable discussing it with their patients.

Tailoring content based on participants perceptions of SDM

We explored participants’ beliefs about consequences, or usefulness of SDM process after completing the e-learning activity. Participants’ descriptions of the benefits and inconveniences of SDM (Table 6), were very useful to appraise participants knowledge after training, and tailor the content to improve knowledge. Several of these comments pointed to known barriers to adopting SDM. We added specific content to the existing modules to address each of these concerns. Overall, these comments led us to describe several strategies for adopting SDM in diverse clinical situations, for example, where time is limited, when there is an emergency and a decision cannot be delayed, when the patients’ preferences go against those of the professional, when risk is low, or when there are several decisions to be made. We also clarified the role of HCPs in situations where the patient’s choice appears contrary to public health recommendations.

Table 6 Participant perceptions of the pros and cons of adopting shared decision-making (SDM) as assessed using open-ended questions after participants’ exposure to the e-learning activity
Full size table

Some of the participants’ comments after reading a decision box also point to a lack of knowledge about SDM, for example that DBs are of little use when stating their opinion or making recommendations (Table 6). To improve understanding of the SDM approach, we added an introductory paragraph to all DBs, entitled “What's this document for?” which described the general SDM approach. We also added patient stories to most of the DBs, usually demonstrating an encounter between a patient and a clinician, to demonstrate the value of seeking patient priorities. The stories were created from testimonies gathered online and were validated by the expert panel. These strategies proved effective, as we received no more comments suggesting that SDM might not be well understood after these changes.

Changes in the level of intention as the rounds progressed

E-learning activity

Visual examination of the quantitative descriptive results suggests that there was no change in participants' intention to adopt SDM after their participation in the e-learning activity. Intention was relatively high and stable across the three rounds, with a mean level of 6.8, on a scale ranging from 1 (low intention) to 7 (high intention) (Additional file 1). Mean levels of potential factors influencing intention were also relatively high, ranging from 5.6 to 7.0, on a scale ranging from 1 to 7.

DBs: Levels of intention and the determinants of this intention

Participants’ level of intention to use what they learned through the DB to explain the pros and cons of health options to patients was also relatively high and stable across the three rounds, with a mean level of 5.7 for all the DBs (Fig. 5a, Additional file 2). Mean levels of potential factors influencing intention were also relatively high, ranging from 4.5 to 6.4, on a scale of 1 to 7. Participants’ level of satisfaction was generally positive, with mean values of 4.2 on a scale ranging from 1 (low satisfaction) to 5 (high satisfaction) (Fig. 5b–g).

Fig. 5
figure 5

Mean levels of participant intention and its determinants after their review of each decision box, at each round. Legend: DB = decision box; R = round; SD = standard deviation

Full size image

Discussion

In this study, we used theory-based and user-centered design approaches to tailor a professional training program on SDM to the needs of primary healthcare clinicians. This process led to three main findings: (1) the use of theory and user-centred design makes it possible to tailor the training program to users’ needs, the effectiveness of this approach being better assessed through qualitative than quantitative techniques; (2) each of the two studied training components appears essential to supporting the adoption of SDM; and (3) training should be tailored to each profession.

Usefulness of theory-based and user-centered design approaches

The theory-based and user-centered design approach enabled us to identify the strengths and weaknesses of the two training components, and to improve their content, design, navigation, and usability, while solving any technical issues.

The theory-based approach allowed focusing on the known determinants most likely to influence participants’ intention to adopt SDM, a strategy previously recommended in the Behavior Change Wheel Model [52] and in a systematic review of the effectiveness of tailored interventions [54]. Légaré et al. also recommend that the development of Continuing Professional Development activities be based on behaviour change theories, to equip HCPs with the skills needed to change their practice, and ultimately improve clinical performance for the benefit of patients [55]. The use of theory also has the potential to systematically highlight the influences of individual perceptions on the adoption of a targeted behaviour, and thus facilitate the comparison of results obtained with those of other studies interested in implementation science, and ultimately improve the uptake of research findings in practice [56].

Furthermore, the user-centered design approach allowed us to focus on the learners’ perspective of the problem by validating our interpretation of their assessments during the next evaluation round. Several earlier studies have described the benefits of user-centered design to create evidence-based information [30, 31, 57,58,59,60,61], supporting the adoption of these tools in healthcare contexts [62]. However, to the best of our knowledge, no other study to date has used assessments of intention and its determinants within a user-centered design approach to support improvement to tools or training. Future studies should aim to evaluate whether this type of program design improves the adoption of evidence-based practice and patient outcomes.

However, although the use of theory within an iterative user-centered design approach makes it possible to develop high-quality training, it required considerable resources and a continuous commitment from the research team, as previously highlighted in another study [63]. We also found that the semi-structured interviews used during the think-aloud session to optimize the e-learning component were superior to the questionnaires used to evaluate the DBs, despite the fact that the questionnaires used open-text fields that were also analyzed qualitatively. Indeed, the interviews provided greater insight into the weaknesses and strengths of the training components, and allowed us to better adapt the program so as to limit its weaknesses. This coincides with the finding elsewhere that interviews are more robust and provide greater data quality than open-ended survey questions [64].

Findings from this study and from two of our other recent study on user-centered design [31, 65], led to the observation that our systematic approach consisting in modifying a tool every three evaluations is perhaps not optimal. Indeed, if a major problem is discovered after a single evaluation, then modifying this aspect immediately before the next evaluation allows conducting a more useful evaluation in the following round, and optimizing the whole process. This ‘organic’ approach is what is described in the website design literature from which user-centered design originates [66].

The CPD-reaction questionnaire to assess the DBs was also limited in that it was already near to the maximum after a single evaluation round, leaving very little room to measure improvements through subsequent rounds. These results are consistent with those of previous studies that reported a strong intention of clinicians to support women in breast cancer decision-making [67] and a high intention to use DBs in their practice [42]. The examination of the determinants of intention across rounds was therefore more useful than the study of intention to support design of the training program.

Each training component is important

Overall, our study revealed that each of the two training components was essential for professionals to adopt SDM (Table 7). Firstly, the generic e-learning activity provided knowledge on the theory and practice of SDM. Then, the DBs allowed learners to implement the recommendations in practice, by providing the practical information to discuss specific health matters with their patients. The DBs thus enabled learners to apply the knowledge gained through the e-learning activity to diverse clinical contexts. In the scientific literature, authors are unanimous in observing a lack of structured frameworks to guide the design of e-learning to meet both theoretical and practical needs [68, 69]. DBs, with their simple vocabulary and with their list of services available near to the patient’s home, provide a way to bridge the gap between general knowledge in SDM and its application in specific contexts and for localized populations. In addition, DBs include simple vocabulary and definitions to support professionals in explaining more complex concepts to their patients. They also provide a list of the services available near the patient’s home in order to support implementation of the selected option. This concurs with the findings of a recent integrative review on e-learning to deliver self-management support, that show that incorporating practice and application opportunities improves training effectiveness [68].

Adapting training to each profession and area

Despite the interprofessional context of care, participants asked that training be adapted to their specific professional role. Indeed, both in the evaluations of DBs and e-learning activity, professionals asked that the clinical examples provided during training match each of their professions. This finding is congruent with the observations that, for continuing professional development to be valued, it must meet the individual needs of professionals, the populations they serve, and the organizations in which they work [70]. This may be because professionals find it more useful and optimal to further their knowledge in areas where they are comfortable. It might also be because they require more incentive to extend their scope of practice, such as a better understanding of the relevance of doing so. This finding converges with conclusions reported in a recent qualitative study to the effect that primary care physicians only read printed educational materials relevant to their patients [71]. Consequently, it might be better to allow participants to select the DBs that coincide with their interests and areas of clinical intervention.

We also found that, for clinicians to consider using the DBs, they should list the health and social services needed to implement the options presented, along with the related contact information. This implies that any decision aid should be tailored to the area where it is distributed.

Table 7 Participants’ perceptions of how each program component could facilitate their adoption of shared decision-making
Full size table

Determinant of participants’ intention to adopt SDM

In each evaluation round, we observed significant associations between intention and two of its primary determinants, namely beliefs about consequences (or attitude) and social influence. These findings concur with those of an extensive review of the determinants of clinician behaviours, to the effect that said determinants are among those most related to intention [36]. This also confirms previous findings on the influence of these primary determinants on HCPs’ intention to adopt SDM [72], to engage in an interprofessional approach to SDM [73], to participate in a training program in SDM [20], and to use DBs in clinical practice [42]. It is of note that, despite HCPs’ strong intention and the adaptation of tools to users, certain factors external to the training program, including the lack of access to services in some regions, as well as the lack of time, are difficult to control and can still influence the effective use of these tools and the adoption of SDM in practice. In addition, although intention is a useful approximation of actual behavior [74], it may be higher than actual behavior due to a social desirability bias.

Study limitations

Despite its comprehensiveness, our study has some limitations

The use of a non-random study sample may also have affected the results by introduction of selection bias. For instance, we may have recruited HCPs with higher intentions to adopt shared decision-making compared to the overall population of professionals who practice in primary care settings. This selection bias could then be responsible for the high intentions we observed in the participants from the start of the study.

The sample sizes were relatively small for the planned quantitative evaluations. Our conclusions were limited by the fact that the quantitative scores showed a ceiling effect. Nevertheless, the qualitative evaluation of each component allowed for a rich description to complement the quantitative results.

The literature indicates that professionals’ intention alone does not always predict SDM adoption [74] or the effective use of SDM tools [75]. It would therefore be interesting for future research to evaluate if professional training programs encourage SDM adoption directly, not only on intention to do so.

We used convenience samples, so the participants who accepted to participate may be different from the general population.

Most participants were physicians and nurses, and none practiced in rural areas. Our conclusions may therefore not apply to other types of professionals, or to those practicing in rural areas. Moreover, our findings may have been different if more social workers had participated in the study, especially since the DB topics concerned social aspects of care. We also acknowledge the high proportion of participants who were women (78%); however, this proportion reflects the overall gender balance among HCPs in Quebec [76].

Some of the comments received during the evaluation of the DBs via the open-text field of the web-based questionnaire were hard to interpret and would have required further discussion with the participants to clarify their opinions.

Conclusions

A theory-based design approach for continuing professional development interventions on shared decision-making appeared particularly useful to identify the most important determinants of learners’ intentions to use SDM in their clinical practice. A user-centered approach allowed focusing on learners’ perspectives of the problem by validating our initial interpretations of their assessments during the subsequent evaluation round. Participants’ qualitative assessments of the programme provided greater insight into the weaknesses of the training and allowed us to better adapt the program than their quantitative assessments. We also observed a complementarity of the two studied training components, with the e-learning activity providing knowledge on the theory and practice of SDM, and the decision boxes providing the practical information needed to discuss specific health questions with older patients with neurocognitive disorders and their family or friend caregiver. In future research, it would be interesting to compare a group exposed to training tailored using such a theory-based user-centered design approach, to a group exposed to non-tailored training, to assess whether this design approach actually creates a more effective training program to increase adoption of SDM by health professionals. Further research is also needed to evaluate this two-component training program and to highlight the barriers and facilitators for its completion, in order to optimize its implementation and ensure effective uptake and use of SDM.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

DB:

Decision box

HCP:

Healthcare professional

IAM:

Information Assessment Method

SDM:

Shared Decision Making

TAM-2:

Technology Acceptance Model

TPB:

Theory of Planned Behaviour

References

  1. Groen-van de Ven L, Smits C, Oldewarris K, Span M, Jukema J, Eefsting J, et al. Decision trajectories in dementia care networks: decisions and related key events. Res Aging. 2016;39:1039–71. https://doi.org/10.1177/0164027516656741.

  2. Groen-van de Ven L, Smits C, Elwyn G, Span M, Jukema J, Eefsting J, et al. Recognizing decision needs: first step for collaborative deliberation in dementia care networks. Patient Educ Couns. 2017;100:1329–37. https://doi.org/10.1016/j.pec.2017.01.024.

  3. Charles C, Gafni A, Whelan T. Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999;49:651–61.

    Article  CAS  Google Scholar 

  4. Legare F, Stacey D, Briere N, Robitaille H, Lord MC-. C, Desroches S, et al. An interprofessional approach to shared decision making: an exploratory case study with family caregivers of one IP home care team. BMC Geriatr. 2014;14:83. https://doi.org/10.1186/1471-2318-14-83.

  5. Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27:1361–7. https://doi.org/10.1007/s11606-012-2077-6.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Khanassov V, Vedel I. Family physician-case manager collaboration and needs of patients with dementia and their caregivers: a systematic mixed studies review. Ann Fam Med. 2016;14:166–77. https://doi.org/10.1370/afm.1898.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Moore A, Patterson C, Lee L, Vedel I, Bergman H. Fourth Canadian consensus conference on the diagnosis and treatment of dementia: recommendations for family physicians. Can Fam Physician. 2014;60:433–8.

  8. Spenceley SM, Sedgwick N, Keenan J. Dementia care in the context of primary care reform: an integrative review. Aging Ment Heal. 2015;19:107–20.

    Article  Google Scholar 

  9. Daly RL, Bunn F, Goodman C. Shared decision-making for people living with dementia in extended care settings : a systematic review. 2018;:1–11.

  10. Groen-van de Ven L, Smits C, Span M, Jukema J, Coppoolse K, de Lange J, et al. The challenges of shared decision making in dementia care networks. Int Psychogeriatr. 2016;30:1–15.

  11. Miller LM, Whitlatch CJ, Lyons KS. Shared decision-making in dementia: A review of patient and family carer involvement. Dement. 2016;15:1141–57.

    Article  Google Scholar 

  12. Stevenson M, McDowell ME, Taylor BJ. Concepts for communication about risk in dementia care: a review of the literature. Dement. 2018;17:359–90. https://doi.org/10.1177/1471301216647542.

    Article  Google Scholar 

  13. Daly R, Bunn F, Goodman C. Shared decision-making for people living with dementia in extended care settings: protocol for a systematic review. BMJ Open. 2016;6:e012955.

    Article  Google Scholar 

  14. Austin CA, Mohottige D, Sudore RL, Smith AK, Hanson LC. Tools to promote shared decision making in serious illness: a systematic review. JAMA Intern Med. 2015;175:1213–21. https://doi.org/10.1001/jamainternmed.2015.1679.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Beck ER, McIlfatrick S, Hasson F, Leavey G. Health care professionals’ perspectives of advance care planning for people with dementia living in long-term care settings: a narrative review of the literature. Dement. 2017;16:486–512. https://doi.org/10.1177/1471301215604997.

    Article  Google Scholar 

  16. Lai M, Jeon YH, McKenzie H. The key factors for the engagement of primary stakeholders in decision-making for the future care of people with dementia living in the community: a systematic integrative review. Int Psychogeriatr. 2019;:1–16. https://doi.org/10.1017/S104161021900005X.

  17. Mariani E, Vernooij-Dassen M, Koopmans R, Engels Y, Chattat R. Shared decision-making in dementia care planning: barriers and facilitators in two European countries. Aging Ment Heal. 2017;21:31–9. https://doi.org/10.1080/13607863.2016.1255715.

    Article  Google Scholar 

  18. Légaré F, Adekpedjou R, Stacey D, Turcotte S, Kryworuchko J, Graham ID, et al. Interventions for increasing the use of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2018;7:CD006732. https://doi.org/10.1002/14651858.CD006732.pub4.

  19. Coulter A. Shared decision making: everyone wants it, so why isn’t it happening? World Psychiatry. 2017;16:117–8. https://doi.org/10.1002/wps.20407.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Allaire AS, Labrecque M, Giguere A, Gagnon MP, Legare F. What motivates family physicians to participate in training programs in shared decision making? J Contin Educ Heal Prof. 2012;32:98–107. https://doi.org/10.1002/chp.21132.

    Article  Google Scholar 

  21. Deitte LA, Omary RA. The Power of Design Thinking in Medical Education. Acad Radiol. 2019.

  22. Gottlieb M, Wagner E, Wagner A, Chan T. Applying design thinking principles to curricular development in medical education. AEM Educ Train. 2017;1:21–6.

    Article  Google Scholar 

  23. Norman G, Shannon S, Marrin M. The need for needs assessment in continuing medical education. Br Med J. 2004;328:999–1001. https://acces.bibl.ulaval.ca/login?url=http://sfx.bibl.ulaval.ca:9003/sfx_local?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2015-12-04T15%3A32%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.co.

  24. Albert W, Tullis T. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes; 2013.

  25. Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inf. 2004;37:56–76.

    Article  Google Scholar 

  26. Rosenbaum SE, Glenton C, Nylund HK, Oxman AD. User testing and stakeholder feedback contributed to the development of understandable and useful Summary of Findings tables for Cochrane reviews. J Clin Epidemiol. 2010;63:607–19.

    Article  Google Scholar 

  27. Witteman HO, Dansokho SC, Colquhoun H, Coulter A, Dugas M, Fagerlin A, et al. User-centered design and the development of patient decision aids: Protocol for a systematic review. Syst Rev. 2015;4.

  28. Abras C, Maloney-Krichmar D, Preece J. User-centered design. In: Bainbridge W, editor. Encyclopedia of human-computer interaction. Thousand Oaks, Ca: Sage Publications; 2004.

  29. Kastner M, Lottridge D, Marquez C, Newton D, Straus SE. Usability evaluation of a clinical decision support tool for osteoporosis disease management. Implement Sci. 2010;5:96.

    Article  Google Scholar 

  30. Garvelink MM, Emond J, Menear M, Briere N, Freitas A, Boland L, et al. Development of a decision guide to support the elderly in decision making about location of care: an iterative, user-centered design. Res Involv Engag. 2016;2:26. https://doi.org/10.1186/s40900-016-0040-0.

    Article  Google Scholar 

  31. Bilodeau G, Witteman HO, Légaré F, Lafontaine-Bruneau J, Voyer P, Kröger E, et al. Reducing complexity of patient decision aids for community-based older adults with dementia and their caregivers: multiple case study of Decision Boxes. BMJ Open. 2019;9:e027727.

    Article  Google Scholar 

  32. Dehlendorf C, Fitzpatrick J, Steinauer J, Swiader L, Grumbach K, Hall C, et al. Development and field testing of a decision support tool to facilitate shared decision making in contraceptive counseling. Patient Educ Couns. 2017;100:1374–81. https://doi.org/10.1016/j.pec.2017.02.009.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Plaisance A, Witteman HO, LeBlanc A, Kryworuchko J, Heyland DK, Ebell MH, et al. Development of a decision aid for cardiopulmonary resuscitation and invasive mechanical ventilation in the intensive care unit employing user-centered design and a wiki platform for rapid prototyping. PLoS One. 2018;13 2 LB-UCD patient decision aid usability:e0191844.

  34. Elwyn G, Edwards A, Kinnersley P, Grol R. Shared decision making and the concept of equipoise: the competences of involving patients in healthcare choices. Br J Gen Pr. 2000;50:892–9. https://www.ncbi.nlm.nih.gov/pubmed/11141876.

  35. Makoul G, Clayman ML. An integrative model of shared decision making in medical encounters. Patient Educ Couns. 2006;60:301–12.

    Article  Google Scholar 

  36. Godin G, Belanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.

    Article  Google Scholar 

  37. Kukafka Johnson SB, Linfante AR, Kukafka R, Johnson SB, Linfante A, Allegrante JP. Grounding a new information technology implementation framework in behavioral science: a systematic analysis of the literature on IT use. J Biomed Inf. 2003;36:218–27.

    Article  Google Scholar 

  38. Wu L, Li J-Y, Fu C-Y. The adoption of mobile healthcare by hospital’s professionals: An integrative perspective. Decis Support Syst. 2011;51:587–96.

    Article  Google Scholar 

  39. U.S. Dept. of Health and Human Services, Services USD of H and H. The Research-Based Web Design & Usability Guidelines, Enlarged/Expanded edition. 2006;2014 16 June. http://usability.gov.

  40. Giguere AMC, Lawani MA, Fortier-Brochu É, Carmichael P-H, Légaré F, Kröger E, et al. Tailoring and evaluating an intervention to improve shared decision making among seniors with dementia, their caregivers and healthcare providers: study protocol for a randomized controlled trial. Trials. 2018;19:332. https://doi.org/10.1186/s13063-018-2697-1.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Poirier A, Voyer P, Légaré F, Morin M, Witteman HO, Kröger E, et al. Caring for seniors living with dementia means caring for their caregivers too. Can J Public Heal. 2018;108:639. https://doi.org/10.17269/cjph.108.6217.

    Article  Google Scholar 

  42. Giguere AMC, Labrecque M, Haynes RB, Grad R, Pluye P, Legare F, et al. Evidence summaries (decision boxes) to prepare clinicians for shared decision-making with patients: a mixed methods implementation study. Implement Sci. 2014;9:144.

    Article  Google Scholar 

  43. Giguere A, Legare F, Grad R, Pluye P, Haynes RB, Cauchon M, et al. Decision boxes for clinicians to support evidence-based practice and shared decision making: the user experience. Implement Sci. 2012;7:72. https://doi.org/10.1186/1748-5908-7-72.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Joseph-Williams N, Newcombe R, Politi M, Durand MA, Sivell S, Stacey D, et al. Toward minimum standards for certifying patient decision aids: a modified delphi consensus process. Med Decis Mak. 2014;34:699–710. https://doi.org/10.1177/0272989X13501721.

    Article  Google Scholar 

  45. Lawani MA, Valéra B, Fortier-Brochu, Légaré F, Carmichael P-H, Côté L, et al. Five shared decision-making tools in 5 months: use of rapid reviews to develop decision boxes for seniors living with dementia and their caregivers. Syst Rev. 2017;6:56.

  46. U.S. Department of Health and Human Services Food and Drug Administration. Applying Human Factors and Usability Engineering to Medical Devices: Guidance for Industry and Food and Drug Administration Staff. Rockville (MD); 2016. http://www.fda.gov/downloads/MedicalDevices/.../UCM259760.pdf.

  47. Degner LF, Kristjanson LJ, Bowman D, Sloan JA, Carriere KC, O’Neil J, et al. Information needs and decisional preferences in women with breast cancer. Jama. 1997;277:1485–92. http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=9145723.

  48. Strull WM, Lo B, Charles G. Do patients want to participate in medical decision making? JAMA. 1984;252:2990–4. https://www.ncbi.nlm.nih.gov/pubmed/6502860.

  49. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manage Sci. 2000;46:186–204.

    Article  Google Scholar 

  50. Légaré F, Freitas A, Turcotte S, Borduas F, Jacques A, Luconi F, et al. Responsiveness of a simple tool for assessing change in behavioral intention after continuing professional development activities. PLoS ONE. 2017;12:e0176678. https://doi.org/10.1371/journal.pone.0176678.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57:660–80.

    Article  Google Scholar 

  52. Michie S, van Stralen MM, West R. The Behaviour Change Wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.

    Article  Google Scholar 

  53. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5:80–92.

    Article  Google Scholar 

  54. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;:CD005470. https://doi.org/10.1002/14651858.CD005470.pub3.

  55. Légaré F, Freitas A, Thompson-Leduc P, Borduas F, Luconi F, Boucher A, et al. The majority of accredited continuing professional development activities do not target clinical behavior change. Acad Med. 2015;90:197–202. https://doi.org/10.1097/ACM.0000000000000543.

    Article  PubMed  Google Scholar 

  56. Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58:107–12. https://doi.org/10.1016/j.jclinepi.2004.09.002.

    Article  PubMed  Google Scholar 

  57. Woodard TL, Hoffman AS, Covarrubias LA, Holman D, Schover L, Bradford A, et al. The Pathways fertility preservation decision aid website for women with cancer: development and field testing. J Cancer Surviv. 2018;12:101–14. https://doi.org/10.1007/s11764-017-0649-5.

    Article  PubMed  Google Scholar 

  58. Melnick ER, Hess EP, Guo G, Breslin M, Lopez K, Pavlo AJ, et al. Patient-centered decision support: formative usability evaluation of integrated clinical decision support with a patient decision aid for minor head injury in the Emergency Department. J Med Internet Res. 2017;19:e174. https://doi.org/10.2196/jmir.7846.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Henderson VA, Barr KL, An LC, Guajardo C, Newhouse W, Mase R, et al. Community-based participatory research and user-centered design in a diabetes medication information and decision tool. Prog Community Heal Partnersh. 2013;7:171–84. https://doi.org/10.1353/cpr.2013.0024.

    Article  Google Scholar 

  60. Thursky KA, Mahemoff M. User-centered design techniques for a computerised antibiotic decision support system in an intensive care unit. Int J Med Inf. 2007;76:760–8. https://doi.org/10.1016/j.ijmedinf.2006.07.011.

    Article  Google Scholar 

  61. Williams PA, Furberg RD, Bagwell JE, LaBresh KA. Usability testing and adaptation of the pediatric cardiovascular risk reduction clinical decision support tool. JMIR Hum Factors. 2016;3:e17. https://doi.org/10.2196/humanfactors.5440.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Luna D, Quispe M, Gonzalez Z, Alemrares A, Risk M, Garcia Aurelio M, et al. User-centered design to develop clinical applications. Literature review. Stud Heal Technol Inf. 2015;216:967. https://www.ncbi.nlm.nih.gov/pubmed/26262269.

  63. Fleisher L, Ruggieri DG, Miller SM, Manne S, Albrecht T, Buzaglo J, et al. Application of best practice approaches for designing decision support tools: the preparatory education about clinical trials (PRE-ACT) study. Patient Educ Couns. 2014;96:63–71. https://doi.org/10.1016/j.pec.2014.04.009.

    Article  PubMed  PubMed Central  Google Scholar 

  64. LaDonna KA, Taylor T, Lingard L. Why open-ended survey questions are unlikely to support rigorous qualitative insights. Acad Med. 2018;93:347–9. https://doi.org/10.1097/ACM.0000000000002088.

    Article  PubMed  Google Scholar 

  65. Bogza L, Patry-Lebeau C, Farmanova E, Witteman HO, Elliott J, Stolee P, et al. Design of a web-based decision aid to support explicit values clarification and informed decision making of older adults with mild cognitive impairment and their healthcare providers. JMIR. 2020.

  66. Nielsen J. Why You Only Need to Test with 5 Users. 2000;2011 15 December. http://www.useit.com/alertbox/20000319.html.

  67. Kiyang L-N, Labrecque M, Doualla-Bell F, Turcotte S, Farley C, Bas MC, et al. Family physicians’ intention to support women in making informed decisions about breast cancer screening with mammography: a cross-sectional survey. BMC Res Notes. 2015;8:663.

    Article  Google Scholar 

  68. Lawn S, Zhi X, Morello A. An integrative review of e-learning in the delivery of self-management support training for health professionals. BMC Med Educ. 2017;17:183. https://doi.org/10.1186/s12909-017-1022-0.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Sluijsmans DMA, Prins FJ, Martens RL. The design of competency-based performance assessment in e-learning. Learn Environ Res. 2006;9:45.

    Article  Google Scholar 

  70. Schostak J, Davis M, Hanson J, Schostak J, Brown T, Driscoll P, et al. “Effectiveness of continuing professional development” project: a summary of findings. Med Teach. 2010;32:586–92. https://doi.org/10.3109/0142159X.2010.489129.

    Article  PubMed  Google Scholar 

  71. Grudniewicz A, Bhattacharyya O, McKibbon KA, Straus SE. User-centered design and printed educational materials: a focus group study of primary care physician preferences. J Contin Educ Heal Prof. 2016;36:249–55. https://doi.org/10.1097/CEH.0000000000000112.

    Article  Google Scholar 

  72. Thompson-Leduc P, Clayman ML, Turcotte S, Légaré F. Shared decision-making behaviours in health professionals: a systematic review of studies based on the theory of planned behaviour. Heal Expect. 2015;18.https://doi.org/10.1111/hex.12176.

  73. Legare F, Stacey D, Briere N, Fraser K, Desroches S, Dumont S, et al. Healthcare providers’ intentions to engage in an interprofessional approach to shared decision-making in home care programs: a mixed methods study. J Interprof Care. 2013;27:214–22. https://doi.org/10.3109/13561820.2013.763777.

    Article  PubMed  PubMed Central  Google Scholar 

  74. Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, et al. Do self- reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28. https://doi.org/10.1186/1748-5908-1-28.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Graham ID, Logan J, Bennett CL, Presseau J, O’Connor AM, Mitchell SL, et al. Physicians’ intentions and use of three patient decision aids. BMC Med Inf Decis Mak. 2007;7:20.

    Article  Google Scholar 

  76. Cloutier-Villeneuve L, Rabemananjara J. Portrait de la situation des Québécoises sur le marché du travail au cours des 35 dernières années. 2016. http://www.stat.gouv.qc.ca/statistiques/travail-remuneration/bulletins/cap-remuneration-201603.pdf.

Download references

Acknowledgements

We wish to acknowledge the contribution of our caregiver partner, Juliette Bruneau, for her revisions of the e-learning activity and Decision Boxes. We also wish to acknowledge the help received from several experts who reviewed the content of the training program, especially Michel Cauchon, Johanne Senneville, Dominique Giroux, Magalie Dumas, and Dominique Stibre. We would, furthermore, like to recognize the contribution of several students and professionals who participated in the literature reviews to create the Decision Boxes, namely Béatriz Valéra, Philippe Jacob, Danielle Caron, Audrey Michaud, Eyal Derhy, Elizabeth Parenteau, Nelia Domingues, Valérie Carnovale, and Emilie Fortier-Brochu. Special thanks to Danielle Caron and Emilie Fortier-Brochu for helping create the e-learning activity. Lastly, we wish to thank Josée Boulet and Danielle Caron for designing the Decision Boxes, Pierre-Hugues Carmichael for helping conduct statistical analyses, and Katherine Hastings for writing assistance.

Funding

This project was funded by the Ministère de l’Économie, de l’Innovation et de l’Exportation du Québec and by the Société de Valorisation (SOVAR). We also received in-kind support from the Office of Education and Continuing Professional Development at Laval University and from University Laval Research Centre on Community-Based Primary Health Care. MAL is funded by a fellowship from VITAM, the Research Centre on Sustainable Health. AMCG and HOW are funded by Research Scholar Junior 2 Career Development Awards by the Fonds de Recherche du Québec—Santé. FL is funded by a Tier 1 Canadian Research Chair in Shared Decision Making and Knowledge Translation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Laval University, Pavillon Ferdinand-Vandry, Room 2881, 1050 avenue de la Médecine, Quebec, QC, G1V 0A6, Canada

    Moulikatou Adouni Lawani & Holly O. Witteman

  2. CISSS de la Gaspésie – Service externe de gériatrie ambulatoire, 455 rue Mgr Ross Est, Chandler, QC, G0C 1K0, Canada

    Yves Turgeon

  3. Laval University, Pavillon Ferdinand-Vandry, Room 1323, 1050 avenue de la Médecine, Quebec, QC, G1V 0A6, Canada

    Luc Côté

  4. VITAM Research Centre on Sustainable Health, Pavillon Landry-Poulin, Pavillon Landry-Poulin, Door A-1-2, 4th floor, Room 4578, 2525 Chemin de la Canardière, Québec, QC, G1J 0A4, Canada

    France Légaré

  5. Laval University, Pavillon Ferdinand-Vandry, room 4211, 1050 avenue de la Médecine, Quebec, QC, G1V 0A6, Canada

    Michèle Morin

  6. Quebec Excellence Centre in Aging, St-Sacrement Hospital, 1050 chemin Ste-Foy, Quebec, QC, G1S 4L8, Canada

    Edeltraut Kroger

  7. Pavillon Ferdinand-Vandry, Room 3445, 1050 avenue de la Médecine, Quebec, QC, G1V 0A6, Canada

    Philippe Voyer

  8. Departmentof Family Medicine, McGill University, 5858 chemin de la Côte-des-Neiges, 3rd floor, Montreal, QC, H3S 1Z1, Canada

    Charo Rodriguez

  9. VITAM Research Centre on Sustainable Health, Pavillon Landry-Poulin, Door A-1-2, 2nd floor, Room 2416, 2525 Chemin de la Canardière, Québec, QC, G1J 0A4, Canada

    Anik Giguere

Authors
  1. Moulikatou Adouni Lawani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yves Turgeon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luc Côté
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. France Légaré
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Holly O. Witteman
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michèle Morin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Edeltraut Kroger
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Philippe Voyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Charo Rodriguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Anik Giguere
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AMCG planned the study with FL. AMCG supervised the team and coordinated data collection. MAL, YT, and AMCG participated to data collection. MAL, AMCG, FL, YT, HOW, MM, EK, PV and CR participated in the interpretation of the data to improve the training program. MAL and AMCG conducted the final data analyses and prepared the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Anik Giguere.

Ethics declarations

Ethics approval and consent to participate

We obtained ethical approval for this project from the Ethics Review Board of the Ministre de la Santé et des Services Sociaux du Québec (reference CCER15-16-05) and the Centre Hospitalier Universitaire de Québec (reference 2016-2521). All participants signed an informed consent prior to participation in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Participants’ level of intention to adopt shared decision-making and levels of the potential predictors of this intention at baseline and after each evaluation round of the e-learning activity (scale ranges from 1-7).

Additional file 2.

Participants’ level of intention to use what they learned through the DBs to explain the pros and cons of health options to patients, and levels of the potential predictors of this intention at each evaluation round (scale ranges from 1-7).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lawani, M.A., Turgeon, Y., Côté, L. et al. User-centered and theory-based design of a professional training program on shared decision-making with older adults living with neurocognitive disorders: a mixed-methods study. BMC Med Inform Decis Mak 21, 59 (2021). https://doi.org/10.1186/s12911-021-01396-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-021-01396-y

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us