- Study protocol
- Open Access
Development and field testing of a patient decision aid for management of acute Achilles tendon rupture: a study protocol
BMC Medical Informatics and Decision Making volume 21, Article number: 225 (2021)
Achilles tendon ruptures are common injuries in an otherwise healthy, active population. Several treatment options exist, with both surgical and non-surgical options. Each treatment option has a unique set of risks and harms, which may present patients with decisional conflict. The aim of the proposed study is to develop, alpha test and field test a patient decision aid for patients presenting with acute Achilles tendon ruptures.
This is a three-stage study protocol. First, we will assemble a multi-disciplinary steering group including patients, clinicians, educators, and researchers to develop the patient decision aid prototype using the Ottawa Decision Support Framework. Second, we will perform a mixed-methods alpha test of the decision aid prototype with patients and clinicians experienced in acute Achilles tendon ruptures. Outcomes measured will include acceptability and usability of the patient decision aid measured using validated outcome scales and semi-structured interviews. A minimum of three rounds of feedback will be obtained. Results will be analyzed using descriptive statistics, reviewed by the steering group, to guide revisions to decision aid prototype at each round. The third stage will be field testing the revised decision aid prototype in usual clinical care. A pre-/post-study will be performed with patients with acute Achilles tendon ruptures. Patients will be recruited from the emergency department and complete the pre-consultation decision aid prior to a one-week follow up with their surgeon. The primary outcome of field testing will be feasibility of implementing the decision aid in the clinical setting and will be measured with recruitment and completion metrics. Secondary outcomes include acceptability of the decision aid, knowledge, preparedness for decision making, and decisional conflict, measured using validated outcome measures. Statistical analysis will be performed using descriptive analysis for primary outcomes and a student t-test and Wilcoxon Rank-Sum test for secondary outcomes.
This comprehensive study protocol outlines the development, alpha testing, and field testing of a patient decision aid for patients with acute Achilles tendon rupture. Systematic and transparent development and testing of patient decision aids is critical to improve decision aid quality.
Trial registration Not Applicable.
Patients presenting to hospital with an acute Achilles tendon rupture are faced with an important decision regarding treatment management: to have surgery or pursue conservative management. There are harms and benefits to each approach. Historically, non-operative care has been associated with a higher tendon re-rupture rate, and surgery with the risks of surgical complications including infections, wound healing problems, and subsequent surgery .
The decision is made more complex by the existence of varying non-operative and surgical treatment options [1, 2]. Non-operative management has evolved from a period of prolonged immobilization in a cast to allow tendon healing, to early motion and functional rehabilitation protocols. Use of these protocols has led to decreased re-rupture rates, but requires early patient enrollment, high patient engagement, and ideally, access to physiotherapy to provide optimal outcomes . Surgical care is also evolving, from traditional open surgery, to more percutaneous and minimally invasive options that attempt to decrease wound healing problems. These surgical techniques, however, come with increased risk of other harms, including nerve injury . Given the evolution in the benefit-to-harm ratio, practice trends in Scandinavia  and Canada  have shifted towards non-operative functional rehabilitation, with rates of surgery declining.
When several reasonable treatment options exist with varying harms and benefits, patients often experience decisional conflict . Decisional conflict is uncertainty over a course of action, and may result in worry, questioning of personal values, physical stress and ultimately, decision delay .
Meanwhile, the delivery of patient care is in the midst of a paradigm shift . The patient-clinician relationship is changing from a paternalistic one of unilateral discussion to more of a patient-centered approach. The concept of shared decision-making (SDM) is the crux of this approach [9, 10]. SDM involves an exchange of information around health-care decisions, supplementing the patient-clinician discussion and allowing patients to make a more personal, values-based decision . Decision support tools facilitate this process [11, 12].
Patient Decision-Aids (PtDAs) are tools that may be used by patients either in preparation for or within a consultation with their physician. They explicitly state the decision to be made and provide patient-friendly information on decision options, harms, and benefits in a format that allows the patient to clarify what matters to them most .
The utility of PtDAs has been widely studied with demonstrated effectiveness in improving patient knowledge, decreasing decisional conflict, and increasing patient participation in decision-making . As facilitators of SDM, PtDAs may also lead to improved satisfaction with their patient experience .
There are no known PtDAs in the published literature to assist patients making treatment decisions regarding acute Achilles tendon ruptures. The aim of this study protocol is to develop and test a PtDA to help patients make a more informed, values-based decision when considering treatment options for acute Achilles tendon rupture.
The specific objectives of this study are (a) to develop a PtDA for patients to use in preparation for the consultation; and (b) to field test the PtDA with patients and clinicians making involved in decisions regarding this treatment.
This study will involve a three-stage study protocol. First, we will assemble a multi-disciplinary steering group including patients, clinicians, educators, and researchers to develop the patient decision aid prototype using the Ottawa Decision Support Framework (ODSF). Second, we will perform a mixed-methods alpha test of the decision aid prototype with patients and clinicians experienced in acute Achilles tendon ruptures. Third, we will field test the revised decision aid prototype in a usual clinical care setting.
Stage 1: developing the patient decision aid prototype
Guiding conceptual frameworks
The PtDA will be developed using the Ottawa Decision Support Framework (ODSF)  and in accordance with the International Patient Decision Aids Standards (IPDAS) quality criteria . The ODSF is a theory-based model for helping guide patients making health decisions. It is grounded on cognitive, socioeconomic, and psychology theories and has been used in the creation dozens of PtDAs [15, 17], twenty-four of which have been evaluated in randomized controlled trials . The IPDAS criteria were developed to systematically guide the PtDA development, content and evaluation, with agreement from over 100 stakeholders including patients, policy makers, clinicians and researchers .
Development of the patient decision aid
The IPDAS criteria specific to development have subsequently been updated and expanded to include steps to help guide the PtDA development process . These steps include: (1) defining the purpose, scope and audience of the decision aid, (2) collecting and synthesizing the data for inclusion, (3) developing the PtDA prototype, (4) alpha testing by end-users to ensure usability of the PtDA, (5) field testing feasibility with end-users in the clinical setting, and (6) producing the final version (Fig. 1) .
In keeping with an integrated knowledge translation (iKT) approach  and as recommended by the IPDAS , a steering group will be assembled to guide the PtDA development process. Central to the iKT approach is the involvement of and feedback from end-users longitudinally throughout the research process . This approach has demonstrated benefits in terms of development of a more useful tool with increased end-user knowledge buy-in, uptake and impact [21,22,23,24,25]. For this protocol and subsequent study, the knowledge end-users include patients, physiotherapists, and orthopaedic surgeons. The steering group will be inter-disciplinary and will include end-users with content expertise, two members with methodological expertise in shared decision-making and PtDAs, patient educators, and a web-developer to facilitate creation of a web-based tool.
Establishing the scope of the PtDA
According to IPDAS, the scope of the PtDA involves establishing the specific decision, the target audience, and the purpose of the PtDA . The purpose of this pre-consultation PtDA is to inform patients with acute Achilles tendon rupture about treatment options, as well as harms and benefits of each of the options. The goal is to assist patients in deciding on a course of treatment. Specifically, the decision to be made is “Should I have surgery or non-operative management for my Achilles tendon rupture?”.
Design of the PtDA
The steps in designing the PtDA prototype include an assessment of decisional needs of patients and clinicians, formulating a format and distribution plan, and reviewing and synthesizing the evidence for inclusion as content . Recent literature demonstrates conflicting clinician opinions on how to advise patients with an Achilles tendon rupture [26, 27], and the first steering group agenda item will be a discussion with clinician and patient members to identify patients’ decisional needs. The steering group will develop and revise the PtDA through an iterative process until consensus is reached on content and structure. The prototype design will be based on the ODSF template  and it meets the IPDAS minimal development standards recommended for minimizing risk of bias in PtDAs .
The initial prototype will paper-based and drafted in English, with plans for final distribution electronically and printable paper versions available in clinical practice in both English and French translations. Treatment initiation for Achilles tendon rupture is time sensitive thus it is essential that the PtDA be administered to patients soon following injury. With accessibility being a key aspect of PtDA usability, offering both paper and electronic formats will facilitate and maximize patient uptake . The PtDA will be designed knowing that the most common points of first patient contact is the emergency room or outpatient orthopaedic clinic.
The prototype will be written in plain language appropriate for an 8th grade reading level or lower as determined by the Flesh-Kincaid Readability Test Tool . It will be formatted to include: (a) information on Achilles tendon ruptures and specify which patients are eligible for the PtDA, (b) treatment options to consider, (c) summarized evidence on benefits and harms of each approach, (d) a values clarification exercise, (e) space to indicate a preferred treatment option; and (f) the SURE test . The SURE test is a 4-item questionnaire validated for screening for decisional conflict. Probabilities will be presented numerically and in words, with links to graphical representations to facilitate patients’ understanding and adhering to the IPDAS criteria specific to presenting probabilities . There will also be links included for additional information about Achilles tendon ruptures, literature used to develop the PtDA, and treatment specifics including rehabilitation protocols.
Stage 2: alpha testing
Alpha testing aims to evaluate the acceptability and usability of the decision tool from the perspective of patients and clinicians . Alpha testing will be performed exclusively with the English version of the PtDA prototype. The steering group will discuss results and feedback from the alpha testing in an iterative fashion until consensus is reached on required revisions to the PtDA prototype and field testing outcomes of interest.
A mixed-methods study will be performed with both acceptability and usability questionnaires (Additional file 1: Appendix A, Additional file 2: Appendix B, Additional file 3: Appendix C), as well as qualitative descriptive methods used to optimize stakeholder feedback [33, 34]. This approach has the advantage of allowing evaluation of the outcomes of interest, while also allowing for participants to go beyond explicit questioning, expressing their thoughts and perspectives on the PtDA. This type of qualitative data collection and analysis allows ‘low inference’ discussion and analysis of participant’s responses without manipulation. Specifically, the primary data collection methods will be semi-structured interviews (SSI) with patients and clinicians, allowing for participants to elaborate and clarify responses.
Participants for alpha testing will be end-users of PtDA: clinicians and patients who have previously made this decision.
Clinician participants will include emergency room physicians, orthopaedic surgeons, and physiotherapists, all members of the care team typically involved in the diagnosis and care of these patients. Convenience sampling [35, 36] will be used to recruit clinician participants through professional networks. Members of the Division of Orthopaedic Surgery and Department of Emergency Medicine at the Ottawa Hospital, in addition to physiotherapists from the Riverside Hospital (Ottawa, Ontario) will be invited by email to participate in the study, as will orthopaedic surgeons from across Canada (through the Canadian Orthopaedic Foot and Ankle Society member email list). This will increase the diversity of participants and raise awareness of the PtDA for future dissemination. We will attempt to include both male and female surgeons to maintain diversity of the sample. Recruitment emails will include an information sheet explaining the purpose of the PtDA and the alpha testing.
A convenience sample of patients who have been or are actively being treated for an acute, first-time Achilles tendon rupture at TOH will be recruited for participation. Although this is predominantly a male compared to female injury (6:1) , we will strive to include both men and women patients that have been treated both with and without surgery. A study poster will be placed both in the orthopaedic clinic waiting area and eligible patients will be approached by a member of the clinical team to provide a description of the purpose and structure of alpha testing for the PtDA. Patients will be excluded if they are unable to understand the PtDA due to language barrier or visual impairment.
The target sample size for alpha testing will be 20 participants, with 10 patients and 10 clinicians. This is derived from the work of Faulkner , who demonstrated that problem identification was substantially decreased in usability testing with increasing participant size. With participant sizes of five, 10 and 20, the lowest percentage of problem identification increased from 55 to 80% and finally 95%, respectively .
Alpha testing will be an iterative process of revising and redrafting the PtDA  using a minimum of three rounds with five participants in each round (Fig. 2). Further rounds will be added at the discretion of the steering group based on ongoing feedback from participants.
The first round of testing will be with five clinician participants who are routinely part of the care team of Achilles tendon rupture patients. This will include three orthopaedic surgeons, an emergency medicine physician, and a physiotherapist. Those who agree to participate will be sent a study package with consent form, a copy of the updated PtDA prototype, and alpha testing clinician outcome questionnaires. They will be contacted by the research assistant either in person or on the phone depending on geographic location and preference. Recruited clinician participants will be sent a $20 gift voucher. Following an explanation of the purpose of the study, participants will be asked to sign consent for participation. They will then review the PtDA, complete the outcome instruments and participate in the SSI with the research assistant. The steering group will meet to review outcome measures and interview feedback and decide on revisions to the PtDA prototype.
The second round of testing will be with five patients recruited from the Ottawa Hospital Foot and Ankle clinic. Patients will meet with the research assistant who will review the study goals and provide consent. To simulate the intended setting of the PtDA, they will take the PtDA home with instructions to review it and complete the alpha test patient outcome questionnaires. They will then be invited for an SSI either on the phone or in person depending on their comfort and preferences. Recruited patients will be given a $20 gift voucher for compensation for their time as well as a hospital-parking pass. Once again, results and feedback will be brought to the steering group for review and revisions to the prototype made as needed. Despite being a predominant male injury , we will aim for two female participants for each block of five so as not to miss potential important gender differences.
The third round of testing will be concurrently performed with five additional clinicians and five additional patients. The structure will remain the same as in previous rounds. If the steering group deems further prototype revisions necessary, subsequent recruitment will be performed in blocks of 3–5 participants.
Outcomes and instruments
Baseline clinician and patient demographics will be collected. For clinicians this will include profession, sex, gender, years in practice, number of Achilles tendon rupture patients treated monthly, and clinical subspecialty training for surgeons. Baseline patient demographics collected will include age, sex, gender, level of education, occupation and treatment status.
The primary outcomes of interest are acceptability and usability of the PtDA, which will be evaluated quantitatively and qualitatively. For measuring PtDA acceptability with both patients and clinicians, we will adapt the Ottawa Acceptability Tool (OAT) from the ODSF website . For patients, this questionnaire (Additional file 1: Appendix A) evaluates user perception of the PtDA using a combination of closed and open-ended questions, specifically asking about length, perceived usefulness for decision support, amount of and balance of information presented. This tool has strong face validity and has been used extensively in PtDA evaluation with a wide range of conditions [38,39,40]. The OAT has also been adapted for use with clinicians with a 15-question format (Additional file 2: Appendix B) and will be used as the primary quantitative measure of acceptability for clinician participants.
Usability will be evaluated both quantitatively using the System Usability Scale (SUS) [41, 42] and qualitatively through feedback from the semi-structured interviews. The SUS is a validated  questionnaire (Additional file 3: Appendix C) using five-point Likert scale response categories, with a score over 68 indicating higher than average usability. It has been previously used in usability testing of PtDAs .
Semi-structured interviews will be conducted with separate interview guides for clinician and patient participants. Interview guides will be reviewed by the steering group. For clinicians, a series of open and closed-ended questions will be asked about process usability, mode of delivery in the clinical setting, and feedback on content (length, language, information and balance). For patients, the focus of the interview will be on presentation (layout and format) and content (length, language, information and balance) to help ensure the end product is optimized for the end user. Interviews will be recorded and transcribed.
Data will be analyzed iteratively following each round of testing. Quantitative data will be coded and stored in an encrypted Microsoft Excel spreadsheet. Descriptive statistics will be used to summarize data from the OAT and SUS. Response frequencies from the patient OAT will be reported and dichotomized into positive and negative responses. Given the small sample size, we will use medians and ranges for the practitioner OAT and SUS. Qualitative data, including feedback from the OAT and SSIs will be compiled and analyzed using thematic analysis [45, 46]. This will be performed in 6-phases, beginning with (1) transcription and initial data review, (2) broad generation of initial codes, (3) collating codes into themes, (4) reviewing the themes to either further collapse or expansion, (5) defining and naming the themes and (6) generating a final report.
The steering group will perform iterative data review following each round of testing. Revisions will be discussed and suggested when negative responses are encountered on the patient OAT or SUS, median scores less than three on the clinician OAT when further suggestions are found through qualitative descriptive analysis.
Stage 3: field testing the revised PtDA prototype
Field testing by end users is a critical component of PtDA development as identified by IPDAS . As opposed to the alpha testing, field testing solicits feedback on the PtDA from patients within the typical clinical setting. The primary outcome of the field testing is to evaluate the feasibility of using the PtDA at the point-of-care and to guide any final revisions, with secondary outcomes including acceptability, and potential of the PtDA to have the desired impact without adverse consequence.
We will perform a field test of the revised paper-based, pre-consultation PtDA prototype resulting from the alpha testing phase using a pre-/post-test study design and embedded qualitative feedback. A pre/post-test design has been chosen as it allows for evaluation of the secondary outcomes of the PtDA having the desired impact, which will provide us with baseline data to calculate a sample size for a larger evaluation study . The prototype will be given to patients following initial presentation with the injury in the emergency department and self-administered by the patient at home prior to final treatment consultation with the orthopaedic surgeon.
Patient recruitment will take place at The Ottawa Hospital Emergency Department (ED). The Ottawa Hospital serves a population of 1.2 million people for orthopaedic care in Eastern Ontario, Canada and sees an average of 60 acute Achilles tendon rupture annually, or an average of 5 per month.
Eligibility for participation will include (1) adult patients over 18 years, (2) clinical or radiographically confirmed Achilles tendon rupture, (3) presentation and immobilization within 72 h of injury, (4) willingness to consent to the study, and (5) ability to speak and read English. Patients will be excluded for (1) re-rupture of the Achilles tendon, (2) musculotendinous junction tears and (3) delayed presentation over 72 h as this limits the ability to optimally treat with non-surgical methods.
The procedure flow for patient recruitment is summarized in Fig. 3. Upon consultation from the emergency department physician, a member of the orthopaedic team (resident, staff physician or physician assistant) will meet patients presenting with an acute Achilles tendon rupture. The orthopaedic team will confirm the diagnosis, discuss the diagnosis and management options with the patient. Concurrently, they will verify if the patient meets inclusion criteria, discuss the study procedures, answer patients’ questions, and obtain the patients’ signed consent to participate. The patient will be asked to complete a baseline questionnaire including questions about their demographics (age, sex, gender, occupation, highest level of education) and secondary outcome measures. The patient will be splinted in plantarflexion in keeping with standard practice and given a copy of the PtDA to review and complete in preparation for their follow-up appointment in the orthopaedic clinic.
As per usual clinical practice, patients will be given a follow-up appointment in the orthopaedic plaster room 3–5 days following their emergency department visit. At the plaster room, the orthopaedic resident or surgeon will discuss the treatment options, answer patients’ questions and make the treatment decision with the patient. Either immediately following or within 2 weeks, the research assistant will ask the patient to complete a questionnaire including the secondary outcome measures and conduct the semi-structured interview.
We will also obtain feedback from orthopaedic residents and surgeons who consulted with patients in the study to determine the clinician experience with patients using the PtDA. After the last patient is recruited, these orthopaedic surgeons will be sent a link to an online survey using the SurveyMonkey (San Mateo CA) platform to elicit feedback on the PtDA.
Outcomes and instruments
Field test outcomes of interest have been chosen based on those recommended by IPDAS . Field test outcomes are summarized in Table 1 and include: (1) feasibility of PtDA administration and use by patients, (2) barriers to PtDA use among patients and clinicians, (3) patients’ acceptability of the PtDA, and (4) potential of the PtDA to have the desired impact without adverse consequence.
Specific patient feasibility metrics will include the (1) percent of screened eligible patients recruited, (2) reasons for ineligibility, (3) percentage of recruited patients that completed the PtDA prior to the follow-up appointment and the (4) percentage of missing data on follow up outcome questionnaires. We will set a level of success at 80% participant recruitment of those meeting eligibility, 80% participant completion of the PtDA, and 80% minimal completed data on follow up questionnaires, in keeping with levels set in previously performed field tests .
The semi-structured interview with the patients will ask them to share their experiences on using the PtDA, their experiences discussing the decision with the orthopaedic surgeon, suggestions to improve the process of using the PtDA, formatting, and any barriers to use.
Acceptability of the PtDA, will be evaluated using the OAT previously used in the alpha test phase. This validated instrument measures key outcomes including; amount of information, length, clarity and balanced presentation, which is important for avoiding biased presentation of information on options.
To evaluate whether the PtDA potential to have the desired impact without adverse consequence, patients will complete a knowledge test and the SURE test as a pre-/post-outcome and the Preparation for Decision Making Scale (PDMS)  as a Post-PtDA outcome measure.
Patient knowledge will be measured using a knowledge test developed by the steering group and embedded within the PtDA. The test will be adapted from the template available on the Ottawa Decision Support Group website  and will consist of 4–6 questions about key content important to know when making this decision. This format has been adapted for several clinical conditions and been shown to have high internal consistency and validity. Patient knowledge of their specific pathology and treatment options underlies one of the pillars of informed consent , and improved decision quality is based on patients making an informed, value-based decision .
The SURE test will be used to screen patients for decisional conflict . It has four questions with ‘yes’ or ‘no’ responses in the domains of certainty, knowledge, values and support. Any ‘no’ answer is indicative of clinically significant decisional conflict. This test has been validated in a range of clinical settings [53, 54].
We will use the Preparation for Decision Making Scale (PDMS)  to measure patients’ perceived usefulness of a PtDA in preparing for a medical consultation. This specifically measures the IPDAS criteria for the quality of the decision process. This instrument consists of 10 questions to be ranked on a 5-point Likert scale, has both high reliability and internal consistency with a Cronbach’s alpha of 0.92–0.96 .
The survey of orthopaedic surgeons will ask questions about how the PtDA influenced the patient-surgeon encounter. Data collected will aim to quantify experience with the PtDA including (1) number of times and reasons the PtDA was used or not used for eligible patients, (2) if they plan to continue to use the PtDA and (3) barriers and facilitators to implementation in usual clinical care. Specific feedback will be sought with respect on how and when the PtDA can best be administered in the patient journey to optimize uptake by both clinicians and patients. As part of the survey, we will also use the 11-question practitioner version of the PDMS to evaluate clinician views on how effective the PtDA was on the patient encounter .
There is a paucity of guidance for sample size justification for field test methods. With the primary objectives being feasibility of use in the clinical setting, we will aim to recruit a sample of 30 patient participants. This sample size is consistent with minimum numbers required to demonstrate adequate feasibility in pilot studies , and consistent with other pre-/post-studies testing PtDAs with patients facing the decision [57,58,59]. Based on usual referral volumes, we expect to recruit 3 patients per month and complete study recruitment after 10–12 months.
Data management and analysis
Quantitative data will be uploaded and stored in an encrypted Microsoft Excel spreadsheet. As the focus of the field test is on feasibility rather than efficacy outcomes, analysis will be primarily descriptive with baseline participant characteristics and feasibility data presented using frequencies and percentages. Tests for data normality will be performed and summarized using means and standard deviation if normally distributed, and medians and ranges if not. For post-test only outcomes (acceptability, PDMS), patients’ responses will be summarized and described. For pre-/post-test outcomes (knowledge and SURE test), questionnaires will be compared using the student t-test if normally distributed and using the Wilcoxon rank-sum test if not. Data will be disaggregated by sex and gender to examine how these variables may affect patient and clinician experience with the PtDA and associated outcome measures. Qualitative data from the semi-structured interviews will be transcribed verbatim and analyzed using thematic analysis as described for alpha testing.
There are no known defined standards for determining success of field testing measures. As such, we have determined the following a-priori criteria as determinants for success of the field test: (1) no insurmountable barriers identified from semi-structured interviews or open-ended feedback based on review from the steering group, (2) minimum of 80% targets for feasibility outcomes, (3) minimum of 66% of participants find the PtDA acceptable and balanced, (4) minimum score of 66 on the PDMS (5) 66% demonstrate nominal improvement on pre-/post-test outcomes for desired impact (knowledge and SURE). For the SURE test, an overall finding of > 66% participants responding with a 4/4 score will also be deemed a measure of success. If the cutoffs for determining success of the field test are not reached, revisions to the PtDA will be discussed and implemented by the steering group with further recruitment and testing at the discretion of the steering group.
This is a multi-faceted study protocol outlining the development, alpha and field testing of a pre-consultation PtDA for patients presenting with an acute Achilles tendon rupture. The need for a decision support tool for this treatment decision is evident from the existence of longstanding controversy in the orthopaedic community about the effectiveness of surgery versus conservative management [26, 27] and regarding important differences in the benefit-to-harm profile offered by the varying treatment methods. The treatment decision for patients with acute Achilles tendon rupture is time-sensitive, and so feasibility testing with patients presenting to the emergency department with these injuries is imperative to ensure the PtDA can be effectively administered in a timely fashion.
Strengths and limitations
A major strength of this protocol lies in the use of an iKT approach to develop the PtDA. This approach has been demonstrated to maximize knowledge users input, increase use, and improve impact . We have adhered to a rigorous methodology guided by the ODSF and the IPDAS to ensure the PtDA is developed to a high quality standard . Additionally, engaging stakeholders from multiple disciplines and Canadian locations in the development and alpha testing of the PtDA will ensure the end product is usable and optimized to meet the needs of a variety of patients and clinicians. This approach will also raise early awareness of the PtDA’s existence, necessary for achieving our of aim of public availability and national dissemination. Additionally, the inclusion of qualitative methods allows for collection of deeper stakeholder insights, perceptions and opinions , all of which are critical in designing a PtDA that will optimize user uptake.
Limitations of this study protocol include the arbitrary success endpoints for both alpha and field testing outcomes. To our knowledge, discrete success endpoints have not been previously described. Our endpoints remain largely qualitative and at the discretion of the steering committee. Despite this, we are using methods recommended by IPDAS , and will have steering committee members with expertise in PtDA development and evaluation. Further work and study to better define these endpoints is necessary. Additionally, the sample is unlikely to allow us to identify sex and gender-specific differences from either patients or clinicians because it will likely be majority male, reflecting the populations represented; Achilles tendon ruptures occur far more frequently in men , and orthopaedic surgeons are disproportionately male. Nonetheless, our analysis plan details an effort to capture and analyze these differences. Finally, there are inherent limitations of the before/after study design, including the lack of a control arm. This makes it difficult to control for confounding factors that may affect patient outcomes, such as independent research into treatment options. However, the design been previously used in the evaluating PtDAs  and offers the advantage of facilitating patient recruitment.
Patient decision aids are meant to improve patient preparation for decision-making. By providing foundational information and encouraging patients to reflect on relevant personal values for outcomes of options, these tools may facilitate the patient-physician decision making interaction and enhance patient-centered care. Our aim is to develop, alpha test and field test this pre-consultation Achilles tendon rupture decision aid. We hope this will be the first of a series of orthopaedic PtDAs developed as part of a quality improvement initiative for facilitating shared decision making for patients receiving musculoskeletal care.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Integrated knowledge translation
International patient decision aids standards
Ottawa acceptability tool
Ottawa decision support framework
Preparation for decision making scale
System usability scale
Soroceanu A, Sidhwa F, Aarabi S, Kaufman A, Glazebrook M. Surgical versus nonsurgical treatment of acute Achilles tendon rupture: a meta-analysis of randomized trials. J Bone Joint Surg Am. 2012;94:2136–43.
Kadakia AR, Dekker RG II, Ho BS. Acute Achilles tendon ruptures: an update on treatment. J Am Acad Orthop Surg. 2017;25:23–31.
Patel MS, Kadakia AR. Minimally invasive treatments of acute Achilles tendon ruptures. Foot Ankle Clin. 2019;24:399–424.
Mattila VM, Huttunen TT, Haapasalo H, Sillanpää P, Malmivaara A, Pihlajamäki H. Declining incidence of surgery for Achilles tendon rupture follows publication of major RCTs: evidence-influenced change evident using the Finnish registry study. Br J Sports Med. 2015;49:1084–6.
Sheth U, Wasserstein D, Jenkinson R, Moineddin R, Kreder H, Jaglal SB. The epidemiology and trends in management of acute Achilles tendon ruptures in Ontario, Canada: a population-based study of 27 607 patients. Bone Joint J. 2017;99B:78–86.
Garvelink MM, Boland L, Klein K, Nguyen DV, Menear M, Bekker HL, et al. Decisional conflict scale use over 20 years: the anniversary review. Med Decis Mak. 2019;39:301–14.
O’Connor AM. Validation of a decisional conflict scale. Med Decis Mak. 1995;15:25–30.
Barry MJ, Edgman-Levitan S. Shared decision making–pinnacle of patient-centered care. N Engl J Med. 2012;366:780–1.
Scholl I, Zill JM, Härter M, Dirmaier J. An integrative model of patient-centeredness: a systematic review and concept analysis. PLoS ONE. 2014;9:e107828.
Weston WW. Informed and shared decision-making: the crux of patient-centered care. CMAJ. 2001;165:438–9.
Charles C, Gafni A, Whelan T. Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999;49:651–61.
Stacey D, Hill S, McCaffery K, Boland L, Lewis KB, Horvat L. Shared decision making interventions: theoretical and empirical evidence with implications for health literacy. Stud Health Technol Inform. 2017;240:263–83.
Stacey D, Légaré F, Lewis K, Barry MJ, Bennett CL, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017;4:CD001431.
Shay LA, Lafata JE. Where is the evidence? A systematic review of shared decision making and patient outcomes. Med Decis Mak. 2014;35:114–31.
O’Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, et al. A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation. Patient Educ Couns. 1998;33:267–79.
Joseph-Williams N, Newcombe R, Politi M, Durand M-A, Sivell S, Stacey D, et al. Toward minimum standards for certifying patient decision aids. Med Decis Mak. 2014;34:699–710.
Stacey D, Légaré F, Boland L, Lewis KB, Loiselle M-C, Hoefel L, et al. 20th anniversary Ottawa decision support framework: part 3 overview of systematic reviews and updated framework. Med Decis Mak. 2020;40:379–98.
Elwyn G. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417.
Coulter A, Stilwell D, Kryworuchko J, Mullen PD, Ng CJ, van der Weijden T. A systematic development process for patient decision aids. BMC Med Inform Decis Mak. 2013;13:S2.
Jull J, Giles A, Graham ID. Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge. Implement Sci. 2017. https://doi.org/10.1186/s13012-017-0696-3.
Cargo M, Mercer SL. The value and challenges of participatory research: strengthening its practice. Annu Rev Public Health. 2008;29:325–50.
Walter I, Davies H, Nutley S. Increasing research impact through partnerships: evidence from outside health care. J Health Serv Res Policy. 2003;8(Suppl 2):58–61.
Golden-Biddle K, Reay T, Petz S, Witt C, Casebeer A, Pablo A, et al. Toward a communicative perspective of collaborating in research: the case of the researcher-decision-maker partnership. J Health Serv Res Policy. 2003;8(Suppl 2):20–5.
Bartunek J, Trullen J, Bonet E, Sauquet A. Sharing and expanding academic and practitioner knowledge in health care. J Health Serv Res Policy. 2003;8(Suppl 2):62–8.
Kujala S. User involvement: A review of the benefits and challenges. Behav Inf Technol. 2003;22:1–16.
Cohen D, Martineau PA. What do the experts say? Achilles tendon treatment options debate. COA Bull. 2019;125:19–20.
Erad MU. Acute Achilles tendon injuries. Clinical Summary. JBJS. January 3, 2020. https://www.jbjs.org/summary.php?id=284&native=1. Accessed May 10, 2020
Ottawa Patient Decision Aid eTraining. Ottawa Hospital Research Institute. 2019. https://decisionaid.ohri.ca/eTraining/. Accessed May 12, 2020
Edwards A, Evans R, Elwyn G. Manufactured but not imported: new directions for research in shared decision making support and skills. Patient Educ Couns. 2003;50:33–8.
Flesch R. A new readability yardstick. J Appl Psychol. 1948;32:221–33.
Légaré F, Kearing S, Clay K, Gagnon S, D’Amours D, Rousseau M, et al. Are you SURE?: Assessing patient decisional conflict with a 4-item screening test. Can Fam Physician. 2010;56:e308–14.
Trevena LJ, Zikmund-Fisher BJ, Edwards A, Gaissmaier W, Galesic M, Han PK, et al. Presenting quantitative information about decision outcomes: a risk communication primer for patient decision aid developers. BMC Med Inform Decis Mak. 2013;13(Suppl 2):S7.
Sandelowski M. What’s in a name? Qualitative description revisited. Res Nurs Health. 2010;33:77–84.
Colorafi KJ, Evans B. Qualitative descriptive methods in health science research. HERD. 2016;9:16–25.
Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Mental Health. 2015;42:533–44.
Sandelowski M. Sample size in qualitative research. Res Nurs Health. 1995;18:179–83.
Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput. 2003;35:379–83.
Drake ER, Engler-Todd L, O’Connor AM, Surh LC, Hunter A. Development and evaluation of a decision aid about prenatal testing for women of advanced maternal age. J Genet Couns. 1999;8:217–33.
Man-Son-Hing M, Laupacis A, O’Connor A, Wells G, Lemelin J, Wood W, et al. Warfarin for atrial fibrillation The patient’s perspective. Arch Intern Med. 1996;156:1841–8.
Fiset V, O’Connor AM, Evans W, Graham I, Degrasse C, Logan J. Development and evaluation of a decision aid for patients with stage IV non-small cell lung cancer. Health Expect. 2000;3:125–36.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24:574–94.
Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4:114–23.
Sauro J. A practical guide to the system usability scale: background, benchmarks and best practices. Denver, USA: CreateSpace; 2011.
Bansback N, Chiu JA, Carruthers R, Metcalfe R, Lapointe E, Schabas A, et al. Development and usability testing of a patient decision aid for newly diagnosed relapsing multiple sclerosis patients. BMC Neurol. 2019. https://doi.org/10.1186/s12883-019-1382-7.
Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15:398–405.
Graneheim UH, Lindgren BM, Lundman B. Methodological challenges in qualitative content analysis: a discussion paper. Nurse Educ Today. 2017;56:29–34.
O'Connor AM, Fiset V, DeGrasse C, Graham ID, Evans W, Stacey D, et al. Decision aids for patients considering options affecting cancer outcomes: evidence of efficacy and policy implications. J Natl Cancer Inst Monogr. 1999:67–80.
Carroll SL, Stacey D, McGillion M, Healey JS, Foster G, Hutchings S, et al. Evaluating the feasibility of conducting a trial using a patient decision aid in implantable cardioverter defibrillator candidates: a randomized controlled feasibility trial. Pilot Feasibility Stud. 2017. https://doi.org/10.1186/s40814-017-0189-9.
O'Connor AM, Cranney A. User manual – acceptability. Ottawa: Ottawa Hospital Research Institute; 1992 [updated 2002]. http://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Acceptability.pdf. Accessed May 5, 2020.
O'Connor AM. User manual – knowledge. Ottawa: Ottawa Hospital Research Institute; 2000 [updated 2004]. https://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Knowledge.pdf. Accessed August 14, 2020.
Graham ID, O’Connor AM. User manual – preparation for decision making scale. Ottawa: Ottawa Hospital Research Institute; 1995 [updated 2010]. https://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_PrepDM.pdf. Accessed August 14, 2020.
Berger K. Informed consent: information or knowledge? Med Law. 2003;22:743–50.
Bennett C, Graham ID, Kristjansson E, Kearing SA, Clay KF, O’Connor AM. Validation of a preparation for decision making scale. Patient Educ Couns. 2010;78:130–3.
Ferron Parayre A, Labrecque M, Rousseau M, Turcotte S, Légaré F. Validation of SURE, a four-item clinical checklist for detecting decisional conflict in patients. Med Decis Mak. 2014;34:54–62.
Boland L, Légaré F, McIsaac DI, Graham ID, Taljaard M, Dècary S, et al. SURE test accuracy for decisional conflict screening among parents making decisions for their child. Med Decis Mak. 2019;39:1010–8.
Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health. 2008;31:180–91.
Hoffman AS, Bateman DR, Ganoe C, Punjasthitkul S, Das AK, Hoffman DB, et al. Development and field testing of a long-term care decision aid website for older adults: engaging patients and caregivers in user-centered design. Gerontologist. 2020;60:935–46.
Sivell S, Marsh W, Edwards A, Manstead ASR, Clements A, Elwyn G. Theory-based design and field-testing of an intervention to support women choosing surgery for breast cancer: BresDex. Patient Educ Couns. 2012;86:179–88.
Hooiveld T, Molenaar JM, van der Heijde CM, Meijman FJ, Groen TP, Vonk P. End-user involvement in developing and field testing an online contraceptive decision aid. SAGE Open Med. 2018. https://doi.org/10.1177/2050312118809462.
Sepucha KR, Abhyankar P, Hoffman AS, Bekker HL, LeBlanc A, Levin CA, et al. Standards for UNiversal reporting of patient decision aid evaluation studies: the development of SUNDAE checklist. BMJ Qual Saf. 2018;27:380–8.
Rahman MS. The advantages and disadvantages of using qualitative and quantitative approaches and methods in language “testing and assessment” research: a literature review. J Educ Learn. 2017. https://doi.org/10.5539/jel.v6n1p102.
This study has received funding from the Canadian Orthopaedic Foundation, through the Canadian Orthopaedic Research Legacy (CORL) fund. The three-stage study protocol has undergone peer-review by this funding body. This organization was not involved in manuscript writing or the decision to submit the manuscript for publication.
Ethics approval and consent to participate
This protocol describes three stages: (1) a development stage, in which a multi-disciplinary steering group will develop a prototype, (2) a stage of mixed-methods alpha testing of the decision aid prototype with patients and clinicians experienced in acute Achilles tendon ruptures, and (3) a stage of field testing the revised decision aid prototype in usual a clinical care environment. The Ottawa Health Science Network Research Ethics Board (OHSN-REB) approved the experimental protocol and granted approval for stages (1) and (2) of this study (Protocol #20210048-01H). Approval has not yet been sought for stage (3). In accordance with the protocol approved by the OHSN-REB, verbal or written consent will be obtained from all study participants. All methods have been and will be carried out in accordance with Canada’s Tri-Council Policy Statement on Ethical Conduct for Research Involving Humans (TCPS 2), Integrated Addendum to ICH E6 (R1): Guideline for Good Clinical Practice E6 (R2), and the provisions of the Ontario Personal Health Information Protection Act (PHIPA 2004) and its applicable regulations.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
. Ottawa Acceptability Tool (Patient Version): supplementary material; PtDA acceptability to patients will be evaluated using this questionnaire.
. Ottawa Acceptability Tool (Clinician Version): supplementary material; PtDA acceptability to clinicians will be evaluated using this questionnaire.
. System Usability Scale: supplementary material; PtDA usability will be evaluated using this questionnaire.
About this article
Cite this article
Meulenkamp, B., Brillinger, J., Fergusson, D. et al. Development and field testing of a patient decision aid for management of acute Achilles tendon rupture: a study protocol. BMC Med Inform Decis Mak 21, 225 (2021). https://doi.org/10.1186/s12911-021-01589-5
- Achilles tendon rupture
- Decision aid
- Shared decision-making