Skip to main content

Determinants of successful guideline implementation: a national cross-sectional survey

Abstract

Background

CPGs are not uniformly successful in improving care and several instances of implementation failure have been reported. Performing a comprehensive assessment of the barriers and enablers is key to developing an informed implementation strategy. Our objective was to investigate determinants of guideline implementation and explore associations of self-reported adherence to guidelines with characteristics of participants in China.

Methods

This is a cross-sectional survey, using multi-stage stratified typical sampling based on China's economic regional divisions (the East, the Middle, the West and the Northeast). 2–5 provinces were selected from each region. 2–3 cities were selected in each province, and secondary and tertiary hospitals from each city were included. We developed a questionnaire underpinned by recommended methods for the design and conduct of self-administered surveys and based on conceptual framework of guideline use, in-depth related literature analysis, guideline development manuals, related behavior change theory. Finally, multivariate analyses were performed using logistic regression to produce adjusted odds ratios (OR) and 95% confidence intervals (95% CI).

Results

The questionnaire consisted of four sections: knowledge of methodology for developing guidelines; barriers to accessing guideline; barriers to guideline implementation; and methods for improving guideline implementation. There were 1732 participants (87.3% response rate) from 51 hospitals. Of these, 77.2% reported to have used guidelines frequently or very frequently. The key barriers to guideline use were lack of education or training (46.2%), and overly simplistic wording or overly broad scope of recommendations (43.8%). Level of adherence to guidelines was associated with geographical regions (the northeast P < 0.001; the west P = 0.02; the middle P < 0.001 compared with the east), hospital grades (P = 0.028), length of practitioners’ practice (P = 0.006), education background (Ph.D., P = 0.027; Master, P = 0.002), evidence-based medicine skills acquired in work unit (P = 0.012), and medical specialty of practitioner (General Practice, P = 0.006; Surgery, P = 0.043).

Conclusion

Despite general acknowledgement of the importance of guidelines, the use of guidelines was not as frequent as might have been expected. To optimize the likelihood of adherence to guidelines, guideline implementation should follow an actively developed dissemination plan incorporating features associated with adherence in our study.

Peer Review reports

Background

Health research, practice, and policy focus on improving delivery, organization, and outcomes of care. Clinical Practice Guidelines (CPGs) that collate evidence-based recommendations for physicians and other health professionals are critical in this regard [1, 2], and the number of guidelines being published are increasing annually [3]. Guideline implementation, a complex and challenging task [4], requires a change in clinician behavior [5]. Poor implementation may lead to suboptimal patient outcomes as it may miss out on beneficial therapies and may fail to avoid preventable harm, while wasting limited health care resources [4].

In 2010, a Cochrane systematic review by Shaw et al. indicated that guideline implementation interventions selected and tailored according to the prior identification of potential barriers to guideline use were more likely to improve professional practice compared with either no intervention or the dissemination of guidelines alone [6]. It explicitly describes how barriers were identified and how overcoming those barriers could form part of any implementation strategy [6]. In 2013, Flottorp et al. conducted a systematic review of frameworks of determinants of practice and described seven domains of potential determinants of practice: guideline factors, individual health professional factors, patient factors, professional interactions, incentives and resources, capacity for organizational change, and social, political, and legal factors [7]. The Cochrane Effective Practice and Organization of Care (EPOC) group has published a summary of 44 systematic reviews of implementation interventions, giving an indication of the most effective approaches, such as audit and feedback, local consensus conferences, patient-mediated interventions and education outreach [8]. Factors intrinsic to the guideline can also contribute to implementation failure, e.g., ambiguity, inconsistency, and incompleteness, and some guidelines have been found to be more difficult to put into practice than others [9].

An effective implementation strategy involves inclusion of stakeholders in guideline development, identification and overcoming of barriers by assessing individual and organizational preparedness, and capturing the adherence of guidelines via audit and feedback [6,7,8].

269 guidelines were produced by 256 Chinese developers and 115 were published in Chinese medical journals between 1993 and 2010, yet no systematic and national studies have evaluated strategies that examine barriers and factor related to adherence [10]. Recognizing this information gap, we have investigated the determinants of their implementation and explored the association between guideline adherence and survey participant characteristics in a nationwide study.

Methods

This study was approved by the Committee for Ethical Affairs of Zhongnan Hospital of Wuhan University.

After having obtained ethics approval, we designed and conducted a robust survey study between January 2019 and July 2019 which complies with recommended methods [11] and aims to maximize compliance with reporting guidelines [12].

Framework

A multitude of factors, including enablers and barriers of guideline adherence, clinician, organization, and system levels, may influence whether and how guidelines are used [7,8,9, 13,14,15,16]. In order to formally assess the determinants of guideline implementation, we used the following literature and resources for the conceptualization of our research framework: (a) ideas of implementability formalized by Gagliardi et al. [16] consisting of 22 elements within eight domains, including adaptability, usability, applicability, validity, accommodation, communicability, implementation, and evaluation; (b) Guideline Implementability Appraisal (GLIA and GLIA 2.0) tool to provide information about implementability to authoring groups enabling them to decide on content in anticipation of potential problems in implementation [17] and taking into account decidability, executability, validity, flexibility, measurability, effect on process of care, novelty/innovation, and computability [5]; (c) Qualitative approach to exploring the medical practitioners’ perceptions and experiences regarding guideline implementation with general, open-ended and non-leading questions having developed a basic understanding of the reaction of medical practitioners and system mechanism to the introduction of guidelines [18]; (d) Systematic reviews of guideline implementation [19,20,21] literature with five main areas identified: (1) the guideline, (2) the target health care professional user, (3) the patient characteristics, (4) the work environment, and (5) the implementation strategy; (e) Systematic examination of the content of guideline development manuals to identify implementation methodology of known organizations [22,23,24]; and (f) Behavior change and social-cognitive theory applied in implementation research for improving understanding of determinants of evidence-based medicine (EBM) practice and guideline use [25,26,27].

Item selection

Items collected during the review of literature and existing instruments or frameworks formed the basis of an item pool. This was then further extended with items emerging from interviews with medical practitioner and discussed based on expert opinions and behavior change and social-cognitive theory. Parsimony was achieved by combining multiple items into one, and the number of items was reduced by several expert meetings. The first version was field tested in single interviews among clinicians from Zhongnan Hospital of Wuhan University. A series of draft versions were piloted.

Questionnaire construction, piloting and reliability testing

A bespoke questionnaire, consisting of four parts, was developed as a self-administered survey and its design was based on recommended methods [11]. The aim of the survey was to investigate barriers and enablers related to guideline adherence. First, the survey instrument covered background information about the participants (qualifications, education level, clinical department, years of practice) and some specific questions related to guideline implementation (e.g., “Have you had EBM or EBM related education?”, “Do you agree that high-quality guidelines provide basic guidance for healthcare delivery?”, “Are you are willing to acquire and read high quality guidelines?”, and “To what extent do you think you are applying the guidelines in your clinical practice?”). A 4-point Likert-type scale was used to rate the extent of guideline adherence.

The second section captured knowledge of a broad and comprehensive range of the methods and processes for producing guidelines with 17 items. Questionnaire items were based on the manuals considered in our framework section (e) as mentioned above, with particular reference to NICE and WHO [22, 23].

Given that guideline noncompliance may come from difficulty in searching or downloading guidelines which is a separate issue to guideline implementation barriers, like guideline flaw, lack of atmosphere of EBP etc., we divided the third section of barriers into guideline acquisition barriers and guideline implementation barriers. So the third section had four multiple choice items relating to barriers to guideline acquisition and 15 multiple choice items relating to barriers to guideline implementation which were categorized into three areas: intrinsic flaw in guideline (eight items); deficient or incomplete system mechanism and external environment (four items); and awareness and ability of clinicians (three items). The fourth part consisted of questions which looked at methods for improving guideline implementation; this included seven multiple choice items which addressed external enablers and four multiple choice items which adopted a microcosmic perspective to focus on internal enablers relating to the guideline implementation. The full questionnaire is provided in Additional file 1.

The content validity and readability of the questionnaire were tested by five experts of guideline development, six clinical EBM experts and 20 clinical experts from different medical specialties. All experts commented on the clarity and relevance of each survey item. There was agreement among the experts on the clarity and relevance of most of the included items, and we revised some items to improve clarity. Before implementing the study survey, we tested for repeatability by administering the questionnaires to the same population of 40 participants twice, with a two-week interval in between the first and second survey. The test–retest reliability coefficient was excellent at 0.80 (1 = perfect repeatability).

Survey sampling, questionnaire administration and data collection

A cross-sectional survey was used which took into account the differences of geographical location and the number of medical institutions. We used a multi-stage stratified sampling strategy based on China's economic regions (the East with seven provinces and three municipalities; the Middle with six provinces; the West with 11 provinces and one municipality; and the Northeast with three provinces). Two to five provinces were selected for each region with two to three cities selected for every province, and each city included both secondary and tertiary hospitals. Sampling procedures for hospitals was decided by Medical Standards Bureau of Management Center of Medical Management Services, National Health Commission of the People's Republic of China Mainland based on Proportion Report of Hospital Institutions of Health Statistics Yearbook 2018 [28]. We did not include Hong Kong, Macao or Taiwan in this survey. In total, 32 cities from three provinces and two municipalities in the East, three provinces in the Middle, three provinces and one municipality in the West, and two provinces in the Northeast were chosen. More provinces and municipalities were selected from the East because there is a higher concentration of medical institutions in that region. Doctors in each hospital were recruited using the hospitals’ directories which held a database of their ID numbers. Licensed doctors, pharmacists and nurses, regardless of specialty, with over 5 years of continuous working experience of providing direct or indirect clinical care optimizing health promotion, wellness, and disease prevention were invited to take part in the survey.

The survey was administered during the period from January 2019 to July 2019. Four researchers were each allocated to one of the regions and all used the agreed set of instructions included in the protocol. The researcher explained the nature and purpose of the study to the participants in a meeting room. Informed consent was obtained before the printed copies of questionnaires were distributed. The survey data were anonymized. Data were validated using Epidata (version 3.1, Odense Denmark, EpiData Association, 2010). Questionnaires with more than 10% of data missing were excluded from the analysis.

Data analysis

We hypothesized that the guidelines use is associated with demographic characteristics, attitudes, and knowledge. All included data were analyzed using SPSS [version 17.0 (SPSS, Chicago, IL, USA)]. Categorical variables from survey items were described using frequencies and percentages. Continuous variables were described as median with interquartile range (IQR 25–75% percentile) or mean with standard deviation (SD) as appropriate. We used Chi-squared test to explore if there were differences in the barriers to guideline implementation based on the different grade of hospitals.

Univariate and multivariate analyses were carried out using logistic regression. The dependent variable was the self-reported guideline adherence, and the independent variables were region, hospital grade, years of practice, professional title, EBM education in work unit, education background, EBM education in college, participation in guideline development, acknowledgment of guideline for clinical practice, knowledge score, and professional practice area. Factors of P < 0.1 in the univariate analysis were included into the multivariate analysis to identify the independent determinants of guideline adherence. The associations are reported as adjusted odds ratios (ORs) with 95% confidence interval (95% CI). Two-sided P < 0.05 was considered to be statistically significant.

Results

In total, 1984 questionnaires were administered in 51 hospitals (30 tertiary public hospitals and 21 secondary public hospitals) located in all the main cities in 11 provinces and three municipalities in China (Fig. 1). Of these, 252 questionnaires were excluded because of missing answers (> 10% of data missing). The overall response rate was 87.3% (n = 1732/1984; 1234 and 498 in tertiary and secondary hospitals respectively). As shown in Table 1 the respondents included staff from a wide range of specialties. The specialties “Medicine” and “Surgery” represented 22% and 15.7% of the survey sample, respectively. The median years of participants’ practice was 15.0 (± 10.3) years. Although more than half of participants (54.3%) had received EBM or related education, only a small proportion had participated in the development of guidelines (14.7%). Nearly all participants considered guidelines to provide essential or basic guidance for healthcare delivery (Table 1).

Fig. 1
figure1

Flow chart of distribution and collection of questionnaires

Table 1 Characteristics of survey participants

Knowledge for CPGs development

Most of the respondents (94.5%, range 85.4–98.2%) agreed or strongly agreed with all methodological items. Out of all the items considered to be an important component of the key methodology in the development of guidelines, “conducting a systematic and comprehensive search for evidence” was the item that was strongly agreed or agreed upon by the highest proportion of the surveyed population (98.2%) (Additional file 2).

Barriers and enablers of guideline adherence

Overall, 1313 (77.1%) participants reported frequent or very frequent use of guidelines (61.8% participants were using Chinese guidelines). Only 50 (2.9%) participants seldom used guidelines even though they were aware of the guidelines (Table 1). Table 2 shows barriers to acquisition and implementation of guidelines. A noteworthy finding with regards to the acquisition of guidelines was that over half of the participants were too busy to pursue acquisition (58.6%). The most frequent barrier in implementation of guidelines was “lack of education or training in guideline use” which comes under “awareness and ability of clinicians” domain in our framework, as reported by 787 participants (46.2%). The other most cited implementation barriers were that the “wording of recommendations were too simple or that the scope of the recommendations were too broad”, as reported by 746 participants (43.8%), “lack of agreement between different guidelines dealing with a similar topic” as reported by 699 participants (41.1%), “ambiguity and lack of clarity of recommendations” as reported by 697 participants (41.0%) and “lack of evidence from Chinese sample” as reported by 654 participants (38.4%) which all come under “existing intrinsic flaw of guideline” domain in our framework.

Table 2 Barriers to guideline acquisition and implementation

When compared to the answers provided by participants in tertiary hospitals, more health care practitioners in secondary hospitals thought that the lack of a conducive atmosphere to encourage guideline use (P < 0.001), lack of education or training (P < 0.001), guideline implementation affects physician’s income (P < 0.001) were barriers of guideline use (Fig. 2).

Fig. 2
figure2

Barriers to guideline implementation in secondary versus tertiary hospitals

When compared to the answers provided by participants from secondary hospitals, more health care practitioners in tertiary hospitals thought that the lack of validity (P < 0.001), delayed updates (P < 0.001), lack of agreement between different guidelines(P < 0.001), low quality of underlying evidence (P < 0.001), lack of evidence from Chinese sample (P = 0.001), ambiguity and lack of clarity of recommendations (P < 0.001) and overly simplistic wording or overly broad scope of recommendations (P < 0.001) were barriers to guideline implementation (Fig. 2).

Additional file 3 showed data on enablers and we found that the utilization of various media, short format presentations, linking of guidelines to patient electronic medical records, identification of the possible barriers, facilitators, or feasible solutions, and provision are important guideline implementation tools.

Features associated with guideline adherence

Multivariate analysis showed that adherence was associated with regions (Northeast OR 2.02, 95% CI 1.42–2.88, P < 0.001; West OR 1.53, 95% CI 1.07–2.18, P = 0.02; Middle OR 2.16, 95% CI 1.48–3.15, P < 0.001 compared with the East), hospital grades (OR 0.70, 95% CI 0.50–0.96, P = 0.028), practitioners’ years of practice (OR 1.03, 95% CI 1.01–1.05, P = 0.006), education background (PhD OR 1.90, 95% CI 1.07–3.37, P = 0.027; Master OR 2.11, 95% CI 1.31–3.41, P = 0.002 compared with Junior college degree), EBM skills acquired in work unit (OR 1.44, 95% CI 1.08–1.92, P = 0.012), and specialty (General practice OR 2.06, 95% CI 1.23–3.45, P = 0.006; Surgery OR 1.49, 95% CI 1.01–2.19, P = 0.043). Participants in the Northeast, Middle, and West regions were more likely than those in the East region to consider using guidelines. Participants in secondary public hospitals showed higher self-reported guideline adherence than those in tertiary public hospitals. The longer the years of practice and the higher the education background, the more likely participants were to considered guideline use. We found that EBM or EBM-related education in work unit is significantly associated with self-reported guideline adherence.

No associations were found between professional titles (chief physician or professor of medicine, associate senior doctor or associate chief physician), EBM or related education in college, acknowledgment of guidelines providing basic guidance for clinical practice, participation in the development of guidelines, and knowledge scores for guideline development (Table 3).

Table 3 Determinants associated with guidelines adherence

Discussion

Main findings

Our survey found that over two-thirds of practitioners used guidelines frequently or very frequently and had a positive attitude towards the guidelines’ potential impact on their clinical practice. The key barriers to guideline use were lack of education or training, overly simplistic wording of recommendations or overly broad scope of recommendations, and disagreement between guidelines on the same topic. Secondary hospitals showed higher adherence than tertiary hospitals. Guideline adherence was associated with regions, hospital grades, practitioners’ years of practice, education background, EBM skills acquired in work unit, and general practice or surgical specialty.

Strengths and limitations

To our knowledge this is the first nationally representative survey that used a reliable and validated instrument to examine the factors influencing guideline implementation among Chinese health care practitioners. With an excellent response rate and geographical coverage, we believe that our results should be representative of other parts of China. However, as Hong Kong, Macao and Taiwan were omitted from the survey, and that we did not include first level hospitals and grass-roots medical and health institutions, these limitations should be borne in mind with respect to generalizability. Furthermore, the cross-sectional design limits inferences concerning causal relationships. Finally, as in all self-reported data, social desirability bias may lead to an overestimation of guideline use. Overall, we believe that the quality of our data is sufficiently strong for use in the development of implementation strategies that target the identified barriers to guideline implementation.

Interpretation of findings

Nothing could be more frustrating to a guideline developer than failure of its implementation. Neither the positive attitude towards the significance of guideline implementation nor the knowledge of key methodology for developing guidelines were the prerequisite for guideline use. The result is similar to a survey by Mengyu Liu, et al. in China. They investigated the views of Chinese medicine (CM) doctors on guidelines in China, and showed that a majority of respondents stated that they were familiar with CPGs, however, significantly fewer claimed to be following some form of these [29].

Many factors may influence the implementation of a guideline in China. The most commonly perceived barriers were related to “lack of education or training for guideline use” which comes under “incomplete system mechanism or external environment”. Linan Zeng reported, in primary care settings in China, only 11.3% frequently used CPG, and the most frequently identified barrier to guideline use was lack of training (49.9%) which is consistent with those of our study [30]. A scoping review stated that print material and education for professionals and patients were the most commonly employed strategy for translating guidelines to practice [21]. Workforce education for guideline implementation as an important strategy was illustrated by multiple guideline development manuals [22,23,24]. Our research also stated that EBM or EBM related education in the work unit is significantly associated with self-reported guideline adherence. So education programs should take those factors into account. Education in guideline use and building an atmosphere to encourage guideline use is more important for lower grade hospitals, since our research showed that more health care practitioners in secondary hospitals chose lack of education and atmosphere to encourage guideline use as barriers of guideline use than tertiary hospitals. Workforce education should be interprofessional in scope and integrated in practice [31]. The major stakeholders, including representatives of the various practitioner and patient groups as well as local administrators and policy makers, should be engaged [22,23,24, 31].

We found that ambiguity in the wording of the recommendations confused practitioners and hampered uptake of guidelines, as reported previously [32]. Key action statements should be clear so as to prevent inappropriate practice variation [33]. Confidence in ability to practice the recommended behavior is key to its implementation [34,35,36]. Formulating recommendations and suggestions can be based on the “Who? What? Where? How?” approach suggested by guideline development manuals to standardize the recommendations and wording [37].

Style, content, and format consistency with transparency in rationale and congruence with organization-specific policies can improve implementation [33, 38]. With the development of information technology [39], adapting the form of presentation for mobile devices, pocket guides, wall posters and summary versions are badly needed for just-in-time accessibility.

Guideline implementation plans tailored to overcome the potential barriers identified in advance are more likely to improve healthcare compared with passive dissemination of guidelines [6, 34]. There are many known features that influence the journey of evidence and guidelines from publication into practice [7, 8, 19, 21]. Features intrinsic to guideline development, including stakeholder involvement during all stages from its conception and content development to formatting and dissemination, are now recognized as important components [9, 23]. Responding to the recognized need for understanding why guideline implementation works in some contexts and not in others, our study sheds light directly on this matter through a national representative survey. Francke et al. [19] performed a systematic review and reported that effective strategies usually have multiple elements and that the use of a single strategy is less effective.

Our study found that unimpeded promotion, multichannel and multiform guideline presentation combined with extensive education and training of all health care practitioners were considered paramount for guideline implementation. Concerns about how the perceived need for high level of resource hinders guideline implementation have been addressed by developing a framework for stratifying guideline recommendations according to health care setting level [32].

The National Health Commission could suggest that specialty associations or societies establish specific guideline implementation working groups to participate in guideline development. For example, each guideline expert panel has a Practice Guidelines Implementation Network (PGIN) representative, and their role is to examine whether guideline recommendations can be implemented in real world practice [40].

There is no doubt that Chinese guideline developers will improve guideline recommendations in such a way that they will be more applicable to different health care settings in China in the future.

Conclusion and implications

Our survey provides a comprehensive, valid and generalizable snapshot to understand the state of guideline implementation in China, with lessons for other countries and regions. Major challenges lie ahead in: (a) making guidelines more accessible at the point of care; (b) strengthening guideline development, focusing on unambiguous presentation of recommendations with bespoke implementation tools; and (c) training medical staff to embrace guidelines. In conclusion, guideline development should tailor the content for effective dissemination and, for optimizing the likelihood of adherence, guideline implementation should follow a bespoke plan incorporating features identified through our study.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CPGs:

Clinical Practice Guidelines

GLIA:

Guideline Implementability Appraisal

IQR:

Interquartile range

SD:

Standard deviation

OR:

Odds ratios

CI:

Confidence interval

References

  1. 1.

    Gagliardi AR, Brouwers MC. Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice. Implement Sci. 2012;7:67.

    Article  Google Scholar 

  2. 2.

    IOM. Clinical practice guidelines we can trust. Washington: National Academies Press; 2011.

    Google Scholar 

  3. 3.

    Shekelle PG. Clinical practice guidelines: what’s next? JAMA. 2018;320:757–8.

    Article  Google Scholar 

  4. 4.

    Pronovost PJ. Enhancing physicians’ use of clinical guidelines. JAMA. 2013;310:2501–2.

    CAS  Article  Google Scholar 

  5. 5.

    Kashyap N, MD, Dixon J. Guideline implementability appraisal v. 2.0. http://nutmeg.med.yale.edu/glia/login.htm. 2018. Accessed 4 Dec 2018.

  6. 6.

    Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane DatabaseSystRev. 2010;3:CD005470.

    Google Scholar 

  7. 7.

    Flottorp SA, Oxman AD, Krause J, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8(1):35.

    Article  Google Scholar 

  8. 8.

    Mowatt G, Grimshaw JM, Davis DA, Mazmanian PE. Getting evidence into practice: The work of the Cochrane Effective Practice and Organization of Care Group (EPOC). J Contin Educ Health Prof. 2001;21(1):55–60.

    CAS  Article  Google Scholar 

  9. 9.

    Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, et al. Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review. J Clin Epidemiol. 2015;68(5):498–509.

    Article  Google Scholar 

  10. 10.

    Chen YL, Wang C, Shang HC, Yang KH, Susan LN. Clinical practice guidelines in China. BMJ. 2018;360:j5158.

    Article  Google Scholar 

  11. 11.

    Burns KE, Duffett M, Kho ME, Meade MO, Adhikari NK, Sinuff T, Cook DJ. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ. 2008;179:245–52.

    Article  Google Scholar 

  12. 12.

    Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335:806–8.

    Article  Google Scholar 

  13. 13.

    Baatiema L, Otim ME, Mnatzaganian G, et al. Health professionals’ views on the barriers and enablers to evidence-based practice for acute stroke care: a systematic review. Implement Sci. 2017;12(1):74.

    Article  Google Scholar 

  14. 14.

    Prior M, Guerin M, Grimmer-Somers K. The effectiveness of clinical guideline implementation strategies—a synthesis of systematic review findings. J Eval Clin Pract. 2010;14(5):888–97.

    Article  Google Scholar 

  15. 15.

    Girlanda F, Fiedler I, Becker T, et al. The evidence–practice gap in specialist mental healthcare: systematic review and meta-analysis of guideline implementation studies. Br J Psychiatry. 2017;210(1):24–30.

    Article  Google Scholar 

  16. 16.

    Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw GM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.

    Article  Google Scholar 

  17. 17.

    Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, O’Connell R. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005;5:23.

    Article  Google Scholar 

  18. 18.

    Jin Y, Li Z, Han F, et al. Barriers and enablers for the implementation of clinical practice guidelines in China: a mixed-method study. BMJ Open. 2019;9(9):e026328.

    Article  Google Scholar 

  19. 19.

    Francke AL, Smit MC, de Veer AJ, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008;8:38.

    Article  Google Scholar 

  20. 20.

    Medves J, Godfrey C, Turner C, Paterson M, Durando P. Systematic review of practice guideline dissemination and implementation strategies for healthcare teams and team-based practice. Int J Evid Based Health. 2010;8:79–89.

    Google Scholar 

  21. 21.

    Gagliardi AR, Alhabib S, Members of Guidelines International Network Implementation Working G. Trends in guideline implementation: a scoping systematic review. Implement Sci. 2015;10:54.

    Article  Google Scholar 

  22. 22.

    WHO. Handbook for guideline development. http://www.who.int/publications/guidelines/handbook_2nd_ed.pdf?ua=1. Accessed 5 Dec 2018.

  23. 23.

    NICE. Developing Nice guidelines, the manual. 2018. https://www.nice.org.uk/process/pmg20/chapter/introduction. Accessed 5 Dec 2018.

  24. 24.

    SIGN. A guideline developer’s handbook. 2018. https://www.sign.ac.uk/our-guidelines/sign-50-a-guideline-developers-handbook/. Accessed 5 Dec 2018.

  25. 25.

    Godin G, Belanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.

    Article  Google Scholar 

  26. 26.

    Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14.

    Article  Google Scholar 

  27. 27.

    Fishbein M, Ajzen I. Belief, attitude, intention and behavior: an introduction to theory and research. Reading: Addison-Wesley; 1975.

    Google Scholar 

  28. 28.

    China NHCotPsRo. China’s health statistics yearbook 2018. Beijing: Peking Union Medical College Press; 2018.

    Google Scholar 

  29. 29.

    Liu M, Zhang C, Zha Q, Yang W, Ya Y, Zhong L, Bian Z, Han X, Lu A. A national survey of Chinese medicine doctors and clinical practice guidelines in China. BMC Complement Altern Med. 2017;17:451.

    Article  Google Scholar 

  30. 30.

    Zeng L, Li Y, Zhang L, Liu G, Zhang Y, Zhen S, et al. Guideline use behaviours and needs of primary care practitioners in China: a cross-sectional survey. BMJ Open. 2017;7:e015379.

    Article  Google Scholar 

  31. 31.

    IDF. Guide for guidelines. https://www.idf.org/our-activities/advocacy-awareness/resources-and-tools/81:clinical-guideline-development.html. Accessed 5 Dec 2018.

  32. 32.

    Carlson RW, Scavone JL, Koh WJ, McClure JS, Greer BE, Kumar R, et al. NCCN framework for resource stratification: a framework for providing and improving global quality oncology care. J Natl Compr Cancer Netw. 2016;14:961–9.

    Article  Google Scholar 

  33. 33.

    Yang N, Yu Y, Zhang A, Estill J, Wang X, Zheng M, et al. Reporting, presentation and wording of recommendations in clinical practice guideline for gout: a systematic analysis. BMJ Open. 2019;9:e024315.

    Article  Google Scholar 

  34. 34.

    Rosenfeld RM, Shiffman RN. Clinical practice guideline development manual: a quality-driven approach for translating evidence into action. Otolaryngol Head Neck Surg. 2009;140:S1-43.

    Article  Google Scholar 

  35. 35.

    Michie S, Johnston M. Changing clinical behaviour by making guidelines specific. BMJ. 2004;328:343–5.

    Article  Google Scholar 

  36. 36.

    Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, et al. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implement Sci. 2009;4:61.

    Article  Google Scholar 

  37. 37.

    KHA-CARI. KHACARI Guideline Development Manual. http://www.cari.org.au/docs/KHACARI_Guideline_development_%20manual.pdf. Accessed 15 Dec 2018.

  38. 38.

    Ramerman L, Hoekstra PJ, de Kuijper G. Exploring barriers and facilitators in the implementation and use of guideline recommendations on antipsychotic drug prescriptions for people with intellectual disability. J Appl Res Intellect Disabil. 2018;31:1062–70.

    Article  Google Scholar 

  39. 39.

    Institute NLR. The 15th national reading survey. Natl Libr J. 2018;27:38.

    Google Scholar 

  40. 40.

    Somerfield MR, Bohlke K, Browman GP, Denduluri N, Einhaus K, Hayes DF, et al. Innovations in American Society of Clinical Oncology Practice Guideline Development. J Clin Oncol. 2016;34(26):3213–20.

    Article  Google Scholar 

Download references

Acknowledgements

We extend special thanks for the contribution of consultant experts and health care practitioners for the development of the instrument and the cooperation of all study units. We also thank Kristy Yiu for English assistance.

Funding

This study was supported by grants from the National Key Research and Development Program of China (No. 2016YFC0106300). The funding body did not have any role in the study and writing of the manuscript.

Author information

Affiliations

Authors

Contributions

QW and XHW conceived and designed the study, and critically reviewed the manuscript. YH J, LMT, QW, XHW and KSK developed questionnaire. YHJ, CH, FH, JZ, DH, DQW, YW, XTZ and TD collected the data. YHJ and QH analyzed and interpreted the data. YHJ and LMT wrote the manuscript. All authors read and approved the manuscript.

Corresponding authors

Correspondence to Qiang Wang or Xing-huan Wang.

Ethics declarations

Ethics approval and consent to participate

Approval was obtained from the ethics committee of Zhongnan Hospital of Wuhan University (No. 2019020). Verbal Informed consent was obtained before the questionnaires were distributed, and this was approved by the ethics committee.

Consent for publication

Not applicable.

Competing interests

All the authors (Ying-hui Jin, Li-Ming Tan, Khalid S. Khan, Tong Deng, Chao Huang, Fei Han, Jing Zhang, Qiao Huang, Di Huang, Dan-qi Wang, Yu Wang, Xian-tao Zeng, Qiang Wang, Xing-huan Wang) declare no competing financial interests. Ying-hui Jin, Xian-tao Zeng, Qiang Wang and Xing-huan Wang have conducted several clinical practice guidelines.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

The survey questionnaire.

Additional file 2.

Table of Knowledge scores of key methodology for developing guidelines.

Additional file 3.

Table of Enablers for guideline implementation in all respondents.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jin, Yh., Tan, LM., Khan, K.S. et al. Determinants of successful guideline implementation: a national cross-sectional survey. BMC Med Inform Decis Mak 21, 19 (2021). https://doi.org/10.1186/s12911-020-01382-w

Download citation

Keywords

  • Guideline
  • Adherence
  • Implementation
  • Barriers