Skip to main content

Clinician perceptions of a clinical decision support system to reduce cardiovascular risk among prediabetes patients in a predominantly rural healthcare system

Abstract

Background

The early detection and management of uncontrolled cardiovascular risk factors among prediabetes patients can prevent cardiovascular disease (CVD). Prediabetes increases the risk of CVD, which is a leading cause of death in the United States. CVD clinical decision support (CDS) in primary care settings has the potential to reduce cardiovascular risk in patients with prediabetes while potentially saving clinicians time. The objective of this study is to understand primary care clinician (PCC) perceptions of a CDS system designed to reduce CVD risk in adults with prediabetes.

Methods

We administered pre-CDS implementation (6/30/2016 to 8/25/2016) (n = 183, 61% response rate) and post-CDS implementation (6/12/2019 to 8/7/2019) (n = 131, 44.5% response rate) independent cross-sectional electronic surveys to PCCs at 36 randomized primary care clinics participating in a federally funded study of a CVD risk reduction CDS tool. Surveys assessed PCC demographics, experiences in delivering prediabetes care, perceptions of CDS impact on shared decision making, perception of CDS impact on control of major CVD risk factors, and overall perceptions of the CDS tool when managing cardiovascular risk.

Results

We found few significant differences when comparing pre- and post-implementation responses across CDS intervention and usual care (UC) clinics. A majority of PCCs felt well-prepared to discuss CVD risk factor control with patients both pre- and post-implementation. About 73% of PCCs at CDS intervention clinics agreed that the CDS helped improve risk control, 68% reported the CDS added value to patient clinic visits, and 72% reported they would recommend use of this CDS system to colleagues. However, most PCCs disagreed that the CDS saves time talking about preventing diabetes or CVD, and most PCCs also did not find the clinical domains useful, nor did PCCs believe that the clinical domains were useful in getting patients to take action. Finally, only about 38% reported they were satisfied with the CDS.

Conclusions

These results improve our understanding of CDS user experience and can be used to guide iterative improvement of the CDS. While most PCCs agreed the CDS improves CVD and diabetes risk factor control, they were generally not satisfied with the CDS. Moreover, only 40–50% agreed that specific suggestions on clinical domains helped patients to take action. In spite of this, an overwhelming majority reported they would recommend the CDS to colleagues, pointing for the need to improve upon the current CDS.

Trial registration: NCT02759055 03/05/2016.

Peer Review reports

Background

While prediabetes is sometimes viewed as a minor health condition, it increases the risk of developing type 2 diabetes and many other conditions associated with diabetes, such as stroke, multiple diseases involving the eyes, nervous system, or kidneys, or being diagnosed with cardiovascular (CV) or coronary heart disease [1,2,3]. While 1 in 3 Americans meet conditions for prediabetes [1, 3], just 16% of those are aware they have prediabetes [1].

Periodic testing for abnormal glucose levels [2] in adults is recommended based on age, Body Mass Index (BMI), and other risk factors. Primary Care Clinicians (PCCs) play an important role in identifying patients with prediabetes, assessing CV risk, and delaying or preventing diabetes onset; however, glucose screening and follow-up of elevated fasting glucose values is often incomplete due to the nature of compressed patient visits, competing demands, fragmented care, inefficient health information systems, lack of accountability, and lack of point-of-care clinical decision support (CDS) [4,5,6,7].

To exacerbate things, focusing on diabetes prevention is often not a high clinical priority in busy primary care practices, and PCCs often have limited interest or skill in behavior change science or patient education, which are prominent components of prediabetes care in most patients [8]. Algorithm-based CDS tools may offer great assistance to PCCs by enhancing identification and management of prediabetes and guiding CV risk factor control in such patients, as has been the case with prostate and other cancers, particularly when PCCs need to discuss screening options [9,10,11]. Current evidence is lacking regarding PCCs’ usage or lack of usage of algorithm-based decision tools as well as their perceptions on the utility of CDS, and how such tools may support CV risk reduction among prediabetes patients.

Algorithmically-driven decision support tools have been found useful in many non-medical disciplines and often outperform expert judgment [12, 13], yet optimal utilization of these tools in primary care and other health care settings remains aspirational. For example, Saleem et al. [14] found six common barriers to CDS integration including “receiving and documenting ‘outside’ exam results, inaccuracy of the CDS, compliance issues, poor usability, lack of coordination between primary care and gastroenterology, and the need to attend to more urgent patient issues”. An earlier study (1998) concluded that CDS systems were highly promising and that the quality of studies were improving; however, they also reported that the effects of patient outcomes had not been sufficiently studied [15]. Very early computer assisted support in the emergency room suggested some promise for optimizing drug administration [16]. However, few studies to date have investigated PCC attitudes towards CDS systems for cardiometabolic care, and CDS use and effectiveness in outpatient chronic disease care remains inconsistent [17, 18].

Objective and hypothesis

This cross-sectional study of PCCs aims to: (1) improve our understanding of PCCs' experience in delivering care to adult patients with prediabetes and one or more uncontrolled CVD risk factors, and (2) assess intervention clinic PCCs' overall satisfaction with the CDS system and satisfaction with specific aspects of the CDS system, and (3) assess intervention clinic PCCs' perceptions of CDS impact on shared decision making with patients.

Methods

Study participants

There were a total of 299 (pre-implementation) and 294 (post-implementation) Essentia Health PCCs from 36 primary care clinics included in a randomized control trial of an electronic medical record (EMR)-linked web-based CDS tool referred to as the Wizard. The CDS tool was designed to improve cardiovascular care for adults with prediabetes and one or more uncontrolled CVD risk factors. For the present study, the Essentia Health PCCs were invited to complete two cross-sectional electronic surveys. Essentia Health’s integrated healthcare system serves a wide and rural population in Minnesota, North Dakota, and Wisconsin with 14 hospitals and 71 clinics. The clinic-cluster randomized trial included PCCs who were either physicians (family practice or internal medicine) or advanced care practitioners (adult, pediatric, family, or geriatric nurse practitioners or physician assistants) practicing in one of the 24 intervention or 12 control primary care clinics. No compensation was provided for survey completion. PCCs who did not respond or who reported seeing patients in these clinics less than 3 days per week or were missing data on this question were excluded.

Intervention

We conducted the surveys within a cluster-randomized control trial, previously described [19, 20], of a CDS intervention in 34 primary care clinics clusters within two study arms: (a) usual care (UC) and (b) CDS. The CDS arm of the study allowed rooming staff and PCCs to receive CDS alerts and treatment recommendations for adult patients with prediabetes and one of more uncontrolled cardiovascular risk factors. The CDS summary was a unique paper printout for patients (patient version) and another for PCCs (more technical version) that included six modifiable cardiovascular risk factors as well as patient-specific treatment recommendations around each of these risk factors if uncontrolled. Figures 1 and 2 show examples of both the patient and PCC version of the CDS printout, respectively [20]. In the CDS intervention arm, an algorithm-based, point-of-care, EMR-linked CDS tool identified adults with prediabetes and one or more uncontrolled cardiovascular risk factors (smoking, BMI, blood glucose, cholesterol, aspirin usage, and blood pressure). In the EMR, a best practice alert notified rooming staff of eligible patients and instructed them to print the CDS materials, giving the lay version to patients and placing the more technical PCC version on the patient’s exam room door prior to the PCC entering. PCCs in the UC arm clinics did not have access to the CDS and participants in the UC study arm would have met criteria for the CDS if they had visited an intervention clinic. The CDS was developed by the study team and tested at two pilot clinics with routine feedback collected from PCCs by the study team, with study design described in a previous publication [20]. The overall results of the RCT are forthcoming.

Fig. 1
figure 1

Patient view and printout of the clinical decision support system. Reprinted from Contemporary Clinical Trials, 114, Desai J, Saman D, Sperl-Hillen JM, Pratt R, Dehmer SP, Allen C, Ohnsorg K, Wuorio A, Appana D, Hitz P, Land A, Sharma R, Wilkinson L, Crain AL, Crabtree BF, Bianco J, O'Connor PJ. Implementing a prediabetes clinical decision support system in a large primary care system: Design, methods, and pre-implementation results, 106,686, Copyright (2022), with permission from Elsevier [20]

Fig. 2
figure 2

Provider view and printout of the clinical decision support system. Reprinted from Contemporary Clinical Trials, 114, Desai J, Saman D, Sperl-Hillen JM, Pratt R, Dehmer SP, Allen C, Ohnsorg K, Wuorio A, Appana D, Hitz P, Land A, Sharma R, Wilkinson L, Crain AL, Crabtree BF, Bianco J, O'Connor PJ, Implementing a prediabetes clinical decision support system in a large primary care system: Design, methods, and pre-implementation results, 106,686, Copyright (2022), with permission from Elsevier [20]

Survey instrument

The surveys were administered through the Center for Evaluation and Survey Research at HealthPartners Institute using REDCap (Research Electronic Data Capture) and sent to eligible PCCs [21, 22]. Both surveys measured PCCs’ demographics, experiences in delivering care to adult patients at high risk of cardiovascular disease, views on shared decision making, their opinions of the EMR’s ability to assess and manage CV risk [6], and their overall perceptions of the CDS tool in managing CV risk (post-implementation survey only). As noted by Harry et al. [6], the surveys contained measures that were adapted from two validated instruments:  the Shared Decision-Making Questionnaire–physician version (SDM-Q-Doc) [23] and the System Usability Scale (SUS) [24]. Survey questions regarding experience and satisfaction with the CDS tool among PCCs in intervention clinics were developed internally by the study team.

Data collection

The electronic surveys were administered pre-implementation (6/30/2016–8/25/2016) and post-implementation (6/12/2019–8/7/2019). For both surveys and as described by Harry et al. [6], an initial email requesting survey participation was sent to PCCs eligible for this study from primary care leadership at Essentia Health. This was followed by an email invitation including the survey link sent from REDCap, with up to eight email reminders sent to those who had not yet completed the survey. Pre-implementation and post-implementation surveys could only be taken once each through a unique link tied to a PCC's email address through REDCap. Completion of the survey implied PCC consent. Essentia Health’s Institutional Review Board reviewed this study in advance, approved it, and monitored its progress.

Data analysis

Bivariate tests of association compared responses between pre- and post-implementation, as well as differences within the intervention and UC groups in the post-implementation survey. Tests were two-tailed, with an alpha of 0.05. Survey responses were collapsed into meaningful categories (e.g., scales from 0 to 10 where 0 = Never and 10 = Always were dichotomized into groups responding either 0–6 or 7–10). Differences in survey responses by treatment group within measurement time points (i.e., pre- and post-implementation) were assessed using Pearson's chi-squared tests and two-sample t-tests. Generalized linear mixed models assessed whether changes in survey responses from pre- and post-implementation differed by treatment group (i.e., treatment by time interaction). These models included random clinician intercepts to account for dependence in pre- and post-implementation survey data from clinicians and used normal or binomial distributions and identity or logit link functions, as appropriate for the survey response variable. This analysis was performed to account for the paired data arising when some PCCs completed both pre- and post-implementation surveys. Analyses were performed with SAS version 9.4 [25].

For the 10-year CVD risk score and each CVD risk factor (smoking, blood pressure, A1C, lipid, and weight), we measured PCC perceptions of the CDS’s usefulness using four-point scale items (extremely useful, very useful, somewhat useful, not useful). Measurement of PCC satisfaction also used four-point scale items (extremely satisfied, very satisfied, somewhat satisfied, not at all satisfied). The percent agree shown in Tables 3, 4 and 5 are expressed by combining responses for extremely useful/satisfied and very useful/satisfied.

We asked PCCs to rate their level of CDS use and how often they give the more comprehensive clinician version of the CDS patients on a percentage scale ranging from 0% to 100%. The percent agree shown in Table 5 are expressed by combining responses from 50% to 100%. PCCs selected either “yes” or “no” if they would recommend the CDS to colleagues. The percent agree shown in Table 5 is expressed by those who selected “yes”.

Results

We emailed 294 PCCs an invitation to take part in the post-implementation survey, to which 131 responded (44.5% response rate). Table 1 shows PCC respondent demographics at pre- and post-implementation. Similar to pre-implementation, where 41% of PCCs practiced in a rural or small-town clinic and women comprised 60% of the sample [6], post-implementation survey respondents were largely women (58%) and practiced in rural or small-town clinics (40%). Physicians comprised the majority of respondents.

Table 1 Characteristics of study-eligible primary care clinician (PCC) survey respondents

CDS impact on PCC management of CV risk factors in prediabetes patients

We found no significant differences between pre-and post-implementation survey responses, and no significant differences within the post-implementation survey respondents for intervention and UC groups (Table 2). Only 52% of intervention and 45% of control respondents reported always using CV risk calculations with patients. However, over 90% of post-implementation respondents reported they are well prepared to discuss dietary and physical activity for preventing diabetes or reducing CV risk. Only 38% of intervention respondents and 52% of control respondents believed it was easy to follow aspirin guidelines to determine if a patient would benefit for primary prevention (non-significant).

Table 2 Provider experience in delivering care to adult patients at high risk of cardiovascular disease or diabetes

CDS impact on shared decision making with prediabetes patients

A significantly greater proportion of intervention respondents reported shared decision making with their patients compared to UC clinic respondents in the post-implementation survey (96% vs. 83%, respectively p = 0.0163) (Table 3). Most PCC respondents in both study arms believed they precisely explained advantages and disadvantages of treatment options to their patients, and most agreed they ask their patients which treatment the patient prefers, with no significant differences between pre- and post-implementation surveys. A greater proportion of intervention clinicians (88%) reported wanting to know how patients wanted to be involved in making decisions than UC clinicians (78%) (p = 0.0616).

Table 3 Provider perceptions of shared decision making with adult patients at high risk of cardiovascular disease or diabetes

Clinician perceptions of EMR’s ability to help assess and manage CV risk

A significantly greater proportion of intervention vs control PCCs (59% vs. 41%, p = 0.0482) agreed that the EMR decision support is easy to use and helps manage a patient’s CV risk post-implementation (Table 4). Only about half of post-implementation PCCs agreed that most clinicians could learn to use our EMR decision support very quickly to help manage a patient’s CV risk. Compared to pre-implementation (CDS = 26%, UC = 27%), post-implementation CDS intervention arm respondents had significantly higher changes in the rate of agreeing that the various functions in Essentia Health’s EMR decision support were well integrated for helping manage a patient’s CV risk (CDS = 47%, UC = 35%, p = 0.0352). No other significant differences were seen.

Table 4 Provider perceptions of EMR’s ability to help assess and manage CV risk of patients at high risk of cardiovascular disease or diabetes

PCC perceptions of the CDS Wizard to manage CV risk

Among post-implementation respondents in the intervention clinics (n = 78), 73% agreed the CDS intervention improved CV risk factor control (despite only 38% agreeing that they were satisfied with the CDS), but only 42% reported frequently using the CDS as a tool to help care for patients. Among CDS intervention clinic PCCs, 78% reported the American College of Cardiology/American Heart Association (ACC/AHA) Pooled 10-year CV disease risk score calculated within the CDS to be useful. In contrast, only 46% found the smoking domain useful, 50% found the blood pressure domain useful, 46% found the glucose domain useful, 51% found the lipid domain useful, 42% found the weight domain useful, and 42% found the aspirin domain useful. Similar results were found regarding how PCCs responded to the usefulness of the CDS Wizard in getting patients to take action on smoking (16%), blood pressure (31%), glucose (29%), lipids (33%), weight (20%), and aspirin (31%). Only 40% and 42% responded that the Wizard saves time talking about CV risk reduction and preventing diabetes, respectively, while 53% reported the Wizard actually increases the duration of appointments with patients. However, about 68% reported the Wizard adds value to patient clinic visits. Finally, 78% reported the 10-year American College of Cardiology atherosclerotic CVD risk score calculated by the Wizard to be useful (Table 5).

Table 5 Provider perceptions of CDS Wizard to manage CV risk of patients at high risk of cardiovascular disease or diabetes

Discussion

PCC attitudes towards and use of modern EMR-linked and web-based point-of-care CDS systems are not well understood. In this study, we sought to expand our understanding of factors that may affect use and effectiveness of an integrated cardiometabolic CDS system in primary care settings. We previously described transportable lessons based on our experiences for modifying CDS systems [26]. We reiterate the value of gaining “front-line key informant input early—and sustain[ing] those relationships”, as well as better estimation of “the challenges of technology” [26]. The data we report here suggests there are many opportunities to improve CDS design, implementation, and use in primary care settings.

Most PCCs exposed to the CDS reported that it helped improve CV risk factor control in patients, and most felt the CDS was well integrated in the EMR. While an overwhelming majority of post-implementation intervention arm PCCs valued easy access to a patient’s ACC/AHA 10-year CV disease risk score, only about half valued treatment suggestions related to specific clinical domains such as lipid, blood pressure, smoking, or weight management. These differences in PCC valuations of certain parts of the CDS over others suggests specific directions for future CDS development and preferred clinical use. For example, detailed information on specific treatment recommendations may not be as valuable a function in primary care CDS as directing patient and PCC attention to clinical issues, such as blood pressure or lipid management, that merit attention.

Evidence-based clinical algorithms have the potential to improve decision making, enhance shared decision making, and save time [9, 13, 18, 27, 28]; however, a majority of PCCs in our survey did not agree that the tool saved time talking about CV risk or diabetes, and about half responded that CDS use increased the duration of a clinical encounter. This finding points to the need for further refinements and focusing of CDS content, as well as flexible integration of CDS use in the clinic workflow—a workflow that may vary across PCCs even within the same clinic. Using workflow integration analysis, Salwei et al. [29] recently described 25 components of workflow integration of a CDS in the emergency department and proposed a checklist so future CDS teams can consider workflow integration. This type of analysis may prove to be relevant in improving CDS utilization in primary care as well as other departments in healthcare [29].

Although most respondents were not fully satisfied with the Wizard CDS system, over 70% would recommend it to their colleagues. Though a seemingly contradictory finding, this is evidence of a clear need for CDS improvement rather than eliminating it altogether, and much greater investigation into why PCCs were so dissatisfied. Moreover, the study team identified that while the CDS was routinely printed for patients and PCCs as we established an 80% print goal, it was often not actually utilized within the patient visit for several reasons: printing and technological issues, CDS firing too often at visits because of the addition of a cancer clinical domain due to an additional study, PCCs not having enough time, and non-optimal placement of printers outside of patient rooms [26, 30, 31]. A forthcoming manuscript reporting on our primary outcome will explore this further.

However, in prior studies of similar CDS systems, we have found similar levels of PCCs who would recommend the CDS system to their colleagues [27, 28, 32]. The consistency of this finding across several studies suggests broad PCC support for use of CDS in primary care, as well as the need for ongoing improvement of CDS tools designed for use in primary care settings. As patients are also primary users of the tool, a forthcoming study will be examining patient satisfaction with the CDS tool.

Several factors limit the interpretation of these data. The sample size was limited as was the survey response rate at 44.5% at post-implementation. Most of the randomized clinics were located in rural areas or small towns, and generalizability of results to large urban settings should be done with caution. PCC perceptions were related to only one CDS system, and all PCCs in both CDS intervention and UC clinics had some access to simple EMR-based prompts and reminders. Also, many of our survey questions around satisfaction were developed internally and not from a standardized survey instrument. Despite these limitations, our results suggest widespread PCC interest in and use of CDS systems in primary care and suggest specific enhancements that may be considered to improve CDS design and clinical content in primary care settings.

Conclusions

PCCs in UC clinics reported confidence in their ability to manage major CV risk factors in high-risk patients such as those with prediabetes. PCCs in CDS intervention clinics reported that easy access to 10-year CVD risk estimates was useful and believed that CDS improved CV risk factor management. However, they did not place high value on domain-specific care suggestions and reported that CDS use takes too much time. Despite their perceptions of limited CDS usefulness and lack of satisfaction, about 72% would recommend use of this CDS system to their colleagues, suggesting that improving the design and content of CDS systems to support chronic disease care in primary care settings would be valued by PCCs. Future iterations of CDS systems designed for use in primary care should take into account these findings to guide improvements.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available due to privacy but are available in deidentified form from the corresponding author on reasonable request.

Abbreviations

CVD:

Cardiovascular disease

CDS:

Clinical decision support

PCC:

Primary care clinician

CV:

Cardiovascular

UC:

Usual care

BMI:

Body mass index

EMR:

Electronic medical record

REDCap:

Research electronic data capture

SDM-Q-Doc:

Shared decision-making questionnaire–physician version

SUS:

System Usability Scale

References

  1. Centers for Disease Control and Prevention (CDC). The surprising truth about prediabetes 2020. Available from: https://www.cdc.gov/diabetes/library/features/truth-about-prediabetes.html.

  2. Hostalek U. Global epidemiology of prediabetes - present and future perspectives. Clin Diabetes Endocrinol. 2019;5:5.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Huang Y, Cai X, Mai W, Li M, Hu Y. Association between prediabetes and risk of cardiovascular disease and all cause mortality: systematic review and meta-analysis. BMJ. 2016;355:i5953.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43.

    Article  PubMed  Google Scholar 

  5. Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.

    Article  PubMed  CAS  Google Scholar 

  6. Harry ML, Saman DM, Allen CI, Ohnsorg KA, Sperl-Hillen JM, O’Connor PJ, et al. Understanding primary care provider attitudes and behaviors regarding cardiovascular disease risk and diabetes prevention in the northern midwest. Clin Diabetes. 2018;36(4):283–94.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Saman DM, Walton KM, Harry ML, Asche SE, Truitt AR, Henzler-Buckingham HA, et al. Understanding primary care providers’ perceptions of cancer prevention and screening in a predominantly rural healthcare system in the upper Midwest. BMC Health Serv Res. 2019;19(1):1019.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kandula NR, Moran MR, Tang JW, O’Brien MJ. Preventing diabetes in primary care: providers’ perspectives about diagnosing and treating prediabetes. Clin Diabetes. 2018;36(1):59–66.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Bhuyan SS, Chandak A, Gupta N, Isharwal S, LaGrange C, Mahmood A, et al. Patient-provider communication about prostate cancer screening and treatment: new evidence from the health information national trends survey. Am J Mens Health. 2017;11(1):134–46.

    Article  PubMed  Google Scholar 

  10. Dunn AS, Shridharani KV, Lou W, Bernstein J, Horowitz CR. Physician-patient discussions of controversial cancer screening tests. Am J Prev Med. 2001;20(2):130–4.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  11. Guerra CE, Jacobs SE, Holmes JH, Shea JA. Are physicians discussing prostate cancer screening with their patients and why or why not? A pilot study. J Gen Intern Med. 2007;22(7):901–7.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Jia P, Zhang L, Chen J, Zhao P, Zhang M. The effects of clinical decision support systems on medication safety: an overview. PLOS ONE. 2016;11(12):e0167683.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med. 2020;3:17.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Saleem JJ, Militello LG, Arbuckle N, Flanagan M, Haggstrom DA, Linder JA, et al. Provider perceptions of colorectal cancer screening clinical decision support at three benchmark institutions. In: AMIA Annual Symposium Proceedings. 2009. p. 558–62.

  15. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280(15):1339–46.

    Article  PubMed  CAS  Google Scholar 

  16. Gonzalez ER, Vanderheyden BA, Ornato JP, Comstock TG. Computer-assisted optimization of aminophylline therapy in the emergency department. Am J Emerg Med. 1989;7(4):395–401.

    Article  PubMed  CAS  Google Scholar 

  17. Han PK, Kobrin S, Breen N, Joseph DA, Li J, Frosch DL, et al. National evidence on the use of shared decision making in prostate-specific antigen screening. Ann Fam Med. 2013;11(4):306–14.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Marc DT, Khairat SS. Why do physicians have difficulty accepting clinical decision support systems? Stud Health Technol Inform. 2013;192:1202.

    PubMed  Google Scholar 

  19. Sperl-Hillen JM, Rossom RC, Kharbanda EO, Gold R, Geissal ED, Elliott TE, et al. Priorities wizard: multisite web-based primary care clinical decision support improved chronic care outcomes with high use rates and high clinician satisfaction rates. EGEMS (Wash DC). 2019;7(1):9.

    Google Scholar 

  20. Desai J, Saman D, Sperl-Hillen JM, Pratt R, Dehmer SP, Allen C, Ohnsorg K, Wuorio A, Appana D, Hitz P, Land A, Sharma R, Wilkinson L, Crain AL, Crabtree BF, Bianco J, O’Connor PJ. Implementing a prediabetes clinical decision support system in a large primary care system: design, methods, and pre-implementation results. Contemp Clin Trials. 2022;114:106686.

    Article  PubMed  Google Scholar 

  21. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

    Article  PubMed  Google Scholar 

  23. Scholl I, Kriston L, Dirmaier J, et al. Development and psychometric properties of the shared decision making questionnaire: physician version (SDM-Q-Doc). Patient Educ Couns. 2012;88:284–90.

    Article  PubMed  Google Scholar 

  24. JB. SUS: a 'quick and dirty' usability scale. In: Jordan PW TB, Weerdmeester BA, McClelland AL, editor. Usability evaluation in industry. London: Taylor and Francis; 1996. p. 189–94.

  25. SAS Institute Inc. Version 9.4. Cary, North Carolina, USA. 2013.

  26. Harry ML, Saman DM, Truitt AR, Allen CI, Walton KM, O’Connor PJ, et al. Pre-implementation adaptation of primary care cancer prevention clinical decision support in a predominantly rural healthcare system. BMC Med Inform Decis Mak. 2020;20(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  27. O’Connor PJ, Sperl-Hillen JM, Rush WA, Johnson PE, Amundson GH, Asche SE, et al. Impact of electronic health record clinical decision support on diabetes care: a randomized trial. Ann Fam Med. 2011;9(1):12–21.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Sperl-Hillen JM, Crain AL, Margolis KL, Ekstrom HL, Appana D, Amundson GH, et al. Clinical decision support directed to primary care patients and providers reduces cardiovascular risk: a randomized trial. J Am Med Inform Assoc. 2018;25(9):1137–46.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Salwei ME, Carayon P, Hoonakker PLT, Hundt AS, Wiegmann D, Pulia M, Patterson BW. Workflow integration analysis of a human factors-based clinical decision support in the emergency department. Appl Ergon. 2021;97:103498.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Harry ML, Truitt AR, Saman DM, Henzler-Buckingham HA, Allen CI, Walton KM, Ekstrom HL, O'Connor PJ, Sperl-Hillen JM, Bianco JA, Elliott TE. Barriers and facilitators to implementing cancer prevention clinical decision support in primary care: a qualitative study. BMC Health Serv Res. 2019;19(1):534.

  31. Pratt R, Saman DM, Allen C, Crabtree B, Ohnsorg K, Sperl-Hillen JM, Harry M, Henzler-Buckingham H, O'Connor PJ, Desai J. Assessing the implementation of a clinical decision support tool in primary care for diabetes prevention: a qualitative interview study using the Consolidated Framework for Implementation Science. BMC Med Inform Decis Mak. 2022;22(1):15.

  32. Gilmer TP, O’Connor PJ, Sperl-Hillen JM, Rush WA, Johnson PE, Amundson GH, et al. Cost effectiveness of an electronic medical record based clinical decision support system. Health Serv Res. 2012;47(6):2137–58.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank HealthPartners Institute, Essentia Health, and Dr. Joseph A. Bianco, Essentia Health Co-Investigator on the study, for clinical advice.

Funding

This research was funded by the National Heart, Lung, and Blood Institute (grant number R01HL128614). The funder did not take part in the design of the reported study or the collection, analysis, or interpretation of data or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

DS, LF, MH, CA, and PO drafted the manuscript. JH and LC analyzed the survey results. DS, JD, PO, and CA led the drafting of the survey. JZ led the survey administration. JSP, JZ, JH, JD, and KO edited the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Melissa L. Harry.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the Essentia Health Institutional Review Board (Protocol number EIRH-15-1481). All methods were performed in accordance with relevant institutional and federal guidelines and regulations. The Essentia Health Institutional Review Board waived the requirement of documentation of informed consent for this survey; therefore, written informed consent was not required or obtained for survey participants. The electronic survey stated that: “completing this survey lets us know that you consent to participate in this research study.” All respondents to this survey were age 18 and over.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saman, D.M., Allen, C.I., Freitag, L.A. et al. Clinician perceptions of a clinical decision support system to reduce cardiovascular risk among prediabetes patients in a predominantly rural healthcare system. BMC Med Inform Decis Mak 22, 301 (2022). https://doi.org/10.1186/s12911-022-02032-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-022-02032-z

Keywords