- Research article
- Open Access
- Open Peer Review
Clinical decision support system for the management of osteoporosis compared to NOGG guidelines and an osteology specialist: a validation pilot study
BMC Medical Informatics and Decision Makingvolume 19, Article number: 27 (2019)
Although osteoporosis is an easily diagnosed and treatable condition, many individuals remain untreated. Clinical decision support systems might increase appropriate treatment of osteoporosis. We designed the Osteoporosis Advisor (OPAD), a computerized tool to support physicians managing osteoporosis at the point-of-care. The present study compares the treatment recommendations provided by OPAD, an expert physician and the National Osteoporosis Guideline Group (NOGG).
We performed a retrospective analysis of 259 patients attending the outpatient osteoporosis clinic at the University Hospital in Iceland. We entered each patient’s data into the OPAD and recorded the OPAD diagnostic comments, 10-year risk of major osteoporotic fracture and treatment options. We compared OPAD recommendations to those given by the osteoporosis specialist, and to those of the NOGG.
Risk estimates made by OPAD were highly correlated with those from FRAX (r = 0.99, 95% CI 0.99, 1.00 without femoral neck BMD; r = 0.98, 95% CI, 0.97, 0.99 with femoral neck BMD. Reassurance was recommended by the expert, NOGG and the OPAD in 68, 63 and 52% of cases, respectively. Likewise, intervention was recommended by the expert, NOGG, and the OPAD in 32, 37 and 48% of cases, respectively. The OPAD demonstrated moderate agreement with the physician (kappa 0.51, 95% CI 0.41, 0.61) and even higher agreement with NOGG (kappa 0.69, 95% CI 0.60, 0.77).
Primary care physicians can use the OPAD to assess and treat patients’ skeletal health. Recommendations given by OPAD are consistent with expert opinion and existing guidelines.
Osteoporosis is a common disease that causes progressive deterioration of bone tissue resulting in lower bone density and an increased risk of an osteoporotic fracture .
Osteoporotic fractures carry a significant risk of mortality and morbidities, forming a growing burden in the ageing population .
Most osteoporotic fractures occur in the non-osteoporotic range (T-score > − 2.5) , emphasizing the influence of other risk factors on fracture incidence . This has led to the development of several risk-prediction algorithms whose roles are to facilitate risk assessment . Currently the best validated and the most widely used is the FRAX tool introduced in 2008 by the WHO Task Force . The FRAX algorithm is based on data collected from several large international cohort studies on risk factors from Europe, North America, Asia and Australia, and has been validated in many independent cohorts .
Risk-assessment tools help identify individuals who need treatment , but their usefulness depends on the clinician’s ability to correctly translate their results into clinical practice congruent with evidence-based guidelines [7, 8]. Osteoporosis is a highly treatable condition but despite clinical guidelines being widely available , many individuals that are at substantial risk of fracture still go untreated [10, 11]. Promoting management guidelines is essential, but that alone is unlikely to solve this problem, the fact being that only 11% of patients suffering from a fragility fracture of the hip are started on bone protective treatment as a secondary prevention . Additionally, non-adherence to treatment is frequently reported . Consequently, there is obviously room for improvement in the management of osteoporosis, especially at the primary care level .
Closing this treatment gap is a priority that involves improving selection of patients at risk of fracture for DXA scanning, securing optimal treatment when indicated and providing follow-up that encourages patient adherence to treatment. Given limited resources allocated to health care it is equally important to avoid performing unnecessary and costly DXA scans among people with good bone health. Our objective was to close the gap in osteoporosis care, by identifying individuals at high fracture risk to begin appropriate treatment, and identifying individuals at low risk of fracture who would not benefit from DXA scanning. We thus developed the Osteoporosis Advisor or OPAD (http://www.expeda.is), a computerized clinical decision support system to assess and treat osteoporosis in a primary care setting . The OPAD was developed as a collaboration between a commercial start-up company (Expeda), The University of Iceland and Reykjavik University. Although the source code of the OPAD is currently proprietary, the OPAD system is openly accessible to all practicing doctors in Iceland. OPAD provides a patient’s 10-year fracture probability (with or without BMD values) using a speedometer-like output that users can easily understand. The OPAD also notes whether a patient would benefit from BMD measurement by DXA. OPAD provides patients with lifestyle and treatment recommendations to reduce their fracture risk, incorporating country-specific guidelines for therapy. Finally, OPAD provides guidance on whether to refer to an osteoporosis specialist.
We have previously described the technical design of the OPAD .
The objective of this study was to compare recommendations provided by OPAD both to a osteoporosis specialist and the current management guidelines from the NOGG (National Osteoporosis Guideline Group) . To accomplish this objective, we retrospectively reviewed the DXA reports and medical records of patients undergoing routine DXA at one university setting in 2012.
We performed a retrospective cohort study, reviewing the DXA reports and medical records of 308 consecutive patients undergoing BMD measurement in 2012 at the University Hospital of Iceland Osteoporosis Clinic. We excluded individuals < 40 and > 90 years old (n = 13) and those receiving osteoporosis therapies (n = 36), as FRAX was not developed to estimate fracture risk in these individuals.
In the remaining 259 patients, we gathered data from two major sources:
A standardized questionnaire, which all patients completed prior to DXA scanning. The questionnaire assessed age, gender, menopausal status, past DXA scans, hormone replacement therapy, medication usage (including corticosteroids), current smoking, family history of osteoporosis, rheumatoid arthritis, secondary causes of osteoporosis, previous fracture, calcium and vitamin D intake and exercise.
Detailed DXA reports, stating the height and weight as measured at the time of BMD testing, BMD values from the hip and lumbar spine, and written comments made in a guideline-driven fashion by a physician with expertise in osteoporosis management. Reports contained suggestions for treatment, suitable follow-up, lifestyle modifications and additional diagnostic tests, if indicated.
All patients had BMD measured with the same Hologic QDR 4500A DXA scanner. BMD measurements at the lumbar spine (L2-L4) and the femoral neck were performed. BMD was classified according to WHO definitions (osteopenia, T-score − 1.1 to − 2.4 and osteoporosis, T-scores ≤ − 2.5). Patients taking glucocorticoid therapy (prednisolone > 7.5 mg/day) were diagnosed with glucocorticoid induced osteoporosis if their T-score was below − 1.5.
Using measured BMD and information gathered from the questionnaire, we calculated each person’s 10-year risk of major osteoporotic fracture with FRAX and OPAD. We accessed the online tool on the FRAX website (http://www.shef.ac.uk/FRAX/), to determine 10-year fracture risk estimates with, and without, femoral neck BMD. In a similar fashion, we determined fracture risks using the OPAD with and without femoral neck BMD. As OPAD takes into account several protective factors in its risk prediction (estrogen or testosterone therapy, vitamin D, calcium and exercise), risk estimates were performed while omitting these protective factors, thus, using only the risk factors shared by FRAX and OPAD.
Each case was entered into the OPAD, recommendations were recorded and then grouped into two categories: “reassurance” and “intervention indicated”. Likewise, FRAX scores for each case were evaluated according to the age variable interventional thresholds proposed by the National Osteoporosis Guideline Group (NOGG) , and grouped into the two categories (reassurance and intervention). Finally, the expert physician’s recommendations in each report were grouped into the two categories of reassurance and therapy.
We performed statistical analyses using SPSS software version 22 (Armonk, NY: IBM Corp). We summarized descriptive data using the mean and standard deviation. We compared estimates of fracture risk by FRAX and OPAD using paired t-tests, Pearson correlation coefficients. We used the Bland-Altman test to assess numeric agreement within and between the two fracture risk tools. We assessed inter-rater agreement (reassurance versus treatment for a given individual) between the OPAD, FRAX and expert physician using the Kappa test statistic.
Of the total study population (n = 259), 30 were male and 229 were female, including 182 post-menopausal women. Cases’ mean age was 62 ± 10 years old. One hundred twenty cases had previously undergone BMD measurement. The majority of cases reported sufficient intake of calcium, vitamin D and adequate exercise (Table 1). Sixty-eight individuals (26%) suffered a prior fragility fracture and 64 individuals (25%) reported a family history of osteoporosis. Twenty-five cases (10%) had secondary osteoporosis. We summarize further characteristics of the study population in Table 1.
One hundred eighty individuals (70%) had osteopenia and 52 (20%) had osteoporosis based on the BMD values measured at either the femoral neck or lumbar spine. T-scores were higher at the lumbar spine, compared to the femoral neck (− 1.1 vs. − 1.3, p = 0.044). We summarize BMD data in Table 2.
Using FRAX, the mean 10-year risk of major osteoporotic fracture for the cohort was 15.4 ± 11.3% relying solely on risk factors and 13.6 ± 9.4% when femoral neck BMD was included. Using OPAD, fracture risk was similar (16 ± 11.6% without, and 15.4 ± 11.0% with femoral neck BMD) (Table 3). Risk estimates made by OPAD were highly correlated with those from FRAX (r = 0.99, 95% CI 0.99, 1.00 without femoral neck BMD; r = 0.98, 95% CI, 0.97, 0.99 with femoral neck BMD, Fig. 1).
Bland-Altman analysis revealed that the estimated probability of fracture using FRAX with BMD was lower by 1.8% (95% CI, − 2.5, − 1.1%, p < 0.001), compared to the estimated fracture risk using FRAX without hip BMD values (Fig. 2). OPAD estimates of fracture risk were similar, whether determined with or without hip BMD (p = 0.098). Without BMD values, OPAD overestimated fracture risk compared to FRAX (bias 0.63, 95% CI 0.5, 0.8%, p < 0.001). Likewise, when using hip BMD values to estimate fracture risk, the OPAD overestimated risk compared to FRAX (bias 1.8, 95% CI -1.5%, 2.1, p < 0.001). However, while the OPAD fracture risk estimates were significantly higher than FRAX based on statistical tests, the numeric differences in fracture risk using the two tools were very small.
The physician, NOGG and OPAD recommended reassurance in 68, 63 and 52% of 259 cases, respectively. Conversely, the physician, NOGG and OPAD recommended intervention in 32, 37 and 48% of cases, respectively (Fig. 3). We used kappa test statistics to assess within-subject agreement to reassure or treat, using the OPAD or FRAX with NOGG directed therapy. The OPAD demonstrated moderate agreement with the physician (kappa 0.51, 95% CI 0.41, 0.61) and even higher agreement with NOGG (kappa 0.69, 95% CI 0.60, 0.77). The physician was in moderate agreement with NOGG (kappa 0.53 (95% CL 0.415, 0.629) (Table 4 and Fig. 4).
Osteoporosis is a common disease that remains asymptomatic until a fragility fracture occurs; representing a silent epidemic disorder. The only way to diagnose osteoporosis prior to fracture is by measuring BMD . It is of importance to identify those who are at high risk of fragility fractures and thus could benefit from DXA evaluation and treatment intervention . Several interest organizations including the National Osteoporosis Foundation (NOF) recommend BMD screening for women starting at the age of 65 and for men starting at age 70 . Despite good access to DXA, effective treatments and widely published treatment guidelines, patients remain untreated, even after suffering hip fractures . Therefore, we developed a user-friendly clinical tool to support primary care providers in decisions to screen for and treat osteoporosis. We compared the performance of the OPAD to that of FRAX, the most widely used and best-validated of several fracture risk calculators . In our study, the risk evaluations made by OPAD were highly correlated with calculations made by FRAX. Correlation between FRAX and OPAD remained high even after additional protective factors (hormonal therapy, vitamin D, calcium intake and exercise) where included in the risk calculations made by OPAD (data not shown).
Although low BMD is strongly associated with increased fracture risk, it is essential to incorporate other risk factors to sufficiently evaluate and select at-risk patients for bone protective treatment . The FRAX risk assessment tool is intended to aid the clinician in the decision to initiate preventive treatment by providing the patient’s ten-year risk of an osteoporotic fracture. However, there are several limitations of FRAX that have already been discussed [22, 23]. Furthermore, the fracture risk given by FRAX still needs to be interpreted in accordance with the terms in the current management guidelines. Although those guidelines are readily available, too many patients-at-risk are receiving sub-optimal treatment . Consequently, there is obviously room for improvement in the management of osteoporosis, especially at the primary care level .
The agreement of the recommendations given by the OPAD to those given by the osteoporosis specialist and NOGG guidelines are of importance. Our study shows that recommendations made by OPAD are in good agreement to specialist advice and even stronger agreement to the NOGG intervention thresholds. With zero patients being recommended “reassurance” in discordance to either a specialist or NOGG, our study shows the OPAD system does not overlook individuals who need bone protective treatment. When OPAD recommended active treatment intervention, the majority of cases were in agreement to both the specialist and NOGG but 16% (n = 23) were discordant, demonstrating a slightly more aggressive stance for treatment. In the most of those cases (n = 23, 74%), the OPAD system had made the recommendation to seek expert advice. To facilitate comparison those recommendations where classified as an intervention, thus accounting for some cases of discrepancy between OPAD and the expert physician. The rest of the cases (n = 6) are explained by OPAD’s slight overestimation in its risk estimations compared to FRAX as revealed by Bland-Altman’s analysis. Several other reasons might explain why OPAD and the clinician disagreed, e.g. additional clinical information that the specialist had access to but was not included in OPAD.
More important is the fact that OPAD not only gives the fracture risk, but also recommend clinical decisions based on guidelines . Thus, health care professionals do not need to know the guidelines in order to use OPAD. The software design of OPAD allows it to be effortlessly integrated in to different EMR (Electronic Medical Record) systems so to fit easily in to existing workflow of health care providers, further enabling it’s use at the point of care. Furthermore, with a systematic approach using a CDSS (Clinical Decision Support System) such as OPAD in the osteoporosis care, we might reduce the cost and improve the utilization of diagnostic resources. Further health economic studies on this issue are of interest.
It is important to note that the OPAD system is not solely a risk calculator like FRAX, but a fully featured CDSS that evaluates patient risk factors and BMD values to provide the clinician with treatment recommendation, and advice on proper follow-up. OPAD also highlights primary prevention and selects individuals for further work-up, such as BMD measurement or referral to an osteoporosis specialist . In the present study, the OPAD tool was tested on an Icelandic population, but using different epidemiological data, OPAD is able to run in up to ten different national specific datasets .
Our study has both strengths and limitations. The strength of this study is that it is based on a real-life data, gathered from a BMD centre that does not require a doctor’s referral for post and peri-menopausal females and should therefore be a better representation of a typical primary care population compared to a strict tertiary referral centre. Furthermore, the osteoporosis specialist who analysed the DXAs was unaware of the present study, minimizing potential interpretation or performance bias. In addition, the risk evaluation and recommendations given by the OPAD are concordant with those from FRAX and an osteology specialist. Thus, the data set and results are of interest for general practice. The limitations of this study are its retrospective design, small sample size, non-random sampling of a racially homogenous study population and that it was conducted at a single academic centre.
The OPAD is under active development and adapts to ever changing management guidelines. Further patient factors may be incorporated into the risk assessment model of OPAD, such as loss of height, history of falls and it is even possible to add individual genotypes to improve the fracture risk estimation. We believe the positive observations made from this limited retrospective study warrant the undertaking of a larger multi-centred prospective validation study in a primary care setting.
We conclude that fracture risk estimations made by the OPAD system are equivalent to risk calculations made by FRAX. Treatment recommendations by OPAD are accurate and consistent with NOGG guidelines and those given by a practicing specialist. With the use of a clinical decision aid such as OPAD, we offer a new approach to reduce gaps in screening and treatment for older patients, many of whom suffer from osteoporosis. Our tool is novel as it provides an output that is user friendly and easily understood by both patients and primary care providers, regardless of their knowledge of treatment guidelines.
Bone mineral density
Clinical decision support system
Dual-energy X-ray absorptiometry
Electronic medical record
National Osteoporosis Guideline Group
World Health Organization
Riggs BL, Melton LJ. The worldwide problem of osteoporosis: insights afforded by epidemiology. Bone. 1995;17(5 Suppl):505S–11S.
Ström O, Borgström F, Kanis JA, Compston J, Cooper C, McCloskey EV, et al. Osteoporosis: burden, health care provision and opportunities in the EU. Arch Osteoporos Springer-Verlag. 2011;6(1–2):59–155.
Siris ES, Chen Y-T, Abbott TA, Barrett-Connor E, Miller PD, Wehren LE, et al. Bone mineral density thresholds for pharmacological intervention to prevent fractures. Arch Intern Med. 2004;164(10):1108–12.
Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E. FRAX™ and the assessment of fracture probability in men and women from the UK. Osteoporos Int. 2008;19(4):385–97.
Baim S, Leslie WD. Assessment of fracture risk. Curr Osteoporos Rep. 2012;10(1):28–41 Current Science Inc.
MacLean FR, Thomson SA, Gallacher SJ. Using WHO-FRAX to describe fracture risk: experience in primary care. Scott Med J. 2012;57(1):8–13.
Task Force of the FRAX Initiative, Kanis JA, Hans D, Cooper C, Baim S, Bilezikian JP, et al. Interpretation and use of FRAX in clinical practice. Osteoporos Int. 2011;22(9):2395–411 2nd ed.
Lewiecki EM. Managing osteoporosis: challenges and strategies. Cleve Clin J Med. 2009;76(8):457–66.
Elvey MH, Pugh H, Schaller G, Dhotar G, Patel B, Oddy MJ. Failure in the application of fragility fracture prevention guidelines. Ann R Coll Surg Engl. 2014;96(5):381–5.
Nguyen TV, Center JR, Eisman JA. Osteoporosis: underrated, underdiagnosed and undertreated. Med J Aust. 2004;180(5 Suppl):S18–22.
Vestergaard P, Rejnmark L, Mosekilde L. Osteoporosis is markedly underdiagnosed: a nationwide study from Denmark. Osteoporos Int. 2005;16(2):134–41.
Baba T, Hagino H, Nonomiya H, Ikuta T, Shoda E, Mogami A, et al. Inadequate management for secondary fracture prevention in patients with distal radius fracture by trauma surgeons. Osteoporos Int. 2015;26(7):1–5 Springer London.
Rabenda V, Mertens R, Fabri V, Vanoverloop J, Sumkay F, Vannecke C, et al. Adherence to bisphosphonates therapy and hip fracture risk in osteoporotic women. Osteoporos Int. 2008;19(6):811–8.
Taylor JC, Sterkel B, Utley M, Shipley M, Newman S, Horton M, et al. Opinions and experiences in general practice on osteoporosis prevention, diagnosis and management. Osteoporos Int. 2001;12(10):844–8 Springer-Verlag London Limited.
Halldorsson BV, Bjornsson AH, Gudmundsson HT, Birgisson EO, Ludviksson BR, Gudbjornsson B. A clinical decision support system for the diagnosis, fracture risks and treatment of osteoporosis. Comput Math Methods Med. 2015;2015(9):1–7.
Compston J, Bowring C, Cooper A, Cooper C, Davies C, Francis R, et al. Diagnosis and management of osteoporosis in postmenopausal women and older men in the UK: National Osteoporosis Guideline Group (NOGG) update 2013. Maturitas. 2013;75:392–6.
Rachner TD, Khosla S, Hofbauer LC. Osteoporosis: now and the future. Lancet. 2011;377(9773):1276–87.
Silverman SL. Selecting patients for osteoporosis therapy. Ann N Y Acad Sci. 2007;1117(1):264–72.
Cosman F, de Beur SJ, LeBoff MS, Lewiecki EM, Tanner B, Randall S, et al. Clinician’s guide to prevention and treatment of osteoporosis. Osteoporos Int. 2014;25(10):2359–81 Springer London.
McCloskey E, Johansson H, Oden A, Kanis JA. Fracture risk assessment. Clin Biochem. 2012;45(12):887–93.
Kanis JA, McCloskey EV, Johansson H, Cooper C, Rizzoli R, Reginster JY, et al. European guidance for the diagnosis and management of osteoporosis in postmenopausal women. Osteoporos Int. 2013;24:23–57.
Lewiecki EM, Compston JE, Miller PD, Adachi JD, Adams JE, Leslie WD, et al. FRAX(®) Bone Mineral Density Task Force of the 2010 Joint International Society for Clinical Densitometry & International Osteoporosis Foundation Position Development Conference. 2011. pp. 223–225.
Silverman SL, Calderon AD. The utility and limitations of FRAX: a US perspective. Curr Osteoporos Rep. 2010;8(4):192–7.
Naranjo A, Rosas J, Ojeda S, Salas E, CANAL group. Management of osteoporosis in primary care before and after the result of densitometry: treatments in real practice versus the recommended by guidelines. CANAL study. Reumatol Clin. 2013;9(5):269–73.
The authors would like to thank Klaus Bjorn Jensen and Thorsteinn Geirsson for their contribution to this work, and the staff members at the Osteoporosis Outpatient Clinic at the University Hospital of Iceland for their valuable cooperation through all the study process; professor Gunnar Sigurdsson, Anna M Stefansdottir and Elsa H Buadottir, radiology technicians.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Availability of data and materials
The data analysed in the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study protocol was approved both by the National Bioethics Committee of Iceland (NBC; Reference No. VSNb2010050008) and the Icelandic Data Protection Authority (DPA; Reference No. S5680). According to Icelandic legislation (Act on the Protection of Privacy as regards the Processing of Personal Data, No. 77/2000) neither epidemiologic research nor the use of anonymous data generated from clinical service in scientific research projects require individual consent if the study protocol is approved by NBC and DPA, see further http://www.vsn.is/en/content/criteria.
Consent for publication
Authors BG and BRL are shareholders in Expeda. Other authors declare no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.