Skip to main content
Download PDF

Prediction of Sjögren’s disease diagnosis using matched electronic dental-health record data

BMC Medical Informatics and Decision Making volume 24, Article number: 43 (2024) Cite this article

Abstract

Background

Sjögren’s disease (SD) is an autoimmune disease that is difficult to diagnose early due to its wide spectrum of clinical symptoms and overlap with other autoimmune diseases. SD potentially presents through early oral manifestations prior to showing symptoms of clinically significant dry eyes or dry mouth. We examined the feasibility of utilizing a linked electronic dental record (EDR) and electronic health record (EHR) dataset to identify factors that could be used to improve early diagnosis prediction of SD in a matched case-control study population.

Methods

EHR data, including demographics, medical diagnoses, medication history, serological test history, and clinical notes, were retrieved from the Indiana Network for Patient Care database and dental procedure data were retrieved from the Indiana University School of Dentistry EDR. We examined EHR and EDR history in the three years prior to SD diagnosis for SD cases and the corresponding period in matched non-SD controls. Two conditional logistic regression (CLR) models were built using Least Absolute Shrinkage and Selection Operator regression. One used only EHR data and the other used both EHR and EDR data. The ability of these models to predict SD diagnosis was assessed using a concordance index designed for CLR.

Results

We identified a sample population of 129 cases and 371 controls with linked EDR-EHR data. EHR factors associated with an increased risk of SD diagnosis were the usage of lubricating throat drugs with an odds ratio (OR) of 14.97 (2.70-83.06), dry mouth (OR = 6.19, 2.14–17.89), pain in joints (OR = 2.54, 1.34–4.76), tear film insufficiency (OR = 27.04, 5.37–136.), and rheumatoid factor testing (OR = 6.97, 1.94–25.12). The addition of EDR data slightly improved model concordance compared to the EHR only model (0.834 versus 0.811). Surgical dental procedures (OR = 2.33, 1.14–4.78) were found to be associated with an increased risk of SD diagnosis while dental diagnostic procedures (OR = 0.45, 0.20–1.01) were associated with decreased risk.

Conclusion

Utilizing EDR data alongside EHR data has the potential to improve prediction models for SD. This could improve the early diagnosis of SD, which is beneficial to slowing or preventing complications of SD.

Peer Review reports

Background

Sjögren’s disease (SD) is an autoimmune disease characterized by its effect on exocrine glands, leading to its most common features of dry eyes and dry mouth [1]. It affects an estimated 2 to 4 million Americans, primarily middle aged women, at a 9 to 1 female to male ratio, though this may vary worldwide [2, 3].

SD is a slow progressing disease that currently has no cure, with care focusing on symptom management and prevention of disease complications [4]. Early diagnosis of SD is important as it improves the treatment of and prevents complications related to SD, such as oral complications or lymphoma, a serious complication of SD [5, 6]. Early diagnosis also aids the management of nonspecific symptoms and improves health-related quality of life, which is often low in SD patients [6]. This highlights the critical need for the early diagnosis of SD.

However, early diagnosis of SD is challenging due to the wide spectrum of clinical manifestations, where a quarter of primary SD patients exhibit atypical manifestations [7], nonspecific symptoms such as fatigue and chronic pain [4, 8], and overlapping clinical manifestations with other autoimmune diseases. Prior studies have reported that 50-60% of SD patients have secondary SD, that is, their SD occurs in conjunction with other types of autoimmune diseases such as rheumatoid arthritis and lupus [4, 5]. In addition, there is currently no universally accepted gold standard for the diagnosis of SD. Classification criteria focused on objective tests of SD signs and symptoms have been created to aid clinical research [9, 10] but are less suited for diagnosing atypical or preclinical SD patients compared to diagnosis criteria, which are broad and emphasize accurate diagnosis [11, 12]. Tests based on these criteria may also require seeing multiple medical specialists, potentially delaying diagnosis. These tests do not consider novel antibodies [13] or salivary gland ultrasonography [14], among other tests that may improve the early diagnosis of SD [9, 15]. For these reasons, SD is often diagnosed late [5, 9, 16]. Estimates of the diagnosis delay range from 2 to 12 years between the onset of symptoms and the diagnosis of SD [15, 17, 18].

SD patients experience salivary gland swelling, dental caries, tooth loss, and changes in their saliva as a consequence of decreased saliva flow [19]. Changes in saliva composition due to SD weaken the antimicrobial function of saliva, contributing to caries development, oral infections, and difficulty maintaining good oral hygiene [19, 20]. Despite more frequent dental visits than healthy individuals [21], even with good oral hygiene, SD patients experience more oral issues than healthy patients [19, 22]. These issues may occur in SD patients before clinically significant dry mouth is detected [23], suggesting that oral manifestations may be useful in the early diagnosis of SD.

Electronic health record (EHR) systems are increasingly used for clinical research, particularly in the area of machine learning (ML) [24, 25], taking advantage of the collection of real-world clinical data [26]. Electronic dental record (EDR) data offer much of the same benefits as EHR data but are less often utilized for clinical research [27]. While these systems have historically been siloed from one another, integration of these systems can improve patient care and support clinical research [27, 28].

Few studies have attempted to create prediction models for SD, though ML has been successfully applied to identify other autoimmune diseases that share diagnostic challenges with SD [29, 30]. Using EHR and medical claims data, Dros et al. (2022) classified primary SD with ML based models including logistic regression and random forest [31]. Despite the good discrimination of the models, this study did not separately use patient data prior to the SD diagnosis to predict SD, which is critical for it to be useful in early diagnosis. In addition, there have been no studies that use information from both EHR and EDR to identify SD, despite the potential value of dental information for the early diagnosis of SD.

In this study, we used a highly curated, well-characterized set of integrated EDR-EHR data that describes SD patients to create prediction models for the risk of SD diagnosis. This study is exploratory with the goal of identifying factors significantly associated with the later diagnosis of SD. In focusing on signs and symptoms that appear prior to diagnosis, we hope to identify important variables that can be used to improve the early diagnosis of SD. In addition, we examined whether the inclusion of dental data increases the utility of SD prediction models compared to modeling with medical data alone.

Methods

Data source

This study drew EHR data from the Indiana Network for Patient Care (INPC), an EHR data repository that collects and integrates healthcare data from across the state of Indiana [32]. The INPC is one of the oldest and largest health information exchanges in the United States, with over 10 billion clinical observations and 18 million patients, interacting with approximately two-thirds of the residents of Indiana [33]. The EDR data were extracted from the Indiana University School of Dentistry (IUSD) system (axiUm®) and linked to the EHR data using the Regenstrief Global Linkage Algorithm, a deterministic patient matching algorithm [34].

Study population

This retrospective case-control study examines clinical and dental risk factors that are predictive of SD diagnosis. Data were collected for patients who were at least 18 years of age and had records of at least one dental procedure code between June 2005 and January 2021. Chart review was performed for patients with a recorded International Classification of Diseases, Ninth and Tenth Revision (ICD-9/ICD-10) code of SD within their EHR data (ICD-9: 710.2; ICD-10: M35.0 to M35.09) or Regenstrief internal/local concept code 8232 [35]. We considered patients with an SD code in their history as SD cases, confirmed by clinical diagnosis. Patients who did not have a recorded diagnosis of SD were considered controls. Patients with any of the following conditions were excluded from the study: history of head and neck radiation therapy, active hepatitis C infection, acquired immunodeficiency syndrome (AIDS), sarcoidosis, pre-existing lymphoma, amyloidosis, graft versus host disease, and IgG4-related disease. Up to six controls were matched to each case based on sex, race, age at the time of the dental visit (± 5 years), and the dental visit time (± 3 years). For cases, index dates were defined as the date of the first recorded SD code. Controls were assigned the index date of their matched case patient. We examined EHR and EDR data collected in the three-year period prior to the index date so that we could analyze the potential for modeling SD diagnosis risk using predictors found prior to formal diagnosis. Patients with no observed EHR or EDR records in this period were therefore excluded from this study. Cases and controls left without corresponding matches after applying the exclusion criteria were further excluded. Our final study population is matched under 1:ki case to control matching, with up to six controls matched per case. Figure 1 provides an overview of the study sample generation process. We calculated the Cohen’s d statistic based on our sample size to evaluate the effect size our data is powered to detect using SAS PROC POWER.

Fig. 1
figure 1

Flow diagram of process to generate study sample. EHR: electronic health record; EDR: electronic dental record; Maximum ki = 6

Full size image

Study variables

Variables collected for this study include demographics, comorbidities based on ICD-9/ICD-10 codes, medication history, serological test (antinuclear antibody, rheumatoid factor, anti-SSA, and anti-SSB) history, dental procedures based on Current Dental Terminology (CDT) codes, and symptoms of dry eyes and dry mouth extracted from clinical notes. Based on literature review and expert clinician feedback, we selected potential clinically relevant ICD codes (Additional file 1) and grouped them into categories of comorbidities associated with SD. Comorbidities that were present in less than 3% of patients were excluded from consideration. Drugs commonly prescribed to SD patients were summarized under Medi-Span Generic Product Identifier (GPI) classes to identify drug classes as candidate predictors. For dental procedures, we grouped CDT codes by category of service, categorizing procedures as endodontics, fixed prosthetics, orthodontics, periodontics, preventative, removable prosthetics, restorative, diagnostic or surgical (Additional file 2). Regenstrief Institute’s nDepth™ natural language processing (NLP) tool was used to extract information from clinical notes contained in the HER for the presence of dry eyes and dry mouth using the key terms of dry eye, dry mouth, xerostomia, and hyposalivation. The ConText algorithm [36] was employed to identify and exclude clinical notes in which the key terms were described in a negating or hypothetical context. All nondemographic data were summarized as binary variables, representing any patient level presence in the EHR or EDR data in the three-year period prior to the index date.

Statistical analysis

Demographic and key analysis variables are summarized with descriptive statistics, presenting frequencies and percentages for categorical variables and means and standard deviations for continuous variables. Due to the matched case-control study design, conditional logistic regression (CLR) was used to evaluate the association between predictors and SD.

We used Least Absolute Shrinkage and Selection Operator (LASSO) regression to select the important variables for the prediction of SD in our models. LASSO is a penalized regression method commonly used in prediction models. LASSO shrinks the regression coefficients of variables that are not useful for prediction to zero, performing model selection and creating models that reduce overfitting while maintaining interpretability [37]. Analyses were performed with the R package clogitL1, which fits regularized, LASSO CLR models [38]. We built two models, one using only EHR data and the other using variables from both the EHR and EDR. The performance of our models was evaluated using the concordance index (C-index) proposed by Brentall et al. [39] for the discriminatory ability between cases and controls. We used the C-index rather than the Receiver Operating Characteristic (ROC) curve since CLR cannot be used to generate predicted probabilities, which are needed in the evaluation of sensitivity and specificity and consequently ROC.

We utilized the Cochran-Mantel-Haenszel (CMH) test, which tests the association between two binary variables while controlling for a third [40], to investigate potential confounding relationships among predictors. One variable was excluded due to evidence of significant confounding.

Data analyses were conducted with R version 4.1.0.

Results

A total of 377 SD cases were identified after chart review [35]. We identified 1939 controls from the IUSD EDR, of which 1585 were successfully linked to patients in the INPC database. We excluded 138 controls due to the presence of exclusion criteria codes. After excluding patients without EHR and EDR data in the three-year period prior to the index date, our final dataset included 129 cases and 371 controls (Fig. 1). Based on a power of 0.8, the Cohen’s d of our sample was 0.287, a small effect size. Table 1 presents patient demographic characteristics as well as EHR and EDR variables included in our multivariable models (Additional file 3). The average age (mean ± SD) of patients in this study was 56.0 ± 16.3, where 82.4% of the sample was 40 years or older at the time of index date. Our sample was primarily female (93.3%) and Caucasian (77.2%). Due to matching, demographic characteristics were balanced between cases and controls with no significant differences between the two groups.

Table 1 Descriptive summary of study patient demographics and clinical characteristics by Sjögren’s disease status
Full size table

Diagnostic dental procedures were the most common predictor of interest, present in 86.0% of patients, but did not significantly differ between cases and controls in univariable analysis (p = 0.24). Cases and controls differed significantly in univariable analyses of medication history, diagnoses, surgical dental procedures, rheumatoid factor (RF) testing, and presence of dry mouth, with these predictors appearing more frequently in cases. Of note, the presence of dry mouth differed significantly (p = 1.7e-10), with approximately 30% of cases reporting dry mouth prior to SD diagnosis compared to only 2.7% of controls.

While building the multivariable predictive model for SD, we found that diabetes was borderline significant with a negative association (p = 0.05), even though it was not significant in univariable comparisons (p = 0.94). The negative association between diabetes and SD in the multivariable analysis was inconsistent with prior studies that linked metabolic abnormalities with SD [41, 42]. Such a finding is likely a result of overadjustment since diabetes was significantly associated with dry mouth, joint pain, and depressive disorder (p = 0.04, p < 0.001, and p = 0.001 respectively), which are known risk factors for SD. Therefore, we removed diabetes from consideration in our final models.

The results of the multivariable models are shown in Table 2. The multivariable model based on EHR data (model 1) and the model based on integrated EDR-EHR data (model 2) largely overlap in terms of the variables selected. The prescription of lubricating throat product class drugs, joint pain, tear film insufficiency, rheumatoid factor testing, and the presence of dry mouth were significantly associated with an increased risk of SD diagnosis in both models. Based on model 2, the odds for developing SD were 14.97 (95% CI = 2.70-83.06) times higher in patients who were prescribed throat product drugs than in those who were not, 2.54 (95% CI = 1.34–4.76) times higher in patients who experienced pain in joints, 27.04 (95% CI = 5.37-136.26) times higher in patients who experienced tear film insufficiency, 6.97 (95% CI = 1.94–25.12) times higher in patients who were tested for rheumatoid factor, and 6.19 (95% CI = 2.14–17.89) times higher in patients who reported dry mouth.

Table 2 Odds ratios of risk of Sjögren’s disease diagnosis according to conditional logistic regression models
Full size table

Model 1 provides similar estimates of these effects. Depressive disorder was selected in model 1 with a nonsignificant association with SD, with an odds ratio (OR) of 1.29 (95% CI = 0.62–2.45) when controlling for the other predictors, but it was not selected in model 2. Among variables extracted from the EDR, diagnostic and surgical dental procedures were selected in model 2. Diagnostic procedures were associated with an OR of 0.45 (95% CI = 0.20–1.01) but did not reach statistical significance (p = 0.053). Surgical dental procedures were associated with 2.33 (95% CI = 1.14–4.78) times higher odds when controlling for other predictors. Both models show a strong ability to discriminate between cases and controls. Model 1 had a C-index of 0.811 (95% CI = 0.750–0.872) while model 2 had a C-index of 0.834 (95% CI = 0.775–0.893).

Discussion

To the best of our knowledge, this study is the first to link EDR and EHR data to create a predictive model for the SD diagnosis. Both of our models had a high ability to discriminate between SD cases and controls, with results indicating that the addition of EDR data improves the predictive models that only utilize EHR data. Although the increase in model discrimination was relatively small (2% in C-index), this suggests that the integration of medical and dental health records has the potential to improve the ability to diagnose SD early.

Our models identified several predictors strongly associated with SD, including dry mouth and the presence of other autoimmune diseases, which is consistent with past findings. Evidence of dry eyes and dry mouth, present in approximately 80% of all SD patients [9], was identified via NLP in the EHR clinical notes of approximately one third of our SD cases (Table 2). However, dry eye was not included in our final models, due to its low prevalence in our sample (2.4%). Evidence of dry eyes and mouth may also be captured indirectly within other predictors. For example, fewer SD patients had clinical notes mentioning dry eyes (n = 12) than patients who were diagnosed with tear film insufficiency (n = 21), another significant predictor, with only four SD patients reporting both. This suggests that there is room for improvement in documenting and identifying dry eyes and dry mouth in clinical notes. In our group’s previous study, 117 of 377 (31.0%) SD cases had no evidence of dry eyes or dry mouth, positing that physician-diagnosed SD can be established without sicca symptoms and tests [35]. This is consistent with findings that oral and ocular objective tests are infrequently performed in clinical practice [43]. Despite this, we found that sicca symptom information derived from an NLP analysis of clinical notes was highly predictive of SD diagnosis. This suggests that unstructured data could be used to identify early occurrences of SD symptoms, aiding the early diagnosis of SD. While we only examined clinical notes within the EHR, this represents a potential avenue toward increasing the utilization of EDR data, in which storing information as structured diagnosis data is less common than in EHRs [44,45,46,47].

Antimalarial, glucocorticosteroid, and nonsteroidal anti-inflammatory agent (NSAID) drug prescriptions, as well as pain in joints, are predictors identified by our model that are associated with increased SD diagnosis risk, with the latter three present in 36% or more of cases compared to 15-24% of controls. This indicates that our case patients are experiencing and treating inflammation and pain, symptoms common to autoimmune diseases [48], more frequently than controls. This effect may be mediated by the presence of other autoimmune diseases. In our models, myalgia, myositis, fibromyalgia, and systemic lupus erythematosus were also predictors of SD diagnosis, suggesting that the presence of other autoimmune diseases can be used in SD diagnosis prediction. Nevertheless, overlaps in the clinical and immunological spectrum of SD with other systemic autoimmune diseases make distinguishing between primary SD, secondary SD, and other autoimmune diseases difficult [49]. Serological testing could aid in differentiating the conditions. However, because tests such as rheumatoid factor testing are not unique to SD, care must be taken so that SD prediction models utilizing laboratory data are not predicting a general class of autoimmune diseases. Secondary SD has been studied less extensively than primary SD. Evidence suggests that the clinical phenotypes of an associated autoimmune disease may be affected by the presence of SD. The converse is also true, where patients with secondary SD may express clinical characteristics that differ between associated autoimmune diseases [50, 51]. An improved understanding of secondary SD could also provide information on predictive factors unique to its subclassifications, aiding SD diagnosis.

Our EDR-EHR linked data model found that diagnostic dental procedures may be negatively associated with SD diagnosis. SD patients seek dental care more frequently than healthy patients and require more oral treatments [21], which is consistent with our finding that dental surgical procedures are significantly associated with increased risk of SD diagnosis. The inverse is true for diagnostic procedures, as our SD patients were less likely to have diagnostic procedures than our controls. Patients with more severe oral health problems may be more likely to seek care at the IUSD for known issues and avoid diagnostic procedures they deem unnecessary. This may be because they were diagnosed prior to the three-year period we examined or because they are seeking routine care, including diagnostic procedures, outside of the IUSD, of which we would have no record. Patients with long-standing oral health issues may be more likely to have received diagnoses outside of the examined time period, while healthier patients may be more likely to seek routine diagnostic or preventative dental procedures. As severe oral health issues typically require more expensive treatments, financial considerations may also affect the care-seeking behavior of the patients in our sample, as many patients self-pay for dental treatments at the IUSD, which offers reduced cost dental care to its patients.

Uncommon diseases, such as SD, present additional challenges in utilizing EHR/EDR data to create prediction models. EHR/EDR systems are primarily intended to support patient care and documentation for administrative and patient care purposes, while reusing data from these systems for research is a secondary use case [52, 53]. Because of this, there are significant data quality concerns regarding the secondary use of this data for research, including factors such as the completeness, correctness, and consistency of the data [26, 54]. These concerns are further compounded in the analysis of uncommon diseases. It may be difficult to gather the minimum number of patients needed to construct a robust prediction model for uncommon diseases. In addition, structured data for EHR/EDR is often sparse, containing many codes that are rarely present for individual patients, especially with respect to uncommon diseases. For example, though it was a significant predictor, only 2.4% of our sample reported dry eyes. However, the absence of documentation of a feature does not necessarily indicate the feature itself is absent. In addition, a significant amount of clinical findings are captured in clinical notes rather than structured data [35, 55]. This data is difficult to retrieve without additional processing of clinical notes [46, 47, 54], leaving potentially useful information such as tooth decay data unused. The lack of a diagnostic gold standard, disease heterogeneity, and potential for misclassification also makes accurately capturing SD and other uncommon diseases in the EHR/EDR difficult [56]. Inconsistencies in information may arise from differences in documentation and coding standards between different healthcare settings [54] or while integrating EHR and EDR data [28]. Fitting prediction models to EHR/EDR data is also subject to systematic biases such as selection bias [57, 58].

Another limitation of our study is selection bias due to the criteria we applied to select our sample. Subjects in our study were required to have data from both the INPC EHR and IUSD EDR, with risk factors identified based on the three-year period prior to index date of diagnosis We also required patients to have a minimum amount of analyzable data to be included in our study sample. The IUSD EDR system started collecting data in July 2005, but approximately 16% of our initial 377 cases were diagnosed with SD prior to that date, rendering them ineligible for inclusion in our study sample population. Thus, we have selection bias in our sample arising from missing data, whether it is structural or missing at random [59]. Each of these factors limits the generalizability of our findings outside of our sample population. Techniques such as inverse-probability weighting or multiple imputation could be used to address selection bias caused by missing data, while propensity score matching could be used to reduce the bias introduced by our rule-based case-control matching design [60].

Because of our sample selection procedure, and because SD is uncommon, our study was faced with the limitations due to small sample size. When developing prediction models, sample sizes should be chosen to produce accurate predictions while minimizing overfitting. Larger sample sizes increase the likelihood of building a robust model that can be externally validated, though machine learning models may require even larger sample sizes than traditional models [61]. The wide confidence intervals observed in some of the odds ratios are also a consequence of the small sample size, indicating the precision of such estimates is low and should be interpreted with caution. This is seen in imbalanced predictors such as tear film insufficiency, which was present in approximately 1% of controls compared to 16% of cases. While the association with SD diagnosis may be significant, the effect itself may be overestimated. Future studies should increase the sample size to improve the precision of the estimated confidence intervals or consider techniques designed for imbalanced predictors.

Our study was also limited by its matched case-control design. This design and our small sample size limited our choices for modeling methods. The matched case-control design precluded the possibility of evaluating the effect of matching variables on SD diagnosis risk, though age and gender are known to be significantly associated with SD [62]. We cannot calculate predicted probabilities, which are required to calculate the measures of diagnostic accuracy that are needed to evaluate the calibration of predictive models. Future studies utilizing a prospective study design with a larger sample size are needed to evaluate the risk factors identified in our model for their usefulness in early SD diagnosis. Future work should aim to utilize a large sample of patients to reduce potential biases in the analyses. Exploring study designs beyond the retrospective matched case-control design, such as a prospective cohort study, could be beneficial towards reducing bias and confounding while increasing sample size. While this study largely focused on structured data, further exploration of unstructured data such as caries information, found in EDR clinical notes, could boost a model’s ability to predict SD. Utilizing more advanced modeling methods could improve predictive accuracy and create models with more than one outcome, such as models that delineate primary and secondary SD.

Conclusions

This study built a prediction model using linked EDR-EHR. It showed, using EDR data from a real-world community-based dental practice, that integrating EHR and EDR data has the potential to improve predictions for SD diagnosis. Future studies are needed to evaluate the generalizability of this approach. This could shorten the diagnosis delay for SD.

Data availability

The data that support the findings of this study are available from the Regenstrief Institute, but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of the Regenstrief Institute.

Abbreviations

AIDS:

Acquired Immune Deficiency Syndrome

CDT:

Current Dental Terminology

C-index:

Concordance Index

CLR:

Conditional Logistic Regression

CMH:

Cochran-Mantel-Haenszel

EDR:

Electronic Dental Record

EHR:

Electronic Health Record

GPI:

Generic Product Identifier

ICD-9:

International Classification of Diseases, Ninth Revision

ICD-10:

International Classification of Diseases, Tenth Revision

INPC:

Indiana Network for Patient Care

IRB:

Indiana University Institutional Review Board

IUSD:

Indiana University School of Dentistry

LASSO:

Least Absolute Shrinkage and Selection Operator

ML:

Machine Learning

NLP:

Natural Language Processing

NSAID:

Nonsteroidal Anti-inflammatory Drug

OR:

Odds Ratio

RF:

Rheumatoid Factor

ROC:

Receiver Operating Characteristic

SD:

Sjögren’s Disease

References

  1. Psianou K, Panagoulias I, Papanastasiou AD, de Lastic AL, Rodi M, Spantidea PI, et al. Clinical and immunological parameters of Sjögren’s syndrome. Autoimmun Rev. 2018;17(10):1053–64.

    Article  CAS  PubMed  Google Scholar 

  2. Brito-Zerón P, Acar-Denizli N, Zeher M, Rasmussen A, Seror R, Theander E, et al. Influence of geolocation and ethnicity on the phenotypic expression of primary Sjögren’s syndrome at diagnosis in 8310 patients: a cross-sectional study from the Big Data Sjögren Project Consortium. Ann Rheum Dis. 2017;76(6):1042–50.

    Article  PubMed  Google Scholar 

  3. Brito-Zerón P, Acar-Denizli N, Ng WF, Horváth IF, Rasmussen A, Seror R, et al. Epidemiological profile and north–south gradient driving baseline systemic involvement of primary Sjögren’s syndrome. Rheumatology. 2020;59(9):2350–9.

    Article  PubMed  Google Scholar 

  4. Vivino FB, Bunya VY, Massaro-Giordano G, Johr CR, Giattino SL, Schorpion A, et al. Sjogren’s syndrome: an update on disease pathogenesis, clinical manifestations and treatment. Clin Immunol. 2019;203:81–121.

    Article  CAS  PubMed  Google Scholar 

  5. Kassan SS, Moutsopoulos HM. Clinical manifestations and early diagnosis of Sjögren Syndrome. Arch Intern Med. 2004;164(12):1275.

    Article  PubMed  Google Scholar 

  6. Sisó-Almirall A, Meijer JM, Brito-Zerón P, Conangla L, Flores-Chavez A, González de Paz L, et al. Practical guidelines for the early diagnosis of Sjögren’s syndrome in primary healthcare. Clin Exp Rheumatol. 2021;39(Suppl 133):197–205.

    Article  PubMed  Google Scholar 

  7. Retamozo S, Acar-Denizli N, Rasmussen A, Horváth IF, Baldini C, Priori R, et al. Systemic manifestations of primary Sjögren’s syndrome out of the ESSDAI classification: prevalence and clinical relevance in a large international, multi-ethnic cohort of patients. Clin Exp Rheumatol. 2019;37(Suppl 118):97–106.

    PubMed  Google Scholar 

  8. Negrini S, Emmi G, Greco M, Borro M, Sardanelli F, Murdaca G, et al. Sjögren’s syndrome: a systemic autoimmune disease. Clin Exp Med. 2022;22(1):9–25.

    Article  CAS  PubMed  Google Scholar 

  9. Vivino FB. Sjogren’s syndrome: clinical aspects. Clin Immunol. 2017;182:48–54.

    Article  CAS  PubMed  Google Scholar 

  10. Franceschini F, Cavazzana I, Andreoli L, Tincani A. The 2016 classification criteria for primary Sjogren’s syndrome: what’s new? BMC Med. 2017/04/01 ed. 2017;15(1):69.

  11. June RR, Aggarwal R. The use and abuse of diagnostic/classification criteria. Best Pract Res Clin Rheumatol. 2014;28(6):921–34.

    Article  PubMed  Google Scholar 

  12. Aggarwal R, Ringold S, Khanna D, Neogi T, Johnson SR, Miller A, et al. Distinctions between diagnostic and classification criteria? Diagnostic criteria in Rheumatology. Arthritis Care Res. 2015;67(7):891–7.

    Article  Google Scholar 

  13. Martín-Nares E, Hernández-Molina G. Novel autoantibodies in Sjögren’s syndrome: a comprehensive review. Autoimmun Rev. 2019;18(2):192–8.

    Article  PubMed  Google Scholar 

  14. Obinata K, Sato T, Ohmori K, Shindo M, Nakamura M. A comparison of diagnostic tools for Sjögren syndrome, with emphasis on sialography, histopathology, and ultrasonography. Oral Surg Oral Med Oral Pathol Oral Radiol Endodontology. 2010;109(1):129–34.

    Article  Google Scholar 

  15. Wang B, Chen S, Zheng Q, Li Y, Zhang X, Xuan J, et al. Early diagnosis and treatment for Sjögren’s syndrome: current challenges, redefined disease stages and future prospects. J Autoimmun. 2021;117:102590.

    Article  PubMed  Google Scholar 

  16. Stefanski AL, Tomiak C, Pleyer U, Dietrich T, Burmester GR, Dörner T. The diagnosis and treatment of Sjögren’s syndrome. Dtsch Arztebl Int. 2017;114(20):354–61. 2017/06/15.

    PubMed  PubMed Central  Google Scholar 

  17. Kuryata O, Lysunets T, Karavanska I, Semenov V. Duration till diagnosis and clinical profile of Sjögren’s syndrome: data from real clinical practice in a single-center cohort. Egypt Rheumatol. 2020;42(1):41–6.

    Article  Google Scholar 

  18. Zhao Y, Li Y, Wang L, Li XF, Huang CB, Wang GC, et al. Primary Sjögren Syndrome in Han Chinese: clinical and immunological characteristics of 483 patients. Med (Baltim). 2015;94(16):e667.

    Article  CAS  Google Scholar 

  19. Mathews SA, Kurien BT, Scofield RH. Oral manifestations of Sjögren’s syndrome. J Dent Res. 2008;87(4):308–18.

    Article  CAS  PubMed  Google Scholar 

  20. Fox PC, Bowman SJ, Segal B, Vivino FB, Murukutla N, Choueiri K, et al. Oral involvement in primary Sjögren syndrome. J Am Dent Assoc. 2008;139(12):1592–601.

    Article  PubMed  Google Scholar 

  21. Christensen LB, Petersen PE, Thorn JJ, Schiødt M. Dental caries and dental health behavior of patients with primary Sjögren syndrome. Acta Odontol Scand. 2001;59(3):116–20.

    Article  CAS  PubMed  Google Scholar 

  22. Pedersen AML, Bardow A, Nauntofte B. Salivary changes and dental caries as potential oral markers of autoimmune salivary gland dysfunction in primary Sjögren’s syndrome. BMC Clin Pathol. 2005;5(1):4.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Mignogna MD, Fedele S, Russo LL, Muzio LL, Wolff A. Sjogren’s syndrome: the diagnostic potential of early oral manifestations preceding hyposalivation/xerostomia. J Oral Pathol Med. 2005;34(1):1–6.

    Article  CAS  PubMed  Google Scholar 

  24. Kim E, Rubinstein SM, Nead KT, Wojcieszynski AP, Gabriel PE, Warner JL. The Evolving Use of Electronic Health Records (EHR) for research. Semin Radiat Oncol. 2019;29(4):354–61.

    Article  PubMed  Google Scholar 

  25. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017;2(4):230–43.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inf Assoc. 2013;20(1):144–51.

    Article  Google Scholar 

  27. Song M, Liu K, Abromitis R, Schleyer TL. Reusing electronic patient data for dental clinical research: a review of current status. J Dent. 2013;41(12):1148–63.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Adibi S, Li M, Salazar N, Seferovic D, Kookal K, Holland JN, et al. Medical and Dental Electronic Health Record reporting discrepancies in Integrated Patient Care. JDR Clin Transl Res. 2020;5(3):278–83.

    CAS  Google Scholar 

  29. Jorge A, Castro VM, Barnado A, Gainer V, Hong C, Cai T, et al. Identifying lupus patients in electronic health records: development and validation of machine learning algorithms and application of rule-based algorithms. Semin Arthritis Rheum. 2019;49(1):84–90.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Carroll RJ, Eyler AE, Denny JC. Naïve Electronic Health Record phenotype identification for rheumatoid arthritis. AMIA Annu Symp Proc AMIA Symp. 2011;2011:189–96.

    PubMed  Google Scholar 

  31. Dros JT, Bos I, Bennis FC, Wiegersma S, Paget J, Seghieri C, et al. Detection of primary Sjögren’s syndrome in primary care: developing a classification model with the use of routine healthcare data and machine learning. BMC Prim Care. 2022;23(1):199.

    Article  PubMed  PubMed Central  Google Scholar 

  32. McDonald CJ, Overhage JM, Barnes M, Schadow G, Blevins L, Dexter PR, et al. The Indiana Network for Patient Care: a Working Local Health Information infrastructure. Health Aff (Millwood). 2005;24(5):1214–20.

    Article  PubMed  Google Scholar 

  33. RDS Data. - Regenstrief Institute [Internet]. [cited 2023 Jan 24]. Available from: https://www.regenstrief.org/rds/data/.

  34. Ruppert LP, He J, Martin J, Eckert G, Ouyang F, Church A, et al. Linkage of Indiana State Cancer Registry and Indiana network for patient care data. J Regist Manag. 2016;43(4):174–8.

    Google Scholar 

  35. Felix Gomez GG, Hugenberg ST, Zunt S, Patel JS, Wang M, Rajapuri AS, et al. Characterizing clinical findings of Sjögren’s Disease patients in community practices using matched electronic dental-health record data. PLoS ONE. 2023;18(7):e0289335.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Harkema H, Dowling JN, Thornblade T, Chapman WW, ConText. An algorithm for determining negation, experiencer, and temporal status from clinical reports. J Biomed Inf. 2009;42(5):839–51.

    Article  Google Scholar 

  37. Ranstam J, Cook JA. LASSO regression. Br J Surg. 2018;105(10):1348–8.

    Article  Google Scholar 

  38. Reid S, Tibshirani R. Regularization paths for conditional logistic regression: the clogitL1 Package. J Stat Softw. 2014;58(12):12.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Brentnall AR, Cuzick J, Field J, Duffy SW. A concordance index for matched case-control studies with applications in cancer risk: a concordance index for matched case-control studies with applications in cancer risk. Stat Med. 2015;34(3):396–405.

    Article  MathSciNet  PubMed  Google Scholar 

  40. Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease. JNCI J Natl Cancer Inst [Internet]. 1959 Apr [cited 2023 Jul 24]; Available from: https://academic.oup.com/jnci/article/22/4/719/900746/Statistical-Aspects-of-the-Analysis-of-Data-From.

  41. Binder A, Maddison PJ, Skinner P, Kurtz A, Isenberg DA. SJÖGREN’S SYNDROME: ASSOCIATION WITH TYPE-1 DIABETES MELLITUS. Rheumatology. 1989;28(6):518–20.

    Article  CAS  Google Scholar 

  42. McGuire HM, Vogelzang A, Ma CS, Hughes WE, Silveira PA, Tangye SG, et al. A subset of Interleukin-21 + chemokine receptor CCR9 + T helper cells target Accessory organs of the Digestive System in Autoimmunity. Immunity. 2011;34(4):602–15.

    Article  CAS  PubMed  Google Scholar 

  43. Maciel G, Crowson CS, Matteson EL, Cornec D. Incidence and mortality of physician-diagnosed primary Sjögren Syndrome. Mayo Clin Proc. 2017;92(5):734–43.

    Article  PubMed  Google Scholar 

  44. Patel J, Mowery D, Krishnan A, Thyvalikakath T. Assessing information congruence of documented Cardiovascular Disease between Electronic Dental and Medical Records. AMIA Annu Symp Proc AMIA Symp. 2018;2018:1442–50.

    PubMed  Google Scholar 

  45. Pethani F, Dunn AG. Natural language processing for clinical notes in dentistry: a systematic review. J Biomed Inf. 2023;138:104282.

    Article  Google Scholar 

  46. Patel JS, Shin D, Willis L, Zai A, Kumar K, Thyvalikakath TP. Comparing gingivitis diagnoses by bleeding on probing (BOP) exclusively versus BOP combined with visual signs using large electronic dental records. Sci Rep. 2023;13(1):17065.

    Article  CAS  PubMed  PubMed Central  ADS  Google Scholar 

  47. Patel JS, Kumar K, Zai A, Shin D, Willis L, Thyvalikakath TP. Developing Automated Computer algorithms to Track Periodontal Disease Change from Longitudinal Electronic Dental Records. Diagn Basel Switz. 2023;13(6):1028.

    Google Scholar 

  48. Mifflin KA, Kerr BJ. Pain in autoimmune disorders. J Neurosci Res. 2017;95(6):1282–94.

    Article  CAS  PubMed  Google Scholar 

  49. Ramos-Casals M, Brito-Zerón P, Font J. The overlap of Sjögren’s syndrome with other systemic autoimmune diseases. Semin Arthritis Rheum. 2007;36(4):246–55.

    Article  PubMed  Google Scholar 

  50. Kollert F, Fisher BA. Equal rights in autoimmunity: is Sjögren’s syndrome ever ‘secondary’? Rheumatology. 2020;59(6):1218–25.

    Article  CAS  PubMed  Google Scholar 

  51. Hernández-Molina G, Ávila-Casado C, Cárdenas-Velázquez F, Hernández-Hernández C, Calderillo ML, Marroquín V, et al. Similarities and differences between primary and secondary Sjögren’s syndrome. J Rheumatol. 2010;37(4):800–8.

    Article  PubMed  Google Scholar 

  52. Thyvalikakath TP, Duncan WD, Siddiqui Z, LaPradd M, Eckert G, Schleyer T, et al. Leveraging Electronic Dental Record Data for Clinical Research in the National Dental PBRN practices. Appl Clin Inf. 2020;11(2):305–14.

    Article  Google Scholar 

  53. Thyvalikakath T, LaPradd M, Siddiqui Z, Duncan WD, Eckert G, Medam JK, et al. Root Canal Treatment Survival Analysis in National Dental PBRN practices. J Dent Res. 2022;101(11):1328–34.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Shah SM, Khan RA. Secondary use of Electronic Health Record: opportunities and challenges. IEEE Access. 2020;8:136947–65.

    Article  Google Scholar 

  55. Watson JI, Patel JS, Ramya MB, Capin O, Diefenderfer KE, Thyvalikakath TP, et al. Longevity of Crown Margin repairs using Glass Ionomer Cement: a retrospective study. Oper Dent. 2021;46(3):263–70.

    Article  CAS  PubMed  Google Scholar 

  56. Nestler-Parr S, Korchagina D, Toumi M, Pashos CL, Blanchette C, Molsen E, et al. Challenges in Research and Health Technology Assessment of Rare Disease technologies: Report of the ISPOR Rare Disease Special Interest Group. Value Health. 2018;21(5):493–500.

    Article  PubMed  Google Scholar 

  57. Jensen PB, Jensen LJ, Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet. 2012;13(6):395–405.

    Article  CAS  PubMed  Google Scholar 

  58. Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G. Potential biases in Machine Learning Algorithms Using Electronic Health Record Data. JAMA Intern Med. 2018;178(11):1544–7.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Geneletti S, Richardson S, Best N. Adjusting for selection bias in retrospective, case–control studies. Biostatistics. 2009;10(1):17–31.

    Article  PubMed  Google Scholar 

  60. Mansournia MA, Jewell NP, Greenland S. Case–control matching: effects, misconceptions, and recommendations. Eur J Epidemiol. 2018;33(1):5–14.

    Article  PubMed  Google Scholar 

  61. Riley RD, Ensor J, Snell KIE, Harrell FE, Martin GP, Reitsma JB, et al. Calculating the sample size required for developing a clinical prediction model. BMJ. 2020;368:m441.

    Article  PubMed  Google Scholar 

  62. Qin B, Wang J, Yang Z, Yang M, Ma N, Huang F, et al. Epidemiology of primary Sjögren’s syndrome: a systematic review and meta-analysis. Ann Rheum Dis. 2015;74(11):1983–9.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank Mr. Biju Cheriyan and Ms. Mona Arrageg for assisting with identifying SD related drugs and Steven T. Hugenberg, MD for reviewing ICD-9/10 codes and GPI drug codes for relevance to SD patients. We also thank Ms. Lucy Bicket and Ms. Jess Esch for providing editing assistance with this paper.

Funding

This study was supported by the National Institutes of Health, National Institute of Dental and Craniofacial Research under award numbers R21DE027786 and R56DE029195 (Thankam Thyvalikakath, principal investigator). Jason Mao is part of the Public and Population Health Informatics training program at the Indiana University Richard M. Fairbanks School of Public Health and the Regenstrief Institute, supported by the National Library of Medicine of the National Institutes of Health under award number T15LM012502. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health, Indiana University, or Regenstrief Institute.

Author information

Authors and Affiliations

  1. Department of Biostatistics and Health Data Science, Indiana University Richard M. Fairbanks School of Public Health, 410 W. 10th Street, Indianapolis, IN, 46202, USA

    Jason Mao

  2. Department of Dental Public Health and Dental Informatics, Indiana University School of Dentistry, 1121 W. Michigan Street, Indianapolis, IN, 46202, USA

    Jason Mao, Grace Gomez Felix Gomez, Mei Wang & Thankam P. Thyvalikakath

  3. Department of Biostatistics and Health Data Science, Indiana University School of Medicine, 410 W. 10th Street, Indianapolis, IN, 46202, USA

    Huiping Xu

  4. Center for Biomedical Informatics, Regenstrief Institute, 1101 West 10th Street, Indianapolis, IN, 46202, USA

    Jason Mao, Grace Gomez Felix Gomez & Thankam P. Thyvalikakath

Authors
  1. Jason Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Grace Gomez Felix Gomez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huiping Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thankam P. Thyvalikakath
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

J.M. contributed to the design, data analysis and interpretation, and manuscript drafting and revision for this study. G.G. contributed to the critical manuscript revision. M.W. performed patient matching and generated the study sample. H.X. and T.P.T. contributed to the study design, interpretation, and critical manuscript revision. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Thankam P. Thyvalikakath.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the Indiana University Institutional Review Board (IRB: #18131) as exempt research. The Indiana University Institutional Review Board has granted an exemption from requiring informed consent due to the retrospective nature of the study. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

12911_2024_2448_MOESM1_ESM.xlsx

Additional file 1: ICD codes by diagnosis category. A list of ICD codes we identified to be relevant to SD patients, summarized into groups to create analysis variables.

12911_2024_2448_MOESM2_ESM.xlsx

Additional file 2: CDT codes by procedure category. A list of CDT codes and procedure descriptions, grouped by category of service at IUSD, summarized to create analysis variables.

12911_2024_2448_MOESM3_ESM.xlsx

Additional file 3: Variables not selected for inclusion in the final models. A descriptive summary of demographic, drug, diagnosis, dental procedure, serological test history, and clinical note data we used in our study that were not selected into our final models.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mao, J., Gomez, G.G.F., Wang, M. et al. Prediction of Sjögren’s disease diagnosis using matched electronic dental-health record data. BMC Med Inform Decis Mak 24, 43 (2024). https://doi.org/10.1186/s12911-024-02448-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-024-02448-9

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us