Volume 12 Supplement 1
Discovering context-specific relationships from biological literature by using multi-level context terms
© Lee et al.; licensee BioMed Central Ltd. 2012
Published: 30 April 2012
The Swanson's ABC model is powerful to infer hidden relationships buried in biological literature. However, the model is inadequate to infer relations with context information. In addition, the model generates a very large amount of candidates from biological text, and it is a semi-automatic, labor-intensive technique requiring human expert's manual input. To tackle these problems, we incorporate context terms to infer relations between AB interactions and BC interactions.
We propose 3 steps to discover meaningful hidden relationships between drugs and diseases: 1) multi-level (gene, drug, disease, symptom) entity recognition, 2) interaction extraction (drug-gene, gene-disease) from literature, 3) context vector based similarity score calculation. Subsequently, we evaluate our hypothesis with the datasets of the "Alzheimer's disease" related 77,711 PubMed abstracts. As golden standards, PharmGKB and CTD databases are used. Evaluation is conducted in 2 ways: first, comparing precision of the proposed method and the previous method and second, analysing top 10 ranked results to examine whether highly ranked interactions are truly meaningful or not.
The results indicate that context-based relation inference achieved better precision than the previous ABC model approach. The literature analysis also shows that interactions inferred by the context-based approach are more meaningful than interactions by the previous ABC model.
We propose a novel interaction inference technique that incorporates context term vectors into the ABC model to discover meaningful hidden relationships. By utilizing multi-level context terms, our model shows better performance than the previous ABC model.
With the advent of high-throughput methods and sheer volume of medical publications covering various diseases, biomedical researchers face challenges of distilling an enormous amount of data and discovering knowledge buried in them. Biological entities and their relations such as genes, proteins, molecules, processes, diseases, drugs and chemicals constitute underlying knowledge repository, and those entities and relations exist at various levels of entity types ranging from molecular to phenomic.
Several techniques have been developed to explore the Swanson’s ABC model. Weeber  attempted to discover novel relationships between drugs and diseases in the biomedical literature. With the ABC model, they developed the concept-based system by mapping words to UMLS concepts, and used it for Swanson’s Raynaud-Fish Oil and Migraine-Magnesium discoveries. Weeber  adopted the following two models to generate new hypotheses in discovering two processes: 1) an open discovery procedure with directional process and 2) a closed discovery procedure with bi-directional process.
Several studies employed the MeSH terms to infer the relationships between the biological objects [6–8]. Sehgal  explored genes and their relationships by using MeSH terms. Srinivasan  used MeSH terms and UMLS semantic types for new hypothesis generation.
Other researches arrange the specific context in order to infer the new relationships between biological objects [8, 9]. Srinivasan  suggested novel uses of dietary and pharmacological substance in terms of the Swanson’s ABC model. They identified that some diseases were related with curcumin. In the Swanson’s ABC model, they selected context, curcumin as the A terms in an open discovery procedure. The B, C terms were extracted by MeSH terms from the results of searching A term, curcumin in the PubMed. Patric  developed the literature mining method called RaJoLink to discover hidden relations by the Swansons’s ABC model in the autism domain.
The major concerns with the ABC model are that 1) it does not incorporate context information into relation inference; 2) it generates a large volume of false positive candidate relations; and 3) it is a semi-automatic, labor-intensive technique requiring human experts' manual input. The goal of this study is to infer unknown interactions among entities extracted from the literature of a particular disease by making use of context term patterns. The proposed approach is particularly useful for drug discovery that determines the possibility of drug repositioning.
Context terms, in this paper, are defined as biological entities co-occurring with interaction pairs in a given PubMed record. These biomedical terms can be treated as context terms of the interactions. The major hypothesis explored in this paper is that the similar context terms co-occurring with interactions among entities provide meaningful patterns to detect undiscovered knowledge.
To our best knowledge, none of previous studies resembles our approach that detects context term patterns from text and applies them for the ABC model problem. The most similar one is by Baker and Hemminger  proposing a mining technique based on term co-occurrence based relation model to generate new hypotheses of drug-disease, gene-disease, and drug-function relations. This approach uses diseases-genes-drugs patterns. However, their approach did not utilize context information where interaction of entities is discovered.
We have developed a methodology to extract terms which refer to biological objects from biomedical literature and store them in a repository used to identify interaction pairs of entities from multi-level interaction databases. Applying Swanson's ABC model to stored interaction data, we produced new possible interaction candidates. By applying context term patterns for the interaction results, we were able to improve the precision rates than previous ABC methods.
The contributions of our study are three-folds: First, we built a multi-level interaction database used to identify whether interaction exists among extracted entities. Second, besides the interaction identified by the multi-level interaction DB, we detected patterns of neighbor entities, built pattern vectors, and inferred undiscovered interaction. Third, we validated our approach with 77,711 PubMed records of Alzheimer's disease.
The rest of the paper is organized in the following order. Datasets and methods describe our approach: data collections, evaluation strategy, and evaluation measure. Results and discussions report the experimental results and discuss the results. In conclusions, we conclude the paper with the future plan.
Datasets and methods
In this section, we describe our approach to hidden interaction extraction using multi-level context terms. First, we describe the dataset used in this paper. Second, we introduce the multi-level entity recognition method as well as the interaction extraction method. Third, we explain the concept of context terms and the context similarity-based scoring method. Last, we describe how we evaluated our method.
We use UMLS (Universal Medical Language System)  to find bio-medical entities from the text. As UMLS is composed of many different thesauruses, we applied different export criteria before importing them to our databases. We first chose the NCI thesaurus as our main thesaurus, because NCI thesaurus accurately categorized drug, disease, and symptom entities. Since the UMLS data is composed of the hierarchical structure, from certain nodes, all descendant nodes are considered to be in the same category. We can use periods (,) to represent hierarchical structures in UMLS. For example, a hierarchical structure, 'A0001.A0002', means that 'A0002' entity is under 'A0001' entity category. We searched for each category entities of gene, disease, and symptom in UMLS. As the result, the entities under 'A1412976.A7570735' can be treated as gene entities, the entities under 'A1412976.A7644030.A12793852' can be treated as disease entities, and the entities under 'A1412976.A7644030.A7580815.A7612336.A7589770' can be treated as symptom entities. After we locate entities, we collect all synonyms by extracting all entities which have the same CUI in the UMLS database.
We extracted 96,031 disease synonyms, 45,527 gene synonyms, and 6,132 symptom synonyms from UMLS in total. Using these synonyms, we built up multi-level biomedical synonym databases of UMLS, and tagged biomedical terms in literatures as context terms.
We use PharmGKB (Pharmacogenetics Knowledge Base)  as a dictionary and the golden standard of this study. As a dictionary, we use names of genes, diseases, and drugs in PharmGKB to extract drug-gene or gene-disease relationships. As an answer set, we use interaction pairs between drug and disease defined in PharmGKB.
We extracted 25,693 disease synonyms, 28,091 drug synonyms, and 258,840 gene synonyms from PharmGKB in total. Using these synonyms, we created multi-level biomedical synonym databases out of PharmGKB, and tagged biomedical terms in PubMed records as interaction entities. Also, we extracted 1,992 drug-disease interaction pairs from PharmGKB, and used them as an answer set for the evaluations.
We use CTD (Comparative Toxicogenomics Database)  for tagging chemicals, genes, diseases entities in the text. CTD contains 384,141 chemical synonyms, 679,701 gene synonyms, and 68,211 disease synonyms. CTD provides us for an answer set of interactions between diseases and drugs, whose number of interactions is 336,693.
PubMed is a well-known biomedical literature repository that is widely used for text mining. PubMed has more than 20,000,000 papers' abstracts. For the evaluation, we downloaded 77,711 abstracts of Alzheimer disease in the XML form.
Multi-level entity recognition
The main purpose of the entity dictionary databases is to tag multi-level biomedical entities existing in PubMed records. We use 4 levels of entities such as genes, drugs, diseases, and symptoms. To this end, we first parse the sentences using the Conditional Random Field (CRF)-based sentence detector. Second, we match the extracted entities with PharmGKB, and CTD entity dictionary databases to extract interaction data. And third, we map them to the UMLS entity dictionary database to extract context vectors.
We recognize multi-level entity terms from the PubMed records. Prior to entities tagging, we construct a multi-level entity dictionary to recognize each level terms.
Entity dictionary tables are structured as two fields: term names and accession IDs. The content data are imported from each database. We extract names and synonym terms with their accession IDs. Due to this, there can be same accession IDs with different terms in the dictionary databases.
To extract interactions from the identified multi-level entities, we use two kinds of dictionaries such as PharmGKB and CTD. From these, we create dictionary databases. Gene, drug, and disease entities are tagged, and these serve as the candidate entities for candidate interactions.
To extract biologically meaningful interactions, we limited extracted patterns to 'drug - gene' and 'gene - disease' from the recognized entities. These three patterns (A: Drugs, B: Genes, C: Diseases) based AC inferences enable us to find novel relationships between drugs and diseases which can be also called drug repositioning. We can find new drug target diseases using this method, which are inferred by connecting genes.
As shown in Figure 2, we generate entity dictionaries from PharmGKB and CTD databases. We only use names of drugs (chemicals), genes and diseases in these two databases. Based on the names, we tagged biological entities from PubMed records. After we tagged them, we extracted candidate interactions when two different types of entities co-occur within a sentence.
Based on the dictionary database, we obtain different results. PharmGKB and CTD databases have different synonym terms, so their tagging results are different from each other.
Context vector based similarity scores
To discover the meaningful relationships between AB and BC interactions, we utilize context vectors. Context vectors are defined as the term frequency vectors of each interaction. After extracting interactions, multi-level biomedical entities that were previously extracted and tagged are members of context vectors. In a given PubMed collection, the same interaction can occur in many records, and context terms may be aggregated for one interaction. The average occurrence frequency for each context terms is defined to be a context term pattern for the interaction.
After construction of CV vectors of each interaction, we calculate similarity scores using both cosine similarity and Spearman correlation. Cosine similarity is widely used in text mining as a measure of similarity between two vectors.
Spearman correlation  is also widely used in text mining as a measure of similarity between two vectors.
Besides cosine similarity and Spearman correlation measures, we have tried various different similarity measures including Pearson correlation, Jaccard index, RBFKernel, and we found that Cosine and Spearman made the steady, superior performance over the other measures. Thus, we only reported the results by cosine similarity and Spearman correlation measures in this paper.
Multi-level interaction database
To generate the golden standard answer set, we created multi-level interaction databases. From PharmGKB, and CTD databases, we extracted interactions to create the multi-level interaction database. The database is composed of two accession IDs of interaction entities. Among extracted interactions, we used drug-disease interactions, because our inferred results are limited to only drug-disease interactions. We extracted 1,992 interactions from PharmGKB database, and 336,693 interactions from CTD database.
The A-C (Drug-Disease) interactions inferred using B (gene) terms are evaluated by examining how many inferred interactions are matched in well-known interaction databases such as PharmGKB and CTD. We compare our method to the ABC model that is based on entity frequency in Alzheimer's disease related abstracts.
We retrieved a set of PubMed records with an "Alzheimer's disease" as a query. We downloaded 77,711 Alzheimer's disease related papers from the PubMed. Each record is further parsed into sentences by the Conditional Random Field (CRF) technique . We used the Java-version of CRF implemented in the Stanford NLP package . To extract the biological entities from sentences, we use the LingPipe's Hidden Markov Model (HMM)-based technique . For our study, we utilize the NER model trained on the Genia corpus . The extracted named entities are biomedical concepts in a sentence such as "5 and 10 lM parthenolide", "endoscopy", or "myocardial infarction". To ensure that the identified named entities correspond to a controlled set of vocabulary, we map them to concepts from the UMLS database.
For every meaningful 'B' terms, we apply three different techniques utilizing frequencies for inference to get a similarity score for 'A-C' interaction. The first method is the sum score. For this score we calculate just summation all scores of A-B1-C to A-Bn-C Pairs. The second is the max score. For this score we use the maximum score of A-B1-C to A-Bn-C. The third one is the hybrid score. For this score we utilize both similarity and frequency of interaction information. We sum up the frequency of interactions when similarity scores of them are greater than a pre-defined threshold.
Results and discussion
In this section, we report the experimental results by comparing the frequency based ABC model (baseline) and our context terms based model. We evaluate our method with two answer sets, PharmGKB and CTD. We infer interactions related with "Alzheimer's disease" for the evaluation.
Results of tagging and extraction
In PubMed, we found 77,711 abstracts related with "Alzheimer's disease". There were 1,640,761 biomedical entities in them extracted by our text preprocessing technique. 295,419 of them were tagged by the PharmGKB entity dictionary, 438,987 of them were tagged by the CTD entity dictionary, and 260,291 of them were tagged by the UMLS entity dictionary. We generated 12,432 interactions using PharmGKB tagged entities, and 84,286 interactions using CTD tagged entities. As a result, the size of the context vector for each interaction was 1,641. We generated 14,481 new disease-drug interactions using PharmGKB, and 136,570 interactions using CTD.
In the evaluation, we focused on how many interactions were matched with two answer sets (known interaction databases - PharmGKB and CTD) as the performance evaluation. For the comparison, we used the frequency based ABC model as the baseline.
Our context similarity based method (Hybrid) is superior to the frequency based ABC model in all cases (Top 100, 500, and 1000) on PharmGKB. In this case, the Hybrid approach sets the threshold for cosine similarity to 0.945 and for Spearman coefficient to 0.999999999.
Figures 8 and 9 show the performance results according to the precision by the ABC model based on the frequency count and similarity based models (Sum, Max, and Hybrid) on CTD. The comparison was made for top 100, top 500, and top 1000 pairs. Figure 8 shows the results using cosine similarity measure. Figure 9 shows the results using Spearman correlation. For the CTD case, only the hybrid approach is superior to the baseline in all cases (Top 100, 500, and 1000) using the threshold 0.95 for cosine similarity and 0.999999998 for Spearman correlation. This result indicates that the frequency of interaction is an important factor to find meaningful relationships because only the hybrid method incorporates both frequency and similarity information. These results also show that the context term based similarity is a good feature to find meaningful relationships. When we filtered the inferred interactions using the context term based similarity, we observed that it helped improve performance, which is better than the frequency used only.
Literature analysis of top 10 interactions
In this section, we analyzed top 10 ranked results to examine whether high ranked interactions are truly meaningful or not. The answer set of CTD contains not only known interactions reported in the literature but also interactions based on the related genes that are undiscovered and not reported in the literature. To examine whether high ranked interactions are truly meaningful or not, we searched literatures for the known evidences. For the comparison, we analyzed the top 10 ranked results of the cosine similarity based hybrid method and the frequency based ABC method.
Top 10 ranked interactions from the hybrid approach (cosine)
Nerve growth factor
Tumor necrosis factor-alpha
In the case of D005182:D000544, we found that flavin-adenine dinucleotide dependent oxidoreductases are shared similarities with seladin-1 gene and down-regulated seladin-1 in brain regions selectively degenerated in AD from the literature . Interleukin-6 has relations on AD also reported in the literature .
Tumor necrosis factor (TNF) alpha has also relations on Alzheimer disease . Amyloid beta-peptides are known as a main component of senile plaques (SPs), and senile plaques is highly related to Alzheimer's disease . Finally, Alzheimer disease has a similar risk factor with type 2 diabetes and has relations with insulin reported in this literature .
Top 10 ranked interactions from frequency based basic ABC model
Nerve growth factor
Tumor necrosis factor-alpha
Aural atresia, congenital
In this paper, we proposed a novel approach to infer undiscovered interactions from the literature. We defined interaction specific context vectors which model a specific condition of interactions. We inferred interactions from the known A-B interactions in the literature by utilizing the context vector similarity. We presented three different context vector similarity based scoring functions (sum, max, hybrid). We evaluated our method using PharmGKB and CTD. The results show that the hybrid approach constantly performs better than the frequency based ABC model in all cases. The literature based analysis of top 10 ranked interactions confirms that our hybrid based approach could find more meaningful interactions than the frequency based ABC model.
In the future study, we plan to improve the precision of this method. We believe that the size of the context vector is very large and sparse because we used all bio-medical entities which were tagged by UMLS. If we could extract meaningful features from members of the context vector, we will be able to improve the result. We also plan to find hidden interactions that are associated with specific conditions using context vectors. If we could extract context vectors from the known interaction in the specific disease dataset, we will be able to infer the interaction using context vectors of the condition specific interaction. These will enable us to find the novel interaction between drugs and diseases, called drug repositioning.
This work was supported by the National Research Foundation of Korea funded by the Korea Government, Ministry of Education, Science and Technology through the WCU (World Class University) program (R32-2008-000-10218-0). It was also supported by the KISTI (Korea Institute of Science and Technology Information). DL was also supported by LG Yonam Foundation.
This article has been published as part of BMC Medical Informatics and Decision Making Volume 12 Supplement 1, 2012: Proceedings of the ACM Fifth International Workshop on Data and Text Mining in Biomedical Informatics (DTMBio 2011). The full contents of the supplement are available online at http://www.biomedcentral.com/bmcmedinformdecismak/supplements/12/S1.
- Swanson DR: Fish oil, Raynaud's syndrome, and undiscovered public knowledge. Perspect Biol Med. 1986, 30 (1): 7-18.View ArticlePubMed
- Ijaz AZ, Song M, Lee D: MKEM: a Multi-level Knowledge Emergence Model for mining undiscovered public knowledge. BMC Bioinformatics. 2010, 11 (Suppl 2): S3-10.1186/1471-2105-11-S2-S3.PubMed CentralView ArticlePubMed
- DiGiacomo RA, Kremer JM, Shah DM: Fish-oil dietary supplementation in patients with Raynaud's phenomenon: a double-blind, controlled, prospective study. Am J Med. 1989, 86 (2): 158-164. 10.1016/0002-9343(89)90261-1.View ArticlePubMed
- Weeber M, Klein H, Aronson AR, Mork JG, de Jong-van den Berg LT, Vos R: Text-based discovery in biomedicine: the architecture of the DAD-system. Proc AMIA Symp. 2000, 903-907.
- Weeber M, Klein H, de Jong-van den Berg LT, Vos R: Using concepts in literature based discovery: simulating Swanson's Raynaud-fish oil and migraine-magnesium discoveries. J Am Soc Inf Sci Technol. 2001, 52: 548-557. 10.1002/asi.1104.View Article
- Sehgal A, Qiu XY, Srinivasan P: Mining MEDLINE metadata to explore genes and their connections. Proceedings of SIGIR Workshop on Text Analysis and Search for Bioinformatics. 2003
- Srinivasan P: Text mining: generating hypotheses from MEDLINE. J Am Soc Inf Sci. 2004, 55 (4): 396-413.View Article
- Srinivasan P, Libbus B: Mining MEDLINE for implicit links between dietary substances and diseases. Bioinformatics. 2004, 20 (Suppl 1): i290-i296. 10.1093/bioinformatics/bth914.View ArticlePubMed
- Petric I, Urbancic T, Cestnik B, Macedoni-Luksic M: Literature mining method RaJoLink for uncovering relations between biomedical concepts. J Biomed Inform. 2009, 42 (2): 219-227. 10.1016/j.jbi.2008.08.004.View ArticlePubMed
- Baker NC, Hemminger BM: Mining connections between chemicals, proteins, and diseases extracted from Medline annotations. J Biomed Inform. 2010, 43 (4): 510-519. 10.1016/j.jbi.2010.03.008.PubMed CentralView ArticlePubMed
- Humphreys BL, Lindberg DA: The UMLS project: making the conceptual connection between users and the information they need. Bull Med Libr Assoc. 1993, 81 (2): 170-177.PubMed CentralPubMed
- Hewett M, Oliver DE, Rubin DL, Easton KL, Stuart JM, Altman RB, Klein TE: PharmGKB: the Pharmacogenetics Knowledge Base. Nucleic Acids Res. 2002, 30 (1): 163-165. 10.1093/nar/30.1.163.PubMed CentralView ArticlePubMed
- Davis AP, King BL, Mockus S, Murphy CG, Saraceni-Richards C, Rosenstein M, Wiegers T, Mattingly CJ: The Comparative Toxicogenomics Database: update 2011. Nucleic Acids Res. 2011, 39 (Database issue): D1067-D1072.PubMed CentralView ArticlePubMed
- Myers JL, Well A: Research Design and Statistical Analysis. 2003, Lawrence Erlbaum Associates
- Hirohata K, Okazaki N, Ananiadou S, Ishizuka M: Identifying sections in scientific abstracts using conditional random fields. Proceedings of the Third International Joint Conference on Natural Language Processing. 2008
- Finkel JR, Grenager T, Manning C: Incorporating non-local information into information extraction systems by Gibbs sampling. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL 2005). 2005, 363-370.
- LingPipe: String comparison and string distance tutorial. [http://alias-i.com/lingpipe/demos/tutorial/stringCompare/read-me.html]
- Kim JD, Ohta T, Tateisi Y, Tsujii J: GENIA corpus--semantically annotated corpus for bio-textmining. Bioinformatics. 2003, 19 (Suppl 1): i180-i182. 10.1093/bioinformatics/btg1023.View ArticlePubMed
- Larbanoix L, Burtea C, Ansciaux E, Laurent S, Mahieu I, Vander Elst L, Muller RN: Design and evaluation of a 6-mer amyloid-beta protein derived phage display library for molecular targeting of amyloid plaques in Alzheimer's disease: comparison with two cyclic heptapeptides derived from a randomized phage display library. Peptides. 2011, 32 (6): 1232-1243. 10.1016/j.peptides.2011.04.026.View ArticlePubMed
- Huagn Y, Xu YM, Zhang JW, Ren XH, Suo AQ: [Effects of estrogen on P-Tau, ChAT and nerve growth factor protein expressions in the brain tissue of rats with Alzheimer's disease]. Nan Fang Yi Ke Da Xue Xue Bao. 2010, 30 (10): 2408-2410.PubMed
- Iivonen S, Hiltunen M, Alafuzoff I, Mannermaa A, Kerokoski P, Puoliväli J, Salminen A, Helisalmi S, Soininen H: Seladin-1 transcription is linked to neuronal degeneration in Alzheimer's disease. Neuroscience. 2002, 113 (2): 301-310. 10.1016/S0306-4522(02)00180-X.View ArticlePubMed
- Wang M, Jia J: The interleukin-6 gene -572C/G promoter polymorphism modifies Alzheimer's risk in APOE epsilon 4 carriers. Neurosci Lett. 2010, 482 (3): 260-263. 10.1016/j.neulet.2010.07.051.View ArticlePubMed
- Pardridge WM: Biologic TNFα-inhibitors that cross the human blood-brain barrier. Bioeng Bugs. 2010, 1 (4): 231-234. 10.4161/bbug.1.4.12465.PubMed CentralView ArticlePubMed
- Sultana R, Robinson RA, Di Domenico F, Abdul HM, St Clair DK, Markesbery WR, Cai J, Pierce WM, Butterfield DA: Proteomic identification of specifically carbonylated brain proteins in APP(NLh)/APP(NLh) × PS-1(P264L)/PS-1(P264L) human double mutant knock-in mice model of Alzheimer disease as a function of age. J Proteomics. 2011, 74 (11): 2430-2440. 10.1016/j.jprot.2011.06.015.PubMed CentralView ArticlePubMed
- McClean PL, Parthsarathy V, Faivre E, Hölscher C: The diabetes drug liraglutide prevents degenerative processes in a mouse model of Alzheimer's disease. J Neurosci. 2011, 31 (17): 6587-6594. 10.1523/JNEUROSCI.0529-11.2011.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.