Skip to main content
  • Research article
  • Open access
  • Published:

A Neuro-ontology for the neurological examination

Abstract

Background

The use of clinical data in electronic health records for machine-learning or data analytics depends on the conversion of free text into machine-readable codes. We have examined the feasibility of capturing the neurological examination as machine-readable codes based on UMLS Metathesaurus concepts.

Methods

We created a target ontology for capturing the neurological examination using 1100 concepts from the UMLS Metathesaurus. We created a dataset of 2386 test-phrases based on 419 published neurological cases. We then mapped the test-phrases to the target ontology.

Results

We were able to map all of the 2386 test-phrases to 601 unique UMLS concepts. A neurological examination ontology with 1100 concepts has sufficient breadth and depth of coverage to encode all of the neurologic concepts derived from the 419 test cases. Using only pre-coordinated concepts, component ontologies of the UMLS, such as HPO, SNOMED CT, and OMIM, do not have adequate depth and breadth of coverage to encode the complexity of the neurological examination.

Conclusion

An ontology based on a subset of UMLS has sufficient breadth and depth of coverage to convert deficits from the neurological examination into machine-readable codes using pre-coordinated concepts. The use of a small subset of UMLS concepts for a neurological examination ontology offers the advantage of improved manageability as well as the opportunity to curate the hierarchy and subsumption relationships.

Peer Review reports

Background

The aggregation of clinical data for big data projects from electronic health records poses challenges [1,2,3,4,5]. Much of the clinical data in electronic health records (EHRs) are represented as free text. Although progress is being made in the conversion of free text into structured data by natural language processing (NLP), these methods are not in general use [6,7,8,9,10]. The entry of data about neurological patients in EHRs into large databases requires a method for converting symptoms (patient complaints) and signs (examination abnormalities) into machine-readable codes.

$$ \mathbf{Signs}+\mathbf{Symptoms}=\mathbf{Findings}\rightarrow \mathbf{Concepts}\rightarrow \mathbf{Machine}\ \mathbf{Codes} $$

In this paper, we will use findings to mean signs and symptoms collectively. This conversion process can be facilitated by an ontology that links neurological signs and symptoms to appropriate concepts and machine-readable codes.

The neurological examination and history

There is no standard neurological examination and history [11,12,13]. Depending on the examiner and patient, a neurological examination and history may take as little as three minutes or greater than 30 min to complete. Furthermore, there is no generally accepted format for recording the neurological examination and history. Some neurologists use an outline, some use a table, and others use a narrative. No agreed-upon terminology exists for recording the neurological examination and history. During an examination, a neurologist elicits symptoms such as weakness, slowness, memory loss, speech impairment, blurred vision, numbness, tingling, pain, or imbalance and abnormalities in the mental status, cranial nerves, motor system, sensory system, reflexes, coordination, and gait. Due to a lack of standard terminology, identical neurological abnormalities may be described variously. For example, a failure to abduct the eye may be variously recorded as a sixth nerve palsy, an abducens palsy, or an abducens nerve weakness. Similarly, an upgoing great toe upon stimulation of the plantar surface of the foot may be recorded variously as Babinski sign, upgoing toe, positive Babinski, or upgoing plantar response.

The need for an ontology for the neurological examination

If neurological findings are to be converted into machine-readable codes, an ontology is needed [14]. At a minimum, an ontology for the neurological examination and history that supports big data applications should do the following:

  1. 1.

    Neurological findings with the same meaning but different wording should be represented by the same concept.

  2. 2.

    A unique machine-readable code should be assigned to each concept.

  3. 3.

    The ontology should be organized hierarchically with a root concept and should support subsumption (is_a relationships).

  4. 4.

    The ontology should have a scope (breadth of coverage) and a granularity (depth of coverage) that enables it to capture findings recorded during a neurological examination faithfully.

  5. 5.

    Synonymous terms should be linked to each concept.

Some ontologies have other useful characteristics. Many ontologies attach a definition to each concept. Other ontologies, SNOMED CT in particular, allow simple concepts to be combined to form more complex concepts. For example, the concept |ankle reflex| can be combined with |absent| and is equivalent to |absent ankle reflex|. This is known as post-coordination [15]. Concept ontologies that are organized hierarchically support the calculation of inter-concept distances [16,17,18,19,20,21,22,23,24].

The UMLS Metathesaurus

The UMLS Metathesaurus is not an ontology per se [25, 26]. The 2019 AB release is a curated compendium of 155 distinct terminology sources with 4,258,810 concepts. Each concept is linked to a unique machine-readable code and a specified name. For example, the concept aphasia has the CUI (concept unique identifier) C0003537. Each CUI is eight characters in length and starts with the letter C, followed by seven digits. The concept aphasia is contributed 58 times to UMLS from 58 different source terminologies. Each contribution of aphasia appears in the UMLS with the same CUI but a different atom unique identifier (AUI). The UMLS maintains concept synonyms as normalized concept names. The 2019AB release has 11,882,429 normalized concept names, each with a unique LUI. For example, the concept aphasia has 22 English language synonyms in UMLS, including |loss of words|, |losing words|, |loss of power of expression or comprehension|, |aphasic syndrome|, and |difficulty finding words|. The UMLS Metathesaurus also maintains files with concept definitions, files with relationships between concepts (child-parent, etc.), and files with ontology hierarchies (paths from each concept to the root concept).

Methods

Test-phrases

We abstracted the neurological examinations from 419 published neurological case studies [27,28,29,30,31,32,33]. Based on the neurological findings, we created a dataset of 2386 test-phrases for encoding as concepts by an ontology. Normal findings were ignored.

Mapping of test-phrases to UMLS concepts

Test phrases were mapped to UMLS concepts using the UMLS browser. Except for a few concepts, we ignored laterality (e.g., right ataxia, left ataxia, and bilateral ataxia were all mapped to the UMLS concept ataxia |C0004134|. We mapped the 2386 test phrases to 601 concepts. Concepts recurred a mean of 3.9 ± 5.5 times (range 1 to 47 times) in the 419 test teaching cases. The 15 most common neurology concepts are shown in Table 1.

Table 1 Fifteen most common test concepts found in neurological teaching casesa

Construction of NEO (neurological examination ontology)

We reviewed the neurological history and examination as presented in three standard textbooks [11,12,13] and identified 1100 findings, which were either signs or symptoms. Each of the 1100 concepts was entered into the Protégé ontology editor [34] and consisted of the following:

  • Concept name

  • UMLS CUI (concept identifier)

  • SNOMED CT SCTID (concept identifier) if available

  • Parent concept

We used Protégé to organize the concepts into a mono-hierarchic ontology. The average number of children per concept was 3, and the maximum ontology depth was seven levels. The neuro-ontology is downloadable as a CSV or OWL file at the BioPortal of the National Center for Biomedical Ontology [35]. The neuro-ontology has five high-level branches to mirror the structure of the neurological examination (mental status finding, cranial nerve finding, motor finding, sensory finding, reflex finding) and four additional high-level branches (head finding, neck finding, skin finding, and neurological symptoms). Figure 1 demonstrates a partial expansion of NEO. Table 2 shows the distribution of concepts by the examination section. We had two considerations in building the concept hierarchy for NEO. First, findings related to each part of the neurological examination should be gathered under one consistent heading. Second, the concept hierarchy path distance between findings should reflect a neurologist’s thinking about which concepts are more similar while preserving subsumption. For example, a brisk biceps reflex could be subsumed under either biceps reflex or brisk reflex (see Fig. 2). We chose to subsume brisk biceps reflex under brisk reflex because a brisk biceps reflex is more similar to a brisk knee reflex than it is to an absent biceps reflex.

Fig. 1
figure 1

Major branches of NEO as shown in Protégé ontology editor (Image created with Protégé 5.5.0 ontology editor [34]). Mental Status Finding branch is partially expanded further

Table 2 Composition Of Target Vocabulary By Major Branch Of Ontology
Fig. 2
figure 2

Alternative subsumption strategies for placing brisk biceps reflex in concept hierarchy. Both strategies are semantically correct. Brisk biceps reflex can be grouped with other brisk reflexes (right panel) or with other biceps reflexes (left panel). SNOMED CT groups brisk biceps reflex with bicep reflexes, NEO groups brisk biceps reflex with other brisk reflexes (Image created with Protégé 5.5.0 ontology editor [34].)

Candidate ontologies for a neurological examination ontology

We identified five component ontologies of the UMLS Metathesaurus (Table 3) as a potential basis for a neurological examination ontology: SNOMED CT, HPO (Human Phenotype Ontology), MEDCIN, MeSH (Medical Subject Headings), and OMIM (Online Mendelian Inheritance in Man). We tested how well each of these ontologies provided concept coverage for the 601 neurology concepts identified above.

Table 3 Candidate Ontologies For Use As A Neurological Examination Ontology

Distance measures between concepts

We calculated distances between concepts for the SNOMED CT and NEO ontologies by the method of Wu and Palmer [24]. Distances between concepts were normalized with a minimum of 0.0 (closest) and a maximum of 1.0 (most distant).

$$ \mathbf{Dist}\ \left(\mathbf{a},\mathbf{b}\right)=1-\frac{2\ast \mathrm{depth}\left(\mathrm{LCS}\right)}{\mathrm{depth}\ \left(\mathrm{a}\right)+\mathrm{depth}\left(\mathrm{b}\right)} $$

Dist (a, b) is the semantic distance between concept a and concept b, LCS is the lowest common subsumer in the ontology for both a and b, depth(a) is number of levels from the root concept to concept a, depth (b) is the number of levels from the root concept to concept b, and depth(LCS) is the number of levels from the root concept to the LCS.

Results

We found 2386 neurological examination findings in 419 published neurological teaching cases. On average, each case had 5.7 ± 3.7 neurological findings. Since these cases appeared in neurology textbooks, they likely had more neurological findings per case than can be expected in general neurological practice. These 2386 findings (based on abstracted test-phrases) were mapped to 601 unique UMLS concepts. We examined how well each of the six candidate ontologies was able to cover the 601 test concepts (Table 4). None of the five candidate ontologies had sufficient scope to cover all the concepts. SNOMED CT, the largest of the candidate ontologies, covered 69% of the test concepts. The Neurology Examination Ontology (NEO) constructed from multiple terminologies in UMLS (Table 5), has enough scope to cover all test concepts.

Table 4 Coverage Of Test Neurology Concepts By Candidate Ontologies
Table 5 Terms Contributed To Neurological Examination Ontology (NEO) By Source Vocabulary

Discussion

We created a neuro-ontology of 1100 concepts derived from the UMLS Metathesaurus to encode findings from the neurological examination and history with machine-readable codes. To create an ontology with enough scope to cover common neurological findings, we drew concepts from a variety of terminologies (Table 5). We tested the completeness of the Neurological Examination Ontology (NEO) by assessing its ability to encode neurological concepts derived from 419 test teaching cases. These test teaching cases generated 2386 test phrases and 601 unique neurological concepts. NEO had adequate scope to cover 100% of the test concepts with a single concept. SNOMED CT had pre-coordinated concepts to cover 69% of the test concepts (Table 4). Coverage of test neurology concepts by MEDCIN was almost as good as SNOMED CT, while HPO, MeSH, and OMIM lack many key neurological concepts needed to cover the entire neurologic examination and history (Table 4).

Most of the concepts lacking from SNOMED CT were granular concepts needed to describe the motor and sensory examination in detail, such as which muscle groups were weak and the precise distribution and nature of sensory loss (Table 6). In this study, we did not use the post-coordination of concepts to generate more granular concepts. Post-coordination of SNOMED CT concepts would likely have increased the coverage rate. Elkin et al. [36] have shown that post-coordination of concepts can increase coverage for problems on the medical problem list from 50% to over 90%. Post-coordination of concepts is the process of joining together concepts to increase specificity and granularity of meaning. For example, the concept |weakness of right ankle dorsiflexion| can be represented by bringing together the concepts |right| with |ankle dorsiflexion| and |muscle weakness|. UMLS itself does not have a grammar for combining concepts to create post-coordinated concepts. SNOMED CT has a formal compositional grammar that specifies rules for combining concepts (post-coordination). However, the underlying grammar of post-coordination of SNOMED CT concepts is complex and requires considerable training before its successful implementation. Even professional coders may disagree on how to combine concepts to define more complex concepts [37]. Furthermore, calculating semantic distances between post-coordinated concepts and searching databases with post-coordinated concepts is more complicated than with pre-coordinated concepts.

Table 6 Examples Of Neurological Concepts Available In UMLS And Not Found in SNOMED CT Browser

For each clinical deficit, the clinical teaching cases used a variety of phrasing to express the same concept. For example, the neurological finding of bilateral extensor plantar response was expressed in 13 different ways in the clinical teaching cases (Table 7).

Table 7 Test Phrases Mapped To |C0422917| Bilateral Extensor Plantar Response

This heterogeneity of expressions poses challenges for efforts to use natural language processing algorithms to convert free text neurological examinations into UMLS concepts [7, 8]. In a pilot study with NLM MetaMap [38, 39] in the batch mode, we were able to convert 70.3% of the 2286 test phrases to UMLS concepts. A higher conversion yield might be possible with additional post-processing and pre-processing of the longer and more complex test phrases.

Curation of the hierarchy

One of the advantages of a small domain-specific ontology, such as NEO is that domain experts can more easily identify and correct subsumption errors. Some somewhat arbitrary subsumption decisions may influence how accurately the concept distance measures derived from a concept hierarchy align with expert opinion. Considerable effort has been devoted to finding the best distance metrics for concept hierarchies that give the closest results to expert opinion [19, 20, 22]. However, when the hierarchy itself is not aligned with expert opinion, the choice of distance metric may be less critical. For example, most neurologists would agree that an absent knee jerk is more similar to an absent biceps jerk than it is to a brisk knee jerk (Fig. 2). As a result, in NEO, we have subsumed absent ankle reflex, absent knee reflex, absent biceps reflex, and absent triceps reflex under absent reflex. SNOMED CT subsumes absent ankle reflex and brisk ankle reflex under ankle reflex finding and subsumes absent biceps reflex and brisk biceps reflex under biceps reflex finding. These are ontologically correct (Fig. 2) but yield distance measures that are not in accord with a neurologist’s opinion as to which concepts are more similar (Table 8). In a large ontology like SNOMED CT, some errors in subsumption are inevitable and need to be corrected over time based on input from domain experts [40, 41]. Two examples of likely errors in subsumption are noted in Figs. 3 and 4. Dysmetria is a form of ataxia and hence is correctly subsumed by a finding related to incoordination, but dysmetria is not a reflex finding (Fig. 3). Similarly, apraxia is a disorder of higher cortical functions akin to aphasia and agnosia and should not be subsumed under either incoordination or musculoskeletal disorders (Fig. 4). As a result, distance measures based on the SNOMED CT concept hierarchy show dysmetria as too close to absent reflexes and shows apraxia too close to ataxia (Table 8). One of the goals of SNOMED CT is to have more concepts fully defined, which is achieved by adding qualifiers to concepts to make them distinguishable from other concepts in the ontology. Fully defined concepts cannot be confused logically with any other concept in the ontology. However, adding additional subsumption relationships may yield anomalous distance measures between unrelated concepts. In Fig. 5, the subsumption of asterixis (a flapping tremor of the arm) under a finding of the upper limb yields an anomalous distance measure placing asterixis too close to hemiparesis (Table 8). Similarly, in Fig. 6, the subsumption of oral dyskinesia (adventitious spontaneous chewing and writhing movements of the lips and tongue) under oral cavity finding causes oral dyskinesia to be anomalously close to the unrelated concept of vocal cord paralysis (Table 8). Finally, in a small curated domain-specific ontology like NEO, related concepts can be grouped to provide more accurate concept distance measures. For example, by grouping manifestations of bradykinesia such as masked-facies and micrographia close to bradykinesia, distance measures calculated based on the concept hierarchy can reflect the relatedness of these concepts (Table 8).

Table 8 Some Examples of Discordant Inter-Concept Distancesa
Fig. 3
figure 3

Dysmetria (an imprecision in performing pointing movements with the limbs) is subsumed by incoordination and reflex finding in SNOMED CT. Read hierarchy from right to left (Diagram from Shrimp Ontoserver [42].©Australian e-Health Research Centre)

Fig. 4
figure 4

In SNOMED CT, asterixis (a flapping tremor of the arms) is subsumed by coarse tremor and finding of upper limb. Read hierarchy from right to left. (Diagram from Shrimp Ontoserver [42].©Australian e-Health Research Centre)

Fig. 5
figure 5

In SNOMED CT, oral dyskinesia is subsumed by disease of mouth, movement disorder, and oral cavity finding. Its defining quality is movement disorder. Read hierarchy from right to left. (Diagram from Shrimp Ontoserver [42].©Australian e-Health Research Centre)

Fig. 6
figure 6

In SNOMED CT concept hierarchy, apraxia is subsumed by finding of praxis and musculoskeletal finding and finding of incoordination. Read hierarchy from right to left. (Diagram from Shrimp Ontoserver [42].©Australian e-Health Research Centre)

Manageability

One advantage of a small ontology like NEO is improved manageability. Both the NLM and SNOMED International recommend the use of subsets of UMLS and SNOMED for certain restricted applications [26, 43]. NEO has only 1100 concepts, and the downloadable CSV file has 1100 rows. In contrast, the UMLS 2019AB release has 4,258,810 concepts, the MRREL.RRF (relationships) file has 84,189,164 rows and the MRCONSO.RRF (concepts) file has 15,172,405 rows. Similarly, the 2019 SNOMED CT US Edition release has 357,533 concepts, the relationship snapshot file has 2,989,896 rows, and the concept snapshot file has 478,117 rows. Since each row in the NEO file has the child-parent relationship for each concept, hierarchies and subsumption tables can be generated directly from the primary file.

Limitations

A major limitation of this study is that we did not attempt to combine concepts to generate missing or more complex concepts (post-coordination). Because we did not post-coordinate concepts, we were not able to grade muscle weakness when describing the motor examination. Muscle strength is usually graded on a scale of 0 to 5 (0 = ‘no movement’ to 5 = ‘full strength’). We elected to encode the clinical expression |weak quadriceps (4/5)| as |quadriceps weakness| C0577655 and ignore the degree of weakness. The sensory examination is notoriously difficult to describe in text, and in the era of the paper medical record, neurologists often used drawings to document the sensory examination. For this study, we did not use post-coordinated concepts to describe sensory findings but used instead granular concepts from MEDCIN to describe common sensory findings such as sensory loss in median nerve distribution, sensory loss in C8 dermatome distribution, a sensory level at the T2 level, etc. Similarly, we ignored quantitative visual acuity measurements such as 20/200 and encoded any visual acuity of less than normal as |reduced visual acuity| C0234632. Although UMLS has appropriate lateralized concepts for some findings (hemiparesis, rigidity, myoclonus, chorea, tremor, ptosis), there are not separate lateralized concepts for other common neurological findings (ataxia, hyperreflexia, spasticity, hyporeflexia). We did not develop a method to capture these lateralized findings when existing concepts were not available in UMLS and reverted to using the non-lateralized concept (e.g., ataxia for left ataxia).

Another limitation is that we have not validated the phrase abstraction methods or the phrase-to-concept mapping methods with other neurology experts or tested the methodology on de-identified medical records. More work is needed on whether a concise neurological examination ontology such as NEO is useful and acceptable to neurologists.

Conclusions

With certain limitations, an ontology that is a subset of UMLS with approximately 1100 concepts has adequate breadth and granularity capture the signs and symptoms of the neurological examination and history. Additional concepts may be needed to fully capture the laterality of certain findings (ataxia, hyperreflexia, etc.) as well as the severity of other findings (weakness, spasticity, rigidity, etc.). Using a subset of UMLS concepts to convert neurological signs and symptoms to machine-readable codes offers the advantage of improved manageability and coverage when compared to larger multi-purpose ontologies such as SNOMED CT, MEDCIN, and OMIM.

Availability of data and materials

This ontology is available for download as a CSV or OWL file at the NCBO BioPortal at http://bioportal.bioontology.org/ontologies/NEO. The test phrases are available on request.

Abbreviations

CSV:

Comma-separated value file

CUI:

Concept Unique Identifier

HPO:

Human Phenotype Ontology

MEDCIN:

MEDCIN® is a registered name of Medicomp Corporation

MeSH:

Medical Subject Headings. MeSH® is a registered name of the NLM

NEO:

Neurological Examination Ontology

NLM:

National Library of Medicine

NLP:

Natural Language Processing

OMIM:

Online Mendelian Inheritance in Man. OMIM® is a registered name of the McKusick-Nathans Institute of Genetic Medicine

OWL:

Web Ontology Language

SCTID:

SNOMED CT identifier

SNOMED CT:

SNOMED CT® is a registered name of SNOMED International. It is no longer considered an acronym

UMLS:

Unified Medical Language System. UMLS® is a registered name of the NLM

References

  1. Raghupathi W, Raghupathi V. Big data analytics in healthcare: promise and potential. Health Inf Sci Syst. 2014;2:3. Published 2014 Feb 7. https://doi.org/10.1186/2047-2501-2-3.

  2. Brown SA. Patient Similarity: Emerging Concepts in Systems and Precision Medicine. Front Physiol. 2016;7:561. Published 2016 Nov 24. https://doi.org/10.3389/fphys.2016.00561.

  3. Wang N, Huang Y, Liu H, Fe Xi, Wei L, Zhao X, Chen H, Measurement and application of patient similarity in personalized predictive modeling based on electronic medical records. Biomed Eng Online 2019, 18: 1–15. https://doi.org/10.1186/s12938-019-0718-2.

  4. Parimbelli E, Marini S, Sacchi L, Bellazzi R. Patient similarity for precision medicine: a systematic review. J Biomed Inform 2018;83:87–96. https://doi.org/10.1016/j.jbi.2018.06.001.

    Article  CAS  Google Scholar 

  5. Pai S, Bader GD. Patient Similarity Networks for Precision Medicine. J Mol Biol. 2018;430(18 Pt A):2924–2938. https://doi.org/10.1016/j.jmb.2018.05.037.

    Article  CAS  Google Scholar 

  6. Erhardt RA-A, Schneider R, Blaschke C. Status of text-mining techniques applied to biomedical text. Drug Discov Today. 2006;11:315–25.

    Article  CAS  Google Scholar 

  7. Kreimeyer K, Foster M, Pandey A, Arya N, Halford G, Jones SF, Forshee R, Walderhaug M, Botsis T. Natural language processing systems for capturing and standardizing unstructured clinical information: a systematic review, J Biomed Inform 2017 73: 14–29. https://doi.org/10.1016/j.jbi.2017.07.012.

    Article  Google Scholar 

  8. Leaman R, R. Khare, Z. Lu, Challenges in clinical natural language processing for automated disorder normalization, J. Biomed Inform. 2015 57:28–37. https://doi.org/10.1016/j.jbi.2015.07.010.

    Article  Google Scholar 

  9. Velupillai S, Suominen H, Liakata M, Roberts A, Shah AD, Morley K, Osborn D, Hayes J, Stewart R, Downs J, Chapman W, Dutta R. Using clinical natural language processing for health outcomes research: overview and actionable suggestions for future advances, J Biomed Inform 2018 88: 11–19. https://doi.org/10.1016/j.jbi.2018.10.005.

    Article  Google Scholar 

  10. Zheng K, Vydiswaran VG, Liu Y, et al. Ease of adoption of clinical natural language processing software: An evaluation of five systems. J Biomed Inform. 2015;58 Suppl(Suppl):S189–S196. https://doi.org/10.1016/j.jbi.2015.07.008.

    Article  Google Scholar 

  11. Biller J, Gruener G, Brazis P. DeMeyer’s The neurologic examination: A programmed text. 6th ed. New York: McGraw Hill Medical; 2011.

    Google Scholar 

  12. Campbell WM. DeJong’s The neurologic examination. 7th ed. Philadelphia: Wolters Kluwer Health; 2013.

    Google Scholar 

  13. Prasad K, Yavdav R, Spillane J. Bickerstaff’s neurological examination in clinical practice. New Delhi: Wiley; 2013.

    Google Scholar 

  14. Bodenreider O, Stevens R. Bio-ontologies: Current trends and future directions, Brief. Bioinform. 2006 7:256–274. https://doi.org/10.1093/bib/bbl027.

    Article  CAS  Google Scholar 

  15. SNOMED International. Compositional Grammar - Specification and Guide, 2019. https://confluence.ihtsdotools.org/display/DOCSCG.

    Google Scholar 

  16. Caviedes JE, Cimino JJ. Towards the development of a conceptual distance metric for the UMLS, J Biomed Inform 2004 37: 77–85. https://doi.org/10.1016/j.jbi.2004.02.001.

    Article  Google Scholar 

  17. Girardi D, Wartner S, Halmerbauer G, Ehrenmüller M, Kosorus H, Dreiseitl S. Using concept hierarchies to improve calculation of patient similarity, J Biomed Inform 2016: 63: 66–73. https://doi.org/10.1016/j.jbi.2016.07.021.

    Article  Google Scholar 

  18. Henry S, A. McQuilkin, B.T. McInnes. Association measures for estimating semantic similarity and relatedness between biomedical concepts, Artif Intell Med. 2019 93: 1–10. https://doi.org/10.1016/j.artmed.2018.08.006.

    Article  Google Scholar 

  19. Jia Z, Lu X, Duan H, Li H. Using the distance between sets of hierarchical taxonomic clinical concepts to measure patient similarity. BMC Med Inform Decis Mak. 2019;19(1):91. Published 2019 Apr 25. https://doi.org/10.1186/s12911-019-0807-y.

  20. Lee WN, Shah N, Sundlass K, Musen M. Comparison of ontology-based semantic-similarity measures. AMIA Annu Symp Proc. 2008;2008:384–8.

    PubMed Central  Google Scholar 

  21. McInnes BT, Pedersen T, Pakhomov SV. UMLS-Interface and UMLS-Similarity : open source software for measuring paths and semantic similarity. AMIA Annu Symp Proc. 2009;2009:431–435. Published 2009 Nov 14.

  22. McInnes BT, Pedersen T. Evaluating semantic similarity and relatedness over the semantic grouping of clinical term pairs. J Biomed Inform. 2015;54:329–36.

    Article  Google Scholar 

  23. Pedersen T, Pakhomov SVS, Patwardhan S, Chute CG. Measures of semantic similarity and relatedness in the biomedical domain, J Biomed Inform 2007 40:288–299. https://doi.org/10.1016/j.jbi.2014.11.014.

    Article  Google Scholar 

  24. Wu Z, Palmer M. Verbs semantics and lexical selection. Proceedings of the 32nd Meeting of Association of Computational Linguistics; 1994. p. 33–138.

    Google Scholar 

  25. Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology, Nucleic Acids Res. 2004: 32, Issue suppl_1, D267–D270. https://doi.org/10.1093/nar/gkh061.

    Article  Google Scholar 

  26. NLM. UMLS Reference Manual. Bethesda: National Library of Medicine (US); 2009.

    Google Scholar 

  27. Blumenfeld H. Neuroanatomy through clinical cases. 2nd ed. Sunderland: Sinauer Associates; 2010.

    Google Scholar 

  28. Hauser SL, Levitt LP, Weiner HL. Case studies in neurology for the house officer. Baltimore: Williams and Wilkins; 1986.

    Google Scholar 

  29. Macleod M, Simpson M, Pal S. Clinical cases uncovered: neurology. West Sussex: Wiley; 2011.

    Google Scholar 

  30. Noseworthy JH. Fifty neurologic Cases from Mayo Clinic. Oxford: Oxford University Press; 2004.

    Google Scholar 

  31. Pendlebury ST, Anslow P, Rothwell PM. Neurological case histories. Oxford: Oxford University Press; 2007.

    Book  Google Scholar 

  32. Toy EC, Simpson E, Mancias P, Furr-Stimming EE. Case files neurology. 3rd ed. New York: McGraw-Hill; 2018.

    Google Scholar 

  33. Waxman SG. Clinical Neuroanatomy. 28th ed. New York: McGraw Hill Education; 2017.

    Google Scholar 

  34. Musen MA The Protégé project: a look back and a look forward. AI Matters. 2015 1(4), 4–12. https://doi.org/10.1145/2757001.2757003.

    Article  Google Scholar 

  35. Noy NF, Shah NH, Whetzel PL, Dai B, Dorf M, Griffith N, Jonquet C, Rubin DL, Storey MA, Chute CG, Musen MA. BioPortal: ontologies and integrated data resources at the click of a mouse. Nucleic Acids Res. 2009;37:W170–3.

    Article  CAS  Google Scholar 

  36. Elkin PL, Brown SH, Husser CS, Bauer BA, Wahner-Roedler D, Rosenbloom ST, Speroff T. Evaluation of the content coverage of SNOMED CT: ability of SNOMED clinical terms to represent clinical problem lists, Mayo Clin Proc 2006 81:741–748. https://doi.org/10.4065/81.6.741.

    Article  Google Scholar 

  37. Andrews JE, Richesson RL, Krischer J. Variation of SNOMED CT coding of clinical research concepts among coding experts. J Am Med Inform Assoc 2007;14(4):497–506. https://doi.org/10.1197/jamia.M2372.

    Article  Google Scholar 

  38. Aronson AR, Lang FM, An overview of MetaMap: historical perspective and recent advances. J Am Med Informatics Assoc. 2010 17: 229–236. https://doi.org/10.1136/jamia.2009.002733.

    Article  Google Scholar 

  39. Reátegui R, Ratteé S. Comparison of MetaMap and cTAKES for entity extraction in clinical notes. BMC Med Inform Decis Mak 2018. https://doi.org/10.1186/s12911-018-0654-2.

  40. Rector AL, Brandt S, Schneider T. Getting the foot out of the pelvis: modeling problems affecting use of SNOMED CT hierarchies in practical applications, J Am Med Informatics Assoc 2011 18: 432–440. https://doi.org/10.1136/amiajnl-2010-000045.

    Article  Google Scholar 

  41. Mortensen JM, Minty EP, Januszyk M, Sweeney TE, Rector AL, Noy NF, Musen MA. Using the wisdom of the crowds to find critical errors in biomedical ontologies: a study of SNOMED CT, J Am Med Informatics Assoc. 2015 22: 640–648. https://doi.org/10.1136/amiajnl-2014-002901.

    Article  Google Scholar 

  42. Metke-Jimenez A, Steel J, Hansen D, Lawley M. Ontoserver: a syndicated terminology server, J Biomed Semantics 2018 9:1–10. https://doi.org/10.1186/s13326-018-0191-z.

  43. SNOMED International. Data analytics with SNOMED CT. 2019. https://confluence.ihtsdotools.org/display/DOCANLYT.

    Google Scholar 

Download references

Acknowledgments

This work was conducted using the Protégé resource, which is supported by grant GM10331601 from the National Institute of General Medical Sciences of the United States National Institutes of Health. Figures 3, 4, 5, and 6 are reproduced by permission of the Australian E-Health Research Centre, copyright reserved.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

DBH contributed to the conception, design, acquisition of data, analysis of data, drafting of the article, and final approval. SUB contributed to the analysis of data, acquisition of data, drafting of the article, and final approval.

Corresponding author

Correspondence to Daniel B. Hier.

Ethics declarations

Ethics approval and consent to participate

This work did not involve human studies. Research Protocol # 2018–1355 was reviewed and approved by the Institutional Review Board of the University of Illinois at Chicago.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hier, D.B., Brint, S.U. A Neuro-ontology for the neurological examination. BMC Med Inform Decis Mak 20, 47 (2020). https://doi.org/10.1186/s12911-020-1066-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-020-1066-7

Keywords