Evidence in clinical reasoning: a computational linguistics analysis of 789,712 medical case summaries 1983–2012
© Bell et al.; licensee BioMed Central. 2015
Received: 15 April 2014
Accepted: 3 February 2015
Published: 21 March 2015
Better understanding of clinical reasoning could reduce diagnostic error linked to 8% of adverse medical events and 30% of malpractice cases. To a greater extent than the evidence-based movement, the clinical reasoning literature asserts the importance of practitioner intuition—unconscious elements of diagnostic reasoning. The study aimed to analyse the content of case report summaries in ways that explored the importance of an evidence concept, not only in relation to research literature but also intuition.
The study sample comprised all 789,712 abstracts in English for case reports contained in the database PUBMED for the period 1 January 1983 to 31 December 2012. It was hypothesised that, if evidence and intuition concepts were viewed by these clinical authors as essential to understanding their case reports, they would be more likely to be found in the abstracts. Computational linguistics software was used in 1) concept mapping of 21,631,481 instances of 201 concepts, and 2) specific concept analyses examining 200 paired co-occurrences for ‘evidence’ and research ‘literature’ concepts.
‘Evidence’ is a fundamentally patient-centred, intuitive concept linked to less common concepts about underlying processes, suspected disease mechanisms and diagnostic hunches. In contrast, the use of research literature in clinical reasoning is linked to more common reasoning concepts about specific knowledge and descriptions or presenting features of cases. ‘Literature’ is by far the most dominant concept, increasing in relevance since 2003, with an overall relevance of 13% versus 5% for ‘evidence’ which has remained static.
The fact that the least present types of reasoning concepts relate to diagnostic hunches to do with underlying processes, such as what is suspected, raises questions about whether intuitive practitioner evidence-making, found in a constellation of dynamic, process concepts, has become less important. The study adds support to the existing corpus of research on clinical reasoning, by suggesting that intuition involves a complex constellation of concepts important to how the construct of evidence is understood. The list of concepts the study generated offers a basis for reflection on the nature of evidence in diagnostic reasoning and the importance of intuition to that reasoning.
KeywordsClinical reasoning Medical intuition Evidence-based practice
The 21st Century evidence-based medicine movement has placed less emphasis on intuition and tacit knowing in forming sound clinical judgements [1,2]. Yet a growing debate about the evidence-practice divide in medicine over the last decade asserts the limited value of research for complex practitioner decision-making [3-6]. It has been argued that practitioner judgement must be better valued because guidelines synthesised from the ‘gold standard’ evidence of clinical trials, reviews and meta-analyses are about groups, not individuals [6,7]. Such evidence has been described as suffering from an insufficiency linked to the narrowness of its aims versus the breadth of clinical judgement required for ‘point of care’ complexities [3,8].
This tension between scientific ‘evidence-based’ thinking and intuitive thinking is suggested also by the clinical reasoning literature. Yet this emerging body of literature offers little clear consensus on what is clinical reasoning . Since 1983 (the period encompassed by this study) over a thousand papers are listed in PUBMED as journal articles with the term ‘clinical reasoning’ in the abstract or title. Strategies for improving clinical reasoning processes refer to building knowledge acquisition, data gathering, data processing, as well as metacognition capacities that manage bias through self-awareness [10-12]. Practice setting—a construct that includes the interactions between patient, practitioner, environment and other ambient contextual factors—has also been argued to be important for clinical reasoning [9,13]. A machine-driven ‘cognitive mapping methodology’ has been used to represent the multidimensional, non-linear, dynamic nature of clinical reasoning to confirm the importance of a sound knowledge base, as well as hypothesis generation and problem representation mechanisms. The clinical encounter was found to activate a series of cognitive actions: tapping of clinical knowledge reservoirs, mobilising and enriching of scripts and accessing of bio-psycho-social knowledge, parallel control of these processes by metacognition . Yet whatever model is used to describe clinical reasoning, such models do not fit current diagnostic ‘evidence-based’ clinical practice guidelines [15,16].
Better understandings of clinical reasoning could help manage diagnostic error. Diagnostic error has been linked to 8% of adverse medical events and 30% of malpractice cases . Diagnostic error has been mostly (75%) found comprise of cognitive issues that are about how information is collected, integrated and verified . Yet while a recent review found a hundred papers suggesting interventions to decrease the likelihood of cognitive-based errors in diagnostic reasoning, those few that had been tested involved trainees in artificial contexts removed from practice .
Bias, associated with non-analytical reasoning, has been described in one review as neutralised by reflective reasoning that is particularly important for diagnostic accuracy in complex cases [19,20]. Emotional intelligence and empathy in sound clinical reasoning for quality medical diagnoses are less well valued than the role of hypothetico-deductive cognition [21,22]. Yet emotional intelligence has been elsewhere demonstrated to be the only variable that contributes to a clinical reasoning construct . Clinical ‘first impressions’ have also been found to deliver similar diagnostic reasoning performance as directed structured analytic thinking . Further, a 2010 review found very little evidence to support claims for diagnostic errors being associated with non-analytical reasoning . Fast, unconscious, contextual process (System 1) thinking is no more associated with bias or diagnostic error than slow, analytical and conscious (System 2) thinking—encouraging both can reduce error .
Alternative theories to resolve such tensions include the supposedly analytical and intuitive elements of clinical decision-making in ‘balanced’ models [27,28]. These may include a ‘distributed intelligence’ approach in which patients and practitioners share problem-solving in the practice setting . For example, ‘cognitive continuum theory’ asserts that clinical reasoning can be better described on an analysis-intuition continuum such that much reasoning may be ‘quasi-rational’ involving elements of both . Such balanced theories appear supported by evidence of both analytic and nonanalytic elements found in clinical reasoning processes using functional magnetic resonance imagining and ‘think aloud protocols’ .
The language in which practitioner case reports are summarised offers elements of ‘real world’ case scenarios. Such scenarios have been the foundation of teaching clinical reasoning: hypothesis generation, pattern recognition, formulation of context, diagnostic test interpretation, differential diagnosis as well as diagnostic verification . We aimed to use machine-driven techniques for quantifying large qualitative datasets to address the question of how clinical practitioners conceptualise evidence in one kind of case scenario genre—abstracts of case reports—particularly as it relates to understanding the role of intuition versus research literature.
The description of the method that follows draws upon the method described in our previous Bayesian-based machine-driven studies of other large language databases .
The research question was: ‘How important is a concept of evidence in published summaries of clinical cases? What other concepts do practitioners associate with an evidence concept in their case summaries, particularly concepts to do with research literature and intuition?’
The study design involved treating abstracts of case reports as indicative evidence of what authors of those reports selected as important to understanding them. It was assumed that, if evidence and literature concepts were viewed by these clinical authors as essential to understanding their case reports, they would be more likely to be found in the abstracts of those reports. The study sample comprised all abstracts in English for case reports contained in the database PUBMED for the period 1 January 1983 to 31 December 2012. Case reports are defined in the PUBMED database as ‘Clinical presentations that may be followed by evaluative studies that eventually lead to a diagnosis’. This provided a total of 789,712 distinct abstracts all of which were included in the study. At approximately three abstracts per page, this corpus equates to approximately 263,237 pages or approximately 877 books, assuming 250 pages per book.
Numbers of abstracts in the sample, by period of analysis
The analytic approach involved the application of a machine-driven, computational linguistics approach. This entailed content analysis of concepts in the abstracts using the software Leximancer v4.0 (Leximancer, Brisbane, Australia ). This Bayesian-based software has been extensively applied in hundreds of studies across different disciplines, including in health [33-41]. Many public domain software tools listed in digital libraries such as http://dirt.projectbamboo.org/ lack validation studies. Across four criteria—cost, usability, as well as published validation studies and applications—Leximancer compares favourably with a wide range of other competing commercial text analytics products described in business intelligence product assessments .
A text block of about a paragraph in size is the unit of analysis in Leximancer. Each paragraph may contain one or more concepts. Leximancer ‘learns’ from an uploaded language dataset to create a network of such concepts. The key output of the Leximancer software is a concept map with supporting data. The concept map provides a visual representation of all found and/or user-selected concepts in a corpus, based on their proximity or overall co-occurrence. In summary, concept mapping in Leximancer can be described as an iterative numerical model that simulates relationships between concepts to produce a complex network system with associated visualisations of data . Further detailed discussion of algorithms and other technical aspects of the software are given in a published validity study .
The analysis involved two standardised stages to quantify the conceptual content of the abstracts using the software (Leximancer version 4), as follows.
Stage 1: Concept mapping
This stage obtained a conceptual overview of the case report abstracts. The software produced a concept map with supporting frequency and co-occurrence statistics for all concepts mapped from the abstracts. In this study, the automated features of the software were used to derive the concept map. Very similar concepts were merged either automatically by the software or by the researchers. Thus the concept of ‘evidence’ is likely to include the concept of ‘evidence-based’. However, the concept ‘literature’ will not necessarily include the concept ‘review’ though the two may often be semantically proximate, something the method was designed to also assess. Concepts that did not contribute to an understanding of the content of the abstracts were not used as mapping concepts. That is, ideationally void concept words such as ‘appropriate’ were not used as mapping concepts. Terms such as ‘aims’, ‘methods’ or ‘findings’, which form structural features of abstracts, were also not used as mapping concepts. This does not mean this content was excised from the analysis, merely that such concept words were not used as organising terms under which the content of the abstracts was grouped. Accordingly, in Stage 1 the concept map was used to display all found concepts and their semantic proximity to one another across the entire database of 789,712 abstracts. In this stage, the software mapped 21,631,481 instances of 201 concepts found in 4,808,728 text blocks.
Stage 2: Evidence concept analysis
This stage involved identification and extraction of data for two key concepts: the concepts of ‘evidence’ and ‘literature’. In this stage, 59,341 instances of the evidence concept were analysed to identify concepts that were most to least frequently paired with the evidence concept. Accordingly, 200 types of paired co-occurrences for the evidence concept were extracted and examined. The data providing frequencies and likelihood of paired co-occurrences were obtained. Overall likelihoods of the evidence concept occurring for each sub period of the study were also obtained. The 167,737 instances of the literature concept were similarly analysed.
Manual scanning was also performed to do checks of the validity of the data analyses. The multiple data viewing windows in Leximancer facilitated these checks. That is, Leximancer allows the analyst to see all text blocks for a concept and also extract each instance of a concept to view it in the original data file. These checks were performed to help to ensure that the text blocks selected by Leximancer as part of a concept definition of, for example, ‘evidence’, did in fact always include the word ‘evidence’ or a term associated with it semantically. It is estimated that a total of 5% of the corpus or approximately 44 books were manually scanned for this purpose.
Strengths and limitations of the method
Our method offers indicative evidence of how medical practitioners, engaged in the evidence-making fora of journals, conceptualise evidence when summarising the most important aspects of a case report. It does not offer conclusive evidence of how they use evidence in practice or even in the detail of case reports. Rather, the study suggests how they conceptualise that evidence when summarising clinical cases in the genre ‘case report abstracts’. This is a critical distinction. Further, the study is not indicative of all case reports written for journals, only of those with structured abstracts. Only 60.1% of all 1,312,960 case reports for the period 1983–2012 listed in PUBMED have abstracts used in this study.
Leximancer, like other such machine-based data mining tools, offers scoping of large datasets but not fine-grained explanations of their conceptual nuances. Accordingly, the study was designed to offer broad, not nuanced, findings about how practitioners publishing case reports conceptualise evidence in summaries of those reports i.e. typical semantic features. It is useful to questioning broad assumptions about the nature of those concepts and their presence over time.
Strengths of the study include the novelty of both the database and the method. The study sample as a whole represents 48% of the total 1,638,946 case reports in the PUBMED database for all years (i.e. not just for the study period) and all languages where an abstract in English exists—a substantial corpus. The PUBMED database of case report abstracts has not previously been analysed for this purpose using data mining methods, although the field of computational ‘text analytics’ offers many opportunities for such investigations.
The study is a content analysis of published material in peer reviewed journals. No data were collected from human subjects.
→different → process
→changes → specific
→single → study.
This suggests that evidence as a concept is not only attached to empirical studies but also to dynamic concepts to do with growth, difference and processes.
→young → syndrome
This indicates that the research literature has tended to be constructed in terms of literature reviews closely aligned to the way in which case reports themselves are conceptualised—as might be expected if literature reviews are commonly used to justify the unusualness of a case. Literature is linked to specific syndromes or particular knowledge and descriptions, making sense of presentations, and congenital and rare disease.
Notably, the two concepts of evidence and literature are not semantically similar i.e. they are not proximate to one another. In summary, evidence is linked to amorphous clinical reasoning storylines like process through the amorphous concept of suggest—a term linked to diagnostic hunches. In contrast, literature → review is not linked to such amorphous clinical reasoning concepts. This suggests clinical reasoning involving research literature is possibly narrower and more descriptive than clinical reasoning involving evidence which is dynamic and involves process understandings.
Overall concept relevance
Ranked Concept List (all concepts)
woman; man; diagnosis
results; surgery; associated; syndrome
review; artery; showed; developed
therapy; lesions; severe; literature
revealed; infection; acute; performed; complications; examination
imaging; normal; symptoms; resonance; carcinoma; suggest
Ct; occurred; systemic; children; increased; pain; discussed
effective; pulmonary; previously; renal; tissue; demonstrated; day; features; malignant; bone; possible; type; positive; common; recurrent; improved; successfully; mass; observed
blood; chronic; primary; condition; history; management; complete; hospital; function; transplantation; confirmed; liver; cancer; analysis; biopsy; weeks; related; considered; detected; age; course; resection; time; tomography
MRI, important; evaluation; failure; gene; cardiac; mutations; progressive; changes; chemotherapy; lung; factors; procedure; significant; combination; differential; skin; injury; operation; loss; ventricular; muscle; nerve; response; identified; early; test; pregnancy; technique; serum; defect; bilateral; evidence
region; disorder; signs; activity; risk; brain; affected; presence; follow-up; potential; anterior; neck; families; period; origin; different; heart; medical; secondary; usually; cerebral; congenital; consistent; elevated; control; decreased; adult; posterior; reaction; body
Mg; isolated; site; negative; deficiency; vascular; characterized; benign; peripheral; oral; knowledge; partial; similar; care; human; onset; therapeutic; boy; pattern; fluid; specific; rate; known; role; typical; girl; respiratory; pressure; process; young; marked; complex; growth; difficult; obtained; administration; distal; protein; data
group; plasma; absence; compared; suspected; respectively; single
However, Table 2 also suggests that clinical cases involve a wide number of what might be described as reasoning concepts with the most common including: diagnosis (32%); associated (17%); described (16%); caused (15%); review (14%); showed (14%); revealed (11%). The least common reasoning concepts are: absence, compared, and suspected, which all have a 2% relevance, as well as concepts such as characterized, knowledge, similar, pattern, known, typical, process, marked, complex, growth, data, which all have a 3% relevance. This suggests that summaries of case reports rely explicitly on broad brush diagnostic judgements of what can be associated or described or understood causally or reviewed or showed or revealed. They tend not to rely explicitly on concepts to do with what is suspected or what can be compared or what may be absent or what may be about diagnostic complexity, patterns and underlying processes.
The literature concept
Paired co-occurrences for the literature concept
data; medical; cases
similar; management; described
Rare; therapeutic; compared; features
related; benign; adult; condition; malignant; carcinoma; care; injury
primary; associated; differential; different; possible; known; role; young; identified; important; risk; complications; children; common; pregnancy; study; tumor
congenital; diagnosis; potential; origin; secondary; syndrome; disease; neck; suggest; factors; occurred; usually; treatment; history; process; group; cancer; surgery; disorder; type; single; isolated; course; infection; evaluation; oral; age; systemic
evidence; lesions; body; girl; vascular; difficult; specific; considered; renal; typical; patient; caused; period; site; follow-up; early; combination; results; bilateral; pattern; acute; boy; nerve; procedure; successfully; bone; affected; chronic; posterior; characterized; technique; complex; absence; recurrent; observed; developed; rate; significant; respectively; year-old; symptoms; therapy; woman; man; time; human; signs; effective; operation; pulmonary; respiratory; cytoplasm
liver; region; tissue; presence; skin; artery; resection; cerebral; imaging; severe; onset; resonance; distal; cardiac; transplantation; abdominal; failure; changes; lung; obtained; analysis; families; chemotherapy; reaction; complete; brain; performed; anterior; confirmed; mass; growth; response; consistent; pain; progressive; partial; muscle; examination; revealed; defect; heart; loss; demonstrated; increased; hospital; suspected; function; peripheral; fluid; administration
MRI, CT, deficiency; biopsy; improved; weeks; tomography; control; test; positive; pressure; detected; ventricular; negative; normal; activity; blood; marked; showed; plasma; elevated; day
decreased; serum; protein; mutations; mg; gene
The least common eight paired co-occurrences for the literature concept or those ranging from 2-1% are more narrow biomedical and clinical concepts such as ‘serum’ (1%) and ‘tissue’ (2%). It appears therefore that the more a concept relates to the broader concepts of clinical management the more likely it is to be linked to the literature concept. The more a concept relates to the biomedical and clinical detail of patient management, the less likely it is to be found with the literature concept. Overall, the distribution of concepts in terms of the likelihood percentages suggests that most of these clinical concepts are not very likely to be found with the literature concept. Scrutiny of the placement of reasoning concepts such as ‘detected’ (2%) and ‘suspected’ (3%) further confirms that diagnostic reasoning concepts to do with underlying processes are not found with the literature concept.
Examination of the likelihood figures by sub period of the analysis suggests that there is a difference by sub period in the likelihood of the literature concept being found. That is, references to literature have not remained static with a 4% likelihood overall of being found in any one text block over the years 2003–2012 and a 3% likelihood over the years 1983–2002. That is, it appears that summaries of case reports are increasingly using the literature concept.
The evidence concept
Paired co-occurrences for the evidence concept
suggest; absence; showed; presence
MRI; CT; biopsy; role; data; disease; marked; demonstrated; process; elevated; clinical; human; revealed; activity; obtained; brain; peripheral; examination; consistent; growth; normal; changes; malignant; infection; systemic; function; cytoplasm; study; response; similar; negative; progressive; test; signs; specific; serum; protein; factors; analysis; chemotherapy; period; bone; pattern; families; significant; plasma; vascular; origin; fluid; single; increased; related; time; primary; cerebral; liver
gene; evaluation; typical; tumor; observed; group; tomography; previously; complete; confirmed; history; identified; reaction; tissue; positive; lesions; resonance; region; disorder; possible; suspected; detected; differential; body; site; nerve; abdominal; known; considered; imaging; muscle; respectively; effective; chronic; potential; renal; patient; control; developed; loss; early; deficiency; features; acute; transplantation; onset; lung; knowledge; mutations; affected; failure; different; blood; cardiac; results; compared; course; heart; injury; resection; medical; improved; complex; type; weeks; pulmonary; mass; symptoms; decreased; risk; carcinoma; presented; isolated; pressure; bilateral; associated; ventricular; therapy; severe; condition; rate; young; skin; age; cancer; distal; important; performed; respiratory; characterized; care; therapeutic; defect; combination; administration; partial; occurred; children; adult; day; oral; diagnosis; described; surgery; cases; syndrome; year-old; secondary; operation; common; report; neck; review; caused; pain; congenital; benign; woman; literature; treatment; man; girl; mg; anterior; posterior; usually
boy; artery; pregnancy; discussed; successfully; procedure; management; hospital; rare; difficult; complications; technique
The background section suggested that clinical reasoning literature does not support simplistic mistrust of practitioner intuition or the more unconscious elements of diagnostic reasoning. It suggests that intuitive ‘System 1’ thinking has a role as important as rational ‘System 2’ thinking that includes explicit use of research .
This study suggests that evidence is a fundamentally patient-centred, intuitive concept in summaries of what is important to case reports. Evidence is far more linked to amorphous, dynamic concepts suggestive of suspected underlying processes and diagnostic hunches. Its typical storylines across multiple concepts include, but are not limited to, research studies. The evidence concept is as likely to be found with scientific concepts such as ‘data’ as it is with concepts such as ‘signs’ that may be associated with medical intuitions.
The study also suggested that, at least in abstracts, the use of research literature in clinical reasoning is linked to more superficial reasoning concepts or specific knowledge and descriptions or presenting features of cases. The more a concept relates to the broader concepts of clinical management, the more likely it is to be linked to the literature concept (itself most often found in the concept review i.e. as in literature review). The more a concept relates to the biomedical and clinical detail of patient management, the less likely it is to be found with the literature concept.
The study suggests that the use of research literature in diagnostic reasoning may have become more prevalent, in contrast to intuitive practitioner evidence-making, at least in these data. Of course, such a finding may be an artefact not simply of changes in the practice of clinical reasoning but rather in the requirements of journals in reporting cases. Literature is by far the most dominant concept with an overall relevance of 13% versus 5% for evidence. Further, literature has been increasing in relevance since 2003 while the concept of evidence has remained static.
These findings should be interpreted in light of the fact that clinical case summaries include a wide range of reasoning concepts. The fact that the most frequent reasoning concepts are concepts to do with what can be associated or described or understood causally and so on raises questions about the role of the literature concept in a constellation of more superficial reasoning concepts. The fact that the least present types of reasoning concepts relate to diagnostic hunches to do with underlying processes, such as what is suspected, also raises questions about whether intuitive practitioner decision-making, found in a constellation of dynamic, process concepts, has become less important.
These findings raise more questions than the method can answer. Clearly, the research literature is a critical part of clinical reasoning, but how is it used in practice in relation to more intuitive aspects of clinical reasoning? This study has suggested that literature, primarily literature reviews often used to establish the unusualness of a case, is selected by clinical authors of case reports as important to summary representations of those cases but also that intuition may have a critical role. Future work applying this method should involve examining relationships between intuition and literature reviews, as well as other kinds of evidence, in different kinds of informal unstructured texts gained from clinical reasoning situations. In the meantime, this study adds support to the existing corpus of research on clinical reasoning, by suggesting that intuition involves a complex constellation of concepts important to how the construct of evidence is understood. The list of concepts the study generated offers a basis for teachers, students and clinicians to reflect on the nature of evidence in diagnostic reasoning and the importance of intuition to that reasoning.
- Braude HD. Human all too human reasoning: comparing clinical and phenomenological intuition. J Med Philos. 2013;38(2):173–89.PubMedGoogle Scholar
- Braude HD. Clinical intuition versus statistics: different modes of tacit knowledge in clinical epidemiology and evidence-based medicine. Theor Med Bioeth. 2009;30(3):181–98.View ArticlePubMedGoogle Scholar
- De Maeseneer J, van Driel M, Green L, van Weel C. The need for research in primary care. Lancet. 2003;362:1314–9.View ArticlePubMedGoogle Scholar
- Boseley S. News report. In: The Guardian. vol. June 24. London: Guardian News and Media Limited; 1998.Google Scholar
- O’ Donnell M. Evidence-based illiteracy: time to rescue “the literature”. Lancet. 2000;355(February 5):489–91.View ArticleGoogle Scholar
- Nylenna M, Eiring O, Strand G, Rottingen J. Wiring a nation: putting knowledge into action. Lancet. 2010;375(March 20):1048–51.View ArticlePubMedGoogle Scholar
- Sniderman AD, Lachapelle KJ, Rachon NA, Furberg CD. The necessity for clinical reasoning in the era of evidence-based medicine. Mayo Clin Proc. 2013;88(10):1108–14.View ArticlePubMedGoogle Scholar
- Ioannidis J, Karassa F. The need to consider the wider agenda in systematic reviews and meta-analyises: breadth, timing and depth of the evidence. BMJ. 2010;341:c4875.View ArticlePubMedGoogle Scholar
- Durning SJ, Artino Jr AR, Schuwirth L, van der Vleuten C. Clarifying assumptions to enhance our understanding and assessment of clinical reasoning. Acad Med. 2013;88(4):442–8.View ArticlePubMedGoogle Scholar
- Cutrer WB, Sullivan WM, Fleming AE. Educational strategies for improving clinical reasoning. Curr Probl Pediatr Adolesc Health Care. 2013;43(9):248–57.View ArticlePubMedGoogle Scholar
- Gay S, Bartlett M, McKinley R. Teaching clinical reasoning to medical students. Clin Teach. 2013;10(5):308–12.View ArticlePubMedGoogle Scholar
- Reilly JB, Ogdie AR, Von Feldt JM, Myers JS. Teaching about how doctors think: a longitudinal curriculum in cognitive bias and diagnostic error for residents. BMJ Qual Saf. 2013;22(12):1044–50.View ArticlePubMedGoogle Scholar
- Durning S, Artino Jr AR, Pangaro L, van der Vleuten CP, Schuwirth L. Context and clinical reasoning: understanding the perspective of the expert’s voice. Med Educ. 2011;45(9):927–38.View ArticlePubMedGoogle Scholar
- Charlin B, Lubarsky S, Millette B, Crevier F, Audetat MC, Charbonneau A, et al. Clinical reasoning processes: unravelling complexity through graphical representation. Med Educ. 2012;46(5):454–63.View ArticlePubMedGoogle Scholar
- Bonilauri Ferreira AP, Ferreira RF, Rajgor D, Shah J, Menezes A, Pietrobon R. Clinical reasoning in the real world is mediated by bounded rationality: implications for diagnostic clinical practice guidelines. PLoS One. 2010;5(4):e10265.View ArticlePubMedPubMed CentralGoogle Scholar
- Stempsey WE. Clinical reasoning: new challenges. Theor Med Bioeth. 2009;30(3):173–9.View ArticlePubMedGoogle Scholar
- Nendaz M, Perrier A. Diagnostic errors and flaws in clinical reasoning: mechanisms and prevention in practice. Swiss Med Wkly. 2012;142:w13706.PubMedGoogle Scholar
- Graber ML, Kissam S, Payne VL, Meyer AN, Sorensen A, Lenfestey N, et al. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf. 2012;21(7):535–57.View ArticlePubMedGoogle Scholar
- van den Berge K, Mamede S. Cognitive diagnostic error in internal medicine. Eur J Intern Med. 2013;24(6):525–9.View ArticlePubMedGoogle Scholar
- Mamede S, Splinter TA, van Gog T, Rikers RM, Schmidt HG. Exploring the role of salient distracting clinical features in the emergence of diagnostic errors and the mechanisms through which reflection counteracts mistakes. BMJ Qual Saf. 2012;21(4):295–300.View ArticlePubMedGoogle Scholar
- Marcum JA. The role of emotions in clinical reasoning and decision making. J Med Philos. 2013;38(5):501–19.View ArticlePubMedGoogle Scholar
- Braude HD. Conciliating cognition and consciousness: the perceptual foundations of clinical reasoning. J Eval Clin Pract. 2012;18(5):945–50.View ArticlePubMedGoogle Scholar
- Ashoorion V, Liaghatdar MJ, Adibi P. What variables can influence clinical reasoning? J Res Med Sci. 2012;17(12):1170–5.PubMedPubMed CentralGoogle Scholar
- Ilgen JS, Bowen JL, McIntyre LA, Banh KV, Barnes D, Coates WC, et al. Comparing diagnostic performance and the utility of clinical vignette-based assessment under testing conditions designed to encourage either automatic or analytic thought. Acad Med. 2013;88(10):1545–51.View ArticlePubMedGoogle Scholar
- Norman GR, Eva KW. Diagnostic error and clinical reasoning. Med Educ. 2010;44(1):94–100.View ArticlePubMedGoogle Scholar
- Norman G. Dual processing and diagnostic errors. Adv Health Sci Educ Theory Pract. 2009;14 Suppl 1:37–49.View ArticlePubMedGoogle Scholar
- Marcum JA. An integrated model of clinical reasoning: dual-process theory of cognition and metacognition. J Eval Clin Pract. 2012;18(5):954–61.View ArticlePubMedGoogle Scholar
- Bissessur SW, Geijteman EC, Al-Dulaimy M, Teunissen PW, Richir MC, Arnold AE, et al. Therapeutic reasoning: from hiatus to hypothetical model. J Eval Clin Pract. 2009;15(6):985–9.View ArticlePubMedGoogle Scholar
- Lucchiari C, Pravettoni G. Cognitive balanced model: a conceptual scheme of diagnostic decision making. J Eval Clin Pract. 2012;18(1):82–8.View ArticlePubMedGoogle Scholar
- Custers EJ. Medical education and cognitive continuum theory: an alternative perspective on medical problem solving and clinical reasoning. Acad Med. 2013;88(8):1074–80.View ArticlePubMedGoogle Scholar
- Durning SJ, Graner J, Artino Jr AR, Pangaro LN, Beckman T, Holmboe E, et al. Using functional neuroimaging combined with a think-aloud protocol to explore clinical reasoning expertise in internal medicine. Mil Med. 2012;177(9 Suppl):72–8.View ArticlePubMedGoogle Scholar
- Kassirer JP. Teaching clinical reasoning: case-based and coached. Acad Med. 2010;85(7):1118–24.View ArticlePubMedGoogle Scholar
- Bell E, Robinon A, See C. Do written mandatory accreditation standards for residential care positively model learning organizations? Textual and critical discourse analysis. Int J Nurs Stud. 2013;50(11):1446–58.View ArticlePubMedGoogle Scholar
- Baker SC, Gallois C, Driedger SM, Santesso N. Communication accommodation and managing musculoskeletal disorders: doctors’ and patients’ perspectives. Health Comm. 2011;26(4):379–88.View ArticleGoogle Scholar
- Cretchley J, Gallois C, Chenery H, Smith A. Conversations between carers and people with schizophrenia: a qualitative analysis using leximancer. Qual Health Res. 2010;20(12):1611–28.View ArticlePubMedGoogle Scholar
- Hepworth N, Paxton SJ. Pathways to help-seeking in bulimia nervosa and binge eating problems: a concept mapping approach. Int J Eat Disord. 2007;40(6):493–504.View ArticlePubMedGoogle Scholar
- Hewett DG, Watson BM, Gallois C, Ward M, Leggett BA. Intergroup communication between hospital doctors: implications for quality of patient care. Soc Sci Med. 2009;69(12):1732–40.View ArticlePubMedGoogle Scholar
- Kuyini AB, Alhassan A-RK, Mahama FK. The Ghana community-based rehabilitation program for people with disabilities: what happened at the end of donor support? J Soc Work Disabil Rehabil. 2011;10(4):247–67.View ArticlePubMedGoogle Scholar
- Kyle GJ, Nissen L, Tett S. Perception of prescription medicine sample packs among Australian professional, government, industry, and consumer organizations, based on automated textual analysis of one-on-one interviews. Clin Ther. 2008;30(12):2461–73.View ArticlePubMedGoogle Scholar
- Pakenham KI, Tilling J, Cretchley J. Parenting difficulties and resources: the perspectives of parents with multiple sclerosis and their partners. Rehabil Psychol. 2012;57(1):52–60.View ArticlePubMedGoogle Scholar
- Travaglia JF, Westbrook MT, Braithwaite J. Implementation of a patient safety incident management system as viewed by doctors, nurses and allied health professionals. Health (London, England: 1997). 2009;13(3):277–96.View ArticleGoogle Scholar
- Halper F. Predictive analytics: the Hurwitz victory index report. In: Hurwitz Victory Index. Needham, MA, USA: Hurwitz & Associates; 2011.Google Scholar
- Smith AE, Humphreys MS. Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behav Res Methods. 2006;38(2):262–79.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.