This article has Open Peer Review reports available.
Underutilization of information and knowledge in everyday medical practice: Evaluation of a computer-based solution
© Zakim et al; licensee BioMed Central Ltd. 2008
Received: 18 July 2008
Accepted: 05 November 2008
Published: 05 November 2008
The medical history is acknowledged as the sine qua non for quality medical care because recognizing problems is pre-requisite for managing them. Medical histories typically are incomplete and inaccurate, however. We show here that computers are a solution to this issue of information gathering about patients. Computers can be programmed to acquire more complete medical histories with greater detail across a range of acute and chronic issues than physician histories.
Histories were acquired by physicians in the usual way and by a computer program interacting directly with patients. Decision-making of what medical issues were queried by computer were made internally by the software, including determination of the chief complaint. The selection of patients was from admissions to the Robert-Bosch-Hospital, Stuttgart, Germany by convenience sampling. Physician-acquired and computer-acquired histories were compared on a patient-by-patient basis for 45 patients.
The computer histories reported 160 problems not recorded in physician histories or slightly more than 3.5 problems per patient. However, physicians but not the computer reported 13 problems. The data show that computer histories reported problems across a range of organ systems, that the problems detected by computer but not physician histories were both acute and chronic and that the computer histories detected a significant number of issues important for preventing further morbidity.
A combination of physician and computer-acquired histories, in non-emergent situations, with the latter available to the physician at the time he or she sees the patient, is a far superior method for collecting historical data than the physician interview alone.
Everyday medical practice does not proceed on the basis of up-to-date information about patients nor on up-to-date knowledge for managing problems that are identified [1–4]. History-taking, the acknowledged starting point for quality medical care, is inadequate so that information about patients goes undiscovered [5–9]; and outcomes from treating recognized problems are unequal to what can be achieved through effective use of existing knowledge [1–3, 10, 11]. This underutilization of information about patients and knowledge about management appears to be a major contributor not only to poor outcomes but to the high cost of health care . Short-comings in delivering quality care are unlikely to resolve until the ineffective use of information about patients and knowledge about disease are addressed directly. Since information about patients is pre-requisite for effective use of knowledge to manage their medical problems, it makes sense to address first the issue of poor history-taking.
History-taking, in theory, can be off-loaded from physicians to computers, i.e., the data fields of an "electronic medical record" can be populated by direct, computer-based interview of patients. Computerized history-taking was an active area of academic inquiry at the beginning of the computer age; and early literature demonstrates that history-taking by computer was a promising and effective technology (see reference  for review). Paradoxically, interest in the technology ebbed as computers became cheaper and easier to use and software easier to write. We believe computing can resolve the negative impact on quality of care from deficiencies in history-taking and that this technology thus should be pursued vigorously. We report experience here with a computerized history-taking program that interacts directly with patients in the absence of inputs from physicians or other providers. The data document the extent to which medical problems are not recorded in routine medical histories and show that computerized history-taking can resolve deficiencies in acquiring information from patients about significant medical problems affecting them.
As eluded to already, knowledge as trees for history-taking is broken-down by organ system and further as medical issues within an organ system. The elements acquiring the cardiac history, for example, are organized as separate trees for issues like hypertension, peripheral vascular disease, heart failure, coronary artery disease, and so on. Trees within an organ system and across organ systems are integrated as a single interview by a master tree so that patients are asked relevant questions about all systems no matter what their chief complaint, i.e., where in the set of trees an interview began. Moreover, no matter where the interview begins, e.g., independent of the organ system of the chief complaint or a switch in the pathophysiology pursued by history of the present illness, the program will be directed to acquire a history of all organ systems, a social history, a history of significant past medical events, a history of medications being taken, a history of known allergies and a family history. The master tree will direct the interview to a complete cardiac history as part of the review of systems for a patient with pleuritic pain or a patient with a swallowing disorder manifesting as chest pain. The program thus emulates history-taking by a physician, who may decide as the patient's story develops to switch a line of inquiry to pursue alternate pathophysiologies. This level of flexibility at run time is achieved through the mechanism of gating entry into every tree in the program.
The program "tests" whether a patient should be interviewed about every issue in the program as that issue is reached in the course of an interview. The "test" is based on answers to prior questions in the interview, which "gate" entry to every tree. Questions HUBHIB60 and HUBHIB33 gate the entry into the tree in Figure 1. One of these questions must be answered "Yes" (answer value a) for the tree to be entered. If the tree in Figure 1 is not entered, the interview proceeds to the next tree in the order of trees within the module NAP. The mechanism of gating enables the program to explore all aspects of the history that are significant for a given patient while avoiding redundancy and issues of no medical significance, as determined by answers to questions at each node in an interview.
Authors of content use the tree structures shown to develop their history-taking programs. The information in trees is compiled as machine-readable code, which directs the program at run time by calling questions from a database as the program instantiates one or another node. The program tested in this work comprised 8018 nodes representing approximately 12,000 data fields.
Deployment of software
Prior to deployment, the program was bench-tested extensively for errors in the logic of the trees, for errors in the flow of questions and gating of entry to trees and for errors in reporting of findings. In addition, the program was used by several hundred out-patients in the United States.
The software for acquiring the history operated from a central server behind a firewall within the IT department of the Robert-Bosch-Hospital (RBK, Stuttgart, Germany). Patients connected to the history-taking software via the hospital's Intranet. Patients selected their preferred language of German or English for the interview. After entering demographic data, they were asked to select a chief complaint from a set of menus. All subsequent questions were determined by the software as illustrated in Figure 1. Patients were able to review and change prior answers by moving the program backward one question at a time along the same branching pathways as the forward loop of questions. Moving backward erased answers to questions traversed in the backward direction. Just as the program determines when a specific tree ends (see figure 1), the master tree ends on a "Complete" node at the end of the family history. When the interview ends, all data are stored as codes in a structured, searchable database within the central computer. Data from computer interviews were extracted from compiled reports as in the example in Figure 3 not by review of individual data fields. Computer-acquired histories were available only to reviewers not to patients' physicians. Computer histories were extracted by D.Z.; physician histories were extracted from the hospital chart by N.B.
Patients who were interviewed had been admitted emergently. Patient charts were not consulted prior to any interview; and the study nurse, who picked patients randomly for interview, had no knowledge of these patients before an interview and carried on no discussions with floor staff about a patient's clinical state. No demographic criteria were used to select patients except that interviews were limited to patients on general internal medicine, cardiology and nephrology services, which agreed to participate in the program. Patients were asked simply to participate in a test of a new program by which computers interview patients about their past and present health problems. No attempt was made to explain to patients the clinical value of the medical history. No patient who was asked to participate declined to be interviewed.
Ninety eight patients were interviewed by the computer program after a physician's history was recorded. Patients could choose between a computer workstation in the study unit of the clinic or use a laptop in bed, which had a wireless connection to the intranet of the hospital.
About half the patients had not used a computer previous to being interviewed. These patients were instructed in use of a computer mouse by the study nurse. All patients who agreed to computer interview were able to use the program. Only one patient, of those who started an interview, did not finish the interview, in this case because of severe pain secondary to gangrene of a limb. Hospital charts and records of computer interviews were reviewed in detail and reported here for 45 of these patients, who were interviewed by computer within 48 hours of a physician history. This cut-off was used because present illnesses precipitating hospital admission were not captured adequately by computer interviews for intervals between physician and computer interviews longer than 48 hours. The data relating to patient reaction to the computer interview and ease of use by patients includes all 98 patients, who filled out a questionnaire about their experiences with the computer-assisted interview. Responsible physicians did not know which patients were interviewed by computer and were not shown reports from these interviews.
Data extraction and analysis
Data were extracted from hospital charts by N.B. and M.D.A.; data from the computer histories were extracted by D.Z., who tabulated comparisons between the 2 sets of records. Nurses at Robert Bosch Krankenhaus do not take medical histories in regard to allergies or adverse drug reactions. Pharmacists make no entries into charts and have no separate records of drug allergies or history of adverse drug reactions. Data on these issues either are obtained only by physician interview of the patient.
The local ethics committee and regulating government authorities approved the study (University of Tuebingen, Germany). Written informed consent was obtained from all patients. The study was registered (ClinicalTrials.gov: NCT00430755).
Comparison of problems reported in computer but not physician histories
Significant problems reported by computer histories but not physician histories for 45 hospitalized patients
Problem Reported by Computer History but not Hospital Chart
Patients with Problem
Symptoms heart failure (dyspnea on exertion, paroxysmal nocturnal dyspnea, marked fatigue, pitting edema) with no prior diagnosis
Symptoms decompensated heart failure in patients with prior diagnosis
"Cardiac asthma" versus reactive airway disease
Prior diagnosis angina with chest pain
Symptoms effort-induced angina versus reactive airway disease manifest as chest tightness
Effort induced chest pain, no prior diagnosis angina
Prior MI no invasive treatment
Prior MI and angioplasty in last year
Uncontrolled hypertension by self-reported BP
Symptoms compatible with intermittent claudication
Symptoms intermittent claudication versus spinal stenosis
TIAs in patients with prior CVA
TIAs in patient with no prior CVA
History carotid artery surgery
History peripheral arterial surgery
Symptomatic asthma in patients with prior diagnosis but no rescue or control meds
History treated TB
Symptoms obstructive sleep apnea
Symptoms sleep apnea
34 old woman with daily cough and sputum throughout year. Onset as child. (Computer and physician history reported new onset fever and dyspnea with history pneumonia 4 months prior to admission)
GERD, AM cough and hoarseness in patient with asthma
Symptoms active ulcer disease in patient with prior upper GI bleed
Daily aspirin use in patient with prior upper GI bleed
Dysphagia in patient with scleroderma
Symptoms urinary obstruction in elderly men
Stress incontinence (women)
Symptoms estrogen deficiency in patients taking HRT
Symptoms recurrent cystitis and back pain in woman
Urinary incontinence since prostate surgery 1 year PTA plus 6 months dysuria, back pain and polyuria/polydypsia.
Uncertain thyroid status in patients treated previously for hyperthyroidism
Polyuria/dyspsia, recent onset blurred vision
Gout; no symptoms in last 1 year
Polyphagia with no weight gain
Diabetics with symptoms hypoglycemia
Diabetics not monitoring or inadequately monitoring blood glucose
Diabetics unaware of treatment regime for blood sugar
Tunnel vision in patient with no prior diagnosis glaucoma
Symptoms CNS vasculitis in patient with diagnosis SLE
Tinnitus, hearing loss but no vertigo
Current evidence major depression. No treatment.
Major depression in setting of bereavement. No treatment.
Current evidence moderate depression. No treatment
Past history depression; not currently depressed; no meds
Past history mania
Prior diagnosis bipolar disorder not currently depressed
Symptoms migraine; no prior diagnosis; positive FH migraine
Multiple hospitalizations for falls; negative AUDIT score
High risk for falling because of motor weakness, unsteady gait, past history falls not requiring hospitalization
Episodic dizziness and abnormal gait in patient with positive AUDIT score
Hodgkin's treated with XRT 3 years prior to admission. Now on chemo for 2nd recurrence.
Renal cell cancer treated with surgery and radiation 20 years prior to admission. No recurrence.
Active rheumatoid arthritis on steroids
Active smokers seeking help to stop smoking
Positive AUDIT score
Multiple 1st and 2nd degree relative with breast cancer
Multiple 1st degree relatives with diabetes in patient with history gestational diabetes and recent onset chest pain provoked by emotional upset.
Weight loss > 10 pounds in non-dieting patient
Comparison of problems reported in physician but not computer histories
Comparison of findings reported by physician histories and computer histories for 8 patients presenting to their physicians with a chief complaint of chest pain and for whom there were significant discrepancies between physician and computer histories of the present illness
Physician-based Present Illness
Computer-based Present Illness
No acute disease
Negative cardiac cath
Progressive chest pain for 6 months radiating to L. shoulder, L. elbow and palpitations with emotional upset not effort. Patient also had effort-induced tightness of the chest and shortness of breath. ?Atypical angina and reactive airway disease
Negative cardiac cath; negative stress test.
6 months SOB and tightness of chest with exercise and strong odors. No acute changes.
No diagnosis. No treatment.
Pleuritic chest pain; fatigue; 2 days fever and chills: pneumonia.
DOE progressive to dyspnea at rest at admission: heart failure
No acute disease. Denied chest pain
No work up.
Discharged in 1 day
New onset recurrent angina
DOE with daily chores. Old MI and denied recurrent chest pain.
Negative cardiac cath
Effort-induced chest pressure lasting 2 to 3 minutes and not relieved by NTG
No acute disease
Documented CAD by angiogram
2 years "angina" and dyspnea relieved by NTG
No acute disease
Documented CAD by angiogram
No acute GU history
It is not possible to examine the basis for discrepancies between computer histories and physician histories for the data in Table 1 because the physician leaves only a single record, which is the recorded history [see also Discussion]. The computer history leaves a searchable trail of what was asked, what was answered and the sequence of questions. The details of the computer histories for patients in line 7, 8 and 9 in Table 2 were analyzed to determine the basis for discrepancies between the reported computer histories and the recorded physician histories. The patient in line 7 entered in the computer history that he was admitted because of heart disease but answered "No" to a series of questions about chest pain and anginal equivalents provoked by effort or emotion or occurring at rest. The physician-acquired history for the patient mentioned in line 7 of Table 2 indicated a 2 year history of "angina" and dyspnea relieved by nitroglycerin. When interviewed by the computer-driven history program, the patient in line 8 selected they were admitted for heart disease and to have a heart catheterization, but denied a history of angina or heart attack. The patient answered "No" to the same series of questions cited for the patient in line 7 and "No" to questions about shortness of breath. The failure in interviewing the patient in line 9 was caused by a logic error. The software contained a set of questions appropriate to the patient's complaints suggesting pyelonephritis, as recorded by the physician history, but access to these questions in response to the patient's chief complaint of kidney problems was logically incorrect.
Problems reported in physician histories but not computer histories in 37 patients for whom data were extracted in Table 1 and for the 8 additional patients in Table 2
Number of patients
Weight loss (more than 5 pounds)
Single episode syncope
Ulcerated skin lesions
Drug allergies, adverse drug reactions and potential for adverse drug-drug interactions
Detection of allergies and possible adverse drug reactions in 45 in-patients for whom data are shown in Table 1
Allergic with hives, giant hives and pruritis
Fever without skin reaction
Allergic – not specified
Aspirin sensitive asthma
Allergic with giant hives, urticaria
Allergic with hives and itching
Allergic with rash, hives, itching
Patients could not tolerate drug but denied muscle soreness or weakness or abnormal LFTs
Simvastatin plus calcium channel blocker
Potential adverse interaction
Aspirin plus coumadin
Potential adverse interaction
Patient satisfaction with the interview program
Results of the questionnaire to get information about the experiences of patients after performing a computer-assisted interview
Number of patients
N = 98
58 ± 16 [18-89]
M – F
Never used a computer before:
Was it easy to understand the questions and answer them?
- No (for some questions)
- No (for most of the questions)
If no, what questions were not easy to understand or to answer?
- Questions regarding medication
- Questions regarding family history
- Questions regarding cancer
What describes your experience with the Computer-assisted interview best:
- It is worthwhile to do since it is good for my further treatment
- It is not helpful
- Questions too personal
- Takes too much time
- Did not select an answer to this query
Bachman in 2003 reviewed the accumulated experience with computerized history-taking and found 61 instances of clinical tests of such programs . Only 6 of these programs were in general medicine, and only 1 of these had a large database of medically relevant questions. Histories acquired by computer were compared with physician histories in 28 instances; and computer histories were determined to have provided more sensitive information than the physician histories in 25 of these 28 studies. These studies did not report details about the problems found by computer versus physician; and in some cases the findings were compilations of numbers of symptoms or numbers of questions asked by computerized history versus physician history. It is not possible to determine from these data the extent to which significant clinical information was not recorded by physician histories. Additionally, it is not extractable from the data to which extend a so called "checklist effect" solely is responsible for some of the found differences. This effect describes the phenomenon that a simple reminder of issues, which should be part of history taking, by a checklist can improve the quality of results.
A single study of computerized history-taking coupled to decision support found no advantages from the combination versus physicians providing usual care, measured by the number of problems detected in relatively young out-patients . The report in reference  also lacked details for evaluating the disease burden in the study patients, the problems identified, whether the absence of differences in detecting problems by computer versus physician history applied to all patients and all problems and the relative contributions of the computerized history and decision support components to the measured end point of the study. Indeed, we believe the current report is the first to provide readers with clinical details of a history-taking program in general medicine with a database of questions in the tens of thousands and a patient-by-patient analysis of findings from computerized and physician history-taking and to document the nature of clinical information missing from physician histories. The software tested in the current study had not been refined previously by clinical testing with real patients, and in this sense was in an early stage of development. The data show, nevertheless, the significant extent to which physician histories as compared with computerized history-taking fail to acquire and/or record significant medical information on patients' medical status, that the deficiency in information gathering extends to acute and chronic issues and that the deficiency in collecting robust clinical information can be solved through computerized history-taking.
It is important to consider two issues related to the large false negative rate for physician history-taking. The first is whether this reflects false positive findings or unreasonable sensitivity to trivial symptoms by computerized history-taking. The data in the present report seem sufficient to exclude both possibilities. The computer-based findings are not the simple listing of symptoms or tabulation of questions asked. Problems were identified in the computer histories by automated analysis of answers to series of questions interpreted in the context of known pathophysiology. An obvious extension of the current work, however, is objective confirmation of findings by computerized history through direct, structured re-questioning of patients by an independent observer. The second issue is whether the computer histories benefitted from prior physician histories that triggered recall by patients of details about their health. There is no mechanism for excluding this possibility in acutely ill patients because medical ethics and liability law prevent prior interview of these patients by computer. The more important question is putting in place a method to maximize acquisition of clinically significant historical data. The present data show that a combination of a physician interview and a computer-based interview is a superior method for collecting information from patients as compared with physician interview alone whether or not the physician interview facilitates discovery of clinically significant problems by the computerized interview. We note that this combination can be achieved with little or no demand on doctors' time.
The accuracy of patient answers is a significant issue for computerized and physician history-taking. We mean by this mistaken entries not deliberate falsification of inputs. By testing computer programs against physician histories and objective measures of disease, points of common mistakes in computer entries can be identified. Three patients with diabetes answered "No" when asked directly, during the computer interview, whether they had diabetes. Two patients with objective evidence of coronary disease and physician histories compatible with effort-induced angina answered "No" when asked by computer about effort-induced chest pain and anginal equivalents. These false negatives could reflect failure by patients to read questions and answers carefully, poorly phrased questions and answers, mistaken selection of "No" when "Yes" was the intended answer, failure to comprehend prior diagnoses or intentional entry of false information. Editing of text and page design to facilitate usability and construction of feedback loops in the computer program will minimize chances for false negatives caused by misinterpretation of text, failure to read text carefully and data entry errors. Since the computer system can be configured to operate iteratively, the computer can re-interview patients on selected problems not detected during an initial interview but detected by objective measures of physiologic parameters. However, it also must taken into account that patients are not trained in pathophysiology as physicians are and therefore by building the program the programming doctors could not forecast the answers in precise manner. However, that impairment can be extinguished by repetitive testing of the program under real world conditions.
The demonstrable value of history-taking software as compared with physician-acquired histories depends on the training, knowledge and time available for history-taking by physicians as well as the burden of disease in a population. The differences between computerized and physician histories reported here might not be as large in tests in other facilities. On the other hand, the data indicate that most of the problems detected by computerized history-taking were chronic and had not been attended to prior to hospitalization. It seems clear that computerized history-taking will have value across an array of physicians.
Even at this early stage of development, a combination of computerized and physician histories will be a valuable adjunct to practice because the combination uncovers more significant clinical problems than the physician history alone. In the acute situation, the computerized history can be obtain after the physician history and resuscitation of the patient, as the computer history will indicate a range of co-morbid states otherwise undetected. In the non-emergent setting, the computer history can be available to the physician at the time they see patients in order to focus on specific clinical issues.
Source of funding
Funding for this work was provided by the Robert Bosch Krankenhaus and the Robert Bosch Stiftung. The funders had no role in planning or directing the clinical study and no influence on the data reported.
The authors acknowledge the invaluable contributions of Ms. Katrin Neiderstrasser, who was responsible for recruiting and supervising the patients in this study.
- Institute of Medicine: Crossing the Quality Chasm: A New Health System for the 21st Century. 2001, Washington, D.C.: National Academies PressGoogle Scholar
- Institute of Medicine: Performance Measurement: Accelerating Improvement. 2006, Washington, DC: National Academies PressGoogle Scholar
- McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A: The quality of healthcare delivered to adults in the United States. New Engl J Med. 2003, 348: 2635-45. 10.1056/NEJMsa022615.View ArticlePubMedGoogle Scholar
- Shortell SM, Rundall TG, Hsu J: Improving patient care by linking evidence-based medicine to evidence-based management. JAMA. 2007, 298: 673-76. 10.1001/jama.298.6.673.View ArticlePubMedGoogle Scholar
- Bentsen BG: The accuracy of recording patient problems in family practice. J Med Educ. 1976, 51: 311-16.PubMedGoogle Scholar
- Romm FJ, Putnam SM: The validity of the medical record. Med Care. 1981, 19: 310-15. 10.1097/00005650-198103000-00006.View ArticlePubMedGoogle Scholar
- Ramsey PG, Curtis JR, Paauw DS, Carline JD, Weinrich MD: History-taking and preventive medicine skills among primary care physicians: an assessment using standardized patients. Am J Med. 1998, 104: 152-58. 10.1016/S0002-9343(97)00310-0.View ArticlePubMedGoogle Scholar
- Enright PL, McClelland RL, Newman AB, Gottlieb DJ, Lebowitz MD: Underdiagnosis and undertreatment of asthma in the elderly. Cardiovascular Health Study Research Group. Chest. 1999, 603-13. 10.1378/chest.116.3.603.Google Scholar
- Cox JL, Zitner D, Courtney KD, MacDonald DL, Petersen G, Cochrane B, Mathers J, Merry H, Flowerden G, Johnstone DE: Undocumented patient information: an impediment to quality of care. Am J Med. 2003, 114: 211-16. 10.1016/S0002-9343(02)01481-X.View ArticlePubMedGoogle Scholar
- Wolff JL, Starfield B, Anderson G: Prevalence, expenditures, and complications of multiple chronic conditions in the elderly. Arch Int Med. 2002, 162: 2269-76. 10.1001/archinte.162.20.2269.View ArticleGoogle Scholar
- Gandhi TK, Kachalia A, Thomas EJ, Puopolo AN, Yoon C, Brennan TA, Studdert DM: Missed and delayed diagnoses in the ambulatory setting: A study of closed malpractice claims. Ann Int Med. 2006, 145: 488-96.View ArticlePubMedGoogle Scholar
- Bachman JW: The patient-computer interview: a neglected tool that can aid the clinician. Mayo Clin Proc. 2003, 78: 67-78.View ArticlePubMedGoogle Scholar
- Apkon M, Mattera JA, Lin Z, Herrin J, Bradley EH, Carbone M: A randomized outpatient trial of a decision support information technology tool. Arch Int Med. 2005, 165: 2388-94. 10.1001/archinte.165.20.2388.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/8/50/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.