- Study protocol
- Open Access
Obtaining patients’ medical history using a digital device prior to consultation in primary care: study protocol for a usability and validity study
BMC Medical Informatics and Decision Making volume 22, Article number: 189 (2022)
With the help of digital tools patients’ medical histories can be collected quickly and transferred into their electronic medical records. This information can facilitate treatment planning, reduce documentation work, and improve care. However, it is still unclear whether the information collected from patients in this way is reliable. In this study, we assess the accuracy of the information collected by patients using an app for medical history taking by comparing it with the information collected in a face-to-face medical interview. We also study the app’s usability from the patients’ point of view and analysing usage data.
We developed a software application (app) for symptom-oriented medical history taking specialized for general practice. Medical history taking will take place involving patients with acute somatic or psychological complaints (1) using the app and (2) verbally with trained study staff. To assess the perceived usability, patients will complete a questionnaire for the System Usability Scale. We will collect sociodemographic data, information about media use and health literacy, and app usage data.
Digital tools offer the opportunity to improve patient care. However, it is not self-evident that the medical history taken by digital tools corresponds to the medical history that would be taken in an interview. If simply due to a design flaw patients answer questions about signs and symptoms that indicate possible serious underlying conditions ‘wrong’, this could have severe consequences. By additionally assessing the app’s usability as perceived by a diverse group of patients, potential weaknesses in content, design and navigation can be identified and subsequently improved. This is essential in order to ensure that the app meets the need of different groups of patients.
Trial registration German Clinical Trials Register DRKS00026659, registered Nov 03 2021. World Health Organization Trial Registration Data Set, https://trialsearch.who.int/Trial2.aspx? TrialID = DRKS00026659.
A consultation in primary care takes on average 7.6 min in Germany . During this time, physicians take the patient’s history of present illness, perform the physical examination and suggest and explain possible therapies. The collection of a thorough individual medical history provides the most reliable indication for diagnosis in primary care [2, 3]. However, time pressure in medical consultations often leads to misconceptions about patients’ needs and potentially avoidable misdiagnosis. Some practices use paper questionnaires to collect specific information prior to consultation, especially from patients who are new to the practice. Such questionnaires can include acute medical history, allergies, drug intolerances, or previous treatments, and are neither standardized nor validated. That way, information can be collected comprehensively and expeditiously, but to be of use in the long term, it needs to be transferred into patients’ electronic medical records (EMR). This procedure is tedious for the practice staff. If done by scanning the questionnaire, the resulting document is an attachment to the EMR and of limited use. Manual transcription of the data into the EMR is even more time consuming and prone to mistakes.
Digital tools designed to collect patients’ medical history before consultation could streamline this process and improve quality of care by helping medical professionals to collect a thorough medical history. Their use might augment their work efficiency by reducing documentation work. Additionally, as information is already available to health care providers before the consultation, they can use this data for better preparation, treatment planning and even triage. There are several tools that were developed for medical history taking from specific patient populations, e.g. cardiology  or gastroenterology [5, 6], but only few are designed for use in general practice, or out-of-hours primary care [7, 8]. Although these tools are getting more and more common, it still remains unclear if the information collected is valid and thus can be relied on. As a basic prerequisite for the valid collection of information, the usability for different user groups (e.g. different age, sex, health literacy) must be guaranteed. Usability of such tools have been demonstrated among some smaller cohorts , but necessary research findings especially among certain subgroups are still lacking.
In the project “DASI” (acronym for ‘Digitally assisted system to obtain patients’ medical history before consultation’), we have developed a software application (app) for structured medical history taking for primary health care. It enables to take a symptom-oriented medical history based on the 39 most frequent complaints in general practice.
The aim of the study
In this study we want to (1) assess if patient data obtained by the DASI-app corresponds to the information collected in a medical interview (concurrent validity) and we aim to (2) study the app’s usability as perceived by patients and analysing usage data. For both aspects, validity and usability, will assess the impact of sociodemographic characteristics.
We use a self-developed app that is designed to take the history of present illness from patients in general practice and out-of-hour practices (Fig. 1 shows exemplary screenshots). The app is based on a previous version that was used to collect medical history data from non-German-speaking patients in an initial reception facility for refugees and asylum seekers [7, 10]. Based on guidelines and health literature and tested by experienced general practitioners, the app asks patients about their present illness, including its subjectively perceived severity. Content and structure were adapted and refined for primary care by the aidminutes GmbH together with the Department of General Practice at the University Medical Center Göttingen. At the beginning, general information such as sex, height, weight and age are taken from all patients. Subsequently, the patients select one or several symptoms that as the reason for the appointment and are asked symptom-related questions. Patients’ responses trigger further specific questions about the chosen complaints (cp. Fig. 2), e.g. how and when they have started. If relevant, patients are asked about pre-existing conditions, previous treatments and surgeries, current medication, and living habits, such as drinking and smoking, as well as diseases in the family. Questions and answers are phrased in plain language. Single- and multi-selection questions are to be answered by ticking checkboxes; age, height and weight is entered using the keyboard. The design is kept simple. Menu navigation should be intuitive, so that the app can be used without prior instruction by the patients, e.g. in the waiting room before to seeing a healthcare provider. The DASI-app is designed for general practitioners as well as in out-of-hour practices. General practitioners are the first port of call for any type of medical concern. General practice is aimed at a long-term provision of health care. Out-of-hour practices provide urgent medical care for acute but not life-threatening cases when other practices are closed. The aim of the app is to provide health care providers a comprehensive summary of the current medical history in the EMR before seeing a patient. Thus, doctors are better prepared for the upcoming consultation and can directly and eventually better address patients’ health needs.
For this study, the DASI-app will run on iPad mini device, but it can run on any device with an internet browser.
We aim to evaluate whether the app collects the patient’s current medical history as if it had been obtained in a medical consultation in an interview situation (gold standard). Therefore, we will compare the data generated when patients are using the app independently with the data collected in a medical interview which follows the same thematic structure as the app.
If the answers given in the app and verbally do not match, this may change the rest of the question sequence or leave the rest of the question sequence unaffected. In both cases, it is possible to evaluate whether the non-match is relevant for the history of present illness. For example, if questions concerning signs and symptoms that suggest a potentially serious underlying disease are answered differently.
All patients answer standardized questions including patient characteristics and complaints which were the reason for the appointment. These initial answers can be compared in all patients. Further questions on separate complaints can be compared in participants who stated the same complaints in both time points. Data will be analyzed using contingency tables. Accuracy (with its confidence interval), sensitivity and specificity will be computed in yes–no questions. For contingency tables exceeding 2 × 2 only accuracy and p value of the McNemar-test will be reported. Besides, we will analyse subgroups e.g. by age, health literacy, complaints.
Evaluation of usability
Patients will be asked to evaluate the usability of the app with the System Usability Scale (SUS) [11, 12] which scores 10 statements on five-point-Likert scales . We will use an adapted version of the SUS in German language.
Furthermore, patients will be asked about their daily use of other technological devices, whether German is their native language, and questions assessing their health literacy, reflecting the understanding with which patients navigate in the medical jargon  15.
SUS scores will be compared with published norm data . Further sociodemographic factors (e.g. age, native language German or not), media usage and health literacy will be explored as possible associated factors with perceived app usability, e.g. using linear regressions.
Data collection will take place in a convenience sample of urban and rural primary care and out-of-hour practices in Germany. Potential study participants are patients with acute somatic or/and psychological symptoms.
Inclusion criteria for patients
Patients who meet the following criteria are eligible to participate in the study:
Seeking care in a participating practice
At least 18 years old
Consenting to participate in the study
Exclusion criteria for patients
Patients who meet the following criteria cannot participate in the study:
Younger than 18 years old (legally minor)
Patients in an apparent emergency situation
Patients who require immediate medical treatment
Patients who are unable to consent.
We aim to include 350–400 patients within a frame of about 12 weeks. Since some of the selectable complaints are rare, a sufficiently large number of study participants is needed to form subgroups that are large enough.
Within the SARS-CoV-2 pandemic it may be difficult to find general practitioners, who agree on opening their practices to study staff and are able to provide a separate room. Many practices are currently trying to minimize the number of contacts in their waiting areas. Patients with signs of an infection are now often called in at specific times or advised only by telephone or video. These patients might be underrepresented when compared to non-pandemic circumstances and may lead to a selection bias. Additionally, under-recruitment may occur and an extension of the recruitment period might be necessary.
The DASI project aims to improve patient care using the advantages of digital tools. In 2020, only 5% of primary care physicians in Germany used digital medical history forms, nearly 30% stated that they would like to have the opportunity to do so . The reason may be that the introduction of immature digital applications with insufficient benefits and/or high hurdles for utilization has frustrated practice employees in the past. In order not to jeopardize the acceptance of digitalization there is a need for attractive digital applications that provide a practical implementation for the practices . Although there are similar software developments [8, 9, 19,20,21], DASI is the first app for medical history taking for the use in general practice that is developed in close and independent scientific supervision.
It is not self-evident that the medical history taken by digital tools is ‘true’ and corresponds to the medical history that would be taken verbally. This, however, may not be the case, e.g. for mental or shame-related complaints, for rare (combinations of) complaints, where the predefined items do not fit, or for different user groups. Still, to date, no respective research has been conducted. It may be that patients find it easier to confide in an ‘impersonal’ tool than in a person, but the opposite could also be true. Therefore, it is important to learn whether and how patients answer questions about their medical conditions and medical history differently in a digital tool than in a face-to-face interview. If simply due to a design flaw patients answer questions about signs and symptoms that indicate possible serious underlying conditions ‘wrong’, this could have severe consequences. At the same time, digital tools for medical history taking offer the opportunity to better address patients’ needs and to improve quality care. This may be especially the case in out-of-hour practices. These are staffed with doctors of various specialities and there is little time to identify serious health problems. Besides, patients and care providers usually do not know each other. These aspects make medical history taking even more challenging than in general practice where in long-lasting doctor-patient relationships, practitioners know large part of their patients’ histories.
The validation of the app-based medical history lays the foundation for the next steps in the app development, the creation of a synopsis of patients’ complaints and multilingual use. The evaluation of the usability and the additional feedback given by study participants offers the opportunity to improve the app, to ensure that the app meets the need of the users and therefore increase the likelihood of long-term implementation. In this study, we focus on the validation and usability of the DASI-app. After studying these important aspects and incorporating respective improvements, the next step is to make it usable for physicians and practice staff. Questions and responses are designed in such a way that a concise but comprehensive synopsis can be produced, which reflects the content of the ‘conversation’ and can be understood without knowing what has been asked. This will facilitate to integrate the information to the electronic health records and permits to investigate the app in everyday practice. Here, it should be noted that, even if the DASI-app proves to be usable for patients and serves to collect valid information for physicians, once implemented to practice it needs to be studied if it also improves patient care (e.g. by increasing diagnostic accuracy or patient satisfaction or by positively influencing patient outcome).
Availability of data and materials
The datasets used and analysed during the study are available from the authors upon reasonable request, under consideration of the existing ethics committee vote and the legal framework conditions.
Electronic medical records
Digitally assisted system to obtain patient’s medical history before consultation
Irving G, Neves AL, Dambha-Miller H, Oishi A, Tagashira H, Verho A, Holden J. International variations in primary care physician consultation time: a systematic review of 67 countries. BMJ Open. 2017;7:e017902. https://doi.org/10.1136/bmjopen-2017-017902.
Hampton JR, Harrison MJ, Mitchell JR, Prichard JS, Seymour C. Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. BMJ. 1975;2:486–9. https://doi.org/10.1136/bmj.2.5969.486.
Roshan M, Rao AP. A study on relative contributions of the history, physical examination and investigations in making medical diagnosis. J Assoc Physicians India. 2000;48:771–5.
Brandberg H, Kahan T, Spaak J, Sundberg K, Koch S, Adeli A, et al. A prospective cohort study of self-reported computerised medical history taking for acute chest pain: protocol of the CLEOS-chest pain danderyd study (CLEOS-CPDS). BMJ Open. 2020;10:e031871. https://doi.org/10.1136/bmjopen-2019-031871.
Almario CV, Chey W, Kaung A, Whitman C, Fuller G, Reid M, et al. Computer-generated vs. physician-documented history of present illness (HPI): results of a blinded comparison. Am J Gastroenterol. 2015;110:170–9. https://doi.org/10.1038/ajg.2014.356.
Almario CV, Chey WD, Iriana S, Dailey F, Robbins K, Patel AV, et al. Computer versus physician identification of gastrointestinal alarm features. Int J Med Inform. 2015;84:1111–7. https://doi.org/10.1016/j.ijmedinf.2015.07.006.
Kleinert E, Müller F, Kruse S, Furaijat G, Simmenroth A. Nutzbarkeit digitaler Anamnesehilfen für nicht-deutschsprachige Patienten in der allgemeinärztlichen Sprechstunde: [Usability and efficiency of a digital communication assistance tool to obtain medical history from non-german-speaking patients]. Gesundheitswesen. 2021;83:531–7. https://doi.org/10.1055/a-1144-2848.
Zakim D. Development and significance of automated history-taking software for clinical medicine, clinical research and basic medical science. J Intern Med. 2016;280:287–99. https://doi.org/10.1111/joim.12509.
Miller S, Gilbert S, Virani V, Wicks P. Patients’ utilization and perception of an artificial intelligence-based symptom assessment and advice technology in a British primary care waiting room: exploratory pilot study. JMIR Hum Factors. 2020;7:e19713. https://doi.org/10.2196/19713.
Müller F, Chandra S, Furaijat G, Kruse S, Waligorski A, Simmenroth A, Kleinert E. A digital communication assistance tool (DCAT) to obtain medical history from foreign-languagepatients: development and pilot testing in a primaryhealth care center for refugees. Int J Environ Res Public Health. 2020. https://doi.org/10.3390/ijerph17041368.
Mohamad Marzuki MF, Yaacob NA, Yaacob NM. Translation, cross-cultural adaptation, and validation of the malay version of the system usability scale questionnaire for the assessment of mobile apps. JMIR Hum Factors. 2018;5:e10308. https://doi.org/10.2196/10308.
Hägglund M, Scandurra I. User evaluation of the swedish patient accessible electronic health record: system usability scale. JMIR Hum Factors. 2021;8:e24927. https://doi.org/10.2196/24927.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24:574–94. https://doi.org/10.1080/10447310802205776.
Institute of Medicine (US) Committee on Health Literacy, Lynn Nielsen-Bohlman, Allison M. Panzer, David A. Kindig. Health Literacy: A Prescription to End Confusion. Washington (DC): National Academies Press (US); 2004.
Hersh L, Salzman B, Snyderman D. Health literacy in primary care practice. AFP. 2015;92:118–24.
Lewis JR, Sauro J. Item benchmarks for the system usability scale. J User Exp. 2008;13:158–67.
Albrecht M, Otten M, Sander M, Temizdemir E. PraxisBarometer Digitalisierung 2020.
KBV Kassenärztliche Bundesvereinigung. PraxisBarometer Digitalisierung 2021.
Jungmann SM, Klan T, Kuhn S, Jungmann F. Accuracy of a chatbot (ada) in the diagnosis of mental disorders: comparative case study with lay and expert users. JMIR Form Res. 2019;3:e13863. https://doi.org/10.2196/13863.
Kopp M, Wetzl M, Geissler F, Roth JP, Wallner R, Hoefler D, et al. Structured digital self-assessment of patient anamnesis prior to computed tomography: performance evaluation and added value. J Med Syst. 2021;45:30. https://doi.org/10.1007/s10916-020-01690-8.
Melms L, Schaefer JR, Jerrentrup A, Mueller T. A pilot study of patient satisfaction with a self-completed tablet-based digital questionnaire for collecting the patient’s medical history in an emergency department. BMC Health Serv Res. 2021;21:755. https://doi.org/10.1186/s12913-021-06748-y.
Open Access funding enabled and organized by Projekt DEAL. This research is funded by the German Innovation Fund (Funding Number 01VSF19050) of the Federal Joint Committee (G-BA). The research project has run through an assessment procedure by the funding body that corresponds to a full external peer review. The funders have not influenced the design of this study and will not play any role during its implementation, i.e. data collection and analysis, interpretation, and publication of the results.
Ethics approval and consent to participate
The Medical Ethics Committee of the University Medical Center Göttingen (Ethics Approval No. 26/3/21) approval the study. Written informed consent will be collected from all patients before their inclusion in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Albrink, K., Joos, C., Schröder, D. et al. Obtaining patients’ medical history using a digital device prior to consultation in primary care: study protocol for a usability and validity study. BMC Med Inform Decis Mak 22, 189 (2022). https://doi.org/10.1186/s12911-022-01928-0
- Digital medical history taking
- Primary care
- User friendliness