- Research article
- Open Access
- Open Peer Review
Determinants of a successful problem list to support the implementation of the problem-oriented medical record according to recent literature
BMC Medical Informatics and Decision Making volume 16, Article number: 102 (2016)
A problem-oriented approach is one of the possibilities to organize a medical record. The problem-oriented medical record (POMR) - a structured organization of patient information per presented medical problem- was introduced at the end of the sixties by Dr. Lawrence Weed to aid dealing with the multiplicity of patient problems. The problem list as a precondition is the centerpiece of the problem-oriented medical record (POMR) also called problem-oriented record (POR).
Prior to the digital era, paper records presented a flat list of medical problems to the healthcare professional without the features that are possible with current technology. In modern EHRs a POMR based on a structured problem list can be used for clinical decision support, registries, order management, population health, and potentially other innovative functionality in the future, thereby providing a new incentive to the implementation and use of the POMR.
On both 12 May 2014 and 1 June 2015 a systematic literature search was conducted. From the retrieved articles statements regarding the POMR and related to successful or non-successful implementation, were categorized. Generic determinants were extracted from these statements.
In this research 38 articles were included. The literature analysis led to 12 generic determinants: clinical practice/reasoning, complete and accurate problem list, data structure/content, efficiency, functionality, interoperability, multi-disciplinary, overview of patient information, quality of care, system support, training of staff, and usability.
Two main subjects can be distinguished in the determinants: the system that the problem list and POMR is integrated in and the organization using that system. The combination of the two requires a sociotechnical approach and both are equally important for successful implementation of a POMR. All the determinants have to be taken into account, but the weight given to each of the determinants depends on the organizationusing the problem list or POMR.
Within medical care a patient’s medical record is the main source of patient information. How this medical record is organized varies. A problem-oriented approach is one way of organizing a medical record. Nowadays a medical record is mostly an Electronic Health Record (EHR).
One of the core elements of an EHR (Electronic Health Record) is the problem list. The problem list can be defined as “a list of current and active diagnoses as well as past diagnoses relevant to the current care of the patient” . Opinions differ on what problems should be on the problem list. Therefore it is important to define a policy for maintaining the problem list but such a policy is often hard to implement . The problem list is the centerpiece of the problem-oriented medical record (POMR), also called problem-oriented record (POR). The POMR – a structured organization of patient information per presented medical problem  – was described at the end of the sixties by Dr. Lawrence Weed  to aid dealing with the multiplicity of patient problems. Observations, assessments and healthcare plans are grouped by patient problem. Writing progress notes in the subjective-objective-assessment-plan (SOAP) format can structure the data even further.
There is no clear or widely supported standard in the problem-oriented way of working. Therefore implementation can be difficult. Besides the lack of a standard there are further limitations to the POMR and many modern EHR systems lack functionality. This was already described in the nineties . However the POMR fits in the trend of care becoming more patient-centered. A problem-oriented approach is also useful because patients can relate easily to the problems on the problem list and assess and respond to them . In the Netherlands the intention is to come to a nationwide “model” for a POMR. To learn from previous initiatives and implementation projects where the POMR and/or problem list played an important role we conducted this systematic literature review. Prior to the digital era, paper records presented a flat list of medical problems to the healthcare professional without the features that are possible with current technology. In modern EHRs structured problem lists can be used for clinical decision support, registries, linking data to problems, order management, population health, and potentially other innovative functionality in the future, thereby providing a new incentive to the implementation and use of the POMR. The success of these new uses of the POMR will depend, in addition to many other variables, on the EHR functionality and how it is implemented.
Here, we present a systematic review to identify the determinants that influence the implementation and use of a problem-oriented approach in EHRs.
The objective of this study is to extract determinants of the implementation and use of problem list to support the POMR from recent literature, and thereby support institutions in a successful implementation and use of the POMR.
A literature search was conducted on 12 May 2014 in Embase.com, Medline (OvidSP), Web of Science, Cochrane, PubMed publisher and Google Scholar to find articles from which determinants for the successful implementation and use of a problem list to support the POMR could be extracted. The basic search string was made in Embase.com, the search strings for the other databases were derived from the Embase.com search string. On 1 June 2015 the search was repeated in the databases Embase.com, Medline (OvidSP), Web of Science, Scopus, PsychINFO, Cinahl, Cochrane, PubMed publisher and Google Scholar.
The final search string used in Embase.com was: ((‘medical record’/exp OR ‘medical documentation’/de OR (((medical* OR electronic* OR patient* OR health* OR dental* OR personal* OR hospital* OR nurs* OR psychiatr* OR computer*) NEAR/3 (record* OR documentat*)) OR ehr OR emr OR ehrs OR emrs):ab, ti) AND ((problem* NEAR/3 (‘oriented’ OR ‘orientated’ OR ‘orientation’))):ab, ti OR (CPOMR OR POMR OR (problem-oriented NEXT/3 (record* OR approach* OR system* OR report* OR method*)) OR (problem NEXT/3 (list OR lists OR summar*)) OR problemlist*):ab, ti).
The final search strings for the other databases can be found in the Additional file 1.
Articles were included in two stages. One reviewer (SMJS) made the first selection based on title and abstract, then two reviewers (SMJS, FC) made the selection on full text by first reviewing the full texts individually and secondly discussing all of the individually included articles in face-to-face meetings. If the two reviewers did not agree on a specific inclusion/exclusion of an article, JH made the final decision.
We chose a ten-year period and excluded articles published prior to 2004 because we wanted to focus on recent developments in the use of the POMR. Saturation of determinants was expected to occur within the selected ten-year period. We therefore started both the inclusion/exclusion of articles and the literature analysis with the most recently published articles. The literature analysis was conducted simultaneously with the full text review.
From the retrieved abstracts SMJS removed all articles not written in English, all articles using animal models and all conference abstracts. SMJS then removed articles the title and abstract of which showed that the article did not include some sort of medical record and problem or problem list. When such exclusion could not be certain from the title and abstract the full text was analyzed. These criteria are also summarized in Table 1.
In the full text review we (SMJS and FC) excluded articles focusing only on a technical description of POMR models as technical models are intrinsically related to vendors or specific software. Also, articles were excluded the main subject of which was not the POMR or in which the POMR was merely mentioned as a way to organize medical records without focusing on the use or implementation of the POMR. Thirdly, articles published in 2010 and before 2010 were excluded. This is because the literature analysis showed a saturation of determinants in articles published in 2012 and neither were further determinants found in 2011.
The literature analysis was conducted, starting with the most recent articles until saturation of determinants occurred. In order to extract the determinants SMJS first selected quotes which made a statement about the POMR. After that the quotes were categorized by content. These categorized quotes led to generic determinants, independent of specific vendor or system. FC and JH agreed on the categorization of the quotes and the determinants formulated.
The systematic literature search of 12 May 2014 resulted in 3338 unique articles. Of these 3338 articles SMJS included 297 based on title and abstract. The full text review of these 297 articles led to the inclusion of 33 articles. The literature analysis of these 33 articles showed a saturation of determinants to a total of 12 (see Table 2) in articles published between 2012 and 2014. Articles published in 2011 were then added to the literature analysis to make sure that none of the determinants was overlooked. Articles published in 2011 did not result in extra determinants. Therefore all articles published in 2010 and before were excluded. During the literature analysis we excluded one more article, as the main subject of the article proved not to be about the use of the medical record after all.
On 1 June 2015 the systematic literature search was repeated. It resulted in 4298 unique articles unique in that search. The selection procedure used in the 12 May 2014 search was repeated and led to the inclusion of 5 more articles. None of these articles were found in any of the databases that were added in the 2015 search. This repeated search did not result in any more determinants. The total result of both searches was 38 included articles: 11 from 2011, 7 from 2012, 12 from 2013 and 8 from 2014.
These 38 articles led to 12 generic determinants. In Table 2 these determinants are shown in alphabetical order. In general determinants are rarely perfectly distinct and show considerable overlap. This is also the case with our determinants. For example, usability and functionality cannot be distinguished completely as they are interdependent. Still, the distinction is big enough for these determinants to both be relevant. Our determinants are defined in more detail by relevant statements relating to the determinants in the articles.
The POMR is patient centered and enables clinicians to have a holistic and integral view of the patient. The POMR can give a quick overview of the most important current and past medical issues the patient has. So far there is no international standardized way of working for a POMR or the use of a problem list. Therefore there is a great variety of the use of the problem list within medical practice from no use at all to hospital wide use. Using POMR or even just the problem list on paper is not an easy task to accomplish and can be very cumbersome. Nowadays, computers and other electronic devices are used in every aspect of the medical practice. This technology could be a turning point in the use and the rediscovery of the clinical relevance of the POMR. Our systematic review is therefore timely indicating which determinants play a role in the use, design and implementation of the electronic POMR. From the literature we distilled 12 determinants that influence the use and implementation of the problem list to support the POMR. The determinants are all vendor independent. When these determinants are given adequate attention, they can contribute to a successful implementation of the POMR.
The POMR supports daily clinical practice and clinical reasoning. The Problem list should be the integrating part of the medical record. All data such as observations, assessments and plans (diagnostics, treatments and information to patients) must be associated with a problem on the problem list. Furthermore, all data must be easily retrievable with the option for different views depending on the context.
It is important that healthcare professionals can rely on the content of the problem list. Starting with clear and agreed upon guidelines stating what is a problem to put on the list and how to keep the status of the problem up-to-date. The multi-disciplinary use is an important issue that should be covered by guidelines. These guidelines should be made within the organization the POMR is implemented in, as it is important to match the use of POMR to the size, complexity and previous situation of the organization.
Coded entries to the problem list can attribute to semantic interoperability. Various terminology systems can be used, also in combination, but internationally SNOMED CT is to be preferred. Free text should be an option to indicate that there is a problem when it comes to a hard or impossible observation to code. Also nuances, context or clinical status such as ruled in or ruled out can be of crucial importance. Forced coding without the possibility to add free text can make definitive diagnosis imprecise.
One of the main concerns of clinicians is that new systems require a different way of working. Functionality integration into clinical practice, training of the clinicians, accurate and up-to-date problem lists, and system support can all increase the efficiency and effectiveness of the use of the POMR.
The EHR is an enabler for the POMR in the computer era. Linking problems, interventions, notes, supporting the clinicians with the huge amount of data in EHR’s, context depending views of all data, functions for maintainability i.e. scan function to avoid redundancy may be presented to support the clinicians. Systems should be able to handle free text and misspelled entries with an autosuggest function so coded lists will be used more and more efficient. Clinical decision support is one of the other key functionalities why the digital POMR could succeed. With the enormous growth of knowledge, it is impossible to know everything.
Closely related to data structure/content, efficiency and accuracy. The problem list is an important communication tool. Problems should be recorded unambiguously and only once to prevent miscommunication and redundancy.
With all medical disciplines working together with the patient at the center the problem list should also be multi-disciplinary. A multi-disciplinary list creates a holistic view of the patient and supports patient-centered care. Clear guidelines for the use of the problem list are essential especially in a multidisciplinary setting. The problem list can be used to coordinate care and communicate effectively about the patient among the care team but also with the patient. Use of standardized language is a key element of multi-disciplinary work and problem list use.
Is of vital importance to be quickly and fully informed about what is going on with the patient, especially as many clinicians work under time pressure in daily clinical practice. The problem list should support overview and not increase fragmentation of patient information. Linking data to one or more problems contributes to overview. Filters are important such as chronologically, source and problem oriented. The problem list can function as an index to the patient medical record.
As quality of life for the subject of care i.e., the patient is the main goal for health care providers. The POMR is an enabler to improve quality of care. It enables clinicians to organize and structure data. Problems can be viewed one by one but also in a more multi-disciplinary holistic way. The POMR will also contribute to transparency and accountability. Viewing possibilities and even corrective options for the patient will also contribute to higher quality of care.
As an assistant to give suggestions for diagnosis or treatment as a form of clinical decision support. This is a helpful feature to increase the use of the problem list, but the system should not automatically add problems without the interference of a clinician. Autosuggest and related terms can increase the efficiency of the use of the coded lists. When clinicians experience those features they would be more prone to use coded problem lists. Natural language processing could be helpful, although it depends on how far this is developed and the language in which the NLP is developed.
Both experience in medicine as experience in EHR and problem lists, increase the correct use of the list. When implementing the POMR, make sure proper training is given and training is maintained throughout the years using the POMR. Without proper training, monitoring and feedback clinicians can simply fall back to old habits and use the list incorrectly. Incorrect use of the problem list undermines the reliability of the list and therefore clinicians will use the problem list less. This can become a vicious circle.
Besides functionality usability is of utmost importance. Functions of a system can be very advanced and extensive but if the user interface is not intuitive and easy to use and without useful and fast feedback it will be time consuming with the risk that people do not use it. Encoded libraries should be fast and be able to identify synonyms and misspelled entries. The use of best practice advice options can improve the usability substantially.
Looking at the determinants we can distinguish two main subjects: the system in which the POMR is integrated and the organization with its users in which the system is used. Both the system and the organization should be well prepared for using the POMR. Functionality, usability, system support, overview of patient information, interoperability, supporting clinical reasoning and data structure/content can be designed, naturally while designing the system the maturity of the organization and associated policies has to be taken into account. The organization needs to be ready and willing to use the POMR. More specifically, willing to integrate the problem list into daily routine, using it multi-disciplinary, discussing it with the patient, be sufficiently trained and follow the guidelines on using the problem list. This requires a sociotechnical approach and is equally important for successful implementing a POMR. All the determinants have to be taken into account, but the weight given to each of the determinants depends on the organization the POMR and problem list is used and implemented in. Therefore we did not distinguish important and slightly less important determinants.
This study shows that there is more to a successful implementation of a problem list to support the POMR than the technical software and hardware associated with electronic patient records. Both the technical and organizational aspects should be taken into account while implementing a problem list or POMR. The statements defining our determinants in more detail can be of use here.
The successful implementation and use of a problem list to support the POMR are related to 12 vendor independent determinants. All these determinants taken into account together appear to be a critical success factor for a successful implementation. We have not assigned weight to our determinants as their relative importance depends on various factors and should be determined within the organization the implementation is planned for.
This research has its limitations. Firstly, we wanted to focus on the latest insights and performed a systematic literature search, and analyzed the articles of the last five years. As saturation occurred within these five years we are confident that we managed to gain the latest insight in the use of a problem list and the POMR. Still, there is always a chance of there having been relevant older articles.
Secondly, as some determinants are closely related, describing them separately may come across as somewhat unnatural. Despite these limitations the results of this systematic review can contribute to a better implementation and use of a problem list and the POMR.
Further research is required to establish the predictive quality of our determinants. Studies of the use of a problem list to support the POMR in daily clinical practice over several years are rare, especially generalizable studies combining qualitative and quantitative evaluation. Also the linking of data to items on a problem list is hardly scientifically described. Further research needs to focus on the use of the POMR and the determinants. It would be advisable to develop a scorecard to objectify the relevance of a determinant in a successful implementation of the POMR.
EHR, electronic health record; POMR, problem-oriented medical record; SNOMED, systematized nomenclature of medicine; ICD 9–10, international classification of diseases and related health problems
[cited 2016 04–05]; Available from: http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms.
Shea CM, et al. Assessing organizational capacity for achieving meaningful use of electronic health records. Health Care Manage Rev. 2014;39(2):124–33.
[27-11-2015]; Available from: http://medical-dictionary.thefreedictionary.com/problem-oriented+medical+record.
Weed, L.L., Special article: Medical records that guide and teach. New England Journal of Medicine. 1968: imed.stanford.edu.
Salmon, P., et al., Taking the problem oriented medical record forward. Proc AMIA Annu Fall Symp, 1996: p. 463–7.
Wright A, et al. Increasing patient engagement: patients’ responses to viewing problem lists online. Appl Clin Inform. 2014;5(4):930–42.
Bormel J. Problem lists are the keys to meaningful use. Put the big picture on your problem list. Health Manag Technol. 2011;32(2):40–1.
Bossen C. Accounting and co-constructing: the development of a standard for electronic health records, Computer Supported Cooperative Work (CSCW). 2011.
Holmes C. The problem list beyond meaningful use. Part I: The problems with problem lists. J AHIMA. 2011;82(2):30–3. quiz 34.
Kouematchoua Tchuitcheu G, Rienhoff O. Options for diabetes management in sub-Saharan Africa with an electronic medical record system. Methods Inf Med. 2011;50(1):11–22.
Scichilone RA. Standardizing problem lists in physician practices. J AHIMA. 2011;82(11):50–1.
Wright, A., F.L. Maloney, and J.C. Feblowitz, Clinician attitudes toward and use of electronic problem lists: a thematic analysis. BMC Med Inform Decis Mak, 2011. 11((Wright A.) Brigham and Women’s Hospital, Boston, MA, USA.): p. 36.
Cillessen FH, de Vries Robbe PF. Modeling problem-oriented clinical notes. Methods Inf Med. 2012;51(6):507–15.
Holmes, C., et al., Healthcare provider attitudes towards the problem list in an electronic health record: a mixed-methods qualitative study. BMC Med Inform Decis Mak, 2012. 12((Holmes C.) Brigham and Women’s Hospital, 1 Brigham Circle, Boston, MA 02120, USA.): p. 127.
Wright A, et al. Improving completeness of electronic problem lists through clinical decision support: A randomized, controlled trial. J Am Med Inform Assoc. 2012;19(4):555–61.
Cimino JJ. Improving the electronic health record—are clinicians getting what they wished for? JAMA. 2013;309(10):991–92.
Luna D, et al. Accuracy of an electronic problem list from primary care providers and specialists. Stud Health Technol Inform. 2013;192:417–21.
Acker B, et al. Problem list guidance in the EHR. J AHIMA. 2011;82(9):52–8.
Campion FX, Richter JM. High-level adoption of electronic health records. J Med Pract Manage. 2011;27(1):50–6.
Pacheco, J.A., W. Thompson, and A. Kho, Automatically detecting problem list omissions of type 2 diabetes cases using electronic medical records. AMIA Annu Symp Proc, 2011. 2011((Pacheco J.A.) Northwestern University Feinberg School of Medicine, Chicago, IL, USA.): p. 1062–1069.
Wright A, et al. A method and knowledge base for automated inference of patient problems from structured data in an electronic medical record. J Am Med Inform Assoc. 2011;18(6):859–67.
Matney SA, et al. Development of the nursing problem list subset of SNOMED CT (registered trademark). J Biomed Inform. 2012;45(4):683–8.
Wright A, et al. Use of an electronic problem list by primary care providers and specialists. J Gen Intern Med. 2012;27(8):968–73.
Collins S, et al. A continuum of sociotechnical requirements for patient-centered problem lists. Stud Health Technol Inform. 2013;192:889–93.
Falck S, et al. A trial of indication based prescribing of antihypertensive medications during computerized order entry to improve problem list documentation. Int J Med Inform. 2013;82(10):996–1003.
Galanter W, et al. Indication-based prescribing prevents wrong-patient medication errors in computerized provider order entry (CPOE). J Am Med Inform Assoc. 2013;20(3):477–81.
Kadlec L. Resolving problem list problems. HIM’s role in maintaining an effective EHR problem list. J AHIMA. 2013;84(11):58–9.
Makam AN, et al. Use and satisfaction with key functions of a common commercial electronic health record: a survey of primary care providers. BMC Med Inf Decis Mak. 2013;13:86.
Plazzotta F, et al. Natural language processing and inference rules as strategies for updating problem list in an electronic health record. Stud Health Technol Inform. 2013;192:1163.
Ancker JS, et al. How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use. J Am Med Inform Assoc. 2014;21(6):1001–8.
Samal L, et al. Electronic problem list documentation of chronic kidney disease and quality of care. BMC Nephrol. 2014;15(1):1–6.
Kumarapeli P, De Lusignan S. Using the computer in the clinical consultation; setting the stage, reviewing, recording, and taking actions: Multi-channel video study. J Am Med Inform Assoc. 2013;20(E1):e67–75.
Walton SM, et al. A trial of inpatient indication based prescribing during computerized order entry with medications commonly used off-label. Appl Clin Inform. 2011;2(1):94–103.
McCoy AB, et al. Development and evaluation of a crowdsourcing methodology for knowledge base construction: identifying relationships between clinical problems and medications. J Am Med Inform Assoc. 2012;19(5):713–8.
Hodge CM, et al. Problem management module: an innovative system to improve problem list workflow. AMIA Annu Symp Proc. 2014;2014:661–70.
Mehta N, Vakharia N, Wright A. EHRs in a web 2.0 world: time to embrace a problem-list wiki. J Gen Intern Med. 2014;29(3):434–6.
Walsh CG, et al. Enabling claims-based decision support through non-interruptive capture of admission diagnoses and provider billing codes. AMIA Annu Symp Proc. 2014;2014:1950–9.
Mowery D, et al. Building an automated SOAP classifier for emergency department reports. J Biomed Inform. 2012;45(1):71–81.
Klann JG, et al. Health care transformation through collaboration on open-source informatics projects: integrating a medical applications platform, research data repository, and patient summarization. Interact J Med Res. 2013;2(1):e11.
Bredfeldt CE, et al. Training providers: beyond the basics of electronic health records. BMC Health Serv Res. 2013;13:503.
Feblowitz J, et al. Provider use of and attitudes towards an active clinical alert: a case study in decision support. Appl Clin Inform. 2013;4(1):144–52.
Bakel LA, et al. A quality improvement study to improve inpatient problem list use. Hosp Pediatr. 2014;4(4):205–10.
Wichor Bramer of the medical library of the Erasmus Medical Centre provided assistance with the search strings. His help was greatly appreciated.
This research received no specific grant from any funding agency in the public, non-profit or commercial sector.
Availability of data and materials
The datasets during and/or analyzed during the current study available from the corresponding author on reasonable request.
SMJS, did the majority of the work on the literature review and the literature analysis work, read all the title abstracts and was the first reviewer in the full text reviews. Besides this she wrote the first draft of the article and adjusted the article with the help of comments made by the two other authors. The whole article except for the discussion and background was rewritten by SMJS on the basis of reviewers’ and editor comments. The revised background provided by FC was edited by SMJS. In the second revision SMJS rewrote the inclusion/exclusion criteria. FC, was the second reviewer in the whole text review process. He wrote the background and commented on the drafts of the article presented by SMJS. He rewrote the background on the basis of reviewers’ and editor comments. In the second revision FC changed the title and revised the rest of the article according the reviewers’ comments. JH came up with the idea of this study, supervised the whole process and helped determine the appropriate determinants. Also, he commented on the drafts of the article presented by SMJS. He made minor adjustments to the discussion in the first revision. In the second revision he did the final check on the article.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
About this article
Cite this article
Simons, S.M.J., Cillessen, F.H.J.M. & Hazelzet, J.A. Determinants of a successful problem list to support the implementation of the problem-oriented medical record according to recent literature. BMC Med Inform Decis Mak 16, 102 (2016) doi:10.1186/s12911-016-0341-0
- Problem-oriented medical record
- Electronic Health Record