This article has Open Peer Review reports available.
Sixteen years of ICPC use in Norwegian primary care: looking through the facts
© Botsis et al; licensee BioMed Central Ltd. 2010
Received: 10 June 2009
Accepted: 24 February 2010
Published: 24 February 2010
The International Classification for Primary Care (ICPC) standard aims to facilitate simultaneous and longitudinal comparisons of clinical primary care practice within and across country borders; it is also used for administrative purposes. This study evaluates the use of the original ICPC-1 and the more complete ICPC-2 Norwegian versions in electronic patient records.
We performed a retrospective study of approximately 1.5 million ICPC codes and diagnoses that were collected over a 16-year period at 12 primary care sites in Norway. In the first phase of this period (transition phase, 1992-1999) physicians were allowed to not use an ICPC code in their practice while in the second phase (regular phase, 2000-2008) the use of an ICPC code was mandatory. The ICPC codes and diagnoses defined a problem event for each patient in the PROblem-oriented electronic MEDical record (PROMED). The main outcome measure of our analysis was the percentage of problem events in PROMEDs with inappropriate (or missing) ICPC codes and of diagnoses that did not map the latest ICPC-2 classification. Specific problem areas (pneumonia, anaemia, tonsillitis and diabetes) were examined in the same context.
Codes were missing in 6.2% of the problem events; incorrect codes were observed in 4.0% of the problem events and text mismatch between the diagnoses and the expected ICPC-2 diagnoses text in 53.8% of the problem events. Missing codes were observed only during the transition phase while incorrect and inappropriate codes were used all over the 16-year period. The physicians created diagnoses that did not exist in ICPC. These 'new' diagnoses were used with varying frequency; many of them were used only once. Inappropriate ICPC-2 codes were also observed in the selected problem areas and for both phases.
Our results strongly suggest that physicians did not adhere to the ICPC standard due to its incompleteness, i.e. lack of many clinically important diagnoses. This indicates that ICPC is inappropriate for the classification of problem events and the clinical practice in primary care.
Medical standards are essential resources for clinical decision making and decision support, audit, governance, research, education and training . Medical classifications are medical standards that are developed to facilitate the primary and secondary use of clinical data. The various versions of Systematized Nomenclature of Medicine (SNOMED), International Classification of Diseases (ICD) and International Classification for Primary Care (ICPC) are some examples of medical classifications.
ICPC was first published in 1987 by the WONCA (World Organization of Family Physicians) International Classification Committee (WICC) as a tool to order the domain of family practice in the format of episodes of care . The current version (ICPC-2) is the outcome of many revisions over the first ICPC-1 version . It has been translated in many languages and it is used as part of the primary care practice in several countries.
General practitioners (GPs) are often under-motivated to code their consultation data . The quality of electronic patient record (EPR) data in primary care appears to be a major issue for computerized systems that utilize other terminologies as well, such as the Read clinical classification . Porcheret et al studied the use of Read codes in a UK region and found that the coding completeness for all primary care centre consultations with a physician ranged from 5% to 97% between practices when the system did not demand a code for the storage of clinical narratives .
ICPC coding has been compulsory for all GPs in Norway since 1992 . The Norwegian Centre for Informatics in Health and Social Care (KITH) maintains all the electronic versions of ICPC on behalf of WICC and supports the download of both the English and Norwegian versions . In order to better cover the clinical needs, KITH extended the Norwegian ICPC-2 to include more diagnoses than the English version; thus, each code may correspond to more than one diagnosis for the same problem area.
The present study evaluates the ICPC use in primary care EPRs and focuses on missing and non-existing codes, and diagnoses that do not map the diseases, the symptoms or the procedures of the standard ICPC-2 classification. The extent of the problems with ICPC use was assessed by using a large data set that was collected over a 16-year period in Norway. Based on our findings various aspects are discussed and potential directions for future work are suggested.
The data set that was used in this study was extracted from primary care PRO blem-oriented electronic MED ical records (PROMEDs); PROMEDs operated from 1984 to 2008. The first PROMED version (1984) did not include any disease classification and the diagnoses were entered manually by the physicians. This version was developed in Clipper 87 and Clipper 5 programming languages while the data was stored in dBASE databases.
The functionality for recording ICPC-1 diagnoses and codes was added to RPOMED system in 1992. The period from 1992 to 1999 was considered as a transition phase and physicians were allowed to reuse patient diagnoses (ICPC-adjusted or not) that were stored in the system before 1992 either associating them with an ICPC-1 code or not.
The PROMED version that was used in the regular phase (2000-2008) was built in Ms Visual Basic 6. The dBASE databases were automatically converted to a similar format in Ms Access 97 databases retaining the data that was collected in the period 1984-1999. The Access 97 databases were accessed using ActiveX Data Objects (ADO) and Structured Query Language (SQL). Both PROMED versions ran on personal computers that were interconnected over a Local Area Network (LAN).
PROMED included various modules for narratives, laboratory routines, drugs and prescriptions, referrals, discharge notes, electronic data exchange, reimbursement, etc. The current study used a part of the narrative module and the ICPC classification register only.
It should be noted that physicians were free to store clinical narratives for pneumonia, pregnancy and hypertension in separate problem histories. They also decided how to partition their patients' problems and how to organize the list of events during the consultation. Subsequently, the physicians' overall feedback determined the evolution of the PROMED structure.
The first time an ICPC diagnosis/code is used for a new problem (black boxes; Figure 1) the corresponding diagnosis and code is selected from the ICPC register (see below). Considering that problem histories may evolve, e.g. acute cystitis→acute pyelonephritis→septicaemia, whenever a problem's diagnosis or code is changed, the new ICPC diagnosis and code is selected from the ICPC register again.
Diagnoses and codes associated with events can be reused, typically when a new narrative on diabetes, i.e. a new diabetes event, is added to the diabetes problem; an example is shown in Figure 2. Here, the patient has two problems: septicaemia, which is selected (highlighted in blue in the left list; Figure 2) and diabetes. All the stored narratives for septicaemia are displayed in the middle grey field. The problem history for the selected problem is displayed in inverse chronological order (three problem events in the right list; Figure 2). When an event is selected in the problem history list only the narratives corresponding to this event are displayed (middle grey field; Figure 2). In order to reuse a diagnosis-code combination the physician has to select an event from the problem history list and press the button 'SAVE AS SAME PROBLEM' (Figure 2).
In 2004 all problem events that contained ICPC-1 all codes were automatically updated to meet the latest Norwegian ICPC-2 coding schema using a data conversion file that was provided by KITH. Nevertheless, it should be mentioned that the diagnosis texts were not converted.
Code 'D01' corresponds to the 'Abdominal pain/cramps general' single diagnosis in the English ICPC-2 version and the ICPC-1 Norwegian version; the same code corresponds to 11 text field options in the ICPC-2 Norwegian version, as it is shown in the first column of the table.
Diagnosis text field (Norwegian ICPC-2)
Diagnosis text field (English translation)
Abdomen symptomer/plager INA*
Abdomen symptoms/complaints INA
Abdominal pain/cramp general
Stomach acute pain
Stomach pain, unspecified
Smerte abdomen uspesifikk
Pain abdomen unspecified
Three month colic
L99 ('Musculoskeletal disease other') with 167 options,
T99 ('Endocrine/metabolic/nutritional disease other') with 93 options and
L82 ('Congenital anomaly musculoskeletal') with 82 options.
Only 104 codes are comparable to codes in the English version and are associated with one diagnosis text option only, e.g. X19 ('Postmenopausal bleeding') and W21 ('Concern about body image related to pregnancy'). The brief English ICPC-2 is too limited for creating accurate referrals for specialists, pathologists and radiologists.
The PROMED user group expressed serious concerns about the lack of important diagnoses in the Norwegian ICPC-2 and characterized the existing ICPC-2 diagnosis register as incomplete for clinical and administrative work. Therefore they demanded more diagnoses options than those existing in the ICPC-2 list. Consequently, new routines were embedded in PROMED to allow physicians adding their own diagnosis text still for valid ICPC-2 codes (Figure 3).
The data set that was used for the analysis included only the date, the diagnosis and the code fields of the problem events; any patient and physician identifiers as well as geographic origin data were excluded. The final set was delivered by the vendor in accordance with a written agreement from the physicians. The Regional Ethics Committee did not consider the extracted data to contain sensitive information (Ethical approval number: P REK Nord 41/2009).
Absolute number and collection period for the extracted consultation data per site (after January 2, 1992)
First Event Date
Last Event Date
Problem Events (#)
The official Norwegian ICPC-2 version distributed by KITH served as the basis for analyzing the problem events in each Ms Access database. Specific SQL queries were developed and applied in a 3-step process. In each step all the problem events (records) that passed the previous step were filtered out according to the following criteria:
Step 1: The problem events with an entry in the code field were selected and passed to the next step; records without a code did not enter the next step.
Step 2: It was examined whether the codes of these problem events corresponded to a code in the original ICPC-2 file; only records with valid ICPC-2 codes entered step 3.
Step 3: The problem events from step 2 were queried for their match to the expected ICPC-2 diagnosis text.
The total number of events in all sites (centres and GPs) was the input for the first step; the output was the remaining problem events after applying the appropriate SQL queries. Also, the number of events per site was calculated in each step.
In order to get better insight into the physicians initiative to add new diagnoses, four common clinical problem areas (pneumonia and lower respiratory tract infection, diabetes, tonsillitis and anaemia) were further studied. The events in a problem area, e.g. hereditary haemolytic anaemia and iron deficiency anaemia, were identified using specific SQL queries that contained the appropriate terms and wildcards. Subsequently, the appropriate and inappropriate ICPC use for the four areas was evaluated both for the transition and the regular phase; subsequently, the corresponding frequencies were calculated. SQL queries were also used to study the 'new' diagnoses that were added by the physicians. First, the 'new' diagnoses in the four problem areas were extracted automatically and, second, they were manually evaluated either for the use of synonyms and more specific terms or for the introduction of completely new diagnoses.
SPSS for Windows (version 15.0, SPSS, Chicago, IL) was used for the statistical analysis.
Total number of problem events per site and their specific distribution (percentages are calculated over the total number of problem events per site) according to the criteria set in each step.
Problem events (#)
Missing codes (%)
Code mismatch (%)
Diagnosis text mismatch (%)
Code entries did not always correspond to a correct ICPC-2 code. A mismatch appeared in 4.0% of the total problem events (Table 3). Excluding Centre 1, which is an outlier with 12.7% mismatch, the range for the remaining was between 0.3% and 6.5%. Also, the percentage of problem events with correct ICPC-2 codes was 89.8%. This high value can be explained by the fact that physicians had to use valid codes in order to be reimbursed for their services after 2000.
In most cases, event diagnoses did not match the standard ICPC-2 text (53.8%; Table 3). Particularly, in three sites (GP 7, GP 8 and GP 9) the percentage was remarkably high (up to 82.1%) while lower (but still high) in the rest. Summarizing the results, only 36.0% of the approximately 1.5 million problem events met all the criteria and included a valid ICPC-2 code followed by the correct ICPC-2 diagnosis.
The identification of invalid ICPC-2 diagnoses shows that physicians added 'new' diagnoses to their local ICPC-2 database and used them to classify the problem events. 'New' diagnoses may have been used once, a few times or repeatedly. For example at Centre 1, 3834 'new' diagnoses were used for 49.5% of the problem events; interestingly, 793 of them were used only once, while remarkably less (<50) were reused for more than 10 times.
Moreover, the introduction of 'new' diagnoses was examined specifically for four clinical problem areas. The number of different 'new' diagnoses for pneumonia, diabetes, tonsillitis and anaemia were 56, 114, 78 and 89 respectively. In the case of pneumonia names of microorganisms (mycoplasma, hemophilus influenza, pneumococcal, bacterial), time sequence (acute, relapsing), process (control, observation), anatomical site (right side) and consequence (sequel of) were added.
The KITH ICPC-2 version contained 15 entries with the substring 'tonsi'. Relapsing events and information on treatment were found in the tonsillitis events, however not in the ICPC-2 standard. Also, the ICPC-2 register has an entry for streptococci, which was spelled differently in the examined events. Additionally, tonsillitis was combined with mononucleosis in the 'new' diagnoses, but not in KITH's ICPC-2 version; surprisingly, there were no specifications of mononucleosis in the standard ICPC-2.
Regarding diabetes the KITH ICPC-2 version had 25 main entries and four more for glucose-related problems. Glucosuria was diagnosed in the examined problem events, but the corresponding entries in ICPC-2 included the descriptive term 'sugar in the urine'. In some cases two main problem events were combined in the diagnosis field, e.g. anaemia and diabetes.
The standard ICPC-2 has 25 entries containing the substring 'anemi' most of which were also spelled differently in the examined events. Also, ICPC-2 does not contain information for either the degree, e.g. 'severe', or the cause of bleeding, e.g. 'hypermenorrhoea'; this information was found in the 'new' diagnoses for anaemia.
In all the problem areas, the uncertainty of diagnosis was stated by a question mark; the differential diagnosis was denoted by the inclusion of clinical problems having similar symptoms and signs. The physicians had used many more specific terms and aspects that did not exist in ICPC.
The problem events with appropriate and inappropriate ICPC codes (before and after 2000) for the four problem areas.
Problem events (#)
% of the total events per area
Median ± SD
444 ± 93
0 ± 1
1222 ± 449
114 ± 16
543 ± 107
13 ± 4
702 ± 181
0 ± 11
Mean ± SE
427 ± 32.9
1 ± 0.5
1181 ± 158.7
117 ± 5.6
510 ± 37.8
4 ± 1.4
656 ± 64.1
4 ± 4.0
Problem events (#)
% of the total events per area
Median ± SD
611 ± 199
1 ± 2
2150 ± 381
263 ± 58
442 ± 128
13 ± 4
1138 ± 109
1 ± 1
Mean ± SE
676 ± 70.5
1 ± 0.6
2234 ± 134.8
278 ± 20.4
498 ± 45.2
12 ± 1.5
1112 ± 38.4
1 ± 0.4
The present study shows that a low percentage (only 36.0%) of the codes and diagnoses that were assigned to problem events agreed with the ICPC-2 standard; mismatches were observed at all primary care sites. Our results agree with Tai et al who reported that current systems for clinical coding promote the diversity rather than the consistency of clinical coding . Clinical practice requires accurate diagnoses that reflect the patients' clinical problems. Standards like ICPC are thought to facilitate clinical research, administrative work, epidemiological studies and information exchange between computerized health care systems within the same or different countries. However, the reduction of diagnostic options to the 684 crude classes of the English ICPC version ignores not only the complexity of clinical problems, but also the necessity for accurate information. Our results show that physicians demanded and actually used significantly more diagnoses than the 6390 of the Norwegian ICPC-2. Thus, it is strongly suggested that even the extended ICPC-2 is inappropriate for clinical work.
The physicians created many 'new' diagnoses and assigned them to problem events. In the four selected problem areas, the 'new' diagnoses covered various aspects such as time, progression, degree, aetiology, anatomical sites, treatments and complications; they also stated the uncertainty in diagnosis and included the differential diagnosis if needed. Even though this is a small subset of only four clinical problems, it is obvious that ICPC is missing important diagnostic information. These findings also reveal the fundamental problem with the structure of ICPC (also met in ICD): if diagnoses were presented as one list on the basis of systematic combinations of dimensions (e.g.100 body regions, 5 labels for time course dimension, 10 aetiology agents, 10 pathogenetic mechanisms, 5 degrees of severity, etc.) there would be a long list including millions of elements. The appropriate way (as in SNOMED) could be the selection of one element from each dimension and the construction of a diagnosis [10–12].
The PROMED functionality that allowed the modification of codes and diagnoses might appear to introduce a limitation in our study. However, this should not be attributed to the PROMED system but rather to the fact that physicians actively created and assigned the appropriate diagnoses to the problem events when they were not available in ICPC. Considering that this required additional work load it could be hypothesized that physicians would avoid giving incorrect diagnostic labels to their patients if they had an alternative. It is also obvious that their primary concern was to avoid patients' misclassification, which could lead to wrong treatments and/or inappropriate diagnoses on referrals or sick certificates.
The low number of records with code mismatch compared to the number of records with diagnosis text mismatch was expected given that correct ICPC codes were required for reimbursement purposes. Problem events without a code occurred during the transition phase only, when the PROMED system incorporated ICPC-1 version and allowed the recording of an event without a code. Even though this was expected, it consists an important finding since it underlines the necessity for EPRs to disallow the lack of codes.
It could be argued that our results are not representative of the ICPC use in primary care. However, the problem events that were investigated (approximately 1.5 million) reflect the demands for diagnoses and codes over a huge number of problem events and for a long period of study; the number of physicians involved is also sufficient. Even though these numbers strongly suggest that our results are representative for ICPC use, further studies are required to validate our findings.
Letrilliart et al concluded that when software incorporates large terminologies, physicians will use it only if they are special trained and rewarded . In this context, it might be argued that our physicians were not appropriately trained. It should be mentioned though that they were all trained adequately and were provided with paper-based and online manuals; additionally, the correct use of ICPC was rewarded. Thus, the lack of training and reward is not a solid argument for the validity of our results.
Jordan et al reported that GPs have personal preferences for certain codes, which are not always appropriate, and that they feel pressured to use them even if the codes are not correct for a patient case . The physicians in our cohort decided to put extra effort in order to accomplish the task of adding 'new' diagnoses even though they used most of them only once. We foresee two alternative solutions for this problem. The first is to allow physicians adding diagnosis-code combinations when necessary, as in PROMED; unfortunately, such an approach would ruin the standard. The other alternative is the development of a well-structured dimensional classification like SNOMED, but such a classification should have a solid structure based on clinical practice.
All major classifications, e.g. ICD, ICPC and SNOMED are currently undergoing (major) international revisions. This indicates either problems of structure or problems of content as it was shown in the current study. Full insight into the reasons for the inappropriate use of codes and diagnoses would require a thorough analysis of their documentation in laboratory results, clinical narratives and elsewhere. This could be accomplished only in a dedicated research project that would incorporate full access to patients' data as well as Natural Language Processing (NLP) and other advanced computerized techniques; this is definitely beyond the goals of the current study.
Standards like ICPC are supposed to facilitate clinical research, development, epidemiological studies and data exchange. However, our results strongly suggest that ICPC is inappropriate for clinical work and raise serious objections against its applicability. An in depth revision of ICPC-2 or possibly an entirely new approach is needed. We suggest a combinatorial approach (as in SNOMED), but this would require a complete reworking of ICPC structure. Whether the barriers to such a direction can be overcome remains to be investigated.
We thank Valsamo Anagnostou, MD, for the fruitful discussions during data analysis and her suggestions. This work was partly funded by the Research Council of Norway, Project No: 174934.
- Gardner M: Why clinical information standards matter. BMJ. 2003, 326 (7399): 1101-1102. 10.1136/bmj.326.7399.1101.View ArticlePubMedPubMed CentralGoogle Scholar
- Lamberts H, Wood M: The birth of the International Classification of Primary Care (ICPC). Serendipity at the border of Lac Leman. Fam Pract. 2002, 19 (5): 433-435. 10.1093/fampra/19.5.433.View ArticlePubMedGoogle Scholar
- WONCA: ICPC-2-R: International Classification of Primary Care. 2005, Oxford: Oxford University PressGoogle Scholar
- de Lusignan S, Wells SE, Hague NJ, Thiru K: Managers see the problems associated with coding clinical data as a technical issue whilst clinicians also see cultural barriers. Methods Inf Med. 2003, 42 (4): 416-422.PubMedGoogle Scholar
- Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.View ArticlePubMedPubMed CentralGoogle Scholar
- Porcheret M, Hughes R, Evans D, Jordan K, Whitehurst T, Ogden H, Croft P: Data quality of general practice electronic health records: the impact of a program of assessments, feedback, and training. J Am Med Inform Assoc. 2004, 11 (1): 78-86. 10.1197/jamia.M1362.View ArticlePubMedPubMed CentralGoogle Scholar
- Brage S, Bentsen BG, Bjerkedal T, Nygard JF, Tellnes G: ICPC as a standard classification in Norway. Fam Pract. 1996, 13 (4): 391-396. 10.1093/fampra/13.4.391.View ArticlePubMedGoogle Scholar
- International Classification of Primary Care 2nd edition, electronic version. [http://www.kith.no/templates/kith_WebPage____1062.aspx]
- Tai TW, Anandarajah S, Dhoul N, de Lusignan S: Variation in clinical coding lists in UK general practice: a barrier to consistent data entry?. Inform Prim Care. 2007, 15 (3): 143-150.PubMedGoogle Scholar
- Bassøe C-F: Combinatorial clinical decision-making. Doctoral thesis. 2007, Bergen, Norway: University of BergenGoogle Scholar
- Bassøe C-F: A data structure for decision support systems, medical expert systems and clinical decision making. MEDINFO: 2007. 2007, 350-Google Scholar
- Bassøe C-F: Representing health, disorder and their transitions by digraphs. Stud Health Technol Inform. 2008, 136: 133-138.PubMedGoogle Scholar
- Letrilliart L, Gelas-Dore B, Ortolan B, Colin C: Prometheus: the implementation of clinical coding schemes in French routine general practice. Inform Prim Care. 2006, 14 (3): 157-165.PubMedGoogle Scholar
- Jordan K, Porcheret M, Croft P: Quality of morbidity coding in general practice computerized medical records: a systematic review. Fam Pract. 2004, 21 (4): 396-412. 10.1093/fampra/cmh409.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/10/11/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.