- Research article
- Open Access
Feasibility of extracting data from electronic medical records for research: an international comparative study
BMC Medical Informatics and Decision Making volume 16, Article number: 90 (2016)
Electronic medical records (EMR) offer a major potential for secondary use of data for research which can improve the safety, quality and efficiency of healthcare. They also enable the measurement of disease burden at the population level. However, the extent to which this is feasible in different countries is not well known. This study aimed to: 1) assess information governance procedures for extracting data from EMR in 16 countries; and 2) explore the extent of EMR adoption and the quality and consistency of EMR data in 7 countries, using management of diabetes type 2 patients as an exemplar.
We included 16 countries from Australia, Asia, the Middle East, and Europe to the Americas. We undertook a multi-method approach including both an online literature review and structured interviews with 59 stakeholders, including 25 physicians, 23 academics, 7 EMR providers, and 4 information commissioners. Data were analysed and synthesised thematically considering the most relevant issues.
We found that procedures for information governance, levels of adoption and data quality varied across the countries studied. The required time and ease of obtaining approval also varies widely. While some countries seem ready for secondary uses of data from EMR, in other countries several barriers were found, including limited experience with using EMR data for research, lack of standard policies and procedures, bureaucracy, confidentiality, data security concerns, technical issues and costs.
This is the first international comparative study to shed light on the feasibility of extracting EMR data across a number of countries. The study will inform future discussions and development of policies that aim to accelerate the adoption of EMR systems in high and middle income countries and seize the rich potential for secondary use of data arising from the use of EMR solutions.
Characteristics and benefits of electronic medical records (EMR)
Electronic medical records (EMR) offer a major potential to improve the safety, quality and efficiency of healthcare . The International Organisation for Standardization defines EMR (often referred to as electronic health or patient records, computerised medical or patient records and Electronic Health Record) as a “repository of information regarding the health status of a subject of care, in computer processable form” . Thus, EMRs are an electronic version of patients’ health records which can be used for input, storage, display, retrieval and sharing of information . Accurate and complete data from EMRs can be used by practitioners to improve the safety, quality and efficiency of care. For example, EMRs have been used to provide physicians with data regarding type 2 diabetic patients, which has shown to improve process measures such as an increased number of foot and eye check-ups and biological outcomes including glycated haemoglobin (known as “HbA1c”) and blood glucose .
There are several secondary uses of data from EMR that can improve healthcare services, including population and disease research, detection of adverse drug reactions, assessment of outcomes of interventions, shaping health policies, and guidance on effective use of resources [5–7]. EMR data can be an indispensable source for population and disease research especially when it can be linked with mortality records and genetic data. Data can be made available for research through different mechanisms; for example in the United Kingdom, large primary care databases, the Clinical Practice Research Datalink system , the Health Improvement Network  and QResearch , provide access to National Health Service observational data and interventional research. This data is used for various areas of research including, cardiovascular disease, mental health and pharmacoepidemiology . EMR data are also invaluable to the pharmaceutical industry which, for example, can use data to improve the safety of medication use by monitoring side-effects and interactions with other medication . A major potential benefit of secondary data analysis of EMR data is its use to improve global burden of disease measurement, especially, though not exclusively, of non-communicable diseases .
Barriers to secondary use of EMR data
Despite the large investments in EMR systems worldwide, some countries have yet to realise the potential of EMR to improve the quality, safety and efficiency of healthcare [13, 14]. In many settings, electronically collected data is often not analysed at aggregate level, which limits our understanding regarding a population’s health needs, disease management, quality of management of chronic conditions and outcomes of interventions at both primary care and hospital settings . There are several barriers constraining the potential of EMR data for secondary uses. An important barrier in some cases is the poor accuracy and completeness of EMR data [15, 16]. Other barriers include legal and ethical considerations required for secondary use of EMR data . Information governance procedures can be a barrier as obtaining approvals to extract and analyse EMR data may be challenging given the novelty of this type of research in certain countries. Moreover, the diversity in EMR systems across different settings and differences in legal and information governance systems, social norms and frameworks pose additional challenges for obtaining approvals. Therefore, identifying and addressing current barriers towards secondary use of EMR data is of great importance to facilitate greater use of EMR solutions.
State of EMR adoption internationally
Currently, there is limited evidence on the adoption of EMR internationally [5, 17]. Previous assessments have mainly focussed on the adoption of EMR systems in the United States and some other countries [4, 17–21]. A recent systematic review on the impact of EMR implementations found that nearly two-thirds of EMR studies took place in the United States (n = 62), a small number of studies were conducted in England and Denmark (n = 5), Canada (n = 3), and Norway (n = 4), and an even smaller number (n = 1–2) in other countries . Moreover, according to the same review, there have been few international comparisons of EMR ; the review found only one paper comparing EMR implementations between countries (United States and Sweden) . Given the novelty of using data from EMR in some countries, information regarding ethical and legal procedures that are required is also scarce.
Aim of this study
This study aimed to assess information governance procedures for extracting data from EMR across 16 countries, using the management of type 2 diabetic patients as an exemplar. A secondary aim of the study was to explore the extent of EMR adoption and the quality and consistency of EMR data in 7 countries. Thereby, this study identifies barriers towards secondary uses of EMR data across different countries, which can be used to facilitate future analysis of EMR data.
This international comparative study covered 16 countries (Table 1). We assessed the adoption of EMR, quality of their data in 7 countries, Brazil, Italy, South Africa, Saudi Arabia, Korea, Rep., Taiwan and United Arab Emirates (UAE), and information governance processes for secondary uses of data in all 16 countries.
This study was commissioned by IMS Health (http://www.imshealth.com/) and they chose the countries and developed the questionnaires. The countries were selected for a planned non-interventional study, which included type 2 diabetes mellitus patients. The selection of countries was made based on preliminary expert advice and knowledge whether countries had a reasonable level of EMR adoption and limited fragmentation of EMR providers. The typical treatment settings for type 2 diabetes patients were general physicians and specialists in hospitals, but varied between countries (Additional files 1 and 2).
The study had a multi-method design which included peer-reviewed and grey literature review, email contact with relevant experts in countries studied and interviews with key stakeholders to collect information on governance processes, EMR adoption and data quality. We sought to identify the authorities and assess processes for approval of EMR data extraction and use for research, approximate time needed to obtain all approvals and expected ease of obtaining approval. We also examined the adoption of EMR systems within relevant treatment settings, EMR data quality, which was defined as typical fields covered, average fill rate (percentage of visits in which clinical information, including patient information, vitals, diagnosis, prescription, procedures, lab test results and patient behavioural, is being filled) and fields with close-ended questions, details of electronic health record systems, as well as trend and incentives on EMR use.
We conducted a literature review on academic papers using EMR data from type 2 diabetic patients, as well as other EMR extracted data (a description of the literature on adoption of EMR in the countries can be found in Additional file 3). Sources of information included scientific databases (e.g. PubMed and Google Scholar). Search terms included: electronic medical record*; Electronic Health Records [MeSH]; electronic health record*; electronic patient record*; computer-based or computerised medical record; computer-based or computerised health record; computer-based or computerised patient record; country name; and diabetes. Other optional terms included: adoption, uptake, coverage, governance, trend*, ethic*, and provider*. Where possible, we conducted more general literature searches (e.g. on Ministry of Health and EMR provider websites) to find additional information and contacts for the interviews. We included studies that reported on at least one of the following aspects of EMR: information governance procedures for extracting data from EMR; EMR adoption; and the quality and consistency of EMR data.
A structured interview questionnaire was used that included questions on: treatment setting of type 2 diabetes patients and EMR adoption within treatment settings; use of EMR data and existing relationships with EMR providers; information governance; trends and incentives on EMR use; and details of EMR systems. Contact details of interviewees were compiled through academic connections, contacting authors of literature review publications, searching the internet for research centres, hospitals, diabetes clinics and centres, specialists (diabetologists/endocrinologists) and contacting national and international diabetes organisations. Contacts were a mix of public and private sector professionals, including family practitioners and specialists with an emphasis on individuals in the field of diabetes, EMR providers, academics and information commissioners.
We requested interviews via phone and/or email. All interviewees were informed about the study and provided consent to participate (verbal for telephone calls and written for email). Five trained interviewers conducted phone interviews with participants from each country in English, apart from one interview that was conducted in Polish and transcribed verbatim and translated to English by a speaker native in both the English and Polish language. This was a rapid-response survey and due to time and/or language barriers, a small number of questionnaires were self-completed and sent via email. The number of conducted interviews ranged from 1 to 7 per country, depending on the availability of participants and the information required. We also engaged with those who provided information to self-assess reliability and comprehensiveness of information as an additional guide whether to seek further sources of information. We invited 377 informants and 59 participants were interviewed. Some participants were identified through expert referral and therefore we are unable to provide the exact number of those invited and those who declined participation. Of those who declined, some were unable to provide relevant information and others did not have time for participation in the study. Our purposive sample of 59 participants consisted of the following: 25 physicians, 23 academics, 7 EMR providers, and 4 information commissioners (Additional file 4). Interview data were analysed thematically. Two researchers read through the interview transcripts several times in an active way (searching for meaning) and gave initial codes to findings (units of texts). Then they searched for themes and sorted codes into themes. To verify the data, the results were shared with the research team and discussed.
We synthesised all information from the literature review documents and interview questionnaires thematically (Additional files 1 and 2). When large discrepancies in conflicting information (e.g. time to obtain approval) were found, we provided a range i.e. min to max. When only small discrepancies in conflicting information were found, we provided an average. Other conflicts of information were resolved by consensus among the team members, with a tendency towards the more trustworthy and competent source of information (assessment of those based on personal impressions).
Information governance processes
Authorities and processes for approval for EMR data extraction and use for research
We obtained information regarding processes to obtain approval for EMR data extraction for research purposes in all countries apart from Austria where data from EMR systems were not yet meant to be used for research (Additional file 1). The procedures for obtaining approvals varied highly between countries. Approval processes varied significantly even between European countries. However, typically the different authorities from which approval had to be obtained to allow extraction of data from EMRs included ethics committees (health facility and/or regional or national boards), sites where data was collected, and national, regional or local health authorities. Additional approvals were needed from EMR providers in certain countries (Australia, Czech Republic, Italy, India, Poland and South Africa). There were also differences in approval procedures between different geographical areas within a number of countries (China [see information governance procedures described in Table 2], the Czech Republic, Indonesia, Italy, India, South Africa and UAE).
Additional approvals had to be obtained for data from the private sector in two countries (Australia, Poland). In addition, the approval procedures varied according to the type of study; for example, in Italy, participants said that a simple notification to the ethics board was needed for retrospective studies, while formal approval from the health authority was needed for prospective studies. Individual patient consent was often not required for anonymised data with the exception of South Africa where patient consent was always required. In some countries, obtaining patient consent was usual practice, though not necessary (Italy, the Netherlands).
Approximate time needed to obtain all approvals
The approximate time to obtain all the approvals that were required for extracting data from EMR highly varied. In 7 countries, the average time was between 3 and 6 months (Czech Republic, India, Indonesia, the Netherlands, Poland, Korea, Rep., UAE), whilst in 5 countries between 6 months and 1 year (Australia, Brazil, Italy, Mexico, Saudi Arabia). The time was expected to be less than 3 months for China, while variable times were reported for Taiwan (between 3 months and 6 years). In South Africa, an unsuccessful attempt for obtaining approvals lasted between 1 and 2 years. Typically the process could be lengthy and the time needed was dependent on the number of different sites that were to be included in a study.
Ease of obtaining approval
For most countries it was thought that obtaining approval was moderately easy. The exceptions were India and South Africa where this was difficult, as no standard procedures were in place to obtain approval, and Austria where obtaining approval was currently not feasible because of legal barriers.
The barriers to obtaining approvals were: (i) the novelty of using data from EMR for research, (ii) lack of standard procedures, (iii) bureaucracy, (iv) confidentiality, (v) technical issues and (vi) costs. Firstly, in some countries, there was little previous experience with conducting research using data from EMR (India, Indonesia, South Africa and Saudi Arabia). In another country, showing that a study had a real benefit to the health facility and public was reported to make approval procedures easier (Brazil). Secondly, a lack of uniformity of rules and regulations or policies for EMR data extraction was a challenge for obtaining approvals in three countries (China, India and South Africa). Sometimes, certain individuals had to be involved to obtain approval (South Africa, China); for example, one respondent said that in China the director of the hospital plays a key role in the approval procedure. Thirdly, the process was lengthier and more complex because of the need for approvals from: multiple organisations (Australia, Brazil, Korea, Rep., Taiwan, India), different levels within organisations (South Africa) and different stakeholders (India). One participant also mentioned that there were frequently delays in responses to approval requests (South Africa). Fourthly, there was a reluctance to share data because of concerns about confidentiality (Italy, Mexico), data security (Poland), and data leakage (China), which stressed the importance of developing trust to gain access to the data. Fifthly, technical issues, such as lack of interoperability (South Africa), limited bandwidth (UAE), difficulty with de-identification of data (Australia, Czech Republic) and identification of the correct EMR (India), were also mentioned as common barriers. These were challenging because there was a need for information technology specialists, but lack of experience and poor literacy among staff (South Africa). Finally, respondents considered the cost of administration (China), patents, utilisation and licensing (South Africa) and negotiating prices with EMR providers (Korea, Rep.) as additional barriers to obtaining approval.
Adoption and quality of EMR
EMR adoption was examined in 7 countries. Overall, Italy, Saudi Arabia, Korea, Rep., Taiwan and UAE had high EMR adoption rates while Brazil and South Africa had lower rates. However, EMR adoption rates were variable between different settings within countries (Additional file 2). In UAE, almost 100 % of Health Authority of Abu Dhabi (HAAD) affiliated healthcare facilities, known as Abu Dhabi Health Services Company (SEHA), had an EMR system. In Italy and Korea, Rep., around 90 % of general physician clinics used an EMR. However, in Italy, adoption rates varied between different regions and hospitals. In Korea, Rep., almost 80 % of tertiary hospitals and 40 % of smaller hospitals had an EMR. Finally, in Taiwan, all large medical centres (>1000 beds), approximately 70 % of regional hospitals and almost 30 % of district hospitals used an EMR.
The quality of EMR data and details on EMR systems
In six of these countries (excluding Brazil, see the full assessment described in Table 3), typical fields covered in EMR systems were: patient information, patient vital signs, diagnoses, prescriptions, information about hospitalisations, procedures/tests performed and lab test results. Average fill rates were reported to be high (75–100 %). The fields that were closed-ended were less clearly described and varied between settings. In Brazil, there was very little information regarding the fields and fill rates as this highly varied between clinics. Although it was possible to link information with systems from other sites in most countries (Italy, South Africa, Taiwan, UAE, Saudi Arabia), sometimes this was only for certain information, such as prescriptions, procedures performed and lab test results (Saudi Arabia).
Trend and incentives in EMR use
Overall, the trend for adoption of EMR was increasing in all 7 countries, but this was a slow process. Government incentives were poor in Brazil, but present in all other countries where EMR implementation was seen as a necessity to improve health services. However, EMR providers had a large interest to expand EMR adoption in Brazil’s large market.
This study adds important novel insights into the feasibility of extracting EMR data for research in 16 high– and middle-income countries. We assessed information governance processes and EMR adoption and quality in several countries for which no previous information in academic literature was available. We also examined different countries compared to previous EMR assessments [4, 17–21]. Thereby, this study identified barriers towards secondary uses of EMR data in different countries that can be used to inform future EMR data analysis.
We found that obtaining approval for extracting data from EMR for research was moderately easy in most of the 16 countries for which we assessed information governance procedures. Exceptions were India and South Africa where obtaining approval was difficult and Austria where obtaining approval was currently not feasible as data from EMR were not yet meant to be used for secondary purposes.
Our study found a mix of different levels of EMR adoption and data quality across the seven countries that were assessed. The five high-income countries achieved high adoption, while the two middle-income countries had lower EMR adoption rates. In Italy, Korea, Rep. and Taiwan, EMR implementation started more than 10 years ago and several governmental initiatives were in place to increase uptake. Also, research using EMR data was already published by the time of this study [23–28]. In the Middle-Eastern countries, Saudi Arabia and UAE, EMR research was relatively novel but government incentives were in place. Government funding has been reported as one of the main drivers for EMR adoption  and our findings support this. In the countries with lower adoption rates, government funding was present only in South Africa, but lacking in Brazil. However, several barriers towards EMR use were identified in these countries.
Different factors influenced the feasibility of data extraction for secondary uses, such as EMR adoption, quality of data, trends and incentives for EMR implementation and information governance procedures. Table 4 shows that it seems more feasible to extract EMR data for research in Italy, Saudi Arabia, Korea, Rep., Taiwan and UAE, but less feasible in Brazil and South Africa.
Barriers towards EMR use have been extensively studied [4, 6, 20, 21, 29], though there remains limited evidence that can provide an understanding of the organisational context and process changes. The barriers found in our study were mostly in line with those previously reported in other countries. A systematic review on the costs and benefits of health information technology found that costs and perceived resistance by physicians were the main barriers towards EMR adoption . In our study, costs were reported as a barrier, but resistance by physicians was not mentioned by our interviewees, which may have been because we interviewed stakeholders who knew about EMR in their setting and these stakeholders may have been less resistant towards EMR use.
Another review reported on concerns about patient privacy and legal barriers to the use of EMR . Even though European countries have comprehensive national privacy laws and information commissioners, in our study concerns about data security were still mentioned in the European countries. If a study with data from EMR is undertaken at a single institution, approvals can be easily manageable. However, when a regional or national study is undertaken the approvals become hard to manage , which interviewees also reported in our study.
A limitation of the study is its commissioned nature, which meant that the included countries and the questionnaire were chosen by the client. This also meant that a purposive sample was included and that some countries (Mexico and Czech Republic) only had one interviewee. We used a rapid approach and asked participants to respond within a short period of time (two weeks) and thus the answers were self-reported when no interview could take place. However, this approach allowed us to share up-to-date and new insights into the information governance procedures and adoption and quality of EMR in a number of countries.
Another limitation is that this study only assessed three aspects of data quality: type of fields, fill rates and closed-ended fields. Other aspects of EMR systems, which vary on multiple dimensions, could not be assessed, including the details (clinical data, non-clinical data), data source, level of complexity, incorporation of other documents (digital images, scanned documents) timeframe (single occasion to complete health record) and extent of integration with other services . Nevertheless, this study provides an important overview of the most relevant aspects of the quality of EMR for extracting data for research.
Future research in this area could explore other aspects of data quality and adoption. Both benefits, including data security, legibility, accessibility, completeness, comprehensiveness, efficiency, and risks such as paper persistence, patient disengagement, insecure data, increased time, and increased costs should be assessed . Research is also needed on the views of patients and the public about data from their EMR being used in areas not directly related to providing them with clinical care [30, 31].
This is the first international comparative study to shed light on the information governance procedures and adoption of EMR in several countries. We hope it will inform the discussions and development of policies that aim to accelerate adoption of EMR and seizing of the rich potential for the secondary uses of data arising from them. Data from EMR have considerable scope to improve the safety, quality and efficiency of healthcare; as well as being a valuable resource for research, particularly when linked to other data such as mortality records or genetic data. It is therefore important that countries work towards making these data more accessible for their secondary uses. At the same time confidentiality of the data should be ensured. Also any concerns that patients and the public might have about their data being used for purposes other than providing them with clinical care should be addressed. Last but not least, it is very important also to establish mechanisms for use of such data at national levels. They provide an invaluable source for policymakers, for measurement of disease burden and for planning of investments in healthcare as well as for pharmaceuticals to ensure safe and effective use of medications.
EMR, electronic medical records; HAAD, Health Authority of Abu Dhabi; HbA1c, glycated haemoglobin; SEHA, Abu Dhabi Health Services Company; UAE, United Arab Emirates
Majeed A. Sources, uses, strengths and limitations of data collected in primary care in England. Health Stat Q. 2004;21:5–14.
Kohl LF, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013;15(7):e146.
Car J, Black A, Anandan C, Cresswell K, Pagliari C, McKinstry B, Procter R, Majeed A, Sheikh A. The impact of eHealth on the quality and safety of healthcare. In: Report for the NHS Connecting for Health Evaluation Programme. 2008.
Adaji A, Schattner P, Jones K. The use of information technology to enhance diabetes management in primary care: a literature review. Inform Prim Care. 2008;16(3):229–37.
Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, McKinstry B, Procter R, Majeed A, Sheikh A. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med. 2011;8(1):e1000387.
Hayrinen K, Saranto K, Nykanen P. Definition, structure, content, use and impacts of electronic health records: a review of the research literature. Int J Med Inform. 2008;77(5):291–304.
Coorevits P, Sundgren M, Klein GO, Bahr A, Claerhout B, Daniel C, Dugas M, Dupont D, Schmidt A, Singleton P, et al. Electronic health records: new opportunities for clinical research. J Intern Med. 2013;274(6):547–60.
Clinical Practice Research Datalink (CPRD) website [Available from: http://www.cprd.com/intro.asp] Accessed 2 Mar 2015.
The Health Improvement Network (THIN) website [Available from: http://www.ucl.ac.uk/pcph/research-groups-themes/thin-pub] Accessed 2 Mar 2015.
QResearch website [Available from: http://www.qresearch.org/SitePages/Home.aspx] Accessed 2 Mar 2015.
Kim D, Labkoff S, Holliday SH. Opportunities for electronic health record data to support business functions in the pharmaceutical industry—a case study from Pfizer, Inc. J Am Med Inform Assoc. 2008;15(5):581–4.
Devleesschauwer B, Maertens de Noordhout C, Smit GS, Duchateau L, Dorny P, Stein C, Van Oyen H, Speybroeck N. Quantifying burden of disease to support public health policy in Belgium: opportunities and constraints. BMC Public Health. 2014;14:1196.
Shekelle PG, Goldzweig CL. Costs and benefits of health technology information: an updated systematic review. In: QQUIP and the Quality Enhancing Interventions project. RAND Corporation; Southern California Evidence-based Practice Centre. London: The Health Foundation; 2009.
Mador RL, Shaw NT. The impact of a Critical Care Information System (CCIS) on time spent charting and in direct patient care by staff in the ICU: a review of the literature. Int J Med Inform. 2009;78(7):435–45.
Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. 2008;25(4):213–4.
Thiru K, Hassey A, Sullivan F. Systematic review of scope and quality of electronic patient record data in primary care. BMJ (Clinical research ed). 2003;326(7398):1070.
Nguyen L, Bellucci E, Nguyen LT. Electronic health records implementation: an evaluation of information system impact and contingency factors. Int J Med Inform. 2014;83(11):779–96.
Overview of International EMR/EHR Markets: Results from a Survey of Leading Health Care Companies [Available from: http://www.accenture.com/fi-en/~/media/Accenture/Conversion-Assets/LandingPage/Documents/1/Accenture-EMR-Markets-Whitepaper-Final.pdf] Accessed 2 Mar 2015.
Schoen C, Osborn R, Squires D, Doty M, Rasmussen P, Pierson R, Applebaum S. A survey of primary care doctors in ten countries shows progress in use of health information technology, less in other areas. Health Aff. 2012;31(12):2805–16.
Ben-Assuli O. Electronic health records, adoption, quality of care, legal and privacy issues and their implementation in emergency departments. Health Policy (Amsterdam, Netherlands). 2015;119(3):287–97.
Anderson JG. Social, ethical and legal barriers to e-health. Int J Med Inform. 2007;76(5–6):480–3.
Ovretveit J, Scott T, Rundall TG, Shortell SM, Brommels M. Implementation of electronic medical records in hospitals: two case studies. Health Policy (Amsterdam, Netherlands). 2007;84(2–3):181–90.
Serpelloni G, Gomma M, Genetti B, Zermiani M, Rimondo C, Mollica R, Gryczynski J, O'Grady KE, Schwartz RP. Italy’s electronic health record system for opioid agonist treatment. J Subst Abuse Treat. 2013;45(2):190–5.
Strollo F, Guarino G, Marino G, Paolisso G, Gentile S. Different prevalence of metabolic control and chronic complication rate according to the time of referral to a diabetes care unit in the elderly. Acta Diabetol. 2014;51(3):447–53.
Klein Woolthuis EP, de Grauw WJ, van Gerwen WH, van den Hoogen HJ, van de Lisdonk EH, Metsemakers JF, van Weel C. Yield of opportunistic targeted screening for type 2 diabetes in primary care: the diabscreen study. Ann Fam Med. 2009;7(5):422–30.
Klein Woolthuis EP, de Grauw WJ, van Gerwen WH, van den Hoogen HJ, van de Lisdonk EH, Metsemakers JF, van Weel C. Identifying people at risk for undiagnosed type 2 diabetes using the GP’s electronic medical record. Fam Pract. 2007;24(3):230–6.
Al Alawi S, Al Dhaheri A, Al Baloushi D, Al Dhaheri M, Prinsloo EA. Physician user satisfaction with an electronic medical records system in primary healthcare centres in Al Ain: a qualitative study. BMJ open. 2014;4(11):e005569.
Perez-Cuevas R, Doubova SV, Suarez-Ortega M, Law M, Pande AH, Escobedo J, Espinosa-Larranaga F, Ross-Degnan D, Wagner AK. Evaluating quality of care for patients with type 2 diabetes using electronic health record information in Mexico. BMC Med Inform Decis Mak. 2012;12:50.
Ludwick DA, Doucette J. Primary care Physicians’ experience with electronic medical records: barriers to implementation in a fee-for-service environment. Int J Telemed Appl. 2009;2009:9.
Luchenski SA, Reed JE, Marston C, Papoutsi C, Majeed A, Bell D. Patient and public views on electronic health records and their uses in the United kingdom: cross-sectional survey. J Med Internet Res. 2013;15(8):e160.
Riordan F, Papoutsi C, Reed JE, Marston C, Bell D, Majeed A. Patient and public attitudes towards informed consent models and levels of awareness of Electronic Health Records in the UK. Int J Med Inform. 2015;84(4):237–47.
Pearce C, Bainbridge M. A personally controlled electronic health record for Australia. J Am Med Inform Assoc. 2014;21(4):707–13.
Kim Y. National Health Information Network Development in Korea. Asia Pacific Association for Medical Informatics; 2006.
HIMSS. Electronic health records: a global perspective part 2. In: A work product of the HIMSS Enterprise Systems Steering Committee and the Global Enterprise Task Force, vol. 2. 2010.
Ho CH, Wene HC, Chu CM, Wu YS, Wang JL. Importance-satisfaction analysis for primary care physicians’ perspective on EHRs in Taiwan. Int J Environ Res Public Health. 2014;11(6):6037–51.
Pfeiffer KP, Giest S, Dumortier J, Artmann J. Country brief: Austria. In: eHealth strategies. Brussels: European Commission; 2010.
Bartova S, Walossek U, Giest S, Dumortier J, Artmann J. Country brief: Czech Republic. In: eHealth strategies. Brussels: European Commission; 2010.
Tamburini E, Giest S, Dumortier J, Artmann J. Country brief: Italy. In: eHealth strategies. Brussels: European Commission; 2010.
HIMSS. Electronic health records: a global perspective part 1. In: A work product of the HIMSS Enterprise Systems Steering Committee and the Global Enterprise Task Force, vol. 2. 2010.
Flim C, Giest S, Dumortier J. Country brief: Netherlands. In: eHealth strategies. Brussels: European Commission; 2010.
Turowiec A, Giest S, Dumortier J, Artmann J. Country brief: Poland. In: eHealth strategies. Brussels: European Commission; 2010.
Altuwaijri MM. Electronic-health in Saudi Arabia. Just around the corner? Saudi Med J. 2008;29(2):171–8.
Bah S, Alharthi H, El Mahalli AA, Jabali A, Al-Qahtani M, Al-kahtani N. Annual survey on the level and extent of usage of electronic health records in government-related hospitals in Eastern Province, Saudi Arabia. Perspect Health Inf Manag. 2011;8(Fall):1b.
Ciciriello S, Johnston RV, Osborne RH, Wicks I, deKroo T, Clerehan R, O'Neill C, Buchbinder R. Multimedia educational interventions for consumers about prescribed and over-the-counter medications. Cochrane Database Syst Rev. 2013;4:Cd008416.
WHO. Electronic health records. In: A manual for developing countries. 2006.
Alam Napitupulu T, Hasoloan Julham Patria S. Factors that determine electronic medical records users satisfaction: a case of Indonesia. J Theor Appl Inf Technol. 2013;58(3):499–505.
Xu W, Guan Z, Cao H, Zhang H, Lu M, Li T. Analysis and evaluation of the electronic health record standard in China: a comparison with the American national standard ASTM E 1384. Int J Med Inform. 2011;80(8):555–61.
South African Department of Health. eHealth Strategy South Africa. South Africa: In: National eHealth Strategy, South Africa 2012/13-2016/17; 2012.
WHO regional offices [Available from: http://www.who.int/about/regions/en/] Accessed 2 Mar 2015.
World Bank list of economies. 2015. [Available from: http://data.worldbank.org/about/country-and-lending-groups] Accessed 2 Mar 2015.
We are sincerely grateful to all interviewees for offering their valuable time to us and to all participants who brought us in contact with the interviewees. We would like to greatly acknowledge Ayodele Adiat, Claire Dickie, Sabrina Spieck and Riham Arab for their hard work on collecting information for this study. Also we thank Yewande Adeleke and Hamdi Issa for assistance with the literature review [32–48]. Imperial College London is grateful for support from the North West London National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research & Care, the Imperial NIHR Biomedical Research Centre, and the Imperial Centre for Patient Safety and Service Quality. The views expressed in this publication are those of the authors.
This study received sponsorship from IMS Health. The funders had no role in data collection and analysis, decision to publish, or preparation of the manuscript.
Availability of data and materials
The data from the interviews has not been included in a public database as the interview transcripts contain information that could make identification of study participants possible.
All authors made substantial contributions to conception and design of the study and acquisition and interpretation of data. MHvV and NM analysed the data. MHvV wrote the paper. NM, AM, JOD and JC revised the paper critically and provided important intellectual comments on drafts of the paper. All authors approved the final version of the paper.
Dr Michelle Van Velthoven is a postdoctoral researcher at the University of Oxford and an Honorary Research Fellow at Imperial College London. She has an undergraduate degree in Biomedical Sciences and an MSc in Health Technology Assessment, both from Radboud University Nijmegen in the Netherlands, and a PhD in Global Health from Imperial College London. Her thesis explored the application of mHealth-based collection of information relevant to childhood diarrhoea and pneumonia in rural China.
Dr Nikolaos Mastellos is a Research Fellow in eHealth and Health Services Research at Imperial College London. He has a first degree in Nursing from the Technological Educational Institute of Athens, Greece, an MSc in Health Care Management and a PhD in Health Services Research, both from the University of Surrey. His thesis explored the implementation and uptake of electronic medical records in Greece.
Professor Azeem Majeed is a primary care physician and Professor of Primary Care and Head of the Department of Primary Care and Public Health at Imperial College London. Professor Majeed qualified at the University of Wales College of Medicine in Cardiff, Wales, and is accredited in both General Practice and Public Health. He has a keen interest in connecting medicine and informatics and is an international authority on the use of data from electronic health records for research and development.
Dr John O’Donoghue is a Senior Lecturer in eHealth at Imperial College London. He received his BSc in Computer Science and a research MSc in Real-Time Systems and Simulation from the Department of Mathematics and Computing, Cork Institute of Technology, and a PhD from the Department of Computer Science at University College Cork. His thesis was on the application of context-sensitive quality data management for pervasive computing environments.
Dr Josip Car is an executive physician, a Reader in eHealth at Imperial College London and an Associate Professor of Health Services and Outcomes Research at Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore. Dr Car graduated from the University of Ljubljana Medical School, Slovenia, where he also completed a Research Masters in Primary Care and Specialist training in Family Medicine. He then moved to Imperial College London to do a PhD in Primary Care and eHealth. Dr Car has published numerous academic articles, books, systematic reviews and reports in the field of eHealth.
The authors declare that they have no competing interests.
Consent for publication
All participants gave consent to publish anonymised data from this study. No identifying information related to participants was included in the final manuscript.
Ethics approval and consent to participate
This study was deemed to be a service evaluation and quality and safety improvement initiative and consequently did not require ethics or research governance approval according to the UK’s Health Research Authority guidance [Health Research Authority: Defining Research. 2013]. All participants gave verbal consent prior to participation.
Information Governance; summarized results. (PDF 567 kb)
Adoption of EMR and quality of their data; summarized results. (PDF 463 kb)
EMR adoption in the countries based on literature review; description. (PDF 183 kb)
Number of interviewees; table. (PDF 186 kb)
About this article
Cite this article
van Velthoven, M.H., Mastellos, N., Majeed, A. et al. Feasibility of extracting data from electronic medical records for research: an international comparative study. BMC Med Inform Decis Mak 16, 90 (2016). https://doi.org/10.1186/s12911-016-0332-1
- Electronic medical records
- Electronic health records [MeSH]
- Data collection [MeSH]
- Global health [MeSH]