Skip to main content
Download PDF

Characterization and selection of Japanese electronic health record databases used as data sources for non-interventional observational studies

BMC Medical Informatics and Decision Making volume 21, Article number: 167 (2021) Cite this article

Abstract

Background

Interventional studies are the fundamental method for obtaining answers to clinical questions. However, these studies are sometimes difficult to conduct because of insufficient financial or human resources or the rarity of the disease in question. One means of addressing these issues is to conduct a non-interventional observational study using electronic health record (EHR) databases as the data source, although how best to evaluate the suitability of an EHR database when planning a study remains to be clarified. The aim of the present study is to identify and characterize the data sources that have been used for conducting non-interventional observational studies in Japan and propose a flow diagram to help researchers determine the most appropriate EHR database for their study goals.

Methods

We compiled a list of published articles reporting observational studies conducted in Japan by searching PubMed for relevant articles published in the last 3 years and by searching database providers’ publication lists related to studies using their databases. For each article, we reviewed the abstract and/or full text to obtain information about data source, target disease or therapeutic area, number of patients, and study design (prospective or retrospective). We then characterized the identified EHR databases.

Results

In Japan, non-interventional observational studies have been mostly conducted using data stored locally at individual medical institutions (663/1511) or collected from several collaborating medical institutions (315/1511). Whereas the studies conducted with large-scale integrated databases (330/1511) were mostly retrospective (73.6%), 27.5% of the single-center studies, 47.6% of the multi-center studies, and 73.7% of the post-marketing surveillance studies, identified in the present study, were conducted prospectively. We used our findings to develop an assessment flow diagram to assist researchers in evaluating and choosing the most suitable EHR database for their study goals.

Conclusions

Our analysis revealed that the non-interventional observational studies were conducted using data stored local at individual medical institutions or collected from collaborating medical institutions in Japan. Disease registries, disease databases, and large-scale databases would enable researchers to conduct studies with large sample sizes to provide robust data from which strong inferences could be drawn.

Peer Review reports

Background

During the course of primary-care medical practice, a huge amount of patient data, including laboratory results and diagnoses, administrative data, and health insurance information, are generated and collated as electronic health records (EHRs). Patients’ individual EHRs are then archived in databases that can be accessed by stakeholders throughout the medical field. Because these data arise through actual medical activities, they are considered real-world data; that is, these are observational data obtained through real-world medical practice rather than data obtained in an experimental setting.

Traditionally, interventional studies are the fundamental method for obtaining answers to clinical questions. In such studies, researchers enroll patients, randomize them into two or more groups, provide the groups different medical treatments, and compare the resulting data between groups. However, it is sometimes difficult to conduct interventional studies because of insufficient financial or human resources or the rarity of the disease in question. One means of addressing these issues is to conduct a non-interventional observational study using EHR databases as the data source. Such data sources can range from EHRs obtained from individual medical institutions to large-scale integrated EHR databases organized and maintained by database providers (Fig. 1). Large-scale databases allow researchers to conduct non-interventional observational studies with a large sample size, thus affording robust real-world evidence [1, 2]. Using large-scale databases is also a quick way to analyze the real-world clinical situation at a modest cost [3].

Fig. 1
figure 1

Overview of the construction of a large-scale, integrated, electronic health record (EHR) database. White parallelograms represent the data included in EHRs. Cylinders represent EHR databases. The dark parallelogram represents the dataset provided to researchers who conduct non-interventional observational studies

Full size image

Some large-scale integrated EHR databases in Japan include claims data as well as medical records [4,5,6]. Claims data provides information about diagnoses, prescriptions, medical care, and costs.

When planning a non-interventional observational study using a EHR database, researchers must first identify the databases that are most suitable for their study purpose. Although many such databases are available [4, 5], they each have their strengths and limitations that must be considered and weighed against one another. For example, most EHRs, and therefore most databases, lack patient data regarding the pre-symptomatic stage of disease; therefore, many EHR databases will be of limited benefit to researchers who intend to investigate aspects of the early stages of disease onset such as the pre-symptomatic stage of Alzheimer’s disease. This lack of data likely reflects that, despite the potential benefits of early preventive care [7,8,9,10], patients in the pre-symptomatic stage of disease are rarely seen in hospital. Researchers also need to consider important database characteristics such as the number of records, accessibility to outcome data, duration of follow-up, and potential biases during data collection [11]. How best to evaluate the suitability of an EHR database when planning a study remains to be clarified.

The aim of the present study was to identify and characterize the data sources that have been used for conducting non-interventional observational studies in Japan and to propose a flow diagram to help researchers assess the suitability of a potential EHR database for use in their non-interventional observational study.

Methods

Determination of the data sources used for non-interventional observational studies in Japan

We assessed published articles reporting non-interventional observational studies conducted in Japan in order to determine the data sources for the studies. We used a two-part approach to identify articles: the first part involved searching PubMed; the second part involved collecting articles from the websites of large-scale database providers. We referred to, and followed, the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analysis) Statement [12] to identify and screen articles, specifically the Identification and Screening phases of the PRISMA Flow. Then we selected and classified articles through our own methods because the remaining components of the PRISMA Statement were not fully applicable to our review targeting non-observational studies.

In the first part of our study, we conducted a PubMed search to find articles reporting observational studies conducted in Japan in the last 3 years; the following settings were used: “Japan” was set as the keyword in the Affiliation field, “observational study” was set in the filters for article type, “from December 1, 2017, to November 30, 2020” was set for publication date, “humans” was set for species, and “English” was set for language.

Once candidate articles were identified, we reviewed their abstracts. We excluded articles without an abstract or without a structured abstract. Structured abstracts provide more informative summaries than non-structured abstracts [13].

We reviewed each abstract for information about data source, target disease or therapeutic area, number of patients enrolled in the study, and study design. If the abstract did not include this information, we reviewed the full text of the article. If the full text was not available or lacked enough information, we excluded the article. We also excluded:

  • articles reporting studies conducted multi-nationally or in a country other than Japan. We consider that medical practices and the information contained within EHRs could differ between regions.

  • articles reporting non-clinical studies, interventional studies, or studies with healthy subjects or controls.

Classification of each article was conducted using the following criteria:


Data source: Articles were classified into four types based on the source data used: (1) data stored at a medical institution, (2) data collected from several medical institutions, (3) data obtained from a disease registry or database, (4) data obtained from a large-scale integrated database.

  1. (1)

    When the words “single-center study” were included in the title, abstract, or full text, the article was classified as type (1), as were articles that similarly contained the phrase “single center”, “single-center”, “single centre”, “single-centre”, “single institution”, or “single-institution”. When an article included the words indicating single-center study such as “in a xxxx [adjective] hospital”, “in our hospital”, “at our hospital”, “in our institution”, “at our institution”, “at our institute”, “at XXXX [institution name]”, “in XXXX [institution name]”, or “in a xxxx [adjective] center”, the article was classified as type (1).

  2. (2)

    When the abstract or full text included the words “multi-center study” or “xx [digit]-center study”, the article was classified as type (2). Because post-marketing surveillance (PMS) studies are a kind of multi-center study, these articles should also be classified as (2). However, in Japan, PMS studies are conducted under Good Post-marketing Study Practice (GPSP) regulations [14], whereas observational studies are conducted under the ethical guidelines of the Japan Ministry of Education, Culture, Sports, Science and Technology [15]. Thus, we considered PMS studies separately from the other multi-center studies.

  3. (3)

    When the abstract or full text included “registry” or “study database”, the article was classified as type (3). Articles reporting a multi-center study to construct and/or leverage a disease registry or database was classified as (3).

  4. (4)

    When the abstract or full text included “claims database”, the article was classified as type (4). We classified articles with phrases such as “nationwide database” as type (3) or (4) depending on the name of the database that actually was used, if it was available elsewhere in the abstract or full text. An article reporting several types of studies including single-center or multi-center studies as well as large-scale database analyses, were classified as (4).

Target disease or therapeutic area: Articles were classified according to the following 19 classes; these classes reflect our own classification criteria, which we developed by using the 10th revision of the International Statistical Classification of Diseases and Related Health Problems (ICD-10) [16]: (1) infectious and parasitic diseases other than coronavirus disease 2019 (COVID-19), (2) COVID-19, (3) cancer and neoplasm, (4) diseases of the blood and blood forming organs, (5) endocrine, nutritional and metabolic diseases, (6) diabetes, (7) mental disorder, (8) disease of the nervous system, (9) disease of the eye and adnexa, (10) disease of the ear and mastoid process, (11) disease of the circulatory system, (12) disease of the respiratory system, (13) disease of the digestive system, (14) Disease of the skin and subcutaneous tissue, (15) disease of the musculoskeletal system and connective tissue, (16) disease of the genitourinary system, (17) pregnancy, childbirth, and perinatal, (18) injury or other consequences of eternal causes, (19) others, including surgery, transplantation, hemodialysis, dental, and pain.

By referring to ICD-10, we classified cardiac surgery as “injury, poisoning, and certain other consequences of external causes” and not as “disease of the circulatory system”. We applied this approach to the study focuses as well. For example, an article reporting retinal disorders in diabetic patients was classified as (9) disease of the eye and adnexa and not as (6) diabetes.

Number of patients enrolled in study: The number of patients included in the final analysis was obtained by reviewing the abstract or full article text.

Study design: Studies were classified as either prospective or retrospective, depending on which word was used in the abstract or full article text. We classified articles as “prospective” or “retrospective” according to the article author’s definition. Thus, we classified an article as “unknown” without making a conjecture when it did not mention either “prospective” or “retrospective”.

The review author identified the articles, extracted information from the articles, and summarized the information into an extraction sheet so that the article could be classified. Another author checked the appropriateness of the classification methodology. The review author then self-checked the classification results regarding the classification of the data source and study design. The information about the data source was found in the article title (16%), abstract (40%), or main body (44%).

In the second part of our study, we obtained a list of articles reporting observational studies using data from one or more of four large-scale Japanese EHR databases [17,18,19,20,21]: Japan Medical Data Center Claims Database (JMDC Claim), Medical Data Vision Database (MDV Database), National Database of Health Insurance Claims and Specific Health Checkups of Japan (NDB Japan), and Medical Information Database Network (MID-NET). JMDC Claim and MDV Database are the largest EHR databases in Japan [4]. NDB Japan and MID-NET are widely known databases in Japan that are provided by the Japanese governmental organization. These four databases all include EHR data generated by the Japanese Diagnosis Procedure Combination/Per-Diem Payment System (DPC; the Japanese medical payment framework); therefore, these databases are sometimes colloquially referred to as “DPC databases”. For example, NDB Japan is frequently called “the DPC database” because it is the most well-known database in Japan.

To obtain this information, we accessed the list of published articles available at the website associated with each of the four databases. For JMDC Claim and MDV Database, the publication lists were very long, so we limited our search to the period January 2017 through December 2020. For NDB Japan and MID-NET, the publication lists only included articles published since 2018.

We reviewed each abstract for information about the target disease or therapeutic area, number of patients enrolled in the study, and study design, by using the same classification criteria described above. Because these publication lists were from large-scale databases, data source classification was not needed. If the abstract of an article did not include information regarding the target disease or therapeutic area, number of patients enrolled in the study, and study design, we reviewed the full text of the article. When the full text was unavailable or lacked sufficient information, we excluded the article. We also excluded those articles that overlapped with the articles selected through the PubMed search or another database provider’s site. Finally, we calculated the number of articles classified and compiled the results of the PubMed search and database website investigation.

Characteristics of the large-scale integrated databases

By contacting the relevant organizations through their websites, we solicited information regarding the procedures through which the four large-scale databases were established. JMDC Claim was constructed by the Japan Medical Data Center Inc. and comprises EHR data collected through daily medical practice since 2005. The MDV Database and related services have been maintained by Medical Data Vision Co., Ltd., since 2008. NDB Japan was constructed by the Japan Ministry of Health, Labour and Welfare (MHLW) in 2009. MID-NET has been offered through a governmental organization (under the MHLW) and the Pharmaceuticals and Medical Devices Agency since 2018. In characterizing these databases, we focused on the (1) data sources and procedures for processing data, (2) data items available, and (3) anonymization of data. We also contacted the companies responsible for two of the databases (Japan Medical Data Center and Medical Data Vision) to ask for general information regarding the construction and maintenance of their databases; the same questions regarding data cleaning, data standardization, and database construction were sent to both companies via e-mail messages, not by using any questionnaire form.

Development of a flow diagram for evaluating and choosing databases

We summarized our findings regarding EHR database characteristics and published literature based on studies conducted by using the databases. By considering the available data items, reliability, anonymization, data volume, and subject follow-up period of these datasets, we developed an assessment flow diagram as a tool for evaluating databases and choosing those suitable for the intended use.

Results

Determination of the data sources used for non-interventional observational studies in Japan

Of 2729 articles identified (2318 through PubMed and 411 through the websites of the large-scale database providers), 1511 articles met the eligibility criteria (Fig. 2). The data sources used in the identified studies are shown in Table 1, stratified by study type.

Fig. 2
figure 2

Results of our screening of observational studies in Japan

Full size image
Table 1 Summary of the data source used for non-interventional observational studies conducted in Japan
Full size table

A total of 663 (43.9%) studies were single-center studies. In these studies, the sample size was < 100 in 278 (41.9%) studies and 100–299 in 214 (32.3%) studies (Table 2, Additional files 1 and 2). Thus, 74.2% of the single-center studies used a sample size < 300. The single-center studies were conducted in various target diseases and therapeutic areas.

Table 2 Characteristics of the non-interventional observational studies identified in the present study
Full size table

A total of 315 (20.8%) studies were multi-center studies. In these studies, the sample size was < 100 in 70 (22.2%) studies, 100–299 in 83 (26.3%) studies, and 300–999 in 83 (26.3%) studies. Thus, 74.8% of the multi-center studies used a sample size < 1000. The multi-center studies were also conducted in various target diseases and therapeutic areas.

A total of 38 PMS studies were identified. Generally, PMS studies are used to gather information about a new medicinal product or medical device after it has been granted marketing authorization; thus, 28 of the 38 PMS studies (73.7%) were conducted prospectively. In the 39 PMS studies, the sample size was 1000–2999 in 9 (23.7%) studies, 3000–9999 in 13 (34.2%) studies, and ≥ 10,000 in 2 (5.3%) studies.

A total of 165 studies conducted for the construction of a disease registry or database were identified. Such studies are usually conducted prospectively, although the disease registries or databases themselves are sometimes used for retrospective secondary analysis. In the identified studies, three Japanese registries/databases were used by researchers of different studies: All-Japan Utstein Registry [22, 23], National Database of Rheumatic Diseases by iR-net (Division of Rheumatology, Immunologic Disorder Network, National Hospital Organization) in Japan (NinJa) [24, 25], and Kyoto Congestive Heart Failure (KCHF) Registry [26, 27]. In addition, although our focus was on studies conducted in Japan, we identified seven registry studies conducted by using the Surveillance, Epidemiology, and End Results (SEER) program of the US National Cancer Institute.

Finally, we identified 330 studies using large-scale integrated databases, 243 (73.6%) of which were conducted retrospectively. The sample size was 10,000–99,999 in 95 (28.8%) studies and ≥ 100,000 in 98 (29.7%) studies. In the identified studies, the following large-scale integrated databases were used: JMDC Claim, 152 studies; MDV Database, 130 studies (9 were studies using both JMDC Claim and MDV Database); NDB Japan, 17 studies; MID-NET, 2 studies. In the remaining articles, the databases used were referred to only as “DPC database” and the actual names of the databases were not mentioned. The identified data sources are shown as examples in Table 1. Each data source has its strengths and limitations [27,28,29,30,31].

Characteristics of large-scale integrated databases

Summaries of the four large-scale integrated databases are shown in Table 3. NDB Japan is one of several Japanese DPC databases. MID-NET was launched 2018 and includes laboratory data as well as DPC information. The data sources, available data items, and anonymization status were obtained from the websites of the respective databases [17,18,19,20,21].

Table 3 Japanese large-scale integrated databases and their characteristics
Full size table

Health insurance companies transfer claims data derived at medical institutions to JMDC Claim according to pre-defined procedures once a month. Similarly, MDV receives anonymized data from medical institutions on a monthly basis; the data managers then check the data and update the database. According to the MID-NET website, medical records and claims data are transmitted to the Integrated Data Source of MID-NET through pre-defined procedures. The MID-NET system and data are monitored and verified at variable intervals.

The detailed data processing procedures for NDB Japan are not shown on the information website offered by the Japan Ministry of Health, Labour, and Welfare (MHLW) [19]. Although, the website states that the use of the NDB Japan data is usually permitted for academic researchers only, MHLW does extract part of the NDB Japan data to create a small dataset called NDB Open Data Japan, which is freely available at the MHLW website [20].

Development of a flow diagram for evaluating and choosing databases

Using our combined findings, we developed an assessment flow diagram to identify EHR databases appropriate for various applications (Fig. 3). The order of steps was determined according to the consistency with the researcher’s study purpose, and the quality and quantity of the data.

  1. 1.

    DATA RELATED TO ENDPOINTS: According to our interpretation of the publications’ data, the most important characteristic of an EHR database in terms of its suitability for a non-interventional observational study is that parameters related to endpoints are available. For example, Horii et al. used the MDV Database to reveal that patients with type 2 diabetes who were treated with sodium–glucose cotransporter 2 inhibitors had an increased risk of developing hypoglycemia [32]. The authors were able to perform their study [32] because the MDV database includes information about diagnosis, medications, and patient background such as body mass index and glycohemoglobin (HbA1c). In addition, Takeuchi et al. identified the relationship between hemoglobin and HbA1c by analyzing the JMDC Claim database [33]. Momo et al. also used the JMDC Claim database and reported that compliance with statin therapy needs to be improved among working-age male patients treated with statin and anti-platelet drugs, especially in those patients with increased baseline low-density lipoprotein C [34]. Finally, Koretsune et al. used the MDV Database to investigate cardiovascular event occurrence in patients treated with dabigatran (oral anticoagulant) or warfarin [35]. In all of these example studies, relevant parameter data were available in the databases. To be suitable for a researcher’s non-interventional study, the selected database should contain patient data, including demographic information and details regarding medication [32, 35], surgery [36], and hospitalization [32, 35].

  2. 2.

    CONSTRUCTION PROCESS: For use in non-interventional studies, the database should be established through data-processing procedures those are satisfactorily explained and reproducible. The database construction processes of JMDC Claim, MDV Database, and MID-NET are explained on their websites [17,18,19,20,21].

  3. 3.

    ANONYMIZATION: Appropriate anonymization of data is important from ethics and quality standpoints. Regional regulations regarding anonymization must be accommodated. Data anonymization of JMDC Claim, MDV Database, and MID-NET are mentioned on their websites. Subjects’ personal information is not available for researchers using NDB Japan, and their website states that anonymization is the researcher’s responsibility [19, 20].

  4. 4.

    DATA VOLUME: Having sufficient data to support an appropriate sample size is crucial for robust non-interventional studies. Even when a potential database lacks a sufficient volume of data initially, a researcher might still consider the database when the data-processing processes are known and the volume of data is likely to increase. The data volumes currently available in the JMDC Claim, MDV Database, and MID-NET are summarized in Table 3; data updates are announced on their websites.

  5. 5.

    FOLLOW-UP PERIOD: Having sufficient data that span the researcher’s intended follow-up period is an important feature of a candidate database. Researchers sometimes need long-term information [37]. When data for the scheduled period are unavailable initially, researchers have the option of waiting for data updates to accumulate longer-term data. However, missing data might ultimately be unavoidable. For JMDC Claim, data has been collected since 2005, for MDV Database since 2008, and for NDB Japan since 2009.

Fig. 3
figure 3

Flow diagram for the assessment of the suitability of a registry or database for use in a non-interventional observational study

Full size image

Examples of using the assessment flow diagram

First, consider a researcher who wants to conduct a study to answer the question “Does physicians’ prescription behavior change after they receive a ‘Dear Doctor’ letter?” After referring to the MID-NET website, the researcher is able to confirm the appropriateness of leveraging MID-NET as a potential EHR database for the study by answering ‘yes’ to Questions 1 through 5 of the assessment flow diagram (Fig. 3). If, while assessing JMDC Claim or MDV Database, the researcher needs more information than is available on their websites, the researcher can contact JMDC or MDV representatives.

In contrast, a researcher interested in evaluating patients’ quality of life will likely respond ‘no’ to Question 1 regarding large-scale integrated databases with primary-care information, such as JMDC Claim, MDV Database, MID-NET, and NDB Japan. Therefore, this investigator needs to find other registries that contain data appropriate for quality-of-life evaluation.

Discussion

We investigated the data sources that have been used for conducting past non-interventional observational studies in Japan. We also characterized four Japanese large-scale integrated EHR databases by summarizing their data sources, available data, and anonymization status.

We found that non-interventional observational studies in Japan are mostly conducted by using data stored at individual medical institutions or collected from several collaborating medical institutions. This approach provides a limited volume of data. Using a disease registry, disease database, or large-scale integrated EHR database might be a way to increase the sample size. Such registries and databases have the advantage that the data are already anonymized and cleaned.

Observational studies using large-scale databases are usually conducted retrospectively. However, we found that 27.5% of the single-center studies, 47.6% of the multi-center studies, and 73.7% of the PMS studies, identified in the present study, were conducted prospectively. When a researcher focuses on a new parameter as a study endpoint, they must take a prospective approach because no data for the parameter is yet included in medical records at their medical institution or in integrated large-scale databases. However, if the target parameter data is expected to be collected and added to EHRs and EHR databases in the future, the researcher may wait for further data accumulation.

Applying our present findings, we developed a flow diagram that can be used to assess the suitability of a registry or database for use in a non-interventional observational study (Fig. 3). In this context, it is crucial that the EHR database contains data related to the study endpoints, such as laboratory findings and the treatments (exposures) the patients received. The database should also contain demographic information as well as patients’ medication, surgery, and hospitalization histories.

When planning a non-interventional observational study, it is helpful for researchers to know how a database is constructed and what anonymization processes have been applied to the data. Appropriate anonymization of data is important to adhere to current ethics and quality guidelines. Also, the database should have been established through data-processing procedures that are satisfactorily explained and reproducible. The database construction and data anonymization processes of JMDC Claim, MDV Database, and MID-NET are explained on their websites [17, 18, 21].

Having sufficient data to support an appropriate sample size is crucial to obtain robust outcomes. Even when a potential database lacks a sufficient volume of data initially, a researcher might still consider using the database when the data-processing approach is known and the volume of data is expected to increase. If the patient follow-up period is too short to extract relevant data to cover the duration of the intended study, researchers have the option of waiting for data updates to accumulate longer-term data. However, missing data might ultimately be unavoidable. For JMDC Claim database, data has been collected since 2005, for MDV Database since 2008, and for NDB Japan, since 2009.

PMS studies are performed by taking a prospective approach to gather information about a new medicinal product or medical device after it has been granted marketing authorization. The MHLW, a ministry of the Japanese Health Government, implemented the MID-NET system and intended that it would become a major data source for PMS studies [6, 38]. In addition, by comparing MDV dataset analysis with their prospective PMS study, Sakata et al. demonstrated that large-scale database analysis with MDV Database could be useful in long-term drug safety assessment; these authors also mentioned that using a database decreased the time needed to complete a PMS study and was relatively inexpensive [31]. Data related to exposure to a new medicinal product is very limited in EHRs at the time when planning a PMS study but is collected and added to EHRs at medical institutions and then collated into large-scale integrated databases over time. If a PMS researcher or sponsor can wait for the data to be accumulated, they can use a large-scale database to conduct their study with less financial or human resource costs. In fact, a researcher who intends to conduct a prospective study can use a large-scale database by employing the tactic of waiting for data accumulation of the database. Prospective clinical studies are rigidly managed, which usually means huge amounts of human and financial resources are needed [39, 40].

We acknowledge several limitations to the present study. First, we identified the articles reporting observational studies through PubMed searches and database providers’ publication lists, instead of accessing clinical trial registration sites directly. This strategy means we didn’t focus on all studies those have been planned and initiated in Japan, but our analysis was based on information about completed and published studies. Second, our group has not yet conducted an observational study using the EHR databases evaluated in the present study; in the next phase of our research, we intend to conduct a study using an appropriate EHR database. Finally, we do not address limitations regarding linking Japanese EHR data stored on different platforms, such as the various health insurance databases.

Conclusion

Our analysis revealed that the non-interventional observational studies were mostly conducted using data stored local at individual medical institutions or collected from collaborating medical institutions in Japan. Disease registries, disease databases, and large-scale integrated EHR databases would enable researchers to conduct studies with large sample sizes to provide robust data from which strong inferences could be drawn. Using our flow diagram, researchers planning non-interventional observational studies should consider the strengths and limitations of each available database and choose the most appropriate one to their study goals. Whereas observational studies using large-scale databases are usually retrospective, a researcher, even planning a prospective study, can leverage a large-scale database by employing the tactic of waiting for data accumulation of the database.

Availability of data and materials

The datasets used and/or analyzed during the present study are available from the corresponding author of reasonable request. The identified articles information is available as Additional files 1 and 2.

Abbreviations

COVID-19:

Coronavirus disease 2019

DPC:

Diagnosis Procedure Combination/Per-Diem Payment System

EHR:

Electronic health record

GPSP:

Good Post-marketing Study Practice

ICD-10:

The 10th revision of the International Statistical Classification of Diseases and Related Health Problems

HbA1c:

Glycohemoglobin

JMDC:

Japan Medical Data Center

KCHF:

Kyoto Congestive Heart Failure

MDV:

Medical Data Vision

MHLW:

Ministry of Health, Labour, and Welfare

MID-NET:

Medical Information Database Network

NDB Japan:

National Database of Health Insurance Claims and Specific Health Checkups of Japan

NinJa:

National Database of Rheumatic Diseases by iR-net (Division of Rheumatology, Immunologic Disorder Network, National Hospital Organization) in Japan

PMS:

Post-marketing surveillance

PRISMA:

Preferred Reporting Items for Systematic reviews and Meta-Analyses

SEER:

Surveillance, Epidemiology, and End Results program

References

  1. Nishimura R, Kato H, Kisanuki K, Oh A, Hiroi S, Onishi Y, et al. Treatment patterns, persistence and adherence rates in patients with type 2 diabetes mellitus in Japan: a claims-based cohort study. BMJ Open. 2019;9:e025806. https://doi.org/10.1136/bmjopen-2018-025806.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Shibata N, Kimura S, Hoshino T, Urushihara H. Influenza vaccination effectiveness for people aged under 65 years in Japan, 2013/2014 season: application of a doubly robust method to a large-scale, real-world dataset. BMC Infect Dis. 2019;19:586. https://doi.org/10.1186/s12879-019-4186-x.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Koretsune Y, Yamashita T, Yasaka M, Oda E, Matsubayashi D, Ota K, et al. Usefulness of a healthcare database for epidemiological research in atrial fibrillation. J Cardiol. 2017;70:169–79. https://doi.org/10.1016/j.jjcc.2016.10.015.

    Article  PubMed  Google Scholar 

  4. Saokaew S, Sugimoto T, Kamae I, Pratoomsoot C, Chaiyakunapruk N. Healthcare databases in Thailand and Japan: potential sources for health technology assessment research. PLoS ONE 2015;10(11):e0141993. https://doi.org/10.1371/journal.pone.0141993.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Kimura T, Koide D, Orii T. Large, automated administrative and clinical databases available for pharmacoepidemiology studies in Japan [in Japanese]. Jpn J Pharmacoepidemiol. 2012;17:135–44.

    Article  Google Scholar 

  6. Yamaguchi M, Inomata S, Harada S, Matsuzaka Y, Kawaguchi M, Ujibe M, et al. Establishment of the MID-NET® medical information database network as a reliable and valuable database for drug safety assessments in Japan. Pharmacoepidemiol Drug Saf. 2019;28:1395–404. https://doi.org/10.1002/pds.4879.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Jack CR, Knopman DS, Jagust WJ, Shaw LM, Aisen PS, Weiner MW, et al. Hypothetical model of dynamic biomarkers of the Alzheimer’s pathological cascade. Lancet Neurol. 2010;9(1):119-28. https://doi.org/10.1016/S1474-4422(09)70299-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Sperling RA, Jack CR, Aisen PS. Testing the right target and the right drug at the right stage. Sci Transl Med. 2011;3(111). https://doi.org/10.1126/scitranslmed.3002609.

  9. Bateman RJ, Xiong C, Benzinger TLS, Fagan AM, Goate A, Fox NC, et al. Clinical and biomarker changes in dominantly inherited Alzheimer’s disease. N Engl J Med. 2012;367:795–804. https://doi.org/10.1056/NEJMoa1202753.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Salloway S, Sperling R, Fox NC, Blennow K, Klunk W, Raskind M, et al. Two phase 3 trials of bapineuzumab in mild-to-moderate Alzheimer’s disease. N Engl J Med. 2014;370:322–33. https://doi.org/10.1056/NEJMoa1304839.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Dreyer NA. Advancing a framework for regulatory use of real-world evidence: when real is reliable. Ther Innov Regul Sci. 2018;52(3):362–8. https://doi.org/10.1177/2168479018763591.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). http://prisma-statement.org/. Accessed 12 Mar 2021.

  13. Taddio A, Pain T, Fassos FF, Boon H, Ilersich AL, Einarson TR. Quality of nonstructred and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. Can Med Assoc J. 1994;150:1611–5.

    CAS  Google Scholar 

  14. Ministry of Health, Labour, and Welfare. Good Post-Marketing Study Practice. 2004. https://www.pmda.go.jp/files/000161574.pdf. Accessed 15 Jan 2021.

  15. Ministry of Education, Culture, Sports, Science and Technology, Ministry of Health, Labour, and Welfare. Ethical Guideline. 2014. https://www.mhlw.go.jp/file/06-Seisakujouhou-10600000-Daijinkanboukouseikagakuka/0000069410.pdf. Accessed 15 Jan 2021.

  16. The 10th revision of the International Statistical Classification of Diseases and Related Health Problems (ICD-10). https://icd.who.int/browse10/2019/en.

  17. Japan Medical Data Center. Company website. https://www.jmdc.co.jp/. Accessed 1 July 2019.

  18. Medical Data Vision. Company website. https://www.mdv.co.jp/. Accessed 1 July 2019.

  19. Ministry of Health, Labour, and Welfare. National Database of Health Insurance Claims and Specific Health Checkups of Japan (NDB Japan). https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/kenkou_iryou/iryouhoken/reseputo/index.html. Accessed 12 Oct 2020.

  20. Ministry of Health, Labour, and Welfare. NDB Open Data Japan. https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/0000177182.html. Accessed 12 Oct 2020.

  21. Pharmaceuticals and Medical Devices Agency. MID-NET (Medical Information Network). https://www.pmda.go.jp/safety/mid-net/0001.html. Accessed 8 Jan 2019. https://www.pmda.go.jp/safety/mid-net/0005.html. Accessed 18 Apr 2020.

  22. Matsuyama T, Komukai S, Izawa J, Gibo K, Okubo M, Kiyohara K, et al. Pre-hospital administration of epinephrine in pediatric patients with out-of-hospital cardiac arrest. J Am Coll Cardiol. 2020;75:194–204. https://doi.org/10.1016/j.jacc.2019.10.052.

    Article  CAS  PubMed  Google Scholar 

  23. Suematsu Y, Zhang B, Kuwano T, Sako H, Ogawa M, Yonemoto N, et al. Citizen bystander–patient relationship and 1-month outcomes after out-of-hospital cardiac arrest of cardiac origin from the All-Japan Utstein Registry: a prospective, nationwide, population-based, observational study. BMJ Open. 2019;9:e024715. https://doi.org/10.1136/bmjopen-2018-024715.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Mori H, Sawada T, Nishiyama S, Shimada K, Tahara K, Hayashi H, et al. Influence of seasonal changes on disease activity and distribution of affected joints in rheumatoid arthritis. BMC Musculoskelet Disord. 2019;20:30. https://doi.org/10.1186/s12891-019-2418-2.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Hirata A, Suenaga Y, Miyamura T, Matsui T, Tohma S, Suematsu E, et al. Effect of early treatment on physical function in daily management of rheumatoid arthritis: a 5-year longitudinal study of rheumatoid arthritis patients in the National Database of Rheumatic Diseases in Japan. Int J Rheum Dis. 2018;21:828–35. https://doi.org/10.1111/1756-185X.12877.

    Article  CAS  PubMed  Google Scholar 

  26. Yoshikawa Y, Tamaki Y, Morimoto T, Yaku H, Yamamoto E, Inuzuka Y, et al. Impact of left ventricular ejection fraction on the effect of renin-angiotensin system blockers after an episode of acute heart failure: from the KCHF Registry. PLoS ONE. 2020;15(9):e0239100. https://doi.org/10.1371/journal.pone.0239100.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Yaku H, Kato T, Morimoto T, Inuzuka Y, Tamaki Y, Ozasa N, et al. Association of mineralocorticoid receptor antagonist use with all-cause mortality and hospital readmission in older adults with acute decompensated heart failure. JAMA Netw Open. 2019;2(6):195892. https://doi.org/10.1001/jamanetworkopen.2019.5892.

    Article  Google Scholar 

  28. Miyoshi T, Umekawa T, Hosoda H, Asada T, Fujiwara A, Kurosaki KI, et al. Plasma natriuretic peptide levels in fetuses with congenital heart defect and/or arrhythmia. Ultrasound Obstet Gynecol. 2018;52:609–16. https://doi.org/10.1002/uog.18925.

    Article  CAS  PubMed  Google Scholar 

  29. Iwai T, Miyazaki M, Yamada G, Nakayama M, Yamamoto T, Satoh M, et al. Diabetes mellitus as a cause or comorbidity of chronic kidney disease and its outcomes: the Gonryo study. Clin Exp Nephrol. 2018;22:328–36. https://doi.org/10.1007/s10157-017-1451-4.

    Article  CAS  PubMed  Google Scholar 

  30. Miyake M, Tatsumi Y, Matsumoto H, Nagao K, Matsuyama H, Inamoto T, et al. Outcomes of subsequent non-muscle-invasive bladder cancer treated with intravesical Bacillus Calmette-Guerin after radical nephroureterectomy for upper urinary tract urothelial carcinoma. BJU Int. 2018;121:764–73. https://doi.org/10.1111/bju.14111.

    Article  PubMed  Google Scholar 

  31. Sakata Y, Matsuoka T, Ohashi S, Koga T, Toyoda T, Ishii M. Use of a healthcare claims database for post-marketing safety assessments of eribulin in Japan: a comparative assessment with a prospective post-marketing surveillance study. Drugs Real World Outcomes. 2019;6:27–35. https://doi.org/10.1007/s40801-019-0150-8.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Horii T, Oikawa Y, Kunisada N, Shimada A, Atsuda K. Real-world risk of hypoglycemia- related hospitalization in Japanese patients with type 2 diabetes using SGLT2 inhibitors: a nationwide cohort study. BMJ Open Diab Res Care. 2020;8:e001856. https://doi.org/10.1136/bmjdrc-2020-001856.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Takeuchi M, Kawakami K. Association between hemoglobin and hemoglobin A1c: a data-driven analysis of health checkup data in Japan. J Clin Med. 2018;7:539. https://doi.org/10.3390/jcm7120539.

    Article  PubMed Central  Google Scholar 

  34. Momo K, Yasu T, Yasui H, Kuroda S. Risk factors affecting the failed low-density lipoprotein level achievement rate in working-age male population at high cardiovascular risk. J Clin Pharm Ther. 2019;44:715–9. https://doi.org/10.1111/jcpt.12847.

    Article  CAS  Google Scholar 

  35. Koretsune Y, Yamashita T, Yasaka M, Ono Y, Hirakawa T, Ishida K, et al. Comparative effectiveness and safety of warfarin and dabigatran in patients with non-valvular atrial fibrillation in Japan: a claims database analysis. J Cardiol. 2019;73:204–9. https://doi.org/10.1016/j.jjcc.2018.09.004.

    Article  PubMed  Google Scholar 

  36. Yonekura H, Ide K, Seto K, Kawasaki Y, Tanaka S, Nahara I, et al. Preoperative pulmonary function tests before low-risk surgery in Japan: a retrospective cohort study using a claims database. J Anesth. 2018;32:23–32. https://doi.org/10.1007/s00540-017-2423-2.

    Article  PubMed  Google Scholar 

  37. Kanda E, Kashihara N, Kohsaka S, Okami S, Yajima T. Clinical and economic burden of hyperkalemia: a nationwide hospital-based cohort study in Japan. Kidney Med. 2020;2(6):742–52.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Ishiguro C, Takeuchi Y, Uyama Y, Tawaragi T. The MIHARI project: establishing a new framework for pharmacoepidemiological drug safety assessments by the Pharmaceuticals and Medical Devices Agency of Japan. Pharmacoepidemiol Drug Saf. 2016;25:854–9. https://doi.org/10.1002/pds.4032.

    Article  PubMed  Google Scholar 

  39. Wakabayashi Y, Matsui H, Ikai K, Hayashi M, Wakabayashi H, Yamamoto K. Developing a practical method for validation of computerized systems integrated with smart and/or wearable devices for regulatory compliance of clinical trials. Ther Innov Regul Sci. 2017;51:118–24. https://doi.org/10.1177/2168479016666585.

    Article  PubMed  Google Scholar 

  40. Wakabayashi Y, Matsui H, Hayashi M, Ikai K, Yamamoto K. Clinical trial management adaptation to ICH E6 (R2): Good Clinical Practice. Pharmaceutical Engineering 2019; 39: 66–70. https://ispe.org/pharmaceutical-engineering/january-february-2019/clinical-trial-management-adaptation-ich-e6-r2

Download references

Acknowledgements

We thank Mr. Takashi Itagaki for his helpful comments from his experiences with registries construction. We also thank the experts from Medical Data Vision and Japan Medical Data Center for providing information regarding their database establishment processes. This study was presented in part during the poster sessions of the 15th Drug Information Association Japan Annual Meeting (November 2018 in Tokyo, Japan) and the 40th Annual Meeting of the Society for Clinical Trials (May 2019 in New Orleans, Louisiana, USA).

Funding

This work was supported by an “Initiative for Realizing Diversity in the Research Environment” grant from the Japan Science and Technology Agency, in improvements to the English language within our manuscript. The funding body didn’t play any roles in the design of the study and collection, analysis, and interpretation of data.

Author information

Authors and Affiliations

  1. Integrated Center for Advanced Medical Technologies, Kochi Medical School, Kochi University, Kohasu, Oko-cho, Nankoku, Kochi, 783-8505, Japan

    Yumi Wakabayashi

  2. Department of Environmental Medicine, Kochi Medical School, Kochi University, Kochi, Japan

    Masamitsu Eitoku & Narufumi Suganuma

Authors
  1. Yumi Wakabayashi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masamitsu Eitoku
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Narufumi Suganuma
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YW contributed to the conception of the work and the acquisition and analysis of the data. YW, ME, and NS contributed to the interpretation of the data and to the drafting and revising of the manuscript. NS, ME, and YW contributed to the final version of the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Yumi Wakabayashi.

Ethics declarations

Ethical approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

All authors have declared they have no competing interests. This study was externally funded. No funding/assistance was received from a commercial organization.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. pubmed_literature_observational_Japan_3_years_human_2020. The list of articles identified through PubMed search includes article title, authors, journal, data source, therapeutic area, patient number, and study design.

Additional file 2

. MDV_JMDC_NDB_MIDNET_literature_2020. The list of articles identified through websites of large-scale database providers includes article title, authors, journal, therapeutic area, patient number, and study design.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wakabayashi, Y., Eitoku, M. & Suganuma, N. Characterization and selection of Japanese electronic health record databases used as data sources for non-interventional observational studies. BMC Med Inform Decis Mak 21, 167 (2021). https://doi.org/10.1186/s12911-021-01526-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-021-01526-6

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us