This article has Open Peer Review reports available.
The clinical adoption meta-model: a temporal meta-model describing the clinical adoption of health information systems
© Price and Lau; licensee BioMed Central Ltd. 2014
Received: 19 June 2013
Accepted: 21 May 2014
Published: 29 May 2014
Health information systems (HISs) hold the promise to transform health care; however, their adoption is challenged. We have developed the Clinical Adoption Meta-Model (CAMM) to help describe processes and possible challenges with clinical adoption. The CAMM, developed through an action research study to evaluate a provincial HIS, is a temporal model with four dimensions: availability, use, behaviour changes, and outcome changes. Seven CAMM archetypes are described, illustrating classic trajectories of adoption of HISs over time. Each archetype includes an example from the literature. The CAMM and its archetypes can support HIS implementers, evaluators, learners, and researchers.
Health information systems (HISs) have been described as one of the key tools to transform and improve quality of our healthcare systems [1, 2]. However, the promise of these transformative tools has not been consistently seen [3–5] and meaningful adoption in many jurisdictions remains low [6, 7]. The deployment of HISs has met with a wide variability in outcomes from benchmark successes that lead to transformations in care  to never being deployed in a clinical setting. Adoption of HISs has been a significant and increasing concern in healthcare  and an important problem to be addressed . Adoption needs to be better described and understood with approaches that are accessible to people planning and implementing these systems.
In this paper we present the Clinical Adoption Meta-Model (CAMM). The CAMM has been developed to describe HIS adoption over time. First, we provide background on adoption models. Then we present the CAMM, followed by seven CAMM archetypes that illustrate classic adoption patterns. We finish this paper with a discussion on how the CAMM and its archetypes can support implementers, evaluators, learners, and researchers.
Adoption is the process that “involves the multitude of activities, decisions, and evaluations that encompass the broad effort to successfully integrate an innovation into the functional structure of a formal organization”  (p. 5). An adoption model provides a simplified and limited explanation of the complex process of integration over time. For information systems, this involves the complex sociotechnical aspects that occur over time from initial deployment through to integration into practice . For this paper, we will use the term adoption model to describe models related to the activities of integration into practice post deployment. Adoption models, while they can be quite different, should have a number of common features to be considered an adoption model. These are: (a) they describe a number of dimensions related to adoption; (b) they are designed for a specific audience; (c) they allow for variability in assessment .
Outside of healthcare, there are many general adoption models, such as: Technology Acceptance Model(TAM) [14, 15] and the TAM 2 , Unified Theory of Acceptance and Use of Technology (UTAUT) , IS Success model , Task-Technology-Fit Model , and the Concerns Based Adoption Model (CBAM) . Diffusion of innovation [19, 20] describes the spread (adoption) of an innovation (idea, process, technology) through channels within a social system. Adoption models such as the Capability Maturity Model Integration (CMMI) focus on maturity of the processes of the team managing the development [21, 22]. Models like the CMMI are important for HIS development/configuration, but for clinical adoption, we are more interested in how the tools integrate into clinical practice.
Adoption models in healthcare
Several existing adoption models have been applied to healthcare and to healthcare technology. An extensive review of diffusion of innovation in healthcare  recommends we seek to better understand why innovations are rejected (discontinued) once adopted. The CBAM has been applied to telemedicine . TAM has been used in over 20 studies in healthcare to inform use acceptance and adoption . TAM2 has also been applied .
Adoption models have been developed specific to healthcare. The Fit between Individuals, Task and Technology (FITT) framework highlights that adoption depends on alignment of three factors: technology, individual and task . HOT-fit was used to understand critical adoption factors for HISs . The Clinical Adoption Framework  contextualizes the IS Success Model  into healthcare and extends it by providing meso and macro level factors that can influence the adoption of clinical information systems. The Design-Reality Gap Model from Heeks  outlines seven dimensions from information to management systems and structures related to HIS failure.
Adoption models have been developed for specific domains within healthcare. HIMSS Analytics provides three EMR adoption models (EMRAM), one each for US hospital based HISs, Canadian hospital HISs, and for US Ambulatory EMRs [29, 30]. Each of the three EMRAMs provide an eight-point (0–7) scale of adoption of features of the HIS. Diagnostic imaging have models to describe capability for collaborative jurisdictional infrastructure maturity . The PACS maturity model [32, 33] describes the process maturity of hospital based PACS systems in terms of functionality and integration into practice workflow. The EMR (Electronic Medical Records) Adoption Model  provides an adoption assessment tool that breaks down office-based EMR adoption into 10 functional areas.
What appears missing from these models is a contextualized adoption model that is (a) generic to health, but (b) is sufficiently contextualized as to be accessible to key stakeholder audiences such as clinicians and administrators that (c) ties together HIS adoption and clinical benefit over time to guide expectations of adoption over time. Next, we present our Clinical Adoption Meta-Model (CAMM) that attempts to do that.
Clinical Adoption Meta-Model (CAMM)
CAMM development and evaluation
Through multiple stakeholder meetings during the first two phases, it became clear that a common understanding of HIS adoption over time was needed. Several of the existing models that were considered did not resonate with stakeholders. There were three key gaps: 1. Some models did not fit the deployment/time focus of the stakeholders. 2. They were too complex and thus not engaging. 3. They were too general and did not help focus the discussion of evaluation. The primary need of stakeholders was to have an approach to understanding how to assess their HIS program benefits over time, so that realistic expectations could be set while still ensuring metrics could be measured in a timely manner to show progress. The CAMM grew out of reflections by the research team between iterations in this ongoing action research study.
Evaluation of CAMM has been primarily through the action research project. The CAMM was used to assess the initial evaluation plan, highlighting gaps to stakeholders. It was then subsequently used to co-develop a new evaluation plan that addressed the life cycle of adoption of a provincial HIS. It is now being used through phases of adoption evaluation.
The CAMM has since been used as a discussion and planning tool used with IT leadership, clinicians, IT implementers outside the above mentioned project with other stakeholders who are planning implementations of HIS and also with students who are learning about HIS adoption.
CAMM is a time dependent meta-model, with four dimensions related to post-deployment adoption: availability, use, clinical behaviour, and clinical outcomes. The dimensions are themselves dependent on each other: HIS availability is required before use can occur, use is needed to attribute changes in clinical/health behaviours to the HIS, and behavior changes can result in clinical outcomes change. Each dimension in the CAMM can have one or more aspects, which are dependent on the scope of the HIS implementation being considered. The dimensions and their aspects are described in more detail below. The Y-axis measures indicators for each dimension, the specifics of which necessarily vary from HIS to HIS.
The CAMM is designed to be generic such that it could be applied to a hospital information system deployment, an office based EMR, a personal health record, or a health app on smart phones. It could support thinking around deployment of a full HIS, a specific feature, to a new group of users, or it could be used to consider regional or jurisdictional adoption.
Dimension 1. availability
The first dimension, availability, is defined as ability for the end users to interact with an HIS. Availability includes three aspects: user access; system availability; and availability of content in the HIS. User access considers the ability for intended users to access the system (i.e. they have accounts, have been trained). System availability considers how available the HIS is to the intended users (e.g. uptime, physical availability of terminals, remote login capabilities, mobile applications). Content availability considers depth and breadth of content that is available in the HIS. This will vary, depending on the HIS, such as various types of patient data or knowledge content.
Dimension 2. system use
The CAMM’s second dimension, use, is defined as the interactions with the HIS by intended end-users. There are two aspects to use: use of the system and user experience of the system. Use refers to actual use of the application, such as: logins, time using the system, features used. The user experience aspect is a subjective experience of use that combines the user’s internal state, the information system (in this case the HIS), and the context in which the interactions occur . User experience is broader than user satisfaction or usability. Demonstrated use of the HIS is required in order to make any assumptions correlating the HIS to changes in clinical behaviours or clinical outcomes.
Dimension 3. clinical/health behaviour
The CAMM’s third dimension, clinical/health behaviour, is defined as meaningful adaptation of clinical workflows or health behaviours that are facilitated by the HIS. These can align with clinical/business goals or be unintended changes in behaviour of adopting the HIS. Clinical behaviours differ from system use in that the users are incorporating information and functions provided by the information system into activities not directly related to the use of the system. Aspects of clinical behaviour change include general capacity and specific clinical activity changes. Capacity describes changes in the overall ability of the healthcare organization, which can be impacted positively or negatively by use of the HIS. Clinical activities are those specific behaviours that are impacted by HIS features. Clinical/health behaviours could be seen in providers and patients.
Dimension 4. clinical outcomes
The final dimension, clinical outcomes, is defined as the impacts attributable to the adoption of the HIS. There are five aspects to clinical outcomes that can be considered: patient level outcomes, provider level outcomes, organization level outcomes, population level outcomes, and cost outcomes. Measures of outcomes can be early or late. Early or surrogate outcomes are often needed in cases where it is not possible to wait for final or later outcomes.
Dimensions and Aspects of the CAMM, each dimension can have several more detailed aspects that can be considered
1 – Availability
- System availability
- Percentage of uptime of an EMR
- User access
- Number of users with accounts for a Personal Health Record.
- Content availability
- Months of dispensing data for a dispensing record.
2 – System use
- Number of log ins/user/month
- User experience
- Survey of user experience.
3 – Clinical behaviour
- General capacity
- Number of patients seen per day in office.
- Specific behaviours
- Rates of blood pressure screening
4 – Clinical outcomes
- Patient outcomes
- Change in blood pressure
- Provider outcomes
- Organizational outcomes
- Nosocomial infection rates
- Population outcomes
- Rates of obesity
- Cost outcomes
- Changes in relative cost curves for an organization
CAMM adoption archetypes
The following seven archetypes were developed to describe typical adoption trajectories for clinical information systems. Not all of these archetypes lead to success. Many HIS implementations fail in some way  and thus, the archetypes capture a range of results from successful adoptions to aborted adoptions. For each archetype, we describe the adoption pattern, highlight some potential implications, and provide an exemplar study from the literature that illustrates the archetype. The example studies were selected from the corpus of eHealth studies from two recent systematic reviews [4, 5]. Archetypes may be useful in teaching on HIS adoption, when considering success or challenges of a specific HIS adoption, or when planning implementation and evaluations with stakeholders.
Adoption without Benefit (behaviour and outcome).
Behaviour Change without Outcome Benefit.
Adoption with Outcome Benefits.
Adoption with Harm.
Benefit without Use.
No deployment archetype
This archetype describes an HIS that is not released to its users. There could be many reasons that this occurs, such as: the HIS is not completed, a flaw prevents deployment, or strategic changes prevent implementation. In this model, all four curves are flat (not shown).
The decision support application for primary care, EGADSS (Evidence-based Guidelines And Decision Support System) [37–39], is an example of this archetype. It was developed as an EMR component that connected to an EMR to provide CDSS reminders. However, it was not deployed to end users due to changes in funding and lack of adoption of the standards used in the interface between the EGADSS product and the primary care EMRs.
Low adoption archetype
An example is the 2-year pre/post cluster randomized controlled trial by Eccles et al.  to evaluate the use of computerized guidelines in managing adult patients with asthma and angina in primary care. Sixty general practices with EMRs in northeast England took part in the study where half adopted a guideline decision support software module. At the end of the 1-year intervention, the authors found the module had no significant effect on consultation rates; process of care measures or patient reported outcomes. On closer examination, the system usage log files revealed little to no usage of the module. The authors concluded that the low adoption was likely due to the guidelines not being consistent with the practice norms, the software not integrated into the clinical workflow, and insufficient user training. Thus lack of use precluded it having impacts on behaviour or outcomes.
Adoption without benefits archetype
An example is the 1-year randomized controlled trial by Tierney et al.  on the effects of computerized guidelines in managing heart disease. 706 outpatients with heart disease were followed for 1 year where they made 3,419 primary care visits and were eligible for 2,609 cardiac care suggestions. During the study, 201 physicians in the intervention group had cardiac care suggestions displayed based on data they entered into the EMR in the encounter. The study showed no measurable effects on physicians’ adherence to care suggestions, health care utilization and costs, and patients’ medication adherence, satisfaction with care, and quality of life. The authors reported that physicians felt the guidelines provided useful information, but were constraining their management of individual patients. Although the HIS was used, clinical behaviours or outcomes were not influenced.
Behaviour change without outcome benefits archetype
An example is the interrupted time series study by van Doormaal et al.  on the effect of electronic prescribing on medication errors and preventable adverse drug events in two medical wards at a university medical centre in the Netherlands. Medication orders, errors, and adverse events were tracked for 5 months each before and after the implementation of a computerized provider order entry system with decision support for drug-drug interactions, overdosing, and allergy alerts. The pre/post percentages of medication errors and adverse drug events from 1,195 in patients were compared for differences. The system led to a significant reduction in medication orders with one or more medication errors (behaviour change) but not in preventable adverse events (no outcome change). The authors concluded the system lacked advanced decision support rules in therapeutic error detection and a relevant hospital formulary database in order to reduce adverse events.
Adoption with benefit archetype
This archetype (see Figure 1) is the archetype that HIS implementers expect to see. There is a correlation between HIS availability, use, behaviour, and the expected outcomes. See the initial description of the CAMM above.
An example is the 5-year retrospective time series study by Cook et al.  on the effect of an electronic medical record on antimicrobial use and nosocomial infections at a tertiary care hospital in the United States. In this study, the pattern of antimicrobial drug use, number of medical charts reviewed, number of antimicrobial recommendations made and accepted, and rates of Clostridium difficile and methicillin-resistant Staphylococcus aureus infections were assessed. Data was reviewed for 10 quarters before and 10 quarters after implementing the electronic medical record. Results were compared for differences. The study found significant increase in the number of charts reviewed (use), antimicrobial recommendations made and accepted after implementing the system (behaviour). There were decreased use of 41 commonly used antibacterial agents and reduced rates of nosocomial infections during the study period (early outcome). This retrospective study showed a correlation between HIS feature in use, clinical behaviour, and outcomes.
Benefit without use archetype
Finding a published example of this archetype proved challenging. Perhaps this is because HIS evaluations are often focused on the intervention. Several studies in our corpus may fit this archetype, but they did not explicitly measure use. This was also seen in Dorr’s systematic review of HIS use in improving chronic disease management: “lack of use of otherwise successful components in standard EHR implementations should be quantified and barriers for use identified”  (p.162).
Adoption with harm archetype
An example is the comparison of diabetes care in primary care practices by Crosson et al.  where a cross sectional analysis of 50 primary care practices was completed examining quality of diabetes care through a random sampled chart audit against process guideline and outcome targets. 37 practices were paper based and 13 used EMRs. Multivariate analysis showed that EMR using practices were less likely to be following diabetes care process guidelines (clinical behaviour) and had worse intermediate outcomes (A1c, cholesterol, and blood pressure outcomes). Unfortunately, the authors did not collect duration of EMR use or any other characteristics of EMR adoption (e.g. type of EMR, features available, features used) that could be used to better explain the findings.
Comparison of the CAMM with other adoption models, CAMM is most focused on linking early adoption (e.g. availability and use) to later adoption benefits in the context of healthcare
Contextualized to health
Applicable to a range of HISs
Links adoption with clinical benefit
Diffusion of innovation
No, on diffusion
Is through Canada Health Infoway BE Framework and Clinical Adoption Framework
Yes, on net benefits.
No, focused on fit of individuals, tasks and IT.
Implicit (scores should increase over time)
Yes, to EMRs
Several EMRAMs for different EMRs
Focused on adoption of EMR features.
PACS maturity model
Yes, to PACS
No, PACS specific
Focused on PACS features and integration, not benefit
EMR adoption model
Yes, to EMRs
No, office EMR only.
No, focused on EMR use.
Design-reality gap model
Yes, developed in hospital
No, focused on gaps.
The CAMM can support implementers as they deploy an HIS (or HIS feature). In planning, they can use the CAMM to link goals (i.e. clinical outcomes) backward to expected behaviour changes, use, and availability, thus helping to describe the functionality and deployment needs through a causal chain. For example, if a diabetes chronic disease management tool is being deployed, the desired outcomes may be related to mortality and hospital use and, more proximally, A1c and other surrogate markers. The implementation team could consider how to structure training related to the tool use and to focus on behaviours related to reaching those goals (e.g. patient recalls). Availability could be structured to ensure the proper clinicians have access to the tool at appropriate locations and use could be promoted with those key groups. The CAMM can also help set the expectations of management, describing the processes required to reach the desired outcomes and why these are not seen immediately.
If the CAMM is used as a model to support HIS adoption evaluation, metrics assessing each of the four dimensions should be considered and be conceptually linked to each other. The further from go live, the harder it is to attribute observed changes directly to the HIS. Thus a tight linkage and clear temporal relationships between availability, use, behaviour and outcomes will strengthen attribution. Also, the CAMM highlights the importance of evaluating all four dimensions to ensure “Benefit without Use” is not occurring. CAMM does not specify evaluation methods; however, the CAMM can help theoretically link multi-methods across dimensions. The CAMM was especially useful in the action research study in which it was developed to both set expectations and to determine appropriate dimensions to measure that would align with stakeholder needs. Specifically, the need to provide progress reports on the program at specific times. The CAMM helped facilitate a discussion on what would be reasonable to evaluate for each reporting period. Through using the CAMM, evolving metric sets were considered that evaluated access, use, behaviour and ultimately outcomes over time.
Health informatics students and clinicians learning about HIS adoption can apply the CAMM as a framework for understanding adoption and impact of HISs over time. The CAMM and archetypes can be used with learners as a tool to describe, compare, and discuss implementation case studies.
The CAMM provides a framework to consider the stages of integration into practice that could be helpful in aiding researchers design studies on adoption. It can help researchers better understand challenged implementations. We have provided some examples in this paper. The CAMM provides a common model to compare adoption of HISs (or features) for meta-analyses.
Limitations and future work
There are several areas of future work for CAMM. The CAMM was developed through an action research project and, while it has been informally used in a number of settings since, a more formal evaluation is needed. Specific timeframe for adoption is not specified in the generic CAMM; however, it would be valuable to understand the expected timing of each curve for various kinds of HIS adoptions: office based EMR, hospital information systems, and personal health records. Better understanding the frequency of “Benefit without Use” is needed . There is a need to consider HISs as complex systems [9, 49] and the CAMM can support the assessment by providing a time based model against which one can assess complex interventions. CAMM intentionally focused on the direct aspects of adoption (i.e. the four dimensions). Indirect aspects of adoption were explicitly out of scope as this model was developed. Indirect aspects, however, will impact adoption in a complex system. This is a limitation and area for future development. The CAMM, while contextualized to healthcare (e.g. clinical outcomes), could have applications in other domains (e.g. in education one could consider learning behaviours and learning outcomes for learning tools).
The CAMM is presented to address a gap in the literature that was highlighted through an action research and evaluation project. It is an adoption meta-model that is focused on the temporal dimension of clinical adoption. It is general enough to be applied in multiple settings with multiple HISs from personal health records to hospital information systems. It is designed to be accessible by a range of audiences from implementers to learners. The seven CAMM archetypes provided are helpful in comparing varying levels of successful adoption. It highlights the importance of measuring multiple aspects of adoption over time to ensure that attribution of benefit can be realistically attributed to the use of HISs. As a new adoption meta-model, the CAMM needs additional application with further research.
We would like to thank Alberta Health who supported the evaluation work that led to the initial development of this model and Canada Health Infoway and CIHR for their support of the eHealth Observatory where this model has been further refined.
- Blumenthal D: Stimulating the adoption of health information technology. N Eng J Med. 2009, 360: 1477-1479. 10.1056/NEJMp0901592.View ArticleGoogle Scholar
- Stead WW, Kelly BJ, Kolodner RM: Achievable steps toward building a national health information infrastructure in the United States. J Am Med Inform Assoc. 2005, 12: 113-120.View ArticlePubMedPubMed CentralGoogle Scholar
- Shekelle P, Morton SC, Keeler EB: Costs and Benefits of Health Information Technology. Evidence Report/Technology Assessment No. 132. (Prepared by the Southern California Evidence-Based Practice Center Under Contract No. 290-02-0003.). 2006, Rockville, MD: Agency for Healthcare Research and QualityGoogle Scholar
- Lau F, Kuziemsky C, Price M, Gardner J: A review on systematic reviews of health information system studies. J Am Med Inform Assoc. 2010, 17: 637-645. 10.1136/jamia.2010.004838.View ArticlePubMedPubMed CentralGoogle Scholar
- Lau F, Price M, Boyd J, Partridge C, Bell H, Raworth R: Impact of electronic medical record on physician practice in office settings: a systematic review. BMC Med Inform Decis Mak. 2012, 12: 10-10.1186/1472-6947-12-10.View ArticlePubMedPubMed CentralGoogle Scholar
- Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, Shields A, Rosenbaum S, Blumenthal D: Use of electronic health records in U.S. hospitals. N Engl J Med. 2009, 360: 1628-1638. 10.1056/NEJMsa0900592.View ArticlePubMedGoogle Scholar
- Schoen C, Osborn R, Doty MM, Squires D, Peugh J, Applebaum S: A survey of primary care physicians in eleven countries, 2009: perspectives on care, costs, and experiences. Health Aff. 2009, 28: w1171-w1183. 10.1377/hlthaff.28.6.w1171.View ArticleGoogle Scholar
- Wu S, Chaudhry B, Wang J, Maglione M: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Int Med. 2006, 144: E12-E22.Google Scholar
- Ammenwerth E, Iller C, Mahler C: IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study. BMC Med Inform Decis Mak. 2006, 6: 3-10.1186/1472-6947-6-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Heeks R: Health information systems: failure, success and improvisation. Int J Med Inform. 2006, 75: 125-137. 10.1016/j.ijmedinf.2005.07.024.View ArticlePubMedGoogle Scholar
- Hall GE, Wallace R, Dossett W: A Developmental Conceptualization of the Adoption Process Within Educational Institutions. 1973, Austin: Texus UnivGoogle Scholar
- DeLone WH: The DeLone and McLean model of information systems success: a ten-year update. J Manag Inf Syst. 2003, 19: 9-30.Google Scholar
- Lahrmann G, Marx F: Systematization of Maturity Model Extensions. Lecture Notes in Comp Sci. 2010, Berlin, Heidelberg: Springer Berlin Heidelberg, 6105: 522-525. 10.1007/978-3-642-13335-0_36.Google Scholar
- Henderson JC: A Technology Acceptance Model for Empirically Testing New End-user Information Systems: Theory and Results. 1986, Boston: M.I.TGoogle Scholar
- Lee Y, Kozar KA, Larsen K: The technology acceptance model: past, present, and future. Com Assoc Inform Syst. 2003, 12: 752-780.Google Scholar
- Venkatesh V, Davis FD: A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci. 2000, 46: 186-204. 10.1287/mnsc.18.104.22.16826.View ArticleGoogle Scholar
- Venkatesh V, Morris MG, Davis GB, Davis FD: User acceptance of information technology: toward a unified view. MIS Q. 2003, 27: 425-478.Google Scholar
- Goodhue DL, Thompson RL: Task-technology fit and individual performance. MIS Q. 1995, 19: 213-236. 10.2307/249689.View ArticleGoogle Scholar
- Rogers EM: Diffusion of Innovations. 1995, New York, NY: Simon and Schuster, 5Google Scholar
- Rogers EM, Shoemaker FF: Communication of Innovations; a Cross-Cultural Approach. 1971, New York, NY: The Free PressGoogle Scholar
- CMMI Product Team: Capability Maturity Model® Integration (CMMI), Version 1.1--Continuous Representation. 2002, Pittsburgh, PA: Carnegie Mellon University, 1Google Scholar
- Constantinescu R, Iacob IM: Capability maturity model integration. J App Quant Meth. 2007, 2: 31-37.Google Scholar
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Armer JM, Harris K, Dusold JM: Application of the concerns-based adoption model to the installation of telemedicine in a Rural Missouri nursing home. J Nurses Staff Devel. 2004, 20: 42-10.1097/00124645-200401000-00008.View ArticleGoogle Scholar
- Holden RJ, Karsh B-T: The technology acceptance model: its past and its future in health care. J Bio Inform. 2010, 43: 159-172. 10.1016/j.jbi.2009.07.002.View ArticleGoogle Scholar
- Chismar WG, Wiley-Patton S: Does the extended technology acceptance model apply to physicians. Syst Sci. 2003, 8-doi: 10.1109/HICSS.2003.1174354Google Scholar
- Yusof MM, Stergioulas L, Zugic J: Health information systems adoption: findings from a systematic review. Stud Health Technol Inform. 2007, 129: 262-266.PubMedGoogle Scholar
- Lau F, Price M, Keshavjee K: From benefits evaluation to clinical adoption: making sense of health information system success in Canada. Healthc Q. 2011, 14: 39-45.View ArticlePubMedGoogle Scholar
- Pettit L: Understanding EMRAM and how it can be used by policy-makers, hospital CIOs and their IT teams. World Hosp Health Serv. 2013, 49: 7-9.PubMedGoogle Scholar
- Palacio C, Harrison JP, Garets D: Benchmarking electronic medical records initiatives in the US: a conceptual model. J Med Syst. 2009, 34: 273-279.View ArticleGoogle Scholar
- Bakalar R: Diagnostic imaging on demand, information management insights based on Canadian DI/EHR strategies. Comp in Cardio. 2005, 32: 687-689.Google Scholar
- VANDEWETERING R, BATENBURG R: A PACS maturity model: a systematic meta-analytic review on maturation and evolvability of PACS in the hospital enterprise. Int J Med Inform. 2009, 78: 127-140. 10.1016/j.ijmedinf.2008.06.010.View ArticleGoogle Scholar
- Wetering R, Batenburg R, Lederman R: Evolutionistic or revolutionary paths? a PACS maturity model for strategic situational planning. Int J CARS. 2010, 5: 401-409. 10.1007/s11548-010-0414-y.View ArticleGoogle Scholar
- Price M, Lau F, Lai J: Measuring EMR adoption: a framework and case study. Elect Healthc. 2011, 10: e25-e30.Google Scholar
- Hassenzahl M, Tractinsky N: User experience - a research agenda. Behav Inform Tech. 2006, 25: 91-97. 10.1080/01449290500330331.View ArticleGoogle Scholar
- Kaplan B, Harris-Salamone KD: Health IT success and failure: recommendations from literature and an AMIA workshop. J Am Med Inform Assoc. 2009, 16: 291-299. 10.1197/jamia.M2997.View ArticlePubMedPubMed CentralGoogle Scholar
- Weber-Jahnke J, McCallum G: A Light-Weight Component for Adding Decision Support to Electronic Medical Records. Proc 41st Hawaii Int Conf Syst Sci. 2008, Washington, DC, USA: IEEE Computer Society, 1-10.Google Scholar
- Bilykh I, Price M, Jahnke JH, McCallum G: Using the Clinical Document Architecture as open data exchange format for interfacing EMRs with clinical decision support systems. Proc 19th IEEE Int Symp Computer-Based Med Syst, Salt Lake City, Utah. 2006, Los Almitos, CA: IEEE, 855-860.Google Scholar
- Price M, Jahnke-Weber JH, McCallum G: Making available clinical decision support in service-oriented architectures. J Inform Tech Healthc. 2008, 6: 42-54.Google Scholar
- Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, Purves I: Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325: 941-10.1136/bmj.325.7370.941.View ArticlePubMedPubMed CentralGoogle Scholar
- Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou X-H, Eckert GJ, Smith FE, Nienaber N, McDonald CJ, Wolinsky FD: Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med. 2003, 18: 967-976. 10.1111/j.1525-1497.2003.30635.x.View ArticlePubMedPubMed CentralGoogle Scholar
- van Doormaal JE, van den Bemt PMLA, Zaal RJ, Egberts ACG, Lenderink BW, Kosterink JGW, Haaijer-Ruskamp FM, Mol PGM: The influence that electronic prescribing has on medication errors and preventable adverse drug events: an interrupted time-series study. J Am Med Inform Assoc. 2009, 16: 816-825. 10.1197/jamia.M3099.View ArticlePubMedPubMed CentralGoogle Scholar
- Cook PP, Rizzo S, Gooch M, Jordan M, Fang X, Hudson S: Sustained reduction in antimicrobial use and decrease in methicillin-resistant Staphylococcus aureus and Clostridium difficile infections following implementation of an electronic medical record at a tertiary-care teaching hospital. J Antimicro Chemo. 2011, 66: 205-209. 10.1093/jac/dkq404.View ArticleGoogle Scholar
- Dorr D, Bonner LM, Cohen AN, Shoai RS, Perrin R, Chaney E, Young AS: Informatics systems to promote improved care for chronic illness: a literature review. J Am Med Inform Assoc. 2007, 14: 156-163. 10.1197/jamia.M2255.View ArticlePubMedPubMed CentralGoogle Scholar
- Crosson JC, Ohman-Strickland PA, Hahn KA, DiCicco-Bloom B, Shaw E, Orzano AJ, Crabtree BF: Electronic medical records and diabetes quality of care: results from a sample of family medicine practices. Ann Fam Med. 2007, 5: 209-215. 10.1370/afm.696.View ArticlePubMedPubMed CentralGoogle Scholar
- Ash JS, Stavri PZ, Kuperman GJ: A consensus statement on considerations for a successful CPOE implementation. J Am Med Inform Assoc. 2003, 10: 229-10.1197/jamia.M1204.View ArticlePubMedPubMed CentralGoogle Scholar
- Ash JS: Factors and forces affecting EHR system adoption: report of a 2004 ACMI discussion. J Am Med Inform Assoc. 2004, 2004 (12): 8-12.View ArticleGoogle Scholar
- Lahrmann G, Marx F, Winter R, Wortmann F: Business intelligence maturity models: an overview. VII Conf Ital Chap AIS. 2010, 1-12.Google Scholar
- Greenhalgh T, Russell J: Why do evaluations of eHealth programs fail? an alternative set of guiding principles. PLoS Med. 2010, 7: e1000360-10.1371/journal.pmed.1000360.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/14/43/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.