- Research article
- Open Access
- Open Peer Review
Use of electronic medical records and quality of patient data: different reaction patterns of doctors and nurses to the hospital organization
BMC Medical Informatics and Decision Making volume 17, Article number: 17 (2017)
As the implementation of Electronic Medical Records (EMRs) in hospitals may be challenged by different responses of different user groups, this paper examines the differences between doctors and nurses in their response to the implementation and use of EMRs in their hospital and how this affects the perceived quality of the data in EMRs.
Questionnaire data of 402 doctors and 512 nurses who had experience with the implementation and the use of EMRs in hospitals was analysed with Multi group Structural equation modelling (SEM). The models included measures of organisational factors, results of the implementation (ease of use and alignment of EMR with daily routine), perceived added value, timeliness of use and perceived quality of patient data.
Doctors and nurses differ in their response to the organisational factors (support of IT, HR and administrative departments) considering the success of the implementation. Nurses respond to culture while doctors do not. Doctors and nurses agree that an EMR that is easier to work with and better aligned with their work has more added value, but for the doctors this is more pronounced. The doctors and nurses perceive that the quality of the patient data is better when EMRs are easier to use and better aligned with their daily routine.
The result of the implementation, in terms of ease of use and alignment with work, seems to affect the perceived quality of patient data more strongly than timeliness of entering patient data. Doctors and nurses value bottom-up communication and support of the IT department for the result of the implementation, and nurses respond to an open and innovative organisational culture.
Electronic Medical Records (EMRs) are widely implemented in health care organisations, and much is known about factors affecting implementation processes. Despite the expected benefits of EMRs [1–3] the adoption of EMRs proceeds slowly [3, 4]. The body of literature of implementation of EMRs is considerable and many competing theories and models exist. In many of those theories and models, the organisation, the type of innovation or technology and the user [1, 5–9] play a role. Evidence on organisational factors affecting innovation processes in health care organisations is mixed . Some studies find positive associations  and others find little or no effect on the innovation process [12, 13]. Reasons for users to resist the implementation of an EMR are a poor design , too much pressure to adopt the EMR  or a lack of user involvement in the implementation process [16, 17].
For implementation processes to be successful and to prevent adverse effects it is essential that one considers the interaction between all user groups, the organisation and the innovation. Taking account of potential differences in responses between the user groups increases the chance of a successful implementation of EMRs [18, 19].
We tried to construct a model that was based on knowledge in the literature and searched for operationalisations used in similar research. We build on the knowledge that the environment in which the innovation is adopted is essential for realisation of its potential . An assumption in this paper is that a successful implementation of an EMR improves the quality of patient data. A new element of our study is that we investigate differences in responses to the EMRs between two user groups, doctors and nurses.
Aspects such as organisational culture and climate, leadership style, power balance and social relations  have been found to affect the uptake of innovations. When implementing an IT innovation the “soft” social and cultural aspects are as important as the “hard” technical and product specifications [22, 23]. Adding to the complexity is the fact that EMRs are used by different groups that need to work as a team and at the same time have different positions in the hospitals and can therefore be expected to react differently to organisational factors [24–27]. Implementation processes require users to change their work routines and they may be confronted with disadvantages including loss of autonomy [24, 28, 29]. Advantages and disadvantages may differ between user groups; their expectations may differ , their preferences may differ  and they may prefer different ways to use EMRs . Taking account of the knowledge in the literature, and taking account of possible different reactions between user groups, we constructed a model that includes paths that lead from organisational factors to the outcome of the implementation process and the subsequent added value for its users in their daily routine , which ultimately affects the quality of patient data in the EMR. We hypothesise that the quality of the IT innovation is better if the quality of the organisational system is better and that this positively affect satisfaction of the user, EMR use and quality of patient data. This will affect both the individual and the organisational impact of the newly implemented system. We also expect that organisational factors are more important with regard to the successful implementation and use for nurses than for doctors. The main reason being that most medical specialists work in partnerships within hospitals, while nurses are employed by hospitals. The research question of this paper is: Which organisational factors affect the implementation success of the EMR as perceived by the user groups doctors and nurses most strongly and (on which aspects) does this differ between doctors and nurses?
Questionnaire and data collection
Doctors and nurses were invited to complete an on-line questionnaire if they worked in hospitals where an EMR was being implemented at the time of the data collection. The questionnaire contained items measuring the constructs of the theoretical model. The items in the questionnaire were based on previous research as much as possible. When needed, new items were developed (Additional file 1 presents the items). The constructs and links to theories are presented in the “Study variables” section.
The questionnaire was designed specifically for this study and used one time. The doctors and nurses were recruited from two separate research voluntary registries. The registry of the doctors contains physicians who volunteered to cooperate with studies by answering questionnaires. These volunteers were invited to participate in this study, explaining that is was a study on EMR use. The nurses were selected from a general research voluntary registry. In this registry nurses were selected based on their reported occupation. These nurses were invited to reply to the questionnaire similarly to the doctors. First, they were asked whether they currently worked with EMRs in their hospitals. Only those nurses who scored a “yes” on this question could participate in the present study. Both questionnaires were online for about two weeks. The respondents received a reward after completing the questionnaire,. Doctors received a monetary reward and the nurses were given “points” that enabled them to buy products. No reminders were sent.
The data were analysed using Structural Equation Modelling (SEM), which combines path-analysis, simultaneous-equation models and factor analysis [33, 34]. It enables estimating associations of latent variables (unobserved variables, measured with multiple items) and estimating multiple regression equations, including more than one dependent variable in one model. The results show the level of fit between the observed items and the latent variables. Regression parameters express the strength of the association between the latent variables. The evaluation of model fit is presented using three fit measures : the RMSEA (Root Mean Square Error of Approximation), the CFI (Comparative Fit Index), and the TLI (Tucker Lewis Index). Each measure has to meet a particular threshold to indicate a good fit. We used the package ‘lavaan’ in R to conduct the analyses .
The model that we built to test our hypotheses consists of four parts: Organisational aspects, Success of implementation, Decision of user and Result of using the EMR (Fig. 1 presents the model).
The social system that needs to adopt the innovation  is the hospital and the hospital contains a number of elements affecting the implementation process [36, 37]. There are several management tools and both “hard” organisational aspects and “soft” cultural and social aspects have been found to influence innovation [6, 21, 22, 37, 38]. In the following sections, we present the elements of the empirical model and literature of implementation research related to the subsequent elements.
The management of a hospital has several tools to guide organisational processes. Authentic leadership (Fig. 1) tends to affect other organisation members (e.g. clinicians) in that they legitimise management’s role to guide the organisation [21, 39–41] and that they more readily accept organisational changes. Bottom-up influence is related to leadership and is known to affect the support of EMRs [16, 17, 41–43]. The model includes these two management tools. The precise wordings of the items are presented in the Additional file 1. Authentic leadership has a Cronbach’s alpha of 0.92 and bottom-up communication has a Cronbach’s alpha of 0.90.
Support from other departments
An other organisational aspect that we included in the model is support from other departments. Starting to work with an EMR requires new skills that need specific education and training during the implementation stage . The HR department may help identifying these needs and offer targeted courses and training , thus improving the performance of the clinicians working with the EMR . IT support may help to overcome practical problems. Hence, support from the IT department may play an important role during and after the implementation stage . And because of the intrinsic link between EMR and administration, having administrative staff that supports users with entering patient data is likely to affect the successful implementation and use of an EMR . The model includes three constructs for support from the IT, HR and administrative department. See the Additional file 1 for precise wordings. The Cronbach’s alphas of the scales are 0.91 (IT department.), 0.90 (HR department) and 0.93 (administrative department).
A culture that enhances communication , or a culture that is innovative  and open [21, 42], is likely to contribute to the success of the implementation of EMR. We included two measures of culture: open culture and innovative culture, based on work of Woerkom  and de Jong et al.  respectively. The Cronbach’s alphas are 0.70 for innovative culture and 0.76 for open culture.
Success of implementation
The success of implementation is measured with two items: ease of use and alignment with daily routine . This notion is based on the Technology Acceptance Model (e.g. ). The result of the EMR implementation is measured with two variables: ease of use and alignment with daily routine of the user groups . The Cronbach’s alphas are 0.87 and 0.92 respectively.
Adoption decision by user
When the added value of good quality patient data becomes clear to the user, the satisfaction with the system as well as its use are likely to increase . We assume that the fit between technology, user and task affects the use of the innovation  in the sense that a better fit between daily routine and ease of use is likely to further the use of the innovation. We expect that ease of use and alignment of EMR to the daily routine will positively affect the perceived added value of EMR and that the users consequently will enter the patient data more timely in the EMR.
Data quality in EMR
The ultimate dependent variable, presented in Fig. 1 in the far right “result of use” section, represents the quality of the data in EMR as reported by its users (cf. organisational impact in ). It was assumed that if the data represents reality in terms of the patient’s health and the care provided accurately and completely , its information will support the users (i.e. clinicians) in their work. Then the users will take full advantage of the potential of the EMR and it will support the organisation in process management, e.g. accurate billing .
Three factors are expected to influence quality of the data. First, by the way in which patient data are entered into the EMR (Fig. 1 section “Decision of user”). We assumed that the quality of the data is higher when the time between seeing the patient and entering the patient data is shorter. Second, when the EMR is easy to use, and this may be the result of a well-functioning implementation process, the quality of the data is higher. Third, a better alignment of the EMR functionalities and the daily routine of its users  is also expected to positively affect the quality of the data.
The control variables are gender (0 = male and 1 = female), age and level of implementation of the EMR at the time of data collection. It is known that the implementation stage of the EMR affects the perception and support of users of EMRs [55, 56]. The measurement of level of implementation is based on answers of respondents about computerisation of EMR in their hospital is (next to using paper files). The score is higher for respondents working with a completely computerised EMR. If the complete EMR was reported to consist of a single system, the score on this variable is higher (+1), and if the EMR consists of multiple systems (and not one integrated system), the score is lower (+0.5). When the data entered by nurses are visible to doctors and vice versa, the score of implementation level is also higher (+1).
Comparison of user groups
The groups (doctors and nurses) are compared in two ways. First, we investigate whether the doctors and nurses differ in the regression parameters in differing from zero. Second, we compare significant differences of the regression coefficients between the groups by re-estimating the multi group model, but constraining the regression parameters to be similar across groups. Subsequently, we ran models in which the parameter of interest was allowed to differ. Subsequently, the chi2 change of the two models is compared. If the chi2 improves significantly, we conclude that the doctors and nurses differ in behaviour on this regression parameter. The differences in chi2 and subsequent significance levels are reported in the right hand columns of Table 2.
474 doctors (24%) and 699 (19%) nurses returned the questionnaires. Only complete questionnaires were included. Due to item non-response, 914 respondents were included in the analyses (402 doctors and 512 nurses). Where possible, open answers were used to add to the closed questions, e.g. on the question of quality of the data. Sample characteristics are shown in Table 1. 17% of the nurses reported to work in an academic hospital, 22% in a top-clinical hospital, 50% in a general hospital, 3% in a specialized hospital, 7% in a mental hospital, and 1% in a private hospital. In the Netherlands, there are 85 hospitals, 8 of which are academic hospitals (9.4%), and 90.6% are general or specialized hospitals.Footnote 1 This means that in our respondent group, nurses and doctors from academic hospitals are overrepresented. This can be explained by the fact that we intended to include only nurses and doctors who had experience with working with EMR and that Dutch academic hospitals are at the forefront of implementing EMR.
Table 2 and Fig. 2a,b and c present the main results of the analyses. Table 2 shows the regression coefficients of the multi group model for the two groups (doctors and nurses) and the analyses of the difference between the two groups. In the right columns, the chi2 difference with one degree of freedom is presented of a model with constraint regression parameters and a model with that particular regression parameter allowed to differ between the groups. If the difference is significant, this means that the nurses and doctors differ on this parameter. Figure 2a presents the SEM model for nurses and Fig. 2b for doctors. Figure 2c presents the differences between the two groups. The solid arrows represent the significant regression paths and the dotted arrow the non-significant results. The multi group model (no constraints) has a good fit: chi2 (1966) = 3852.62; CFI = 0.93; TLI = 0.93; RMSEA = 0.046 (95% CI = 0.044-0.048).
Organisational factors and result of implementation
Regression coefficients (reported in B and s.e.) and differences between the groups (the chi2 of model fit) in Table 2 show that nurses and doctors value the influence of organisational factors on the success of implementation differently. In line with the expectations, the doctors report that their EMR is easier to work with if there is more support from the administrative department (B = 0.15, s.e. = 0.09), more support from the IT department (B = 0.22, s.e. = 0.09), more bottom-up communication (B = 0.13, s.e. = 0.05) and a more innovative culture (B = 0.19, s.e. = 0.11). The nurses find their EMR easier to work with if there is more authentic leadership (B = 0.13, s.e. = 0.07) and more support from the IT department (B = 0.37, s.e. = 0.06) and bottom-up communication (0.16, s.e. = 0.05). The nurses find the EMR easier to work with when the culture is less open (B = −0.21, s.e. = 0.11) and when the culture is more innovative (B = 0.23, s.e. = 0.10). The doctors and nurses differ in the influence of the support of the administrative department (chi2 difference = (4.39 (1)) and of the HR department (chi2 difference = 4.27 (1)).
Doctors find the EMR to be better aligned with their daily routine if there is more authentic leadership (B = 0.31, s.e. = 0.11) and more bottom-up communication in the hospital (B = 0.13, s.e. = 0.06). The nurses find their EMR to be better aligned with their daily routine when they get more support of the IT department (B = 0.33, s.e. = 0.07), but the HR department is negatively affect the alignment of the EMR (B = −0.13, s.e. = 0.05). In line with our expectations, nurses find the EMR better aligned with their work when there is more bottom-up communication (B = 0.19, s.e. = 0.06) and an innovative culture (B = 0.27, s.e. = 0.11).
Success of implementation, added for value users and subsequent use
The added value of the users of the EMR increases with easiness to work with and with alignment to their work for both doctors (B = 0.31; s.e. = 0.04 and B = 0.76; s.e. = 0.05 respectively) and nurses (B = 0.21; s.e. = 0.04 and B = 0.78; s.e. = 0.05).
Quality of patient data
Doctors find the patient data in the EMR of better quality when the EMR is easier to use (B = 0.27, s.e. = 0.04). The nurses also find the quality of the patient data to be better when the EMR is easier to use (B = 0.13, s.e. = 0.04) and nurses report that the quality of the data is better when the alignment to work is better (B = 0.17, s.e. = 0.04). The doctors and nurses do not differ in these aspects.
Concerning the control variables, we see that doctors and nurses react differently to the level of implementation. This affects the nurses less than the doctors in their opinion on how it aligns with daily routine (chi2 difference = 6.15 (1)) and quality of the data (chi2 difference = 7.75 (1)).
This study aimed to increase our understanding of which organisational factors affect the success of implementation processes and how this may differ between doctors and nurses. We tried to construct a model that was based on knowledge in the literature and searched for operationalisations used in similar research. The body of literature is considerable and many competing theories and models exist. In many theories and models, the organisation, the innovation or technology and the user [1, 5–9] play a role. In many theories and models the purpose of an implementation process, i.e. to improve the status quo, remains more or less implicit, but we tried to include an outcome measure in the model: quality of the patient data. A new element of our study is that we applied the model to two different user groups (doctors and nurses) and found that they responded differently in a number of ways. Differences between stakeholders in implementation processes are acknowledged previously, but as far as we know, this is the first study to show that different user groups react differently to the same organisational aspects in an implementation process.
The most prominent differences between the doctors and the nurses are in their estimations of the influence of organisational support on implementation success. We find that the doctors and nurses differ in reaction to the support of the HR department. While the nurses tend to value HR support negatively, the doctors appear to state that HR has little influence. The results of bottom-up communication are positive as expected for both user groups and when the EMRs are easier to use and better aligned with the work of the users, the added value is perceived to be higher.
We expected to find that clinicians who saw fewer benefits from working with the EMR would be more inclined to delay entering the patient data. However, organisational aspects were found to restrict much of the opportunities of the clinicians to hamper the use of the EMR. The characteristics of the result of the implementation are more closely associated with the use of the EMR. When the EMR is perceived as easy to use and is better aligned with their daily routines, less time elapses between the patient’s visit and entering the patient data. The data indicate that doctors’ opinions change stronger after working with the EMRs than the nurses’, doctors tend to be more positive about how the EMR aligns with their routine and about quality of patient data. We did not find this for the nurses.
In this study, an innovative culture implies that colleagues and managers are inclined to consider new ideas to improve work processes. Interestingly, we found that an open culture, which is open to discussions on suboptimal performance, did not result in a better outcome of the implementation process. Contrary to expectations, nurses who had more opportunities to discuss problems with colleagues and management also found the EMR harder to work with. An explanation might be that in an innovative culture, the employees are encouraged to try new things, and not to dwell on what went wrong due to new working methods.
It should also be noted that the data used to investigate the measurement of the theoretical constructs relies on the perceptions of members of the organisation as they are reported by members of the organisation. This means that we did not investigate an ‘objective’ measure. Although such information is insightful, for example because organisational members have more confidence in projects if they believe that the management of their organisation can manage them appropriately, it should be acknowledged that these perceptions may not fully capture the actual situation in an organisation. This can be seen as a limitation, but may also be argued that the perceived situations (such as culture but also quality of the data) is what really affects the work processes of the doctors and nurses, more than the objective situation. If management for instance reports to ensure sufficient bottom-up communication, but doctors and nurses experience differently, measuring this parameter at the managerial level is not likely to enhance our understanding of the mechanisms that affect the use of innovations. Measurements of the factors in the model may be improved by combined views of more stakeholders and study where views overlap. Measurement of the quality of the data of EMRs can be measured even better since the files are stored and can be retrieved at a later moment in time. Therefore, improved measurements of the quality of data are for instance to retrospectively rate consistency and completeness of the patient files. This study shows that different actors react differently to the same organisational factors and future studies may focus on differences and similarities of perceptions of organisational factors and how these affect implementation processes.
We constructed the models based on the theoretical consideration presented in the introduction. First, we constructed the scales based on factor analyses. We confirmed the results with reliability analyses, to estimate the Cronbach’s alpha of the scales. Next we built the model, assuming that organisational factors would affect the result of the implementation process and that in turn this would affect the response of the users and subsequent quality of use of the innovation. We took all organisational factors as a starting point without hypothesising on possible causation among these factors. It could also be argued for instance that leadership and bottom-up communication are enablers for the quality of practical support of the HR, IT and administrative departments. This could then maybe provide a mechanism to explain the effects of leadership and bottom up communication. However, given that both aspects also appear to have direct relations with the variables that indicate the success of the implementation, we assume that this model is sufficiently close to reality without having to add to the complexity of the model.
Given the relatively low response and the overrepresentation of respondents working in academic hospitals, the analyses may be biased to a certain extent. In general, academic centres are first to adopt novel techniques and people working in academic hospitals may be more inclined to use innovations than doctors and nurses in non-academic hospitals. By implication, in particular the variance in the attitudinal measure is lower than it would have been if the sample were representative on this parameter. Part of the lack of significance of the attitudinal variable may be that the respondents can do little else but to adopt an innovation that is implemented organisation-wide.
Doctors and nurses differ in a number of aspects in their response to (new) use of EMRs. Bottom-up influence gave the most coherent results: for both doctors and nurses, the success of the innovation came with more bottom-up communication. A second relatively consistent finding is that support of the IT departments yields a positive result on EMR implementation. Doctors and nurses differ in their responses to the support of other department. Organisational culture had some influence but it seems to be less important and may work as a negative factor in use of EMRs.
By comparing the different factors that can influence the success of implementation, this study contributes to the scientific field of innovation and the implementation of new technology. We found indications that characteristics of the EMR (ease of use and alignment with tasks) have more influence on the quality of the data in the EMR than timely entering of patient data by the user groups.
For hospital managers, results of this study are directly applicable. Many of the actions they take, may result in differences in reactions from the user groups, sometimes in subtle but possibly relevant. However, when the users have bottom-up influence during and after the implementation process and when the IT department has the skills and ability to give optimal support to the users, this may positively affect the implementation success. In turn more successful the results of the implementation process, the better the quality of the data in the EMR, regardless of how timely the users enter the data into the system.
Comparative fit index
Electronic medical record
Root mean square error of approximation
Structural equation modelling
Tucker lewis index
Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144:742–52.
Hillestad R, Bigelow J, Bower A, Girosi F, Meili R, Scoville R, Taylor R. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Aff (Project Hope). 2005;24:1103–17.
Nambisan P, Kreps GL, Polit S. Understanding electronic medical record adoption in the United States: communication and sociocultural perspectives. Interact J Med Res. 2013;2:e5.
Boonstra A, Broekhuis M. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res. 2010;10:231.
Ammenwerth E, Iller C, Mahler C. IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study. BMC Med Inform Decis Mak. 2006;6:3.
Ancker JS, Kern LM, Abramson E, Kaushal R. The triangle model for evaluating the effect of health information technology on healthcare quality and safety. J Am Med Inform Assoc. 2012;19:61–5.
DeLone WH, Mclean ER. Information systems success: the quest for the dependent variable. Inf Syst Res. 1992;3:60–95.
Rogers EM. Diffusion of Innovations, 4th Edition. New York: Simon and Schuster; 1995.
Grol R, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85:93–138.
Otieno GO, Hinako T, Motohiro A, Daisuke K, Keiko N. Measuring effectiveness of electronic medical records systems: towards building a composite index for benchmarking hospitals. Int J Med Inform. 2008;77:657–69.
Xue Y, Liang H, Wu X, Gong H, Li B, Zhang Y. Effects of electronic medical record in a Chinese hospital: a time series study. Int J Med Inform. 2012;81:683–9.
Petroll AE, Phelps JK, Fletcher KE. Implementation of an electronic medical record does not change delivery of preventive care for HIV-positive patients. Int J Med Inform. 2014;83:273–7.
Vishwanath A, Singh SR, Winkelstein P. The impact of electronic medical record systems on outpatient workflows: a longitudinal evaluation of its workflow effects. Int J Med Inform. 2010;79:778–91.
Babbott S, Manwell LB, Brown R, Montague E, Williams E, Schwartz M, Hess E, Linzer M. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc. 2014;21:e100–6.
Ford EW, Menachemi N, Peterson LT, Huerta TR. Resistance is futile: but it is slowing the pace of EHR adoption nonetheless. J Am Med Inform Assoc. 2009;16:274–81.
Sassen EJ. Love, hate, or indifference: how nurses really feel about the electronic health record system. Comput Inform Nurs. 2009;27:281–7.
Lium JT, Tjora A, Faxvaag A. No paper, but the same routines: a qualitative exploration of experiences in two Norwegian hospitals deprived of the paper based medical record. BMC Med Inform Decis Mak. 2008;8:2.
Sykes TA, Venkatesh V, Rai A. Explaining physicians’ use of EMR systems and performance in the shakedown phase. J Am Med Inform Assoc. 2011;18:125–30.
Miller RH, Sim I. Physicians’ use of electronic medical records: barriers and solutions. Health Aff. 2004;23:116–26.
Deuten JJ, Rip A, Jelsma J. Societal embedding and product creation management. Technol Anal Strateg Manag. 1997;9:131–48.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.
Greenhalgh T, Morris L, Wyatt JC, Thomas G, Gunning K. Introducing a nationally shared electronic patient record: case study comparison of Scotland, England, Wales and Northern Ireland. Int J Med Inform. 2013;82:e125–38.
Pare G, Raymond L, de Guinea AO, Poba-Nzaou P, Trudel MC, Marsan J, Micheneau T. Barriers to organizational adoption of EMR systems in family physician practices: a mixed-methods study in Canada. Int J Med Inform. 2014;83:548–58.
McGinn CA, Grenier S, Duplantie J, Shaw N, Sicotte C, Mathieu L, Leduc Y, Legare F, Gagnon MP. Comparison of user groups’ perspectives of barriers and facilitators to implementing electronic health records: a systematic review. BMC Med. 2011;9:46.
Holden RJ. Physicians’ beliefs about using EMR and CPOE: in pursuit of a contextualized understanding of health IT use behavior. Int J Med Inform. 2010;79:71–80.
Myers JJ, Koester KA, Chakravarty D, Pearson C, Maiorana A, Shade SB, Steward WT. Perceptions regarding the ease of use and usefulness of health information exchange systems among medical providers, case managers and non-clinical staff members working in HIV care and community settings. Int J Med Inform. 2012;81:e21–9.
McGinn CA, Gagnon MP, Shaw N, Sicotte C, Mathieu L, Leduc Y, Grenier S, Duplantie J, Abdeljelil AB, Legare F. Users’ perspectives of key factors to implementing electronic health records in Canada: a Delphi study. BMC Med Inform Decis Mak. 2012;12:105.
Laerum H, Karlsen TH, Faxvaag A. Use of and attitudes to a hospital information system by medical secretaries, nurses and physicians deprived of the paper-based medical record: a case report. BMC Med Inform Decis Mak. 2004;4:18.
Noblin A, Cortelyou-Ward K, Cantiello J, Breyer T, Oliveira L, Dangiolo M, Cannarozzi M, Yeung T, Berman S. EHR implementation in a new clinic: a case study of clinician perceptions. J Med Syst. 2013;37:9955.
Lambooij MS, Hummel MJ. Differentiating innovation priorities among stakeholder in hospital care. BMC Med Inform Decis Mak. 2013;13:91.
Struik MH, Koster F, Schuit AJ, Nugteren R, Veldwijk J, Lambooij MS. The preferences of users of electronic medical records in hospitals: quantifying the relative importance of barriers and facilitators of an innovation. Implement Sci. 2014;9:69.
Ancker JS, Kern LM, Edwards A, Nosal S, Stein DM, Hauser D, Kaushal R. How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use. J Am Med Inform Assoc. 2014;21:1001–8.
Roseel Y. Lavaan: an R package for structural equation modeling. J Stat Softw. 2012;48:1–36.
Jöreskog KG, Sörbom D. Advances in factor analysis and structural equation models. New York: University Press of America; 1979.
Schumacher RE, Lomax RG. A beginner’s guide to structural equation modeling. Hilsdale: Lawrence Erlbaum; 1996.
Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8:22.
Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003;362(9391):1225–230.
Grol R, Wensing M. Implementatie, effectieve verbetering van de pati√’ntenzorg. Amsterdam: Reed Business; 2011.
Bass BM. Handbook of leadership; theory, research and managerial applications. New York: Free Press; 2008.
West MA, Borrill CS, Dawson JF, Brodbeck F, Shapiro DA, Haward B. Leadership clarity and team innovation in health care. Leadersh Q. 2003;14:393–410.
Paré G, Sicotte C, Poba-Nzaou P, Balouzakis G. Clinicians’ perceptions of organizational readiness for change in the context of clinical information system projects: insights from two cross-sectional surveys. Implement Sci. 2011;6.
Nemeth LS, Feifer C, Stuart GW, Ornstein SM. Implementing change in primary care practices using electronic medical records: a conceptual framework. Implement Sci. 2008;3:3.
Edwards C. Nursing leaders serving as a foundation for the electronic medical record. J Trauma Nurs. 2012;19:111–4. quiz 115–116.
Whitten P, Buis L, Mackert M. Factors impacting providers’ perceptions regarding a midwestern university-based EMR. Telemed J E Health. 2007;13:391–7.
Taft T, Lenert L, Sakaguchi F, Stoddard G, Milne C. Effects of electronic health record use on the exam room communication skills of resident physicians: a randomized within-subjects study. J Am Med Inform Assoc. 2015;22:192–8.
Kraatz AS, Lyons CM, Tomkinson J. Strategy and governance for successful implementation of an enterprise-wide ambulatory EMR. J Healthc Inf Manag. 2010;24:34–40.
Reynolds K, Nowinski C, Becker S, Beaumont J. Organizational culture changes in an integrated delivery system with a fully implemented electronic medical record. AMIA Annu Symp Proc. 2006:1075. PMC1839303.
Retchin SM, Wenzel RP. Electronic medical record systems at academic health centers: advantages and implementation issues. Acad Med. 1999;74:493–8.
van Woerkom M. Critical reflections at work. Bridging individual and organizational learning. Enschede: Printpartners Ipskamp; 2003.
de Jong JPJ, den Hartog DN. Determinants of innovative behaviour: research on knowledge workers in SME (Determinanten van innovatief gedrag: een onderzoek onder kenniswerkers in het MKB). Gedrag Organisatie. 2005;18:235–59.
Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. Manag Inf Syst Q. 1989;13:319–40.
Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q. 2003;27:425–78.
Kimiafar K, Sadoughi F, Sheikhtaheri A, Sarbaz M. Prioritizing factors influencing nurses’ satisfaction with hospital information systems: a fuzzy analytic hierarchy process approach. Comput Inform Nurs. 2014;32:174–81.
Jang J, Yu SH, Kim CB, Moon Y, Kim S. The effects of an electronic medical record on the completeness of documentation in the anesthesia record. Int J Med Inform. 2013;82:702–7.
El-Kareh R, Gandhi TK, Poon EG, Newmark LP, Ungar J, Lipsitz S, Sequist TD. Trends in primary care clinician perceptions of a new electronic health record. J Gen Intern Med. 2009;24:464–8.
McMurray J, Hicks E, Johnson H, Elliott J, Byrne K, Stolee P. ‘Trying to find information is like hating yourself every day’: the collision of electronic information systems in transition with patients in transition. Health Informatics J. 2013;19:218–32.
The authors thank Iris Andriessen, Lidwien Lemmens, Koen vd Swaluw and Barbara Schooneveldt for their constructive comments and discussions on this paper.
This research was funded by the Strategic Research Program of the National Institute of Public Health and the Environment. The funding agency did not influence the study design, collection, analysis, and interpretation of data or decision to publish.
Availability of data and materials
ML initiated data collection and analyses, wrote substantial sections of the manuscript, HD co-wrote the manuscript and conclusions, FK assessed and improved the analyses and wrote sections of the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
According to The Dutch National Ethics Board (Central Committee on Research involving Human Subjects) formal testing by a medical ethical committee was not necessary, because the responding clinicians were asked to fill out 1) a single, anonymous survey that 2) did not include radical, incriminating or intimate questions, and 3) filling out the survey did not require much time. The respondents filled in the questionnaire on a voluntary basis after reading the explanation that the data would be used for scientific research by the National Institute of Health and the Environment. Consent was implied by completion of the questionnaire.
Latent constructs, manifest items, coding and factor loadings. Table with exact wording of questionnaire, factor loadings of items, ordered by scales, including Cronbach’s alpha’s. (DOCX 36 kb)
Data of SEM model in CSV format. Raw data of included cases. The sex and age were removed on request by the journal for protection of privacy for the respondents. (CSV 102 kb)
Codebook to the data. Variable names in the data and translated complete wording of items in questionnaire. Names of variables in Additional file 2 and the items in complete wording as presented in the Quesionnaire, translation from Dutch. (DOCX 19 kb)
Complete Dutch questionnaire. (DOCX 25 kb)
About this article
Cite this article
Lambooij, M.S., Drewes, H.W. & Koster, F. Use of electronic medical records and quality of patient data: different reaction patterns of doctors and nurses to the hospital organization. BMC Med Inform Decis Mak 17, 17 (2017) doi:10.1186/s12911-017-0412-x
- Electronic medical records
- Health personnel
- Health services
- Implementation process
- Quality of patient data