Survey of information technology in Intensive Care Units in Ontario, Canada
© Lapinsky et al; licensee BioMed Central Ltd. 2008
Received: 12 July 2007
Accepted: 24 January 2008
Published: 24 January 2008
The Intensive Care Unit (ICU) is a data-rich environment where information technology (IT) may enhance patient care. We surveyed ICUs in the province of Ontario, Canada, to determine the availability, implementation and variability of information systems.
A self-administered internet-based survey was completed by ICU directors between May and October 2006. We measured the spectrum of ICU clinical data accessible electronically, the availability of decision support tools, the availability of electronic imaging systems for radiology, the use of electronic order entry and medication administration systems, and the availability of hardware and wireless or mobile systems. We used Fisher's Exact tests to compare IT availability and Classification and Regression Trees (CART) to estimate the optimal cut-point for the number of computers per ICU bed.
We obtained responses from 50 hospitals (68.5% of institutions with level 3 ICUs), of which 21 (42%) were university-affiliated. The majority electronically accessed laboratory data and imaging reports (92%) and used picture archiving and communication systems (PACS) (76%). Other computing functions were less prevalent (medication administration records 46%, physician or nursing notes 26%; medication order entry 22%). No association was noted between IT availability and ICU size or university affiliation. Sites used clinical information systems from15 different vendors and 8 different PACS systems were in use. Half of the respondents described the number of computers available as insufficient. Wireless networks and mobile computing systems were used in 23 ICUs (46%).
Ontario ICUs demontrate a high prevalence of the use of basic information technology systems. However, implementation of the more complex and potentially more beneficial applications is low. The wide variation in vendors utilized may impair information exchange, interoperability and uniform data collection.
The intensive care unit (ICU) is a data-rich environment, where information technology may enhance patient care by improving access to clinical data, reducing errors, tracking compliance with quality standards, and providing decision support [1–3]. The presence of more sophisticated information systems in the ICU has been associated with improved care . Despite these potential benefits, utilization of information technology in ICUs is variable, with approximately 10–15% of U.S. ICUs in 2003 having fully implemented clinical information systems . In contrast, electronic health records in other practice settings are becoming well established. For example, almost all general practices in the United Kingdom are computerized , as are the majority in Australia .
In the province of Ontario, Canada, the Ministry of Health and Long Term Care provides medical services for the province's population of 11 million through 134 acute care not-for-profit hospital corporations and an annual budget over $30 billion Canadian . This single payer system offers the opportunity for standardization of information systems, but little is currently known about the implementation and availability of information technology in the province. The ICU plays a central role in the flow of patients through the health system, as the destination of transfer of the sickest patients from the emergency room and operating room. Our objective in this study was to survey ICUs across the province to identify the availability of various types of information technology and the systems and vendors utilized. We believe that this information will be essential to integrate clinical information systems into a province-wide electronic record and to identify areas for quality improvement and future research.
Survey development and administration
We used survey methods (item generation and reduction and clinical sensibility testing) to develop a comprehensive, self-administered internet-based survey that addressed the utilization of information technology in the ICU. We piloted the survey on 3 local intensivists. Domains of interest included:
(i) The spectrum of ICU clinical data accessible electronically (e.g. clinical, laboratory data, imaging, medications)
(ii) Availability and ease of use of computers in the ICU
(iii) Availability of decision support tools
(iv) Availability of electronic imaging systems for radiology (picture archiving and communication systems, PACS)
(v) Use of electronic order entry and medication administration systems
(vi) Use of wireless or mobile systems in the ICU
We generated an email list of Ontario ICU directors from pre-existing research and administrative email lists, as well as by a manual internet search and by contacting ICUs by telephone. Eligible ICUs were those that provided mechanical ventilation (level 3 care). We emailed an information package and link to the survey and also posted the link on a Canadian critical care listserver. The survey was carried out between May and October 2006. As an incentive, participants were offered the opportunity to enter in a draw for free registration at the Toronto Critical Care Medicine Symposium. Data were collected by a commercial internet survey application provider (Surveymonkey, Portland, OR). After the initial emailing, non-respondents received a second email, followed by a personal communication by email or telephone.
The Mount Sinai Hospital Research Ethics Board approved the study. All answers were kept confidential.
Analysis was performed by hospital site for those hospitals with more than one ICU, since ICUs in the same hospital had identical information technology systems. We summarized categorical data with percentages. We used Fisher's Exact tests to analyze the association between IT availability (specifically the availability of PACS, use of an electronic Medication Administration Record and availability of computerized laboratory and imaging order entry) and university affiliation and ICU size. We carried out these statistical calculations using Statistical Analysis Software (SAS version 9.1, SAS Institute, Cary, NC). The Classification and Regression Trees (CART) method  was used to obtain the estimate of the optimal cut-point for the number of computers per ICU bed, and that cut-point was bootstrapped 2000 times to obtain the 95% confidence interval. We used R software (version 2.4.0) for the CART analysis .
We obtained responses from 50 hospitals representing 68.5% of hospitals with level 3 ICUs in the province. Of these, 21 (42%) were university-affilated and 31 (62%) used a intensivist-led management model. Twelve hospitals (24%) were in small towns (<50,000 population) and 14 (28%) in large cities (>500,000). The number of ICU beds varied, with 15 hospitals (30%) having less than 10 ICU beds, 22 hospitals (44%) having 10 to 19 beds and 13 sites (26%) with 20 or more ICU beds. The majority (64%) were medical-surgical ICUs, but various subspecialty ICUs were also represented, including trauma, cardiovascular and burns.
Availability of components of the computerized clinical information system (n = 50)
Medication administration record
Daily nursing notes
Daily physician notes
Order entry – labs/imaging
Order entry – medication
Access to patient data outside the ICU and outside the hospital (n = 50).
Access outside the ICU, within the hospital
Access outside the hospital
Availability of electronic decision support tools at sites with computerized information systems (n = 47)
Automated management guide
Links to guidelines
Link to web resources
Drug allergy alerts
Drug interaction alerts
Standardized order sets
Association between university affiliation or ICU size and (i) availability of Picture Archiving and Communication Systems (PACS), (ii) electronic Medication Administration Record (eMAR) and (iii) computerized order entry, in sites with computerized systems (n = 47).
Association with university affiliation
University affiliated % (n = 20)
Non-university affiliated % (n = 27)
Association with ICU size
<10 beds % (n = 14)
10–19 beds % (n = 20)
≥20 beds % (n = 13)
The hospitals used a large variety of software vendors. Fifteen clinical information system vendors were reported, the most frequent being Meditech (Westwood, MA), GE Healthcare (Bucks, U.K.) and Cerner (Kansas City, MO). Similarly, there was no conformity in the use of PACS vendors with 8 reported, the most frequent being Agfa Impax (Mortse, Belgium) and GE Healthcare.
Use of mobile electronic tools (n = 50).
Mobile computer carts
This self-administered internet-based survey of Ontario ICUs demonstrated a high prevalence of implementation of information technology, with 92% of sites having electronic access to laboratory results and medical imaging reports and 76% using PACS systems. The use of electronic decision support systems was less prevalent and very few sites had fully capable clinical information systems or electronic medication administration systems. We found a wide variation in the use of vendors for clinical information and PACS systems, which may significantly impair information exchange and interoperability. The availability of hardware was variable, with 46% of the sites perceiving the number of computers available to be insufficient. CART analysis, using all sites including those with and without computerized provider order entry, demonstrated a cutoff between physicians satisfied with the number of computers available and those dissatisfied at a value of approximately 0.4 to 1.1 computers per bed. Approximately half the sites surveyed utilized wireless networks with mobile computing systems.
Our survey is the first inventory of information technology capacity in ICUs in a Canadian jurisdiction and provides data on a variety of information technology domains. Our response rate was typical for healthcare surveys . Nonetheless, there are several limitations to this study. Common to all self-administered surveys, responses indicate self-reported rather than directly observed implementation of information technology. This methodology aimed to identify the technology available to practising physicians, but may have failed to identify existing technology that was not in common use. The information was obtained from physician-users of the systems, rather than from information technology specialists or other users, such as nurses. Nurses knowledge of available technology and requirements may be very different to physicians. We did not survey individual intensive care physicians or nurses to understand their attitudes, knowledge and behaviour regarding this information technology.
While rapid advances in computing technology are evident in commerce and industry, healthcare has lagged behind [1, 2]. Information technology has the potential to improve patient safety by optimizing access to information, specifically in operations with a high information and transaction load such as drug interactions and evaluation of monitoring data . The potential benefits include reduced medication errors , improved practitioner performance , and enhanced diagnostic accuracy . The degree of sophistication of computing technology in the ICU has been associated with improved outcome of quality improvement initiatives to reduce catheter related bloodstream infections . Although the literature demonstrating a benefit of computerized clinical decision support is growing [13, 14], several studies have documented the many impediments still to be overcome [15–17]. An expectation and benefit of an ICU clinical information system is that the time that a nurse spends with documentation should be reduced, allocating more time for patient care [18, 19]. However, others have demonstrated an increased documentation time following the implementation of an ICU clinical information system . Furthermore, new software systems can actually facilitate rather than reduce some types of error . Appropriate assessment of any new technology prior to implementation remains essential .
An often quoted barrier to implementation of clinical information systems is the required change in culture to healthcare workers [23, 24]. While this may be true in other clinical areas, our study demonstrates that computing systems are currently an integral component of the ICU. Having overcome these initial barriers, the next step is to introduce the more sophisticated and potentially more beneficial components of the clinical information system. The ICU is a data-rich environment at risk for data overload, and there may be significant benefit to safety and quality of care from decision support applications, medication administration systems and computerized order entry . Our data confirm the lack of standardization of software across the province, with 15 vendors of clinical information systems being used. As new systems are implemented or updated, it is essential that standardization be addressed, to allow data transfer between systems and to reduce the potential for errors related to inadequate familiarity with the software .
Providing efficient, safe, individualized care in the data-rich environment of the ICU can only be achieved with the use of information technology. We have demonstrated a significant level of early implementation in Ontario ICUs but further investment is needed. The variation in systems in use is concerning, and standardization and interoperability need to be addressed.
• Almost all ICUs in the province of Ontario, Canada, have electronic access to some component of patient information, most frequently laboratory data and imaging.
• In contrast, use of decision support systems, electronic medication administration systems and full clinical information systems is very uncommon.
• Multiple different IT vendors are used, which may impair information exchange and interoperability.
List of abbreviations
picture archiving and communication systems
electronic medication administration record
We thank Dr. Brian Haynes for reviewing and commenting on an earlier version of this manuscript.
Some of these data were presented at the American Thoracic Society meeting in May, 2007.
- Bates DW, Gawande AA: Improving safety with information technology. N Engl J Med. 2003, 348: 2526-2534. 10.1056/NEJMsa020847.View ArticlePubMedGoogle Scholar
- Varon J, Marik PE: Clinical information systems and the electronic medical record in the intensive care unit. Curr Opinion Crit Care. 2002, 8: 616-624. 10.1097/00075198-200212000-00022.View ArticleGoogle Scholar
- Martich GD, Waldmann CS, Imhoff M: Clinical informatics in critical care. J Intensive Care Med. 2004, 19: 154-163. 10.1177/0885066604264016.View ArticlePubMedGoogle Scholar
- Amarasingham R, Pronovost PJ, Diener-West M, Goeschel C, Dorman T, Thiemann DR, Powe NR: Measuring Clinical Information Technology in the ICU Setting: Application in a Quality Improvement Collaborative. J Am Med Inform Assoc. 2007, 14: 288-294. 10.1197/jamia.M2262.View ArticlePubMedPubMed CentralGoogle Scholar
- Levy MM: Computers in the ICU. J Crit Care. 2004, 19: 199-200. 10.1016/j.jcrc.2004.10.002.View ArticlePubMedGoogle Scholar
- Royal College of General Practice: Information management and technology in general practice. RCGP Information Sheet No. 7. 2005, [http://www.rcgp.org.uk/pdf/ISS_INFO_07_Feb05.pdf]FebGoogle Scholar
- Western MC, Dwan KM, Western JS, Makkai T, Del Mar C: Computerisation in Australian general practice. Aust Fam Physician. 2003, 32: 180-5.PubMedGoogle Scholar
- Canada Health Act Annual Report, 2005–2006. 2006, Ottawa: Health Canada, [http://www.hc-sc.gc.ca/hcs-sss/alt_formats/hpb-dgps/pdf/pubs/chaar-ralcs-0506/chaar-ralcs-0506_e.pdf]
- Breiman L, Friedman J, Stone CJ, Olshen RA: New York: Chapman & Hall. Classification and Regression Trees. 1984Google Scholar
- R Development Core Team: Vienna: R Foundation for Statistical Computing. R: A language and environment for statistical computing. 2005Google Scholar
- Cummings SM, Savitz LA, Konrad TR: Reported response rates to mailed physician questionnaires. Health Serv Res. 2001, 35: 1347-55.PubMedPubMed CentralGoogle Scholar
- Bates DW, Leape LL, Cullen DJ, Laird N, Petersen LA, Teich JM, Burdick E, Hickey M, Kleefield S, Shea B, Vander Vliet M, Seger DL: Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998, 280: 1311-6. 10.1001/jama.280.15.1311.View ArticlePubMedGoogle Scholar
- Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-38. 10.1001/jama.293.10.1223.View ArticlePubMedGoogle Scholar
- Friedman CP, Elstein AS, Wolf FM, Murphy GC, Franz TM, Heckerling PS, Fine PL, Miller TM, Abraham Vl: Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999, 282: 1851-6. 10.1001/jama.282.19.1851.View ArticlePubMedGoogle Scholar
- Southon G, Sauer C, Dampney K: Lessons from a failed information systems initiative: issues for complex organisations. Int J Med Inform. 1999, 55: 33-46. 10.1016/S1386-5056(99)00018-0.View ArticlePubMedGoogle Scholar
- Wears RL, Berg M: Computer technology and clinical work: still waiting for Godot. JAMA. 2005, 293: 1261-3. 10.1001/jama.293.10.1261.View ArticlePubMedGoogle Scholar
- Lapointe L, Rivard S: Getting physicians to accept new information technology: insights from case studies. CMAJ. 2006, 174: 1573-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Bosman RJ, Rood E, Oudemans-van Straaten HM, Van der Spoel JI, Wester JP, Zandstra DF: Intensive care information system reduces documentation time of the nurses after cardiothoracic surgery. Intensive Care Med. 2003, 29: 83-90.View ArticlePubMedGoogle Scholar
- Wong DH, Gallegos Y, Weinger MB, Clack S, Slagle J, Anderson CT: Changes in intensive care unit nurse task activity after installation of a third-generation intensive care unit information system. Crit Care Med. 2003, 31: 2488-94. 10.1097/01.CCM.0000089637.53301.EF.View ArticlePubMedGoogle Scholar
- Saarinen K, Aho M: Does the implementation of a clinical information system decrease the time intensive care nurses spend on documentation of care?. Acta Anaesthesiol Scand. 2005, 49: 62-5. 10.1111/j.1399-6576.2005.00546.x.View ArticlePubMedGoogle Scholar
- Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, Strom BL: Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors. JAMA. 2005, 293: 1197-1203. 10.1001/jama.293.10.1197.View ArticlePubMedGoogle Scholar
- Adhikari N, Lapinsky SE: Medical informatics in the intensive care unit: overview of technology assessment. J Crit Care. 2003, 18: 41-47. 10.1053/jcrc.2003.YJCRC9.View ArticlePubMedGoogle Scholar
- Clemmer TP: Computers in the ICU: where we started and where we are now. J Crit Care. 2004, 19: 201-207. 10.1016/j.jcrc.2004.08.005.View ArticlePubMedGoogle Scholar
- Garland A: Improving the ICU: part 2. Chest. 2005, 127: 2165-79. 10.1378/chest.127.6.2165.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/8/5/prepub