Table 1 The Constructive eHealth Evaluation Method (CeHEM): phases, objective, activity, and methods
From: Constructive eHealth evaluation: lessons from evaluation of EHR development in 4 Danish hospitals
Phase | Objective | Activity | Methods |
|---|---|---|---|
Pre-analysis | Justify a constructive evaluation need | Identify: Why… When… Who… How… Health care Management meetings based on results from summative evaluation of existing eHealth system performance | Meetings Data assessment Document analysis Satisfaction survey |
Research and planning | Set-up a competent project organisation to provide solid health care and ICT professional insight to management and CIO | a) Identification of relevant actor groups b) Selection of representatives of the identified groups c) Technology carrier analysis d) Identify indicators for final summative evaluation | Interviews Observation of work practices When users identify users Document analysis Survey |
Design | Identify appropriate system developer based on the identified requirement specifications | Identifying user needs Draft requirement specifications Select vendors | User centred and participatory design methods e.g., User Innovation Management method (UIM) |
Development | Design of proto type adjust and re-design | Information meetings with department management from different clinical context Select appropriate clinical context/wards for pilot test Pilot test of Pre-prototype Feed-back structure for errors and changes re-design | Meetings with management from different clinical context Presentation of prototype Selected Interviews for feedback Observation of test |
Implementation and diffusion | Test of proto-type in clinical setting | Form working group at department and/or ward level a) Identification of local actor groups relevant for the clinical settings b) Selection of representatives of the identified groups Customise prototype Test prototype functionalities Test usability | Clinical simulation Think aloud Cognitive walkthrough Observation of work practices |
Modified summative evaluation | Before and after technical, organizational and economic changes | End user assessment Measure based on indicators | Qualitative investigation Quantitative survey |