- Research article
- Open Access
- Open Peer Review
Evaluation of electronic patient-reported outcome assessment with cancer patients in the hospital and at home
© Wintner et al. 2015
- Received: 23 June 2015
- Accepted: 14 December 2015
- Published: 23 December 2015
Patient-reported outcomes (PRO) provide a more comprehensive picture of patients’ quality of life than do mere physicians’ ratings. Electronic data collection of PRO offers several advantages and allows assessments at patients’ homes as well. This study reports on patients’ personal internet use, their attitudes towards electronic and web-based PRO assessment (clinic-ePRO and home-ePRO) and the feasibility of these two assessment modes.
At the Medical University of Innsbruck and Kufstein County Hospital, cancer patients who participated in clinic-ePRO/home-ePRO were asked to complete a comprehensive evaluation form on their personal internet usage, attitudes towards and the feasibility of routine clinic-ePRO/home-ePRO with the Computer-based Health Evaluation System (CHES) software.
In total, 113 patients completed the evaluation form for clinic-ePRO (Ø 45 years, SD 14) and 45 patients for home-ePRO (Ø 58 years, SD 10; 33.1 per cent inclusion rate for this sample). Most patients expressed willingness to complete routine clinic-ePRO assessments in the future (94.7 per cent of clinic-ePRO patients and 84.4 per cent of home-ePRO patients) and to discuss their data with attending physicians (82.2 per cent, home-ePRO patients only). Overall, patients preferred the software over paper-pencil questionnaires (67.2 per cent of clinic-ePRO patients and 60 per cent of home-ePRO patients) and experienced it as easy to use. Only a few minor suggestions for improvement were made (e.g. adjustable font sizes).
The use of clinic-ePRO/home-ePRO was in general shown to be feasible and well accepted. However, to be more inclusive in the implementation of clinic-ePRO/home-ePRO, educational programs concerning their particular benefit in oncology practice potentially could enhance patients’ attitudes towards, and consequently their acceptance of and compliance with electronic PRO assessments.
- Testicular Cancer
- Study Nurse
- Inclusion Rate
- Online Banking
- Internet Activity
Patient-reported outcomes (PRO) regarding symptoms and quality of life (QOL) have become an important part of cancer clinical trials and routine care, as there is strong evidence that clinicians’ ratings alone do not present a complete picture of cancer patients’ symptom burdens [1–5]. Studies emphasise the additional benefit of the use of PROs (improved symptom management , better identification of intimate or psychosocial problems , enhanced communication between health care professionals and patients [7–9]) and the administration of validated questionnaires via specialized software helps to overcome common implementation barriers to the routine use of PROs (e.g., administrative obstacles, concerns that electronic assessments might use more resources than they save) [10, 11]. Electronic PRO (ePRO) assessment is generally well accepted by patients [6, 12] can be conducted in an efficient and timely manner, and both in clinical settings and in patients’ homes. Web-based home monitoring offers insight into the “black box” of a patient’s condition between hospital visits, a parameter that is systematically overlooked by QOL assessment restricted to the hospital setting. The large number of by now available specialized software solutions for ePRO assessment, predominantly developed within English speaking countries and offering a variety of data collection and educational features [13, 14], mirrors the growing interest in ePRO assessments. However, ePRO assessments require a certain level of patients’ computer literacy; therefore, patients’ habits and attitudes regarding the use of new technologies (devices and technologies, which can be summed up under the umbrella term “new media”, e.g., computers, smart phones, and the internet) are particularly important. Devices for internet access and internet infrastructure are becoming increasingly affordable and easy to manipulate. Nevertheless, some groups (e.g., older, computer-illiterate, or socioeconomically disadvantaged patients) might be put at a disadvantage when data collection is conducted mainly via new media (i.e., computer-based assessments via internet-ready devices), as familiarity with such devices seems to play an important role for implementation of ePRO and patient recruitment [15, 16]. Though, available statistics suggest that actual existing problems with lacking familiarity with or open-mindedness to computer and internet-ready devices might vanish in the course of time. For instance in the Austrian general population in 2014, about 40 % of persons older than 65 years access the internet on a regular basis (a slightly more than tenfold increase since 2002), roughly a third of these using mobile devices . Nearly as many cancer patients aged 66 to 99 years reported the availability of their own internet connection and at least occasional use of the internet . Given the actual technical development, this number can be expected to further increase. Nevertheless, the feasibility and user-friendliness of used software solutions for ePRO assessment need to be evaluated for optimization of applied systems.
to assess patients’ basic habits regarding the personal use of the internet
to assess patients’ attitudes towards clinic-ePRO or home-ePRO, and
to evaluate the feasibility of the clinic-ePRO and home-ePRO procedure.
Sample and procedure
Patients at Medical University of Innsbruck were asked to complete the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-30) while waiting for their appointment with their attending physician. Assessments were completed by the patients themselves using a tablet PC for data entry with the Computer-based Health Evaluation System (CHES). A study nurse provided an initial training if necessary and further assistance if patients reported any problem with the device or the questionnaire. Clinicians had access to patients’ self-reports via their work desktop, but there was no record of whether they actually accessed such data and no advice was given on how to use PRO data for patient appointments.
At the Department of Internal Medicine at Kufstein County Hospital, outpatients receiving chemotherapy were asked to complete the EORTC QLQ-C30 before each treatment application (clinic-ePRO). A tablet PC for autonomous data entry was used, and patients could refer any question to a study nurse. Some clinicians used CHES on their work desktops and/or printed QOL-reports in patient appointments, but no structured guideline was provided for the use of these data.
Those patients already involved in clinic-ePRO completion at outpatient visits were asked whether they wanted to provide information about their QOL at home as well by completing the questionnaire via either a website, with an iOS application (app) (developed by World Direct within an OncoTyrol project, used with Apple iPad2, Apple Inc., Cupertino, California) or a telephone interview. Those patients who chose home-ePRO were given a printout that showed their login data (an individual user name and a secure password), and for web access, the URL of the webpage. If necessary, an Apple iPad 2 (including a preinstalled iOS app) was provided by the hospital as a free loan for the duration of study participation.
After participating in clinic-ePRO or home-ePRO, patients were asked to complete an elaborated evaluation form. Patients at Medical University of Innsbruck completed the evaluation via a structured interview with a study nurse right after QOL assessment and during the waiting time for their appointment. Participating patients at Kufstein County Hospital received the evaluation form and return envelope via mail. If there was no response within 3 weeks after the first mail, patients received a written reminder with another evaluation form.
The comprehensive evaluation form was especially developed for this study by two members of our working group, incorporating experiences from previous studies [19, 20] as well as topics of scientific and clinical interest. A preliminary version of this form was reviewed by a clinician who gave advice on appropriateness and acceptable burden for patients. Several domains such as personal internet usage at home, private internet activities, device handling, and attitude towards clinic-ePRO/home-ePRO, were addressed. Because evaluation forms were tailored to the mode of assessment (at the hospital or at home), each questionnaire included, in addition to identical items covering core issues, a section of items dealing with specific aspects of clinic-ePRO or home-ePRO. Patients were asked about the mode of data collection, e.g., their willingness to complete QOL questionnaires in the future (at the hospital as well as at home), their preferred mode of administration (paper-pencil, clinic-ePRO, or no preference), and whether they preferred phone calls over home-ePRO. They also rated the perceived usefulness of clinic-ePRO/home-ePRO for informing their physician about their QOL, and were asked about their interest in seeing and storing their own results. Two questions dealt with subjectively perceived advantages and disadvantages of clinic-ePRO/home-ePRO. All questions had predefined answer categories (e.g. similar to the EORTC QLQ-C30 “not at all”. “a little”, “quite a bit” and “very much”, or other categories according to the content of the question) and an additional open answer, if patients wanted to add information/make suggestions.
Electronic data capture
The Computer-based Health Evaluation System (CHES) is a specialized software for electronic PRO data collection, result calculation, and presentation for use in clinical practice as well as for merging clinical and PRO data for research purposes . We used CHES for both clinic-ePRO in the hospital setting and home-ePRO in patients’ homes; the assessment procedure is outlined above. A study nurse gathered sociodemographic and clinical data from the hospital records and entered them in CHES to link with associated QOL data stored in the CHES database.
Patient characteristics were computed as means, standard deviations, percentages, and ranges. For comparison of mean age of patient groups one-way ANOVA (three groups) and for comparison of distribution of sex χ2—Test were calculated (5 % level of significance).
Clinic-ePRO at the hospital
Home-ePRO at home
(N = 113)
(N = 45)
mean (SD, range)
(SD 14.4, 22 to 81)
(SD 10.4, 29 to 74)
own laptop or PC
Medical University of Innsbruck
Kufstein County Hospital
Of the 166 patients approached for participation at Kufstein County Hospital, 60 declined routine ePRO assessments at home; 55 chose autonomous data entry via the internet (home-ePRO; inclusion rate of 33.1 %); and 51 chose weekly phone calls. Owing to the particular nature of the phone interviews, these were excluded from evaluation. Regarding age, the two samples of refusing patients and those who chose phone calls were comparable but significantly older than patients participating in home-ePRO (F = 13.642, p < 0.001, 68.7/67.6 years [SD 10.5/9.2] versus 58.7 years [SD 10.7]). The groups did not differ in terms of patients’ sex, though a tendency that more men rejected ePRO and more women chose phone calls (χ2 = 4.778, p = 0.092) became apparent.
Of 55 patients participating in home-ePRO, four (7.2 %) died before evaluation, two (3.6 %) refused to evaluate the home-ePRO system, and four (7.2 %) did not respond to repeated mailings. In total, between March and August 2013, 45 patients (inclusion rate: 81.8 %, 27.1 % of all eligible patients) completed the home-ePRO evaluation form. The sex ratio was nearly balanced (51.1 % female); mean age was 58.7 years (SD 10.4, range 29 to 74), and pathology types were gynecological (33.3 %), gastrointestinal (31.2 %), lung (22.2 %), and lymphoma (13.3 %). The most frequent assessment mode was the iOS app (71.9 %). Detailed information on patient characteristics is shown in Table 1.
Patients’ basic habits regarding their personal use of the internet
Patients’ basic habits regarding their personal use of the internet
N = 113
N = 45
Personal internet use
Frequency of internet usea
several times per week
several times per month
less than once per month
no internet use
Used internet-ready devicec
reading and writing e-mailsb
Number of pursued internet activities
no internet activities
4 or more activities
Nearly four fifth (77.8 %) of the 45 home-ePRO patients patients stated to use the internet at home, about the half of them (51.1 %) several times per week. The most often used internet-ready device was laptops (51.1 %), followed by PCs (35.6 %) and tablet PCs (20.0 %). Smart phones were the least commonly used device for internet-access (8.9 %). Respectively almost 18 % of patients stated not to pursue any internet activity (i.e. no internet use at all) or at least one activity. The majority of home-ePRO patients were quite familiar with the internet, as 28.9 % chose two to three activities and 33.3 % reported to use the internet for four or more activities. Searching the internet for information (71.1 %) was the by far most common activity on the internet, next to reading and writing e-mails (53.3 %), online shopping and online banking or booking (31.1 %, respectively), entertainment (28.9 %) and social media (15.6 %) (multiple answers allowed for each patient) (refer to Table 2). Just a few home-ePRO patients (4.4 %) used the additional open answer to note that they use the internet for business matters.
Patients’ attitudes towards clinic-ePRO/home-ePRO
Patients’ attitude towards clinic-ePRO/home-ePRO
N = 113
N = 45
Considering PROs as an useful and adequate method to provide information on QOL to physicians
Wish to see own PRO results
Wish to discuss PRO results with treating physiciana
Willingness to complete QLQ-C30
at the hospital
For patients reasonable time frames for PRO completion at home
at least weekly
Preference of phone interview over home-ePROc
Preferred mode of PRO assessment
decline of assessment
The vast majority of home-ePRO patients (91.1 %) indicated that they viewed PROs as a useful and adequate method to provide information on their QOL to their attending physicians. There was apparently great interest in incorporating PRO data into the clinician-patient communication: 82.2 % of home-ePRO patients would appreciate a discussion of their results with their attending physician. Slightly more than half (53.3 %) of home-ePRO patients considered at least a weekly assessment interval for home monitoring reasonable; one fourth (24.4 %) stated a monthly interval to be sufficient. Electronic PRO assessment was preferred by 60 % over paper-pencil assessments. Those without a preference (20 %) might be open-minded towards an electronic assessment mode. Only a minority of home-ePRO patients (6.8 %) would prefer a regular phone call to autonomous data entry (refer to Table 3).
Evaluation of the clinic-ePRO procedure
Patients’ rating of feasibility of clinic-ePRO/home-ePRO
N = 113
N = 45
Did you have any difficulties completing the questionnaire?
not at all
quite a bit
Did you have any difficulties handling the electronic device?
not at all
quite a bit
Did you have any difficulties starting the app or entering your login data?b
not at all
How satisfied are you with the presentation of the questionnaire on the screen?
quite a bit
not at all
How satisfied are you with the privacy during questionnaire completion?a
quite a bit
not at all
N = 113
N = 45
no personal contact needed
no drive to the hospital neededb
availability of questionnaire at any time
feeling of being well cared for at homeb
handling of the internet is so difficult
the technical requirements are too extensive
does not come up to my individual situation
Overall, how satisfied are you with electronic quality of life assessment at home?b
Ø (SD, range)
9.1 (1.14, 5–10)
Evaluation of the home-ePRO procedure
At Kufstein County Hospital, 45 patients provided information on their experience with home-ePRO. Nearly three-quarters (72.7 %) reported no problems in accessing the website or iOS app or logging in. Six patients (13.3 %) indicated problems with remembering their login data, entering the URL of the website correctly, choosing correct buttons for navigation during the assessment, or issues regarding the SIM card of the provided iPad2. Such problems were solved easily during outpatient visits. Handling of the technical devices (the patient’s own PC or the provided iPad2) occurred without incident in 88.9 % of cases. Only one patient needed technical support for the iPad2 and received this assistance during an outpatient visit. Consistent with the very few reported problems, there were very few suggestions for necessary improvements. On a visual analog scale (ranging from 1 = “not at all satisfied” to 10 = “absolutely satisfied”), patients’ mean satisfaction with home-ePRO was 9.1 (SD 1.14, range 5 to 10).
Regarding advantages of home-ePRO, 57.8 % of patients appreciated most that they felt well cared for at home. Furthermore, patients perceived the always-available feature and independence from hospital visits as positive aspects of home-ePRO (44.4 % and 42.2 %, respectively). About a fourth of patients (24.4 %) reported the low cost of the system (24.4 %) to be beneficial. Only a few patients (6.7 %) rated the capability of providing PRO data without further hospital contact as advantageous.
Not a single patient experienced home-ePRO as too difficult or confusing. A small minority (13.3 %) felt that home-ePRO was too impersonal; 8.9 % thought that the assessment did not speak to their individual situation; and 2.2 % considered the technical requirements too extensive (refer to Table 4). There were no comments concerning other disadvantages.
This study reports on an evaluation of routine PRO assessments using a specialized software within two contexts: first, as an assessment of patients’ QOL before a follow-up/treatment appointment in a hospital setting (clinic-ePRO), and second, as regular monitoring of the symptom burden of chemotherapy outpatients in the home setting (home-ePRO).
The patients included in our study were relatively high experienced in internet use, in general open-minded towards ePRO assessments, rated them to be useful and would continue regular QOL-monitoring. CHES was well accepted and offered a user-friendly as well as feasible system for different assessment settings. In spite of this overall positive feedback, some previously identified implementation barriers of routine ePRO were replicated, and new ideas for further research areas could be generated.
As disclosed by both our study and the available literature, many important issues for successful implementation of ePRO in the routine clinical setting and at patients’ home can be identified. Efforts are needed not only to improve infrastructure for internet access, but also to encourage patients to use the internet for obtaining medical information and transmitting their health status and QOL information to providers . Furthermore, to echo Rose and Bezjak , the person tasked with explaining the concept and implementation of QOL assessments, and instruments like home-ePRO in particular, is crucially important. Older people are particularly prone to have reservations concerning modern computer technology and need to be properly approached. This fact was demonstrated in our study when the most frequently cited reason for refusal of regular QOL-assessment was concern regarding the handling of an internet-enabled device. Simply providing user-friendly devices is not enough; older and/or computer-illiterate patients also need opportunities to familiarize themselves with the devices. Robben et al.  suggest another aspect that should be carefully considered, particularly among older patients: Aside from specific stand-alone training programs (such as heart-healthy eating or stress prevention strategies), web-based health applications should not be introduced without general information about the supplemental nature of these electronic tools. Fear of losing personal contact with health care professionals might deter patients from participating in home-ePRO, even if they are generally able to handle the necessary technology. Especially clinic-ePRO patients perceived the electronic assessments to be too impersonal and not coming up to their personal situation. Though we do not know how ePRO data was used by the clinicians of the Medical University of Innsbruck (it was available on their desktop PC), one might hypothesize that this negative perception of clinic-ePRO might relate to an insufficient integration of assessed data into the medical consultation. Further research needs to assess the use of ePRO data of health care professionals within the medical consultation and how this might influence patients’ perception of PROs.
As in other studies, most of our patients appreciated clinic-ePRO and were favorable to its extension from the hospital setting into their homes. Similarly to the results of Broering et al. , between 60 (home-ePRO) and 67 % (clinic-ePRO) of our patients stated a preference for an electronic mode of data collection for future PRO assessments. In addition, the vast majority of clinic-ePRO as well as home-ePRO patients (at least 97 per cent) did not perceive the assessment as too complex, difficult or the technical requirements as too extensive. Nonetheless, the phenomenon of a digital divide can be seen, especially for older patients, as patients who refused ePRO assessments at the Kufstein County Hospital or chose phone calls over home-ePRO were approximately 10 years older than home-ePRO participants. Those patients, who like to deal with new technologies and the internet, therefore, have a clear advantage over those who are not familiar with new media. Patients’ socioeconomic status may be of importance as well, and although technical progress continues to bring increasing affordability, future studies should also attend to this issue.
Some limitations of the study should be mentioned, as those restrict the generalizability of the reported results. First, some patients may have been especially motivated to participate in home-ePRO because of the provision of the iPad2, including the preinstalled iOS app. Because completion of the questionnaire was slightly more laborious via a web browser, one might hypothesize that without loaner devices, inclusion rates would have been lower. Second, an age bias emerged as older patients declined participation or preferred regular phone interviews to home-ePRO via an iPad2 or a website. It may be reasonable to assume that those patients also differed in terms of available internet equipment, user experience, and affinity for new media. Therefore, a digital divide may have put those patients at a disadvantage and their higher refusal rates may have whitewashed the overall study results, as only one third of all eligible patients agreed to use home-ePRO. Third, though the number of eligible patients and reasons for refusal were in detail assessed at Kufstein County Hospital, this was not the case at Medical University of Innsbruck. Consequently, we neither know how many patients were approached to participate in clinic-ePRO and its evaluation nor why they did not want to provide PRO-data or to evaluate the used ePRO software. Fourth, it should be noted that the clinic-ePRO group predominantly comprised a large number of relatively healthy and young testicular cancer patients. Those patients represent a quite specific sample of cancer patients, whose attitudes and opinions might differ from a mixed cancer patient sample undergoing active treatment. Overall, the results of our study primarily are based on data provided by patients, who seem to be especially open to ePRO from the outset. Further evaluation of CHES within a more heterogeneous sample of cancer patients should to be done.
In line with other study results, our patients well accepted clinic-ePRO and home-ePRO and experienced it to be feasible. However, we must bear in mind that many patients declined to participate owing to computer illiteracy or worries about their own capability to handle the assessment device. To be more inclusive in the implementation of patient monitoring tools in daily clinical practice, the medical community will need to address several persistent doubts. Physicians as well as patients need further information about the complementary nature of PROs, which cannot replace the conventional medical consultation, but help to detect disturbing symptoms earlier, thereby allowing better structuring and more effective use of time in face-to-face encounters between patients and providers.
The study was partly funded by the Society for Tumor Research (Verein für Tumorforschung) and by Janssen-Cilag. The work of LMW was funded by the Austrian National Bank (Österreichische Nationalbank, ÖNB project nr. 14324), the Tyrolean Health Fund (Tiroler Gesundheitsfonds, TGF) and the Austrian Science Fund (FWF P26930). The work of JMG was funded by the Austrian Science Fund (FWF J3353). The work of MS was funded by the Austrian National Bank (ÖNB project nr. 14492). Open access publishing was made possible by the Austrian Science Fund (FWF). The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the manuscript. We thank Barbara Trixl and Lena Trixl for their extensive work in data collection.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Pakhomov SV, Jacobsen SJ, Chute CG, Roger VL. Agreement between patient-reported symptoms and their documentation in the medical record. Am J Manag Care. 2008;14:530–9.PubMedPubMed CentralGoogle Scholar
- Fromme EK, Eilers KM, Mori M, Hsieh YC, Beer TM. How accurate is clinician reporting of chemotherapy adverse effects? A comparison with patient-reported symptoms from the Quality-of-Life Questionnaire C30. J Clin Oncol. 2004;22:3485–90.View ArticlePubMedGoogle Scholar
- Weingart SN, Gandhi TK, Seger AC, Seger DL, Borus J, Burdick E, et al. Patient-reported medication symptoms in primary care. Arch Intern Med. 2005;165:234–40.View ArticlePubMedGoogle Scholar
- Basch E, Jia X, Heller G, Barz A, Sit L, Fruscione M, et al. Adverse symptom event reporting by patients vs clinicians: relationships with clinical outcomes. J Natl Cancer Inst. 2009;101:1624–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Gravis G, Marino P, Joly F, Oudard S, Priou F, Esterni B, et al. Patients’ self-assessment versus investigators’ evaluation in a phase III trial in non-castrate metastatic prostate cancer (GETUG-AFU 15). Eur J Cancer. 2014;50(5):953–62.View ArticlePubMedGoogle Scholar
- Hilarius DL, Kloeg PH, Gundy CM, Aaronson NK. Use of health-related quality-of-life assessments in daily clinical oncology nursing practice: a community hospital-based intervention study. Cancer. 2008;113:628–37.View ArticlePubMedGoogle Scholar
- Detmar SB, Muller MJ, Schornagel JH, Wever LD, Aaronson NK. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. JAMA. 2002;288:3027–34.View ArticlePubMedGoogle Scholar
- Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22:714–24.View ArticlePubMedGoogle Scholar
- Takeuchi EE, Keding A, Awad N, Hofmann U, Campbell LJ, Selby PJ, et al. Impact of patient-reported outcomes in oncology: a longitudinal analysis of patient-physician communication. J Clin Oncol. 2011;29:2910–7.View ArticlePubMedGoogle Scholar
- Atherton PJ, Sloan JA. Rising importance of patient-reported outcomes. Lancet Oncol. 2006;7:883–4.View ArticlePubMedGoogle Scholar
- Wintner LM, Giesinger JM, Kemmler G, Sztankay M, Oberguggenberger A, Gamper EM, et al. [The benefits of using patient-reported outcomes in cancer treatment: an overview]. Wien Klin Wochenschr. 2012;124:293–303.View ArticlePubMedGoogle Scholar
- Gencer D, Tauchert F, Keilhauer N, Al-Batran SE, Stahl M, Oskay-Ozcelik G, et al. Cancer patients and the Internet: a survey of the ‘Quality of Life’ Working Groups of the Arbeitsgemeinschaft fur Internistische Onkologie and the Nord-Ostdeutsche Gesellschaft fur Gynakologische Onkologie. Onkologie. 2011;34:435–40.View ArticlePubMedGoogle Scholar
- Jensen RE, Snyder CF, Abernethy AP, Basch E, Potosky AL, Roberts AC, Loeffler DR, Reeve BB: Review of Electronic Patient-Reported Outcomes Systems Used in Cancer Clinical Care. J Oncol Pract. 2014:e215-e222; published online on December 3, 2013.Google Scholar
- Bennett AV, Jensen RE, Basch E. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin. 2012;62:337–47.View ArticlePubMedGoogle Scholar
- McCleary NJ, Wigler D, Berry D, Sato K, Abrams T, Chan J, et al. Feasibility of computer-based self-administered cancer-specific geriatric assessment in older patients with gastrointestinal malignancy. Oncologist. 2013;18:64–72.View ArticlePubMedPubMed CentralGoogle Scholar
- Stukenborg GJ, Blackhall L, Harrison J, Barclay JS, Dillon P, Davis MA, et al. Cancer patient-reported outcomes assessment using wireless touch screen tablet computers. Qual Life Res. 2014;23:1603–7.View ArticlePubMedGoogle Scholar
- IKT-Einsatz in Haushalten 2014 [http://www.statistik.at/web_de/statistiken/informationsgesellschaft/ikt-einsatz_in_haushalten/]. Accessed at 25.03.2015.
- Holzner B, Giesinger JM, Pinggera J, Zugal S, Schopf F, Oberguggenberger AS, et al. The Computer-based Health Evaluation Software (CHES): a software for electronic patient-reported outcome monitoring. BMC Med Inform Decis Mak. 2012;12:126.View ArticlePubMedPubMed CentralGoogle Scholar
- Erharter A, Giesinger J, Kemmler G, Schauer-Maurer G, Stockhammer G, Muigg A, et al. Implementation of computer-based quality-of-life monitoring in brain tumor outpatients in routine clinical practice. J Pain Symptom Manage. 2010;39:219–29.View ArticlePubMedGoogle Scholar
- Giesinger J, Kemmler G, Meraner V, Gamper EM, Oberguggenberger A, Sperner-Unterweger B, et al. Towards the implementation of quality of life monitoring in daily clinical routine: methodological issues and clinical implication. Breast Care (Basel). 2009;4:148–54.View ArticleGoogle Scholar
- Wang JY, Bennett K, Probst J. Subdividing the digital divide: differences in internet access and use among rural residents with medical limitations. J Med Internet Res. 2011;13:e25.View ArticlePubMedPubMed CentralGoogle Scholar
- Rose M, Bezjak A. Logistics of collecting patient-reported outcomes (PROs) in clinical practice: an overview and practical examples. Qual Life Res. 2009;18:125–36.View ArticlePubMedGoogle Scholar
- Robben SH, Perry M, Huisjes M, van Nieuwenhuijzen L, Schers HJ, van Weel C, et al. Implementation of an innovative web-based conference table for community-dwelling frail older people, their informal caregivers and professionals: a process evaluation. BMC Health Serv Res. 2012;12:251.View ArticlePubMedPubMed CentralGoogle Scholar
- Broering JM, Paciorek A, Carroll PR, Wilson LS, Litwin MS, Miaskowski C: Measurement equivalence using a mixed-mode approach to administer health-related quality of life instruments. Qual Life Res. 2013;23:495–508.Google Scholar