Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Communicating cancer treatment information using the Web: utilizing the patient’s perspective in website development

BMC Medical Informatics and Decision Making volume 14, Article number: 116 (2014) Cite this article

Abstract

Background

Online cancer information can support patients in making treatment decisions. However, such information may not be adequately tailored to the patient’s perspective, particularly if healthcare professionals do not sufficiently engage patient groups when developing online information. We applied qualitative user testing during the development of a patient information website on stereotactic ablative radiotherapy (SABR), a new guideline-recommended curative treatment for early-stage lung cancer.

Methods

We recruited 27 participants who included patients referred for SABR and their relatives. A qualitative user test of the website was performed in 18 subjects, followed by an additional evaluation by users after website redesign (N = 9). We primarily used the ‘thinking aloud’ approach and semi-structured interviewing. Qualitative data analysis was performed to assess the main findings reported by the participants.

Results

Study participants preferred receiving different information that had been provided initially. Problems identified with the online information related to comprehending medical terminology, understanding the scientific evidence regarding SABR, and appreciating the side-effects associated with SABR. Following redesign of the website, participants reported fewer problems with understanding content, and some additional recommendations for better online information were identified.

Conclusions

Our findings indicate that input from patients and their relatives allows for a more comprehensive and usable website for providing treatment information. Such a website can facilitate improved patient participation in treatment decision-making for cancer.

Peer Review reports

Background

Patients increasingly wish to participate in health care decision-making [1]-[3]. For shared decision-making (SDM), a process in which patients are expected to use information in making well-informed decisions, their access to relevant information is crucial. Clinicians are now encouraged to integrate SDM into their routine clinical practice to support patients with cancer, and one study revealed that clinicians were generally positive with SDM [4]. Patients with cancer frequently access the Internet as a source of information [5]-[7], both in order to prepare for their first consultation with a specialist, and subsequently for questions arising following the consultation [8],[9]. All these factors support the provision of comprehensive web-based information for patients.

However, online information may not always be adequately tailored to a patient’s perspective, particularly if professionals did not engage patient groups before developing information. Consequently, the information provided may fail to fulfil the specific information needs of patients, who may vary in health literacy. Health literacy has been defined as the degree to which individuals obtain, process, understand, and communicate about health-related information, in order to make informed health decisions [10]. Patients often have difficulties in comprehending the information provided, especially because health literacy levels are inadequate in a large part of the population [10],[11].

Qualitative user testing can be used to develop information that is tailored to a patient’s perspective, using approaches that are well established in disciplines such as social sciences and marketing research [12]. Such user testing can consist of different approaches such as prompting patients to ‘think aloud’ while using online information, asking probing questions about specific areas of information, and/or asking semi-structured questions about information needs and satisfaction [13]-[18]. These methods allow patients to verbalize their thoughts about the information while evaluating it, thereby enabling problems such as understanding or finding information, to be identified and improved, accordingly.

The aim of the present study was to apply qualitative user testing in order to develop and evaluate online patient information for a new website on stereotactic ablative radiotherapy (SABR). SABR is a relatively recent, guideline-specified non-invasive radiotherapy treatment for patients with a stage I non-small cell lung cancer (NSCLC) [19],[20]. Patients are increasingly provided with the option to undergo outpatient SABR, and should ideally also be provided with information on conventional radiotherapy and surgery. The aim of the website was to provide information about this treatment, in order to prepare patients to discuss treatment options with their physician, and ultimately to make a treatment decision. We considered this topic to provide a good opportunity for developing tailored information to patients with different levels of health literacy and educational levels.

This study focused on the following areas: (i) document the information search behaviour of patients with an early stage lung cancer prior to attending the first consultation with a radiation oncologist, (ii) determine the comprehensibility and usability of the information provided on the new website, and (iii) study the patients’ evaluation of the website. Our ultimate goal was to develop a patient-centred website that is ready to be used by patients who are eligible to undergo SABR.

Methods

Participants

Participants were recruited from new referrals for SABR to the Radiation Oncology department of a large university medical center, as well as their accompanying relatives. The study protocol was approved by the institutional Medical Ethic Committee (NTR 3243). Eligible patients were provided with written information about the study approximately one week prior to their first consultation, and were approached at the outpatient radiation oncology clinic by the treating physician and researcher (WH). Eligible participants had to meet the following criteria: (a) have a diagnosis of a stage I NSCLC, or be either a relative or friend accompanying the patient, (b) be scheduled to undergo SABR, (c) be a Dutch-speaking adult, (d) being able to communicate verbally, and (e) be willing to sign an informed consent form. The study was conducted between March 2012 and September 2014.

Study design

This study consisted of three phases, namely (1) the website development, (2) a qualitative user test of the prototype website and (3) an additional user test after a redesign of the website. We included 18 participants in phase 2, and nine participants in phase 3. Previous research suggested that around 95% of usability problems could be detected by including 15-20 participants [21]. However, as phase 3 focused on partially redesigned or added sections of the website, and not on the complete website, the chosen number of 9 participants was considered appropriate [22].

Phase 1: Website development

The prototype website was developed by a multidisciplinary research team, with assistance from a hospital information technology specialist. The research team was composed of one health scientist (WH), two psychologists (OD, DT) and two radiation oncologists (SS, CH) who held several consensus meetings about the content and design of the website. We included information about: (a) cancer in general and lung cancer, (b) details of the SABR procedure, outcomes and side-effects, and (c) references and links to related websites on cancer and its treatment. The website development was guided by patient information that had been approved by a hospital Ethics committee for a phase III trial of Either Surgery or Stereotactic Radiotherapy for Early Stage Lung Cancer (ROSEL study, ClinicalTrials.gov Identifier: NCT00687986). It was also guided by the usual information provided to all SABR patients during their first consultation at our institution with the radiation oncologist. Text, photographs and videos were incorporated in order to account for the fact that patients differ in their ability to process information in different ways [23]-[25]. Furthermore, textual cancer-related information with audiovisual information has been shown to improve both website satisfaction and recall of online cancer-related information in older lung cancer patients [26]. We assessed the readability of the information provided using the Flesch Reading Ease score, which scores the level of difficulty from 0 to 100 by using the length of sentences and the number of polysyllabic words [27]. We used modified formulas developed for the Dutch language by Brouwer et al. [28]. The prototype website had a Flesh Reading Ease score of 92 points, indicating that the text on the website was easily understandable by an average fifth grader. Figure 1 shows an overview of the homepage with subsections.

Figure 1
figure 1

Overview homepage with subsections.

Full size image

Phase 2: Qualitative user test prototype website

The qualitative user test consisted of several phases. Participants provided written informed consent at the start of the interview, which was audio-taped with their permission. First, several semi-structured questions were asked to establish the participants general search behaviour on the Internet, prior to being exposed to the new website. Next, we assessed comprehensibility and usability of the website using the ‘think aloud’ approach. The participants viewed the website on a PC desktop computer in a private room in the outpatients’ clinic, and were prompted to ‘think aloud’ as they read and navigated through the website. The instruction they received was as follows: “This is the website http://www.stereotactische-bestraling.nl . You may navigate through the website, just like you would do so at home. It is important that you think aloud. That means that you will try to tell me what you are thinking and doing and why you are thinking and doing that. For example, what you are clicking on, which choices you make or what stands out for you and why”. During this phase, the researcher intervened minimally, except to say “tell me what you are thinking” when the participants were quiet. Observations about website use were recorded by scoring patients’ clicks on the website and by drawing their search track. After participants completed the website exploration, several probing questions were posed in order to determine if participants understood the main topics of the website (e.g. ‘Can you tell me in your own words what is meant by stereotactic radiotherapy?’; “Can you tell me in your own words what these different side effects mean?”). Finally, questions were asked in order to assess participants’ own evaluations of the website (e.g. “What do you think of the amount of information on the website?”; “Did you miss a topic on the website?”; “What information presented on the website did you find most useful?”; ‘Would you recommend the website to others and if yes, to whom?”). In order to be able to characterize the study population, we collected demographic details (age, sex, educational level and marital status) and assessed participants’ subjective health literacy by asking three screening questions: “How often do you have someone help you read hospital materials?”; “How confident are you filling out medical forms by yourself?” and “How often do you have problems learning about your medical condition because of difficulty understanding written information?” [29],[30] In addition, we collected questions on Internet use.

Phase 3: Redesigning the website for additional user testing

Following an analysis of participants’ verbalizations and answers to our semi-structured questions, the website content was revised with input from members of the multidisciplinary research team, all of whom subsequently reviewed and modified drafts of the new version. We then invited three patients who had previously commented on the first version of the website, together with six new participants, to ‘think aloud’ while using the redesigned website. This test phase used a similar approach as the first user test, with specific attention paid toward participants’ reactions to the redesigned and newly added sections. After the ‘thinking aloud’ part, where the participants themselves navigated through the website, we posed specific questions to participants regarding the redesigned sections (e.g. “What do you expect to read within the subject of more information?”; “What do you expect to read within the subject of information for relatives?”; “You read about small cell lung cancer and non-small cell lung cancer, can you tell me what this means to you?”; “You read about normal radiation and stereotactic ablative radiotherapy, can you tell me what this means to you?”). In addition, in order to be able to characterize the study population, we collected the same demographic details as in phase 2.

Data analysis

The original audio-tapes were transcribed verbatim by the first author. Analysis consisted of various steps in analysing qualitative data [31],[32]. The first author read, and re-read, all transcriptions and observation notes from phase 2, to have an initial view about how patients’ used the information on the new website. Next, two researchers (WH and OD) both independently analyzed three transcriptions. Analysis consisted of coding transcriptions into particular issues or ‘themes’ related to the 3 areas of patients’ information search prior to attending the website, the problems in comprehensibility and usability of the information, and how patients evaluated the new website. The researchers next held two consensus meetings to compare issues identified in the three transcriptions of phase 2, and to further interpret these issues. The first author analyzed the remaining transcriptions, the final results of which were discussed with the second author, before the recommendations were formulated. Finally, the first author held meetings with all members of the multidisciplinary team to discuss the findings and the recommendations to redesign the website. In addition, data derived from phase 3 were analysed by the first author and discussed with the second author to see if there were still problems in usability and comprehensibility. Next, these issues were discussed with members of the multidisciplinary team. To illustrate the quantity of how often the different issues were mentioned by our participants, we used the guidelines of Sandelowski [33]. This means that we used most, many, often, frequently and generally when a theme was mentioned by more than 75% of participants, common and several when a theme was brought up by 25% to 50% of participants, and few and some were used when a theme was stated by less than 25% of participants.

Results

Participants characteristics

Phase 2

The mean age of the 18 participants was 64.4 years (SD = 6.2), with 6 participants being relatives of patients. Six patients had low health literacy levels, and 4 had low educational levels. Nine participants accessed the Internet daily, of whom 3 indicated that they searched the Internet daily on health-related information.

Phase 3

The mean age of the nine participants was 66.3 years (SD = 12.1). Three participants were female, two had low health literacy levels and two low educational levels. Of these participants, seven stated that they accessed the Internet daily, and one indicated a pattern of searching daily for online health-related information (Table 1).

Table 1 Sociodemograhic participant characteristics
Full size table

General information search before seeing the website (phase 2)

Most participants indicated that they had accessed the Internet for additional information on SABR, mainly following their visit with their lung physician when the diagnosis of early stage lung cancer had been communicated. These persons mentioned using search terms in Google, such as stereotactic radiotherapy, stereotactic radiation, radiation, stereotactic, lung radiation and 4D radiation. Participants wanted to know the details of the SABR treatment procedure, possible side-effects and differences between SABR and conventional radiotherapy. Similar information search behaviour was observed for relatives. We noticed that this search for additional information was particularly apparent in those with lower educational levels and low health literacy. These participants also explicitly mentioned that physicians did provide them with information about the treatment procedure and advantages, but that this information was relatively limited and difficult to recollect during a stressful period. As one participant stated:

“A website adds value. During the consultation, the physician tells you something and then you feel down, you have cancer. What do you remember afterwards? At home, you can take a look again at the information” (male, low health literacy, low education)

In addition, some participants stated that they surveyed the Internet to explore whether the choice for SABR was a good decision, in case a choice had been offered between surgery and SABR.

“I wanted to read some independent information. I did hear the whole story from my lung physician, but I wanted to know whether I made a good decision” (male, high health literacy, high education)

Qualitative user test prototype website (phase 2)

Treatment procedure

Participants appeared most interested in the webpages ‘which treatment options are available’ and ‘what is stereotactic radiotherapy’, and indicated a preference for more detailed information on SABR as they did not completely understand the procedure. The latter was also illustrated by several questions posed about the SABR procedure during the interview:

“All those X-rays, isn’t that bad for your body?” (female, low health literacy, medium education)

“So when I undergo the treatment, I won’t feel pain?” (male, low health literacy, low education)

Both lower- and higher educated and literate participants found the information regarding the choice of number of fractions needed for SABR delivery confusing. For example, with respect to explaining the number of fractions, some participants stated that the information on the website did not match with the information from their clinician:

“My oncologist mentioned two to three times. On the website, I read three to eight times” (male, high health literacy, high education)

“Usually, the treatment will take 3 to 8 times. My husband is scheduled for 12 times” (female, relative of patient, high health literacy, medium education)

In addition, several participants appeared to be unaware of differences between conventional radiotherapy and SABR treatment.

“Here I read that normally, radiation takes 3 to 8 times. So normally, that is the normal radiation, so how many times is stereotactic radiation then?”(male, high health literacy, high education)

Participant’s understanding of epidemiological evidence

All participants had difficulty understanding concepts relating to the scientific evidence and clinical trials mentioned on the website. In this context, participants did not know what “good results” meant, and many expected to read more detailed and more exact information.

“This section doesn’t provide much information. Only that the treatment works within patients who are fit to undergo surgery. Furthermore, not much information and the information provided isn’t very clear to me” (female, low health literacy, medium education)

“Can’t they just say how many patients were treated and what the results were?” (female, relative of patient, high health literacy, high education)

Side-effect information

Some lower educated and less literate patients expressed an interest in having more detailed and more concrete side-effect information, e.g. how tired they would be after treatment, and what was exactly meant by radiation pneumonitis. For example:

“Perhaps you can add an extra link or something, so you can click on it and read some extra information about all these side-effects and what to expect” (female, high health literacy, medium education)

“I would like to read more information about all these side-effects. They have to provide an answer, not only the names of the side-effects. How tired can you be, and what about coughing? Everyone coughs sometimes” (male, high health literacy, low education)

Risk concepts

On the prototype website, we described the risk of side-effects after SABR treatment as follows: “Less than 5% of all radiation patients will have side-effects”. Not all participants clearly understood this explanation. Several patients thought that the 5% risk concerned the inconvenience of getting one of these side-effects, e.g. radiation pneumonia.

“There is a 5% chance to have a radiation pneumonia” (female, relative of patient, high health literacy, medium education)

“What the risks are in undergoing SABR treatment are not very clear to me” (male, high health literacy, high education)

Terminology

Some participants with lower educational level and low health literacy struggled with the definitions of small cell lung cancer and non-small cell lung cancer.

“There a two different types of lung cancer. Small cell lung cancer and non-small cell lung cancer. So, that is non-small cell lung cancer, so big and small? That is not very clear to me” (male, low health literacy, low education)

“So, what is small cell? What is smaller than small cell”? (male, high health literacy, low education)

The use of the device names for radiation treatment, such as “Truebeam”, “Novalis” and “Cyberknife” were often incorrectly verbalised and participants mentioned that these names “do not tell them much” and “should not be mentioned on the website”. Furthermore, a few patients also had difficulty in understanding technical terminology of treatment preparation such as a 4 Dimensional computed tomographic (4D-CT) scan, and also the fact that lung tumors move.

“4D, that doesn’t say much to me. I can imagine that you’ll be radiated from 4 different sites” (male, high health literacy, high education)

“4D, so there will be 4 radiation beams on the tumor” (male, high health literacy, high education)

“Tumor movement? I didn’t expect that the tumor moved. I thought that the tumor was stuck on something and that it can’t move” (female, low health literacy, medium education)

Most participants also had difficulty in understanding what was meant by “a good condition” in the context of being fit to undergoing treatment and wanted to have more concrete information.

“That condition. I suspect that my condition needs to be checked first. What is meant by a good condition? Does that mean that I can walk regularly and feel good”? (male, high health literacy, high education)

Despite these problems encountered, participants frequently described the definition of SABR correctly. Participants brought up terms like: very precise, directly, saving surrounding tissues, localized, high intension and involving the respiration, as illustrated by these quotes:

“Stereotactic radiation is a very precise radiation and focuses on a small tumor. The dose of the radiation is also higher” (male, low health literacy, high education)

“It is a very specific radiation. The radiation focuses on the tumor without damaging the healthy tissues (male, relative of patient, high health literacy, high education)

“A highly intensive radiation, taking into account your breath and limit the damage to the surrounding tissues” (male, high health literacy, high education)

“That they only strongly radiate on the tumor itself and less on the surrounding”(female, low health literacy, low education)

Overall prototype website evaluation (phase 2)

When analysing the questions that were asked in order to assess participants’ own evaluations of the website (e.g., “What do you think of the amount of information on the website?”; “Did you miss a topic on the website?”; “What information presented on the website did you find most useful?”; ‘Would you recommend the website to others and if yes, to whom?”), the prototype website was evaluated positively by participants. Participants found the amount of information to be adequate and that the information on the treatment itself and information on side-effects were most useful:

“The information is clear and concise” (male, low health literacy, medium education)

“How the treatment works. Before, I didn’t have a clue, but now I do. Especially with these pictures and videos, and how the treatment procedure is described” (male, high health literacy, high education)

In addition, participants mentioned that they would view the website again at home and that they would also recommend it to others. Most participants felt that the website adequately informed them about SABR, and some indicated that they would have preferred to access the website prior to their first consultation with the radiation oncologist or lung physician, enabling them to ask fewer questions and to save time.

“We did ask questions about the radiotherapy itself. How does it work, what is the procedure etc. If we would have first looked at this website, we would have already been informed. Maybe the physician would then have asked, ‘do you have any questions’? Then I would have answered: ‘we already visited the website, it is all clear’” (male, high health literacy, medium education)

Some participants mentioned that reading information about the treatment itself, side-effects and results reduced their anxiety.

“The information about the tumor is very reassuring and interesting. When I think of a tumor, I immediately think of a little black devil. The information here really dismantles that” (female, relative of patient, high health literacy, medium education)

The online information was seen as complementary to the information provided by the radiation oncologist, and led to the website information being trusted by participants. Furthermore, some patients had a preference for additional information on their role as patients, such as on how to obtain a second opinion, on contacting patient organizations, and on where to go in case of questions. A final topic raised by some participants was that they would prefer a website providing additional information about surgery.

“I would prefer more information about the other treatment option on the website as well. Then you would have it all in one” (male, low health literacy, high education)

“I would prefer a sort of checklist, with both information about surgery and radiation. Then the choice might be easier to make” (male, high health literacy, high education)

Redesigning the website for additional user testing (phase 3)

Table 2 summarizes several of the changes made to the website, and Figure 2 displays an overview of the redesigned homepage with sections. The revised website included more detailed information about the treatment process, results and side-effects, including additional photographs and videos. For example, we added an information video about the 4D-CT scan, and included a table comparing features on both conventional radiation and SABR. Potential side-effects of SABR were also explained more thoroughly, and the description of risk information was reworded. We changed this description from a percentage (e.g., less than 5% of all radiation patients will have side-effects) to a proportion (e.g., 1 out of 20 patients that undergo this treatment, suffers from side-effects). We also included three new sections with “information for relatives”, “frequently asked questions”, and “about this website”, in response to the information needs of patients (Table 2 and Figure 2). The redesigned website was tested again among users. The information video on the 4D-CT scan procedure, and the table comparing conventional radiation therapy and SABR, were understood well and evaluated positively.

(Reaction to 4D-CT scan video): “Now you can imagine how you have to lay down and you can see the radiation going through your body, right on the tumor cell” (male, high health literacy, medium education)

(Reaction to comparing table): “Stereotactic radiation is very precise, on the tumor cell itself, and you only have to be here for a few times. This is not the case with conventional radiation, which takes much longer and causes more damage” (female, high health literacy, medium education)

Table 2 Changes made to the website
Full size table
Figure 2
figure 2

Overview redesigned homepage with subsections.

Full size image

However, the extra focus on conventional radiotherapy led to some participants questioning why this form of radiotherapy was not considered a treatment option for them. Analysis of participants’ reactions to the reformulated explanations of small cell lung cancer and non-small cell lung cancer, as well as additional information on side-effects, suggested that the explanations provided on the website were comprehensible.

“Small cell lung cancer is the bad one, that goes very fast. Then the cancer has spread through your whole body. I have non-small cell lung cancer, that is still good, it is still small, and it is treatable” (female, high health literacy, high education)

“Radiation pneumonitis. Yes, that is because of the radiation. It can damage your lung and then your lung gets infected” (female, high health literacy, medium education)

However, despite rewording of the text on risks (e.g., that 1 out of 20 patients that undergo this treatment, suffers from side-effects, instead of less than 5% of all radiation patients will have side-effects), this aspect was not correctly understood by all participants:

“Well, that’s 20%. Personally, I would recommend to describe 20%, but not everyone is good at mental arithmetic” (male, high health literacy, low education)

“1 out of 20 patients? That is quite a lot. That is 20%” (male, high health literacy, high education)

When asked about their expectations of the nature of “more information” (e.g., this section provides information when patients still have some questions about SABR after reading the information on the website, patients are advised to contact their physician), participants did not always know what to expect:

“I’ve got no idea. Maybe more information about the hospital itself?” (female, high health literacy, medium education)

“I’ve got no clue, perhaps information about after care?” (male, low health literacy, low education)

This suggests that this section might better be reworded on the website to provide it some meaning, for example ‘conversation with your doctor’.

The revised and expanded sections appeared clearer for patients, and were considered useful as indicated by the comments, for example:

(Reaction to the section “information for relatives”): “That I can imagine what my partner goes through. I’m the one with the cancer, but he is also. He sympathizes, thinks along, stands by me, complements me, and often he knows more than I do” (female, high health literacy, medium education)

Overall, the redesigned website was considered more comprehensible and usable.

“The information is accessible, easy to understand and my relatives can also benefit from this. So when I want to explain something about the treatment, I can recommend them to access the website” (male, low health literacy, low education)

“I think it is a very good website, especially the combination of videos and text. Videos make it more concrete because of the fact that you now know what to expect and text is pleasant because it explains everything briefly with additional background information” (female, high health literacy, high education)

Participants succeeded in navigating the website in a logical manner, and the majority identified no further areas for improvement. However, one participant suggsted that patient stories might prove a useful addition to the website. None of the participants reported missing information.

“Did I miss anything? No, I don’t think so. It is clear, looks good. I’m going to view the website again at home. What was the name of the website again?” (male, high health literacy, high education)

Discussion

Since its introduction in the early 1990’s, the growing use of SABR for stage I NSCLC has resulted in improved population-based survival rates [34],[35]. As more patients are now eligible to undergo SABR, we considered SABR an ideal indication for developing online information tailored to the patient’s perspective. Our study used qualitative user testing in order to develop online information about SABR, and a key finding was that our website created by experts was not considered ideal by patients and their relatives. Many participants wished to have different information than what was provided initially on the website, especially more detailed information about SABR and side-effects. In addition, patients did not fully understand the medical terminology used, or the information used to describe the scientific evidence regarding SABR.

The participants’ felt a need for detailed and concrete information that had not been provided on the initial website. Specifically, participants wanted a step-by-step description of details of the SABR treatment procedure itself, as well as detailed information about the side-effects of SABR. These finding are consistent with previous work which found that older cancer patients placed ‘treatment-related information’ most important [36]. Our finding suggests that routine patient information now provided by thoracic oncologists may not be optimal.

To the best of our knowledge, no other studies have been conducted on the information needs of patients facing a new treatment option for cancer. However, studies on more conventional treatment options showed that information provided by clinicians about treatment options and outcomes is often considered to be insufficient by patients [37]-[40]. In addition, even when clinicians do provide extensive information, patients and relatives may still want to review the information at home. The latter was explicitly stated by some of our participants with low health literacy and low educational levels. Informing patients about a relevant website, both before and after their first consultation seems essential in supporting patients in asking specific questions, preparing them for discussions with their clinicians and sharing their concerns, as well as in supporting their treatment decisions.

We identified problems in patients understanding of the medical terminology provided, such as the definition of NSCLC and terms like ‘4D-CT scan’, a finding reported in earlier studies, for example, on the comprehension of both verbal and written patient information [41]-[44]. A scheme developed to classify errors in lay comprehension of medical information, identified ‘clinical concepts’ and ‘terminology’ as essential categories of lay errors in understanding medical documents [45]. As clinicians do use these terms in their consultations, it appears important to provide clear explanations of these terms consistent in online communication. These findings suggest that clinicians and health professionals often overestimate patients’ health literacy and use medical terms with the presumption that a patient understands it [46],[47]. Our qualitative assessment showed that lay errors in comprehending web information can be relatively easily identified and solved, for example by providing extra explanations.

Another common problem identified concerns misunderstanding of information relating to the scientific evidence with respect to treatment options. Patients have difficulties in understanding information pertaining to clinical research, and treatment risks and benefits are particularly poorly understood [48]. Patients have particular trouble understanding risk information, which is typically complex and abstract in nature [49],[50], and which impacts on patients’ comprehension, as shown in our study, as well as by others [51],[52]. Difficulty in understanding risk information may persist, even when information is presented in accordance with current guidelines [49]. Consequently, use of visual aids (i.e., icon array or bar graph) may be necessary to improve understanding of risk information [53].

One limitation of our study which must be acknowledged is that our study population was already referred to a department of Radiation Oncology. As such, our conclusions may be less applicable to the larger population of patients with early stage lung cancer, for example those who may be receiving other treatment advise.

Conclusions

By using qualitative user testing, we identified problems faced by participants in interpreting available online information about SABR, an outpatient treatment for early-stage lung cancer. Our study patients and their relatives desired information on areas that were not foreseen by professionals who developed the website. These findings indicate that a careful testing of websites among the targeted patient groups is necessary in order to develop patient-centred information that patients may use for treatment decision-making.

Abbreviations

SABR:

Stereotactic ablative radiotherapy

SDM:

Shared decision making

NSCLC:

Non-small cell lung cancer

References

  1. Deber RB, Kraetschmer N, Irvine J: What role do patients wish to play in treatment decision making?. Arch Intern Med. 1996, 156 (13): 1414-1420. 10.1001/archinte.1996.00440120070006.

    Article  CAS  PubMed  Google Scholar 

  2. Frosch DL, Kaplan RM: Shared decision making in clinical practice: past research and future directions. Am J Prev Med. 1999, 17: 285-294. 10.1016/S0749-3797(99)00097-5.

    Article  CAS  PubMed  Google Scholar 

  3. Chewning B, Bylund CL, Shah B, Arora NK, Gueguen JA, Makoul G: Patient preferences for shared decisions: A systematic review. Patient Educ Couns. 2012, 86: 9-18. 10.1016/j.pec.2011.02.004.

    Article  PubMed  Google Scholar 

  4. Hamann J, Mendel R, Buhner M, Kissling W, Cohen R, Knipfer E, Eckstein HH: How should patients behave to facilitate shared decision making - the doctors’ view. Health Expect. 2011, 30: 10-7625.

    Google Scholar 

  5. Fogel J, Albert SM, Schnabel F, Ditkoff BA, Neugut AI: Use of the Internet by women with breast cancer. J Med Internet Res. 2002, 4 (2): e9-10.2196/jmir.4.2.e9.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW: Patients’ use of the Internet for medical information. J Gen Intern Med. 2002, 17: 180-185. 10.1046/j.1525-1497.2002.10603.x.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Trotter MI, Morgan DW: Patients’ use of the Internet for health related matters: a study of Internet usage in 2000 and 2006. Health Informatics J. 2008, 14 (3): 175-181. 10.1177/1081180X08092828.

    Article  PubMed  Google Scholar 

  8. Frosch D, May SG, Rendle KAS, Tietbohl C, Elwyn G: Authoritarian physicians and patients’ fear of being labelled “difficult” among key obstacles to shared decision-making. Health Aff. 2012, 31 (5): 1030-1038. 10.1377/hlthaff.2011.0576.

    Article  Google Scholar 

  9. Sabee CM, Bylund CL, Gueguen Weber J, Sonet E: The association of patients’ primary interaction goals with attributions for their doctors’ responses in conversations about online health research. J Appl Comm Res. 2012, 40 (3): 271-288. 10.1080/00909882.2012.679671.

    Article  Google Scholar 

  10. Berkman ND, Davis TC, McCormack L: Health literacy: what is it?. J Health Comm. 2010, 15 (Suppl 2): 9-19. 10.1080/10810730.2010.499985.

    Article  Google Scholar 

  11. Paasche-Orlow MK, Parker RM, Gazmarariam JA, Nielsen-Bohlman LT, Rudd RR: The prevalence of limited health literacy. J Gen Intern Med. 2005, 20 (2): 175-184. 10.1111/j.1525-1497.2005.40245.x.

    Article  PubMed  PubMed Central  Google Scholar 

  12. van den Haak M, van Hooijdonk C: Evaluating consumer health information Websites: the importance of collecting observational, user-drive data. In International Professional Communication Conference (IPCC). IEEE Xplore Digital Publishers; 2010:333–338.

  13. Ericson KA, Simon HA: Protocol analysis: verbal reports as data. 1984, The MIT Press, Cambridge, MA

    Google Scholar 

  14. Barnum CM: Usability testing and research. 2002, Longman, New York

    Google Scholar 

  15. Van den Haak MJ, de Jong MDT, Schellens JP: Retrospective vs. Concurrent think-aloud protocols: testing usability of an online library catalogue. Behav Inf Technol. 2003, 22: 339-351. 10.1080/0044929031000.

    Article  Google Scholar 

  16. Cotton D, Gresty K: Reflecting on the think-aloud method for evaluating e-learning. Br J Educ Techn. 2006, 37: 45-54. 10.1111/j.1467-8535.2005.00521.x.

    Article  Google Scholar 

  17. Davison GC, Vogel RS, Coffman SG: Think-aloud approaches to cognitive assessment and the articulated thoughts in simulated situations paradigm. J Consult Clinl Psychol. 1997, 65: 950-958. 10.1037/0022-006X.65.6.950.

    Article  CAS  Google Scholar 

  18. Sadasivam RS, Delaughter K, Crenshaw K, Sobko HJ, Williams JH, Coley HL, Ray MN, Ford DE, Allison JJ, Houston TK: Development of an interactive, web-delivered system to increase provider-patient engagement in smoking cessation. J Med Internet Res. 2011, 13 (4): e87-10.2196/jmir.1721.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Palma D, Senan S: Stereotactic radiation therapy: changing treatment paradigms for stage I non-small cell lung cancer. Curr Opin Oncol. 2011, 23 (2): 133-139. 10.1097/CCO.0b013e328341ee11.

    Article  PubMed  Google Scholar 

  20. Vansteenkiste J, De Ruysscher D, Eberhardt WE, Lim E, Senan S, Felip E, Peters S: Early and locally advanced non-small-cell lung cancer (NSCLC): ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2013, 24 (Suppl 6): vi89-vi98. 10.1093/annonc/mdt241.

    Article  PubMed  Google Scholar 

  21. Faulkner L: Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput. 2003, 35 (3): 379-383. 10.3758/BF03195514.

    Article  PubMed  Google Scholar 

  22. Nielsen J: Estimating the number of subjects needed for a thinking aloud test. Int J Hum Comput Stud. 1994, 41 (3): 385-397. 10.1006/ijhc.1994.1065.

    Article  Google Scholar 

  23. Houts PS, Doak CC, Doak LG, Loscalzo MJ: The role of pictures in improving health communication: a review of research on attention, comprehension, recall and adherence. Patient Educ Couns. 2006, 61: 173-190. 10.1016/j.pec.2005.05.004.

    Article  PubMed  Google Scholar 

  24. Hawley S, Zikmund-Fisher B, Ubel P, Jancovic A, Lucas T, Fagerlin A: The impact of the format of graphical presentation on health-related knowledge and treatment choices. Patient Educ Couns. 2008, 73: 448-455. 10.1016/j.pec.2008.07.023.

    Article  PubMed  Google Scholar 

  25. Tait AV, Voepel-Lewis T: The effect of format on parents’ understanding of the risks and benefits of clinical research: a comparison between text, tables and graphics. J Health Comm. 2010, 15: 487-501. 10.1080/10810730.2010.492560.

    Article  Google Scholar 

  26. Bol N, Smets EMA, Ruthers MM, Burgers JA, de Haes HCJM, van Loos EF, Weert JCM: Do videos improve website satisfaction and recall of online cancer-related information in older lung cancer patients?. Patient Educ Couns. 2013, 92: 404-412. 10.1016/j.pec.2013.06.004.

    Article  PubMed  Google Scholar 

  27. Flesch R: A new readability yardstick. J Appl Psych. 1948, 32: 221-233. 10.1037/h0057532.

    Article  CAS  Google Scholar 

  28. Brouwer RHM: Onderzoek naar de leesmoeilijkheden van Nederlands proza. Pedagogische Studiën. 1963, 40: 454-464.

    Google Scholar 

  29. Chew LD, Bradley KA, Boyko EJ: Brief questions to identify patients with inadequate health literacy. Fam Med. 2004, 36: 588-594.

    PubMed  Google Scholar 

  30. Chew LD, Griffin JM, Partin MR, Noorbaloochi S, Grill JP, Snyder , Vanryn M: Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med. 2008, 23: 561-566. 10.1007/s11606-008-0520-5.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Pope C, Ziebland S, Mays M: Qualitative research in health care: analysing qualitative data. BMJ. 2000, 320: 114-116. 10.1136/bmj.320.7227.114.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Green J, Willis K, Hughes E, Small R, Welch N, Gibbs L, Daly J: Generating best evidence from qualitative research: the role of data analysis. Aus N Z J Public Health. 2007, 31: 545-550. 10.1111/j.1753-6405.2007.00141.x.

    Article  Google Scholar 

  33. Sandelowski M: Real qualitative researchers do not count: the use of numbers in qualitative research. Res Nurs Health. 2001, 24 (3): 230-240. 10.1002/nur.1025.

    Article  CAS  PubMed  Google Scholar 

  34. Haasbeek CJ, Lagerwaard FJ, Slotman BJ, Senan S: Outcomes of stereotactic ablative radiotherapy for centrally located early-stage lung cancer. J Thorac Oncol. 2011, 6 (12): 2036-2043. 10.1097/JTO.0b013e31822e71d8.

    Article  PubMed  Google Scholar 

  35. Shirvani S, Jiang J, Chang J, Welsh JW, Gomez DR, Swisher S, Buchholz TA, Smith BD: Comparative effectiveness of five treatment strategies for early-stage non-small cell lung cancer in the elderly. Intern J of Radiat Oncol Biol Phys. 2012, 84 (5): 1060-1070. 10.1016/j.ijrobp.2012.07.2354.

    Article  Google Scholar 

  36. van Weert JC, Bolle S, van Dulmen S, Jansen J: Older cancer patients’ information and communication needs: what they want is what they get?. Patient Educ Couns. 2013, 92 (3): 388-397. 10.1016/j.pec.2013.03.011.

    Article  PubMed  Google Scholar 

  37. Entwistle V, Williams B, Skea Z, MacLennan G, Bhattacharya S: Which surgical decisions should patients participate in and how? Reflections on women’s recollections of discussions about variants of hysterectomy. Soc Sci Med. 2006, 62 (2): 499-509. 10.1016/j.socscimed.2005.06.027.

    Article  PubMed  Google Scholar 

  38. Nelson JE, Gay EB, Berman AR, Powell CA, Salazar-Schicci J, Wisnivesky JP: Patients rate physician communication about lung cancer. Cancer. 2011, 117: 5212-5220. 10.1002/cncr.26152.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Arora NK: Interacting with cancer patients: the significance of physicians’ communication behaviour. Soc Sci Med. 2003, 57 (5): 791-806. 10.1016/S0277-9536(02)00449-5.

    Article  PubMed  Google Scholar 

  40. Hack TF, Degner LF, Parker PA: The communication goals and needs of cancer patients: a review. Psychooncology. 2005, 14: 831-845. 10.1002/pon.949.

    Article  PubMed  Google Scholar 

  41. O’Connell RL, Hartridge-Lambert SK, Din N, St John ER, Hitchens C, Johnson T: Patients’ understanding of medical terminology used in the breast clinic. Breast. 2013, 22 (5): 836-838. 10.1016/j.breast.2013.02.019.

    Article  PubMed  Google Scholar 

  42. Nijland N, van Gemert-Pijnen J, Boer H, Steehouder MF, Seydel ER: Evaluation of internet-based technology for supporting self-care: problems encountered by patients and caregivers when using self-care applications. J Med Internet Res. 2008, 10: e13-10.2196/jmir.957.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Lober WB, Zierler B, Herbaugh A, Shinstrom SE, Stolyar A, Kim EH, Kim Y: Barriers to the use of a personal health record by an elderly population. AMIA Annu Symp Proc. 2006, 2006: 514-518.

    PubMed Central  Google Scholar 

  44. Davis TC, Crouch MA, Wills G, Miller S, Abdehou DM: The gap between patient reading comprehension and the readability of patient education materials. J Fam Pract. 1990, 31: 533-538.

    CAS  PubMed  Google Scholar 

  45. Keselman A, Smith CA: A classification of errors in lay comprehension of medical documents. J Biomed Inform. 2012, 45: 1151-1163. 10.1016/j.jbi.2012.07.012.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Kelly PA, Haidet P: Physician overestimation of patient literacy: a potential source of health care disparities. Patient Educ Couns. 2006, 66: 119-122. 10.1016/j.pec.2006.10.007.

    Article  PubMed  Google Scholar 

  47. Macabasco-O’Connell A, Fry-Bowers EK: Knowledge and perceptions of health literacy among nursing professionals. J Health Comm. 2011, 16: 295-307. 10.1080/10810730.2011.604389.

    Article  Google Scholar 

  48. Cox AC, Fallowfield LJ, Jenkins VA: Communication and informed consent in phase 1 trials: a review of the literature. Support Care Cancer. 2006, 14: 303-309. 10.1007/s00520-005-0916-2.

    Article  CAS  PubMed  Google Scholar 

  49. Trevena LJ, Zikmund-Fisher BJ, Edwards A, Gaissmaier W, Galesic M, Han PKJ, King J, Lawson ML, Linder SM, Lipkus I, Ozanne E, Peters E, Timmermans D, Woloshin S: Presenting quantitative information about decision outcomes: a risk communication primer for patient decision aid developers. BMC Med Inform Dec Mak. 2013, 13 (Suppl 2): S7-10.1186/1472-6947-13-S2-S7.

    Article  Google Scholar 

  50. Gigerenzer G, Gaissmaier W, Kurz-Milcke E, Schwartz LM, Woloshin S: Helping doctors and patients to make sense of health statistics. Psychol Sci Public Interest. 2007, 8: 53-96.

    PubMed  Google Scholar 

  51. Timmermans DRM, Ockhuysen- Vermey CF, Henneman L: Presenting health risk information in different formats: the effect on participants’ cognitive and emotional evaluation and decisions. Patient Educ Couns. 2008, 73: 443-447. 10.1016/j.pec.2008.07.013.

    Article  PubMed  Google Scholar 

  52. Timmermans DRM, Molewijk B, Stiggelbout A, Kievit J: Different formats for communicating surgical risks to patients and the effect on choice of treatment. Patient Educ Couns. 2004, 54: 255-263. 10.1016/S0738-3991(03)00238-6.

    Article  PubMed  Google Scholar 

  53. Zipkin DA, Umscheid CA, Keating NL, Allen E, Aung K, Beyth R, Kaatz S, Mann DM, Sussman JB, Schardt DC, Nagi A, Sloane R, Feldstein DA: Evidence based risk-communication: a systematic review. Ann Intern Med. 2014, 161 (4): 270-280. 10.7326/M14-0295.

    Article  PubMed  Google Scholar 

Download references

Role of funding

This study was funded by the VU University medical center/EMGO+ Institute for Health and Care research.

Author information

Authors and Affiliations

  1. Department of Public and Occupational Health, EMGO+ Institute for Health and care research, VU University Medical Center, Van der Boechorststraat 7, Amsterdam, 1081 BT, The Netherlands

    Wendy Hopmans, Olga C Damman & Danielle RM Timmermans

  2. Department of Radiation Oncology, VU University Medical Center, De Boelelaan 1117, Amsterdam, 1007MB, The Netherlands

    Wendy Hopmans, Cornelis JA Haasbeek, Ben J Slotman & Suresh Senan

Authors
  1. Wendy Hopmans
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olga C Damman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danielle RM Timmermans
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cornelis JA Haasbeek
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ben J Slotman
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Suresh Senan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wendy Hopmans.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

WH participated in the conception and design of the study, the website development, acquisition of the data and analysed and interpreted the data. Furthermore, she wrote the draft version and revisions of the manuscript. OD, DT and SS also participated in the conception and study design, website development, analysing and interpreting the data, and were involved in drafting and rewriting the manuscript. CH and BS participated in website development and drafting and rewriting the manuscript. All authors read and approved the manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hopmans, W., Damman, O.C., Timmermans, D.R. et al. Communicating cancer treatment information using the Web: utilizing the patient’s perspective in website development. BMC Med Inform Decis Mak 14, 116 (2014). https://doi.org/10.1186/s12911-014-0116-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-014-0116-4

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us