Skip to main content

Table 3 Modifiable usability issues identified by participants in testing cycle 1 and changes made

From: Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis

Category

Examples of participant comment

Changes made

1. Information Delivery: clarity of the information and presentation style.

• The narration is a bit long…a little bit repetitive. (Jamie – female, age group: 35–49)

Added key messages for users who prefer a summary of the narrated content.

• Six video clips. That’s quite a lot especially eight minutes long. (Theresa – female, age group: 50–64)

• Reduced the length of videos. The final version ranged from 4 minutes 26 seconds to 7 minutes 55 seconds.

• (On videos) I think it’s a bit long winded. You could have said the same thing with about 2 minutes less so that’s like saying a bit boring for someone to watch him doing the same thing twice or three times. (Sherly – female, age group: 50–64)

• Added subtitles to highlight important points in the video.

2. Navigation Control: Difficulties in recognizing and using buttons to start/stop the narrated content, adjust volume, and control videos.

• This could be a different colour maybe, the narration (button), just because I didn’t see it right away, I went straight to the text to read. (Bob – male, age group: 35–49)

• Used the YouTube format for all videos.

• Enlarged the size of buttons.

• (On accessing the videos) Well I’d be curious so what I would do is I would probably click on, my first inclination is to click this because, you know, you are programmed by YouTube to do that. I saw the narration button later and that’s why I was like, oh, okay, now what do I do? (Bob – male, age group: 35–49)

• Added labels to navigation controls when appropriate.

3. Layout: Positions of the video, text, diagrams and navigation buttons.

• (A comment on watching video and reading information at the same time) …I lose the video so I am like back and forth, back and forth. Keeps me busy, keeps me entertained, but not all (the time), you know, especially when you are dealing with people with arthritis before medication, your hands are not just scrolling down, trust me, it’s very, very hard. (Jamie – female, age group: 35–49)

• Further condensed the key points in order to reduce scrolling with a mouse while viewing a webpage.

• Revised the webpage layout and added hyperlinks for easy access to key summaries and video.

4. Aesthetic: The colour and ‘look and feel’ of the program.

• For aesthetics it might be nice to have a coloured box around each one of these (diagrams)…I don’t know if you can make them all the same or each one different colours because it (the website) looks kind of bland…Or it doesn’t look like a great beginning where none of these really jump out at me… (Bob – male, age group: 35–49)

• Added pictures in the introductory pages and throughout the value elicitation module.

Added a screenshot of the animated story at the top of each page of the information module. A hyperlink was set up to direct people to see the video in a bigger YouTube viewer.

• As to the colour and layout, I think it needs, it’s kind of flat and uninteresting… (Theresa – female, age group: 50–64)

• Probably add a little more just colour. Make it a little more fun so you can actually like you are eager to go into the site. (Jamie – female, age group: 35–49)