The usability and preliminary effectiveness of a web-based physical activity intervention in patients with knee and/or hip osteoarthritis
© Bossen et al.; licensee BioMed Central Ltd. 2013
Received: 20 August 2012
Accepted: 20 May 2013
Published: 28 May 2013
A large proportion of patients with knee and/or hip osteoarthritis (OA) do not meet the recommended levels of physical activity (PA). Therefore, we developed a web-based intervention that provides a tailored PA program for patients with knee and/or hip OA, entitled Join2move. The intervention incorporates core principles of the behaviour graded activity theory (BGA). The aim of this study was to investigate the preliminary effectiveness, feasibility and acceptability of Join2move in patients with knee and/or hip OA.
A non-randomized pilot study was performed among patients with knee and/or hip OA. Primary outcomes were PA (SQUASH Questionnaire), physical function (HOOS and KOOS questionnaires) and self-perceived effect (7-point Likert scale). Baseline, 6 and 12 week follow-up data were collected via online questionnaires. To assess feasibility and acceptability, program usage (modules completed) and user satisfaction (SUS questionnaire) were measured as secondary outcomes. Participants from the pilot study were invited to be interviewed. The interviews focused on users’ experiences with Join2move. Besides the pilot study we performed two usability tests to determine the feasibility and acceptability of Join2move. In the first usability test, software experts evaluated the website from a list of usability concepts. In the second test, users were asked to verbalize thoughts during the execution of multiple tasks.
Twenty OA patients with knee and/or hip OA between 50 and 80 years of age participated in the pilot study. After six weeks, pain scores increased from 5.3 to 6.6 (p=0.04). After 12 weeks this difference disappeared (p=0.5). Overall, users were enthusiastic about Join2move. In particular, performing exercise at one's own pace without time or travel restrictions was cited as convenient. However, some minor flaws were observed. Users perceived some difficulties in completing the entire introduction module and rated the inability to edit and undo actions as annoying.
This paper outlines the preliminary effectiveness, feasibility and acceptability of a web-based PA intervention. Preliminary results from the pilot study revealed that PA scores increased, although differences were not statistically significant. Interviews and usability tests suggest that the intervention is feasible and acceptable in promoting PA in patients with knee and/or hip OA. The intervention was easy to use and the satisfaction with the program was high.
The Netherlands National Trial Register. Trial number: NTR2483
KeywordsOsteoarthritis Physical activity Web-based intervention Development Pilot study Usability study
Osteoarthritis (OA) in the knee and hip is a degenerative joint disorder with a high prevalence that increases with age. The disease is associated with pain, functional disability and impaired quality of life [1, 2]. OA is considered one of the major disabling diseases in the western world, affecting 10% of men and 18% of women over the age of 60 . It has been recognized that regular physical activity (PA) is an effective lifestyle strategy in the management of OA [4–6]. However, to date the vast majority of OA patients remain sedentary [7–9]. In the long term, physical inactivity may lead to functional decline [10, 11]. To maintain and improve physical function, the promotion of PA is a cornerstone in the treatment of OA .
Since general practitioners (GP) are considered the first and main point of contact for people with OA, the general practice is ideally situated to promote PA. In practice, however, a GP’s ability to encourage physical exercise is limited by time constraints and lack of standard protocols [13, 14]. In particular, core elements concerning the risks of sedentary behaviour are insufficiently emphasized. At the same time, it is unlikely that OA patients will receive help elsewhere, since 90% are not referred to other health care professionals such as a physical therapist, orthopaedic doctor, rheumatologist or rheumatology trained nurse . In this study, we call this group ‘outside-care patients’ and define them as those patients who did not have ‘face-to-face’ contact with a health care provider, other than a GP, for OA in the last six months.
The World Wide Web provides an alternative medium for reaching outside care patients. In Europe 61% and in North America 79% of the population have internet access . Although the rate is lower in younger age groups , recent trends show that older people are among the fastest-growing internet users. To illustrate, in the Netherlands 95% of adults (55–65 years) and 75% of older adults (65–75 years) have access to internet in their home . The internet is convenient, anonymous and appealing for those who want to work in their own environment and in their own time . In particular, web-based interventions without the involvement of professionals have the potential to reach large populations, with a minimal burden on scarce health resources . In recent years, several reviews reported that web-based interventions can be effective in promoting PA. Internet programs for patients with diabetes , multiple sclerosis  and heart failure  have led to the improvement of PA outcomes, even though effect sizes are small. Considering the potential of high reach and low costs , even these small effect sizes have large public health consequences. Given the advantages of the internet and its unique ability to reach outside care OA patients, we developed Join2move. Over the course of one year, we used an iterative design methodology to test, analyse and refine the Join2move program. As part of the iterative development process, this paper focuses on the preliminary effectiveness and the usability of Join2move.
Description of the Join2move intervention
1. Filling out a PA Readiness Questionnaire (PARQ)
If participants answered “YES” to any of the seven PARQ, they were advised to see their GP before participation. If patients answered ‘NO’ to all of the questions, it was considered safe for them to engage in Join2move.
2. Provision of educational messages
Core elements of the program are presented on the personal website, including 1) focus on improving physical function rather than pain reduction; 2) first weeks can be accompanied by more pain;3) participant shares responsibility and has an active role.
3. Selection of a central PA
A favourite and a problematic activity are selected from an activity list, including walking, cycling, swimming etc.
4. Determination of baseline value via a 3-day self-test
To determine the baseline value, participants were requested to perform the selected activity three times a week until the pain threshold was reached. PA performances (minutes) and pain scores (1 to 10) were recorded in an online diary and stored on the website.
5. Setting a short and long term goal
In accordance with the baseline values, a range of goals is generated and presented on the website. Between the lower and upper limit of goals, patients could select a short term goal (9 weeks). Furthermore, a long term goal was set for 1 year.
6. Signing an agreement form
Participants sign an online agreement form. This form presents the short term goal and, again, core elements of the program.
7. Gradually increase selected activity (8 weekly modules)
Based on the short term goal, a tailored schedule of eight weekly modules is made on a time-contingent basis (i.e. fixed time points). The start of the schedule is slightly below the baseline value and increases incrementally towards the short term goal. Patients should not under-perform or over-perform this gradually increasing schedule. Every week, new modules and evaluation forms (pain and performance) are posted.
Extensive exploration is needed in order to examine the potential of the Join2move program. Consequently, our research question was:“ What is the preliminary effectiveness (PA, physical function and self-perceived effect), feasibility and acceptability of Join2move in patients with knee and/or hip OA?” “Feasibility” concerns whether we are capable of carrying out Join2move in a larger study. “Acceptability” is whether participants support or reject Join2move.
Study design and objective
This pilot study used a non-randomized design. Our primary focus was to determine the preliminary effectiveness of the Join2move intervention. A second purpose was to determine program use and user satisfaction with the Join2move intervention. This pilot study, which aimed to provide a basis for a large Randomized Controlled Trial (RCT), was part of a research protocol which has been approved by the ethics committee of the VU University Medical Center Amsterdam (Dutch Trial Register NTR2483).
Patients with self-reported knee and/or hip OA were recruited through advertisements in Dutch newspapers and online health-related websites. Eligibility criteria were 1) age 50–80; 2) self-reported OA in knee and/or hip; and 3) no physical therapy and/or treatment from a medical specialist for OA in the last six months. Potential participants were excluded if they 1) had no internet access at home, 2) were unable to understand the Dutch language and 3) had contra-indications (loss of consciousness and cardiovascular disease) for PA without medical supervision. To verify self-reported diagnosis, we performed clinical tests to assess the presence of knee and/or hip OA. Assessments were performed by a physiotherapist after the study period, according to the American College of Rheumatology (ACR) [26, 27].
Procedure and measures
Interested patients who met the inclusion criteria were sent an invitation letter requesting informed consent. Once written informed consent was obtained, participants were invited to fill out a baseline questionnaire. After the baseline assessment, participants were assigned to the intervention. We conducted two online posttests at 6 and 12 weeks after baseline.
To assess the potential effectiveness of the Join2move intervention, primary outcome measures in this study were PA, physical function and self-perceived effect. Secondary outcomes were OA symptoms, sport and recreation and quality of life. The first primary outcome, self-reported PA, was measured by the Short Questionnaire to Assess Health-enhancing PA (SQUASH) . Pain scores and physical function were determined through a 10- point likert scale as well as the subscale pain of The Knee Osteoarthritis Outcome Score (KOOS) [29, 30] and the Hip Injury Osteoarthritis Outcome Score (HOOS) [31, 32]. The three secondary outcomes, symptoms, sport and recreation activity and quality of life, were also collected by using the HOOS and KOOS questionnaire. Descriptive statistics were used to analyse the data. Paired sample t-tests and regression analysis were used to determine the significance of the differences.
Feasibility and acceptability
To assess the feasibility and acceptability of the intervention, program usage and user satisfaction were measured as secondary outcomes. Program usage was measured by the number of weekly modules completed. Once a participant read the weekly assignments and filled out the evaluation form, the module was defined as completed. Adequate exposure to the program was achieved if users interacted at least 75% with the program content. This cut-off point was determined by the research team on the basis of previous research . User satisfaction was measured via the System Usability Scale (SUS) . Besides the usage and satisfaction, patients from the pilot study were invited for interviews to test user experiences. Semi-structured interviews were audio-recorded and transcribed with the interviewee's permission. An interview guide with open questions was employed to provide structure to the interviews. Transcribed texts were read and discussed to gain an overall understanding of the usability and user satisfaction.
Two qualitative tests were performed to determine the usability of the Join2move intervention, viz.,1) heuristic evaluation, and 2) the Thinking Aloud approach. For the heuristic evaluation, four software experts from Netherlands Institute for Health Services Research (NIVEL) were invited to participate. With respect to the Thinking Aloud approach, five patients between the ages of 50–80 years with self-reported knee and/or hip OA were recruited via the Dutch Arthritis Foundation. The sample size for the Thinking Aloud approach was based on previous research by Nielsen . The author claims that five users are enough to catch 85% of the usability problems.
Procedures and measures
The first usability test, the heuristic evaluation, was performed by means of a set of usability criteria created by Jakob Nielsen  and Dana Chisnell . Nielsen  described heuristic evaluation as an informal method of usability testing that consists of a number of evaluators who are presented with an interface design and are then asked to comment on the errors and effectiveness of the product. Heuristics includes concepts such as “Does the system behave consistently?”, “Does the site use words that older adults know?”, “Is the program perceived as helpful?”(see Appendix 1 for the full list of heuristics). Software experts individually evaluated the website, based on the list of heuristics. Subsequent discussion yielded a list of usability issues. The second instrument, the Thinking Aloud approach , was used to consider how end-users interact with the intervention. In a home-based setting, test subjects were encouraged to verbalize their thoughts during the execution of multiple tasks. These tasks represented the major functionality of the intervention. Evaluations were carried out by two moderators. The procedure was video-recorded and transcribed afterwards.
Demographic and clinical characteristics
Participants (N, %)
Age (years, SD)
Location OA (N, %)
Knee and hip
Duration OA symptoms (years, SD)
Comparison of change in PA levels (mean and SD)
PA (mean, SD)
Total PA (min)
Moderate PA (min)
HOOS and KOOS scores (mean and SD)
Feasibility and acceptability
The majority of participants (n=12, 60%) selected walking as the central activity. Other selected activities were floor exercises (n=3, 15%), cycling (n=1, 5%), domestic tasks (n=1, 5%), gardening (n=1, 5%), and rowing (n=1, 5%). A total of twenty participants commenced the intervention with the program introduction. Login-file analyses revealed that 100% (n=20) of the users completed the introduction module. Overall, 55% (n=11) of the participants completed at least 75% of the program (≥7 week assignments). 70% (n=14) achieved 60% program exposure and 30% (n=6) were exposed to at least 30% of the intervention. The exposure percentage declined over time. The most listed reasons for skipping a weekly PA were other commitments or of lack of time. Adverse events, such as extreme pain or injuries, were not reported during the program. The 16 interviews revealed that performing the activities in one's own time and at one's own pace was regarded as convenient. In general, participants perceived the website as an additional motivation to perform PA. However, the interviews also revealed an important usability issue. It became clear that patients were dissatisfied with the rigid character of Join2move. As one user commented “When I skipped my weekly PA exercise due to other commitments, I had no opportunity to repeat that exercise. That was frustrating”. The results from the SUS among 15 participants revealed an average score of 73 points (SD 15) on a 100-point scale questionnaire. According to the study of Bangor et al. , this score can be considered “good”. Only two patients disagreed with the statement “The website was easy to use” and nearly all patients disagreed with the statement “I think I would need technical support to be able to use the program”.
Thinking Aloud test among 5 participants
Average time (sec)
1) What is the moderator's telephone number?
2) Register yourself for the program
3) Search for information about healthy weight and osteoarthritis
4) Login (with your username and password)
5) Complete module 1 (introduction)
6) Navigate to the webpage ‘Symptoms’
7) Navigate to the webpage ‘My profile’
8) Watch home exercise video No. 4
9) Write something in your workbook
10) Navigate to the webpage ‘Programme Aim ”
11) Log out
12) Log in, once again.
13) Fill in the evaluation form (performance and perceived pain)
14) Check the starting point of your programme in minutes
15) Check your most recent update in your workbook
Based on the results of the interviews and the heuristic evaluation, we changed the program's time contingent structure (i.e. fixed time periods) into a more flexible format. In the most recent version, options have been included which give users the choice of repeating modules and adapting the difficulty of the modules. The usability errors from the Thinking Aloud approach had more to do with the design of the website and the location of several buttons. These relatively minor problems were also addressed.
Results from this study indicate that Join2move is a plausible, feasible and acceptable program for patients with knee and/or hip OA. Although effectiveness was not proved due to the lack of power, results do indicate that Join2move has the potential to increase PA levels in patients with knee and/or hip OA. Participants reported higher levels of PA, particularly (and as expected) involving moderate activities like walking and cycling (200 minutes). In line with other research , walking was by far the most frequently selected activity. Our positive results correspond with a comparable face-to-face intervention, showing a moderate PA increase of 170 minutes . In the first three weeks, the increase was accompanied by more pain. Fortunately, after twelve weeks the pain scores declined towards baseline levels. Although the intervention focused on improving PA rather than on pain reduction, the increased pain was certainly a reason for concern. The precise cause of observed elevated pain scores is unclear. A possible explanation is the increased PA which may generate more muscle and joint pain. However, it is important to note that higher levels of pain are not associated with deterioration of OA [42, 43].
Providing an intervention does not automatically mean that patients will use it, particularly when it is self-directed, with minimum personal contact. Since the success of web-based interventions requires active participation, non-usage attrition has been pointed out as a common concern in the field of web-based education. In line with other studies, [21, 22, 44], the number of users gradually decreased during the nine-week program. Overall, 55% (n=11) of the participants completed at least 75% of the program. This exposure percentage corresponds with the study of Steele et al.  and can be rated as reasonably high for web-based interventions without human interference. The delivery of personal information on a weekly basis is a possible explanation for this relatively low non-usage attrition. In this respect, it was not possible for users to run the entire program at one time. Although we did not examine the specific strategies of engagement, the authors assume that the week-by-week basis provided an incentive to return to the website.
With respect to usability, the involvement of end-users was extremely valuable for identifying usability issues and system flaws. Along the way, we incorporated greater flexibility into the program. The implemented changes resulted in a less rigid version with more options tailored to the performance of the individual user.
The findings from this study need to be interpreted in light of the study's limitations. The small sample size, single group design and lack of long-term assessments limit conclusions of causality, long-term effects and generalizability. Furthermore, the potential presence of the so-called Hawthorne effect may have contributed to an overestimation of PA scores. This implies that observed PA changes may be partly the result of study participation. Besides the Hawthorne effect, self-reported PA measures may also contribute to an over-estimation of PA levels in this study. This may be a consequence of recall error, perceived social desirability and other biases. To obtain the best results, a combination of validated questionnaires with objective measures would be preferable in future studies. Another limitation concerns outside-care patients who lack computer skills or internet access. These groups are mostly excluded from web-based interventions. Unfortunately, this disadvantage applies also to the Join2move intervention. Typically, these patients are disproportionately less educated and have a lower income. Particularly with regard to these under-served populations, GPs should refer sedentary OA patients more frequently to a physical therapist or other health care provider. Further, it will be important to translate Join2move for other self-help platforms, such as videos, brochures and self-help books. A final limitation is that we only performed one Thinking Aloud test to detect and resolve usability issues. Unfortunately, we did not retest the redesigned intervention. In order to optimize usability for the implementation phase, a repetition of this procedure is advised.
Strong evidence indicates that regular PA is important in the management of OA. To date, however, many patients with knee and/or hip OA remain sedentary. Unfortunately, the vast majority of these patients do not receive any help in the promotion of PA. Low-cost, effective and accessible PA interventions are needed. Although our results are not conclusive, this study suggests that Join2move has the potential to contribute to meeting this need. The intervention is unique, since this is the first web-based PA intervention focusing on outside-care patients with OA. Moreover, while most web-based PA interventions have additional human contact, the Join2move intervention is fully computerized. Given the fully automatic character, the program has the potential to reach large populations while placing a minimal burden on our scarce health resources. This paper illustrates how involving end-users and experts can contribute successfully to the development of a web-based self-help intervention. The results suggest that the intervention is feasible and acceptable in promoting PA among patients with knee and/or hip OA. The intervention was easy to use and satisfaction with the program was high. This suggests that the intervention is acceptable for patients with knee and hip OA. Preliminary results from the pilot study revealed that PA scores increased, although differences were not statistically significant. A randomized controlled trial is needed to determine the effectiveness of the Join2move program.
Usability items used for the heuristic evaluation
Are the links to websites consistent throughout the website?
Do buttons and links show that they have been clicked?
Does the ‘back’ button appear on the browser toolbar on every page?
Are error pages descriptive, and did they provide a solution to the user?
Does the system inform users what is going on through appropriate feedback within a reasonable time frame?
Does the system behave consistently?
Does the system eliminate error-prone conditions and present users with confirmation options before they commit to the action?
Is the path for any given task a reasonable length (2–5 clicks)?
Is the default font size 12-point or larger? If not, is there an obvious way on the page to increase the font size? If not, does changing the font size in the browser enlarge all of the text?
Are text and interaction elements a different colour from the background? Are clickable items highlighted differently from other non-clickable highlighted items?
Has the amount of text been minimized; is only necessary information presented?
Is the content written in the active voice, directed to “you”?
Does the site use words that most older adults know? Are instructions written in plain language?
Is a relevant help button provided? Does the system provide documentation about the website?
Can users relate to and feel familiar with the context, images and figures that appear in the program?
Does the system contain the knowledge to be learned?
Is the program easy to use and are the tasks easy to perform with a small number of steps and keystrokes?
Can users learn about how they solved the tasks on previous occasions when the system was used?
Are users aware that the moderator can observe and see the results?
Do users get rewards or praise when a task is performed correctly
Is the program perceived as helpful?
Does the program act as a coach?
Particular thanks go to Harm Wouter Snippe from the NIVEL institute for his support in the creation of the program and Richard Zuidam from Hollands Wild for his work on the design of the website. We also thank Henk-Jan Verkerk and Renzo Hoogendoorn for their work on the usability study. Furthermore, we thank all patients and experts who participated in this study.
- Felson DT, Lawrence RC, Dieppe PA, Hirsch R, Helmick CG, Jordan JM: Osteoarthritis: new insights. Part 1: the disease and its risk factors. Ann Intern Med. 2000, 133: 635-646. 10.7326/0003-4819-133-8-200010170-00016.View ArticlePubMedGoogle Scholar
- WHO: The Global Burden of Disease. 2008, 2004 UpdateGoogle Scholar
- Woolf AD, Pfleger B: Burden of major musculoskeletal conditions. Bull World Health Organ. 2003, 81: 646-656.PubMedPubMed CentralGoogle Scholar
- Macera CA, Hootman JM, Sniezek JE: Major public health benefits of physical activity. Arthritis Rheum. 2003, 49: 122-128. 10.1002/art.10907.View ArticlePubMedGoogle Scholar
- Roddy E, Zhang W, Doherty M, Arden NK, Barlow J, Birrell F: Evidence-based recommendations for the role of exercise in the management of osteoarthritis of the hip or knee–the MOVE consensus. Rheumatology (Oxford). 2005, 44: 67-73. 10.1093/rheumatology/keh399.View ArticleGoogle Scholar
- Jones G, Schultz MG, Dore D: Physical activity and osteoarthritis of the knee: can MRI scans shed more light on this issue?. Phys Sportsmed. 2011, 39: 55-61.View ArticlePubMedGoogle Scholar
- Hootman JM, Macera CA, Ham SA, Helmick CG, Sniezek JE: Physical activity levels among the general US adult population and in adults with and without arthritis. Arthritis Rheum. 2003, 49: 129-135. 10.1002/art.10911.View ArticlePubMedGoogle Scholar
- Shih M, Hootman JM, Kruger J, Helmick CG: Physical activity in men and women with arthritis National Health Interview Survey, 2002. Am J Prev Med. 2006, 30: 385-393. 10.1016/j.amepre.2005.12.005.View ArticlePubMedGoogle Scholar
- de Groot IB, Bussmann JB, Stam HJ, Verhaar JA: Actual everyday physical activity in patients with end-stage hip or knee osteoarthritis compared with healthy controls. Osteoarthr Cartil. 2008, 16: 436-442. 10.1016/j.joca.2007.08.010.View ArticlePubMedGoogle Scholar
- Dunlop DD, Semanik P, Song J, Manheim LM, Shih V, Chang RW: Risk factors for functional decline in older adults with arthritis. Arthritis Rheum. 2005, 52: 1274-1282. 10.1002/art.20968.View ArticlePubMedPubMed CentralGoogle Scholar
- Pisters MF, Veenhof C, van Dijk GM, Heymans MW, Twisk JW, Dekker J: The course of limitations in activities over 5 years in patients with knee and hip osteoarthritis with moderate functional limitations: risk factors for future functional decline. Osteoarthr Cartil. 2012, 20: 503-510. 10.1016/j.joca.2012.02.002.View ArticlePubMedGoogle Scholar
- Dunlop DD, Song J, Semanik PA, Sharma L, Chang RW: Physical activity levels and functional performance in the osteoarthritis initiative: a graded relationship. Arthritis Rheum. 2011, 63: 127-136. 10.1002/art.27760.View ArticlePubMedPubMed CentralGoogle Scholar
- Cottrell E, Roddy E, Foster NE: The attitudes, beliefs and behaviours of GPs regarding exercise for chronic knee pain: a systematic review. BMC Fam Pract. 2010, 11: 4-10.1186/1471-2296-11-4.View ArticlePubMedPubMed CentralGoogle Scholar
- Porcheret M, Jordan K, Jinks C, Croft P: Primary care treatment of knee pain–a survey in older adults. Rheumatology (Oxford). 2007, 46: 1694-1700. 10.1093/rheumatology/kem232.View ArticleGoogle Scholar
- Mamlin LA, Melfi CA, Parchman ML, Gutierrez B, Allen DI, Katz BP: Management of osteoarthritis of the knee by primary care physicians. Arch Fam Med. 1998, 7: 563-567. 10.1001/archfami.7.6.563.View ArticlePubMedGoogle Scholar
- Internet World Stats: World Internet Users and Population Stats. 2012, URL: http://www.internetworldstats.com/stats.htm . [accessed 2012-06-30] WebCite: http://www.webcitation.org/68EtPhZnB 2-2-2012Google Scholar
- Seybert H, Lööf A: Eurostat. Data in focus. 2010, URL:http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-QA-10-050/EN/KS-QA-10-050-EN.PDF [assessed 2012-06-06] [WebCite Cache ID 68EsrrGUx]Google Scholar
- CBS-Statline: CBS Statistics Netherlands, The Hague 2011. 2012, URL:http://statline.cbs.nl/StatWeb/ [assessed 2012-06-06] [WebCite Cache ID 685vL3AsT]Google Scholar
- Ritterband LM, Gonderfrederick LA, Cox DJ, Clifton AD, West RW, Borowitz SM: Internet Interventions: In reveiw, In Use, and Into the future. Prof Psychol: Res Pract. 2003, 34: 527-534.View ArticleGoogle Scholar
- Barak A, Klein B, Proudfoot JG: Defining internet-supported therapeutic interventions. Ann Behav Med. 2009, 38: 4-17.View ArticlePubMedGoogle Scholar
- Glasgow RE, Kurz D, King D, Dickman JM, Faber AJ, Halterman E: Outcomes of minimal and moderate support versions of an internet-based diabetes self-management support program. J Gen Intern Med. 2010, 25: 1315-1322. 10.1007/s11606-010-1480-0.View ArticlePubMedPubMed CentralGoogle Scholar
- Motl RW, Dlugonski D, Wojcicki TR, McAuley E, Mohr DC: Internet intervention for increasing physical activity in persons with multiple sclerosis. Mult Scler. 2010, 17: 116-128.View ArticlePubMedGoogle Scholar
- Tomita MR, Tsai BM, Fisher NM, Kumar NA, Wilding G, Stanton K: Effects of multidisciplinary Internet-based program on management of heart failure. J Multidiscip Healthc. 2009, 2008: 13-21.Google Scholar
- Bossen D, Veenhof C, Dekker J, Bakker D: The effectiveness of self-guided web-based physical activity interventions among patients with a chronic disease: A systematic review. J Phys Act Health. 2013Google Scholar
- Veenhof C, Koke AJ, Dekker J, Oostendorp RA, Bijlsma JW, van Tulder MW: Effectiveness of behavioral graded activity in patients with osteoarthritis of the hip and/or knee: A randomized clinical trial. Arthritis Rheum. 2006, 55: 925-934. 10.1002/art.22341.View ArticlePubMedGoogle Scholar
- Altman R, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association: Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Arthritis Rheum. 1986, 29: 1039-1049. 10.1002/art.1780290816.View ArticlePubMedGoogle Scholar
- Altman R, Alarcon G, Appelrouth D, Bloch D, Borenstein D, Brandt K: The American College of Rheumatology criteria for the classification and reporting of osteoarthritis of the hip. Arthritis Rheum. 1991, 34: 505-514. 10.1002/art.1780340502.View ArticlePubMedGoogle Scholar
- Wendel-Vos GC, Schuit AJ, Saris WH, Kromhout D: Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol. 2003, 56: 1163-1169. 10.1016/S0895-4356(03)00220-8.View ArticlePubMedGoogle Scholar
- Roos EM, Lohmander LS: The Knee injury and Osteoarthritis Outcome Score (KOOS): from joint injury to osteoarthritis. Health Qual Life Outcomes. 2003, 1: 64-10.1186/1477-7525-1-64.View ArticlePubMedPubMed CentralGoogle Scholar
- de Groot IB, Favejee MM, Reijman M, Verhaar JA, Terwee CB: The Dutch version of the Knee Injury and Osteoarthritis Outcome Score: a validation study. Health Qual Life Outcomes. 2008, 6: 16-10.1186/1477-7525-6-16.View ArticlePubMedPubMed CentralGoogle Scholar
- Klassbo M, Larsson E, Mannevik E: Hip disability and osteoarthritis outcome score. An extension of the Western Ontario and McMaster Universities Osteoarthritis Index. Scand J Rheumatol. 2003, 32: 46-51. 10.1080/03009740310000409.View ArticlePubMedGoogle Scholar
- de Groot IB, Reijman M, Terwee CB, Bierma-Zeinstra S, Favejee MM, Roos E: Validation of the Dutch version of the Hip disability and Osteoarthritis Outcome Score. Osteoarthr Cartil. 2009, 17: 132-10.1016/j.joca.2008.05.014.View ArticlePubMedGoogle Scholar
- Steele RM, Mummery WK, Dwyer T: Examination of program exposure across intervention delivery modes: face-to-face versus internet. Int J Behav Nutr Phys Act. 2007, 4: 7-10.1186/1479-5868-4-7.View ArticlePubMedPubMed CentralGoogle Scholar
- Brooke J: SUS: a ‘quick and dirty’ usability scale. Usability Evaluation in Industry. Edited by: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL. 1996, London: Taylor & FrancisGoogle Scholar
- Nielsen J: Nielsen, Jakob Why You Only Need To Test With FiveUsers. 2000, 19-3. http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/. WebCite: http://www.webcitation.org/6ECmI7VGw Google Scholar
- Nielsen J, Mack RL: Usability Inspection Methods. 1994, New York: John Wiley & SonsView ArticleGoogle Scholar
- Chisnell D, Redish J, Lee A: New heuristics for understanding older adults as web users. Tech Commun. 2006, 53: 39-59.Google Scholar
- Nielsen JMR: Heuristic evaluation of userinterfaces. Proceedings of the SIGCHI Conference onHuman Factors in Computing Systems: CHI ‘90. 1990, NewYork, NY: ACM, 249-256.Google Scholar
- Nielsen J: Usability Engineering. 1993, San Francisco: Morgan KaufmannGoogle Scholar
- Bangor A, Kortum P, Miller J: An empirical evaluation of the system usability scale. Int J Human-Comput Interact. 2008, 24: 574-594. 10.1080/10447310802205776.View ArticleGoogle Scholar
- King WC, Brach JS, Belle S, Killingsworth R, Fenton M, Kriska AM: The relationship between convenience of destinations and walking levels in older women. Am J Health Promot. 2003, 18: 74-82. 10.4278/0890-1171-18.1.74.View ArticlePubMedGoogle Scholar
- Dougados M, Gueguen A, Nguyen M, Thiesce A, Listrat V, Jacob L: Longitudinal radiologic evaluation of osteoarthritis of the knee. J Rheumatol. 1992, 19: 378-384.PubMedGoogle Scholar
- Schiphof D, Kerkhof HJ, Damen J, de Klerk BM, Hofman A, Koes BW: Factors for pain in patients with different grades of knee osteoarthritis. Arthritis Care Res (Hoboken ). 2013, 65: 695-702. 10.1002/acr.21886.View ArticleGoogle Scholar
- Neve MJ, Collins CE, Morgan PJ: Dropout, nonusage attrition, and pretreatment predictors of nonusage attrition in a commercial Web-based weight loss program. J Med Internet Res. 2010, 12: 69-10.2196/jmir.1640.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/13/61/prepub