Measuring the quality of Patients’ goals and action plans: development and validation of a novel tool
© Teal et al.; licensee BioMed Central Ltd. 2012
Received: 22 May 2012
Accepted: 12 December 2012
Published: 27 December 2012
The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the quality of patients’ diabetes goals and action plans.
We conducted 3-stage development of GET-D, including identification of criteria for observer ratings of goals and action plans, rater training and pilot testing; and then performed psychometric testing of the GET-D.
Trained raters could effectively rate the quality of patient-generated goals and action plans using the GET-D. Ratings performed by trained evaluators demonstrated good raw agreement (94.4%) and inter-rater reliability (Kappa = 0.66). Scores on the GET-D correlated well with measures theoretically associated with goal-setting, including patient activation (r=.252, P<.05), diabetes specific self-efficacy (r=.376, P<.001) and inverse relationship with depression (r= −.376, P<.01). Significant between group differences (P<.01) in GET-D scores between goal-setting intervention (mean = 7.33, standard deviation = 4.4) and education groups (mean = 4.93, standard deviation = 3.9) confirmed construct validity of the GET-D.
The GET-D can reliably and validly rate the quality of goals and action plans. It holds promise as a measure of intervention fidelity for clinical interventions that promote diabetes self-management behaviors to improve clinical outcomes.
Clinicaltrials.gov Identifier: NCT00481286
KeywordsGoal-setting Diabetes Self-management Goals Action plans Measurement
The Chronic Care model provides a framework for improving diabetes care that espouses ongoing interactions between a prepared, proactive team of clinicians and an informed activated patient . Key outputs of this “activated” interaction are the setting of collaborative, patient-centered, management goals (goal-setting) and feedback regarding structured activities patients do on a daily basis to reach their self-management goals (action plans) . Goal setting and action planning are not new concepts in diabetes care  and are routinely discussed as essential and largely inseparable components. Developing goals and action plans has long been promoted as a principal element of effective diabetes self-management programs [4, 5]. However, empirical evidence to support the efficacy of goal-setting in diabetes care has been equivocal at best [5, 6]. This mixed performance possibly stems from the inconsistency of how goal-setting interventions are conducted and the lack of validated tools to measure the quality of the goals and action plans that comprise such interventions .
Traditional assessments of diabetes care, including aspects of collaborative goal-setting, have focused primarily on the structure and process of chronic care management. In many studies, assessments of goal setting included only patient reports about the presence or absence of a discussion about or the development of collaborative goals . Comparatively little attention has been given to the content and quality of the goals and action plans themselves measured against theoretically-grounded criteria. Since the quality of patient goals and action plans is related to their achievement [9, 10], definitive evaluation of the relationship between goal-setting and diabetes outcomes (goal-attainment) cannot be accomplished without a valid measure of the quality of goals and action plans that result from collaborative goal-setting.
To address this critical gap, we developed a criteria-based, observer rating scale that measures the quality of patients’ diabetes goals and action plans (Goal Evaluation Tool for diabetes GET-D) based on goal-setting theory. In this article, we describe the development process and assessment of the GET-D’s reliability and validity.
The GET-D was developed to assess written goals and action plans that result from interventions or encounters designed to facilitate goal setting. Development included: a) identification of relevant criteria and scoring weights for use in rating patients’ goal and action plans, with associated rater instructions and training; b) pilot testing and revision of the GET-D criteria, scoring weights, rater instructions and rater training; and c) psychometric testing of the GET-D using existing data drawn from a clinical trial. This study was approved by the Baylor College of Medicine Institutional Review Board.
GET-D criteria identification and scoring
To identify criteria that define high-quality goals, and establish content validity, we began with a review of key behavioral change theories related to goal setting and action planning, Locke & Latham’s Goal Setting Theory  and Schwarzer’s Health Action Process Approach . Goal Setting Theory identifies two specific attributes of goals – specificity and difficulty. The Health Action Process Approach identifies at least three attributes of action planning – when, where, and how a goal will be achieved. We then undertook a review of articles specifically related to goal-setting in the context of diabetes and health self-management, strictly for the purpose of identifying how these attributes were operationalized and to lend more detail to the instrument being developed. To identify these articles, we conducted a series of key word searches (“goal setting”, “action plan” combined with “patient”) in Pub Med and Psych Info, each limited to the previous fifteen years’ articles. These searches revealed 683 unique articles. The abstracts were then reviewed to identify articles discussing conceptual descriptions of or educational programs teaching adult patients effective goal-setting or action planning. This resulted in 114 (16.7%) articles, which were then reviewed.
This review, with discussion of the research team, resulted in the creation of ten criteria for the instrument, three for goal setting and seven for action planning. Effective goals for diabetes care were operationalized as having three criteria [3, 7, 13, 14], each related to the “specificity” attribute of goals described by Locke and Latham . First, the goal must be related to a self-management task that could potentially affect diabetes outcomes. Second, the goal must have measurable specificity, that is, specify an outcome that could be observed or measured to track one’s success. Third, the presence of a specific deadline or target end date for meeting the goal was essential. After much discussion about expected challenges in having raters score difficulty of goals (which depended on information about the goal-setter that would not be typically available to those assessing goal quality), our team elected not to include the “difficulty” attribute of goals described in Goal Setting Theory.
Effective action plans were operationalized as having seven additional criteria [10, 15–18]. First, previous data collection by our research team suggested that the first criterion should assess if the action plan directly related to the goal that had been set. The second through sixth criteria referenced five specific elements, including a) explicit actions that will be carried out (related to the “how” attribute of action planning described by Schwarzer)  b) the frequency or schedule on which the actions will be carried out (related to Schwarzer’s “when” attribute of action planning), c) the location in which the action is carried out (related to the “where” attribute), d) the intensity or duration of the actions (related to the “how” attribute), and e) how the activity will be monitored or tracked (a criteria suggested by data demonstrating the effectiveness of monitoring in goal achievement) . The seventh criterion was whether the action plan was feasible for the patient to carry out, which was suggested as a pilot item by our research team in response to observing numerous patients’ plans.
Source of patient goals and action plans: the empowering patient in collaborative care (EPIC) study
The Empowering Patient in Collaborative Care (EPIC)  is a randomized comparative effectiveness study involving primary care patients with type 2 diabetes recruited from a diabetes registry of a large regional health system (additional details of study participants were provided in the prior publication). EPIC participants were randomized to two groups using block randomization, each receiving distinct approaches to group diabetes self-management, described previously . After the active intervention period, all EPIC participants completed a comprehensive assessment including providing written answers to two open-ended questions related to diabetes goals and action plans they set during the intervention: 1) “Being as specific and detailed as possible please describe your diabetes goals” and 2) “Being as specific and detailed as possible, what actions will you take to reach your diabetes goal?” We utilized these written goals and action plans, which were selected and written by the participants independent of assistance from professionals, for the psychometric evaluation of the GET-D.
Pilot testing and modifications to GET-D, rater instructions and training
The objectives for the pilot test were 1) to assess inter-rater reliability of the GET-D among multiple raters using patients’ hand-written goals and action plans, and 2) to obtain raters’ feedback on the rater instructions and training sessions and on the usefulness of the GET-D. Seven raters were trained in a group session and then asked to independently rate five patient-generated, hand-written goals and their associated action plans. All raters were compared to each other rater.
To carry out the first objective, we examined raw agreement and inter-rater reliability (using a multi-rater, multi-category Kappa)  for each criterion, averaging these findings. We found consistency across the eleven GET-D criteria as evidenced by strong average raw agreement among raters (80.0%) and good average inter-rater reliability (Kappa = 0.67). Nine of the ten criteria (i.e., those that were dichotomous) had ratings that clustered around the same score (0, 1, or 3). However, feasibility ratings showed greater discrepancies between the raters. To promote inter-rater reliability, we developed a decision tree to guide raters while assessing action planning feasibility; these were included in the rater instructions. When all modifications to the GET-D were made, the Goal-Setting subtotal included a possible 7 points and the Action Planning subtotal included a possible 19 points, for a possible total GET-D score of 26 points. The final GET-D, with ten criteria, is shown in the Figure.
To evaluate objective two (assessing raters’ perceptions of usability of the GET-D), the trained group of raters reviewed the scores assigned by all raters for each of the five training samples, and disagreements were discussed in detail. These discussions produced several clarifications to the training and GET-D instructions provided to potential raters. Additionally, we modified the GET-D instructions (shown in online Additional file 1: Appendix) to include more detail regarding each criteria and guidelines for scoring.
Psychometric testing of the GET-D
After revising the instrument in its current format, we validated the GET-D with existing data from EPIC. We aimed to assess the inter-rater reliability and construct validity of the GET-D. The research team formed one hypothesis regarding the GET-D’s reliability and four additional hypotheses about construct validity. Criterion-based validity, or the comparison of the GET-D to a “gold standard”, was not assessed, because no standard measures of goal setting and action planning quality currently exist. However, two forms of construct validity could be assessed, including nomological validity (i.e., does the GET-D behave as expected with measures of variables that should have a relationship with goal-setting and action planning quality?) and known groups validity (i.e., can the GET-D produce relevant and expected group differences?) . Our psychometric hypotheses and corresponding statistical expectations were as follows:
Hyp.1. The GET-D would demonstrate high inter-rater reliability between two raters for each of the ten criteria as evidenced by a Cohen’s Kappa greater than 0.70.
Hyp.2. Participants with greater patient activation scores at baseline and after the intervention would write higher quality goals and action plans (GET-D), as evidenced by a modest positive correlation between the measures.
Hyp.3. Based on previous research , we expected that participants with greater self-efficacy for diabetes self-management before and after the intervention period would write higher quality goals and action plans (GET-D), as evidenced by a strong positive correlation between the measures. We expected that the post-intervention self-efficacy scores would be more highly correlated with GET-D than those collected at baseline.
Hyp.4. Based on previous research , we expected that participants with lower self-reported depressive symptoms at baseline would write higher quality goals and action plans (GET-D) as evidenced by a modest negative correlation between the measures.
Hyp.5. Participants in the goal-setting intervention group (relative to comparison group) would have higher quality goals and action plans (GET-D), as evidenced by a comparison of group means.
We recruited and trained two physician-fellows to use the GET-D to rate each goal and action plan. Raw scores for each rater were used for calculations of inter-rater reliability using Cohen’s Kappa , except for the feasibility ratings, which were dichotomized (into low and high feasibility) for each rater prior to calculating inter-rater reliability. Averaged rater scores were calculated for each criterion and used in subsequent analyses.
Validation data for each study participant included three self-report measures collected as part of the study’s baseline measures. The Diabetes Self-Efficacy Scale (DSES) is an eight-item measure evaluating respondents’ confidence in performing specific diabetes management tasks, such as diet, exercise, blood glucose management, and lifestyle domains . Individual DSES scores represent the mean value of all 8 items with higher scores corresponding to greater self-efficacy. The Patient Assessment of Chronic Illness Care (PACIC) measures respondents’ perception of how their health care providers’ communication and behavior are consistent with the elements of the Chronic Care Model [8, 25]. One PACIC subscale is patient activation (meaning the health care provider was perceived as having encouraged greater patient involvement in their care and self-management). Individual PACIC patient activation scores represent the mean value of all subscale items, ranging from 1–5 with higher scores corresponding to greater encouragement. Both the DSES and the PACIC were collected again after the intervention period. The Depression Anxiety Stress Scale (DASS) is a 42-item self-report measure of anxiety, depression and stress with three distinct subscales . Higher DASS scores indicated greater levels of depression and distress.
The patient activation subscale of PACIC, the full DSES, and the depression subscale of DASS were used in the testing of hypotheses 2–4, respectively. Pearson’s correlation coefficients were calculated for each of the construct validation measures with the overall GET-D and for each of the goal and action plan subscales of the GET-D. For hypothesis 5, we used descriptive statistics (t-test) to determine the statistical significance of the differences between the two study group means and standard deviations for the overall and subscale scores on the GET-D.
Characteristics of the study population (N=85)
Goal-setting intervention arm (n=44)
Group education arm (n=41)
Age, mean (SD)
Race, number (%)
Hispanic or Latino
Co-morbidity Score*, mean (SD)
Baseline Hemoglobin A1C, mean (SD)
Education Level, number (%)
≤ High School
> Some College/Trade School
Knowledge and Understanding of Diabetes†, mean (SD)
How Much Diabetes Interferes with Daily Life‡, mean (SD)
Inter-rater scoring and agreement by item on the goal-evaluation tool
Goal evaluation tool-diabetes (GET-D) items
Frequency of scores*
Raw agreement (%)
Goal 1: Relation to Self-Management
Goal 2a: Measurable Specificity
Goal 2b: Presence of a Deadline
Action Plan 3: Relation to the Goal
Action Plan 4a: Specific Action
Action Plan 4b: Frequency or Schedule
Action Plan 4c: Location
Action Plan 4d: Intensity or Duration
Action Plan 4e: Activity Monitoring
Action Plan 5: Feasibility
Average across all 10 Criteria
Validation Results for GET-D with 85 participants
GET-D Goal Sub-Total
GET-D Action Plan Sub-Total
Correlation ^ with
Patient Activation (PACIC) at Baseline (n=85)
Patient Activation (PACIC) after intervention (n=84)
Self Efficacy (DSES) at Baseline (n=85)
Self Efficacy (DSES) after intervention (n=84)
Depression (DASS) at Baseline (n=85)
Mean (SD) by Treatment Group &
Intervention Group (n=44)
Comparison Group (n=41)
The absence of tools to reliably assess the quality of patients’ reported goals and action plans creates a critical methodological gap for self-management research, and ultimately, for chronic care outcomes. In this study, we describe a tool that begins to fill this gap. The GET-D demonstrates both reliability between raters and validity in assessing rater-determined quality measured against theoretical goal-setting criteria. This suggests that trained raters could consistently and adequately judge goal-setting and action planning quality based on nothing more than patients’ written goals and action plans. Further, the statistical relationships between the GET-D and our validation measures reflect the theoretical relationships we expected. Self-efficacy had the strongest positive relationship with the GET-D ratings, particularly after the intervention. Self-efficacy has often been described as a mediator between setting and achieving goals  and our data partially support this . The decrease in the relationship between GET-D and patient activation from baseline to post-intervention was initially surprising, but upon reflection, is intriguing. It suggests that those participants with more encouraging providers at baseline (as compared to post-intervention) were more likely to produce higher GET-D scores after the intervention, emphasizing the importance of collaborative, supportive care as foundational to later outcomes. The negative relationship between depression and GET-D ratings was much stronger than expected, but consistent with prior goal-setting studies , and the literature describing the association of diabetes, depression, and diabetes care related-distress . Finally, the GET-D could distinguish between participants who received the EPIC goal-setting intervention and those who received a traditional diabetes education intervention . These patterns suggest that the GET-D is measuring constructs we intended it to measure.
Our assessment of the validity of the GET-D is not without limitations. The EPIC participants’ (who were older and relatively educated) goals and action plans were uniformly of lower quality than expected, creating floor effects in the data. This was particularly evident in the action-planning criterion “location”, regarding where proposed activities would take place; few action plans included this information. As such, we elected to retain this criterion in the GET-D, pending additional validation studies. Though most criteria did not reflect the severe floor effects of this specific criterion, the data overall reflected lower quality for goal setting and action plans than desirable for optimal validation, attenuating the statistical relationships we measured. These floor effects also inhibited our ability to discern the relative contribution of goal versus action plan criteria in our validation analyses, and as such we focused on the overall GET-D score. The floor effects likely arise from the structure of the GET-D questionnaire because patients are not guided by the scoring criteria when developing their goals and action plans. This design element was deliberate, and reflects the psychological literature on motivation [7, 9, 10]. The clinical relevance of this contention is that artificially improving GET-D scores by providing patients with a scoring “cheat-sheet” may cause the GET-D to lose its predictive and construct validity. While the GET-D should be further assessed on a higher quality sample (and perhaps reflect a different population of goal-setters), the instrument performed well in spite of our data sample. The GET-D serves as a useful first step for a rigorous evaluation of the potential effectiveness of goal-setting in diabetes self-management. Additional studies with larger and more diverse patient samples are needed to further validate the GET-D. Subsequent studies should evaluate the relationship between goal-setting quality and the likelihood of goal-attainment and improvement in clinical diabetes outcomes.
Like most observer rating scales, the GET-D requires some training to use properly and promote consistency across raters. We developed a relatively brief training session that can be easily used by other researchers and educators. Second, we observed common rater perspectives with which trainers should be familiar, namely, that of the severe rater who takes a very literal approach to using the GET-D and that of the lenient rater who wants to give the participant the benefit of the doubt. Despite this finding, raters of both types were easily trainable through our brief session. Though we utilized physician-fellows as our final raters (due to their availability), the scale was tested on a variety of raters in its piloting phase (including lay persons and clinicians) and does not require advanced medical knowledge for use.
In conclusion, goal-setting is frequently proposed as the mechanism to enhance diabetes self-management, but evidence to suggest that goal-setting is beneficial is mixed [7, 19]. Measures for evaluating the quality of goals and action plans, the principal mediator of goal-setting effectiveness, are limited . The GET-D is a reliable and valid tool for rating the quality of patients’ written goals and action plans and can potentially address this critical gap.
The GET-D holds promise as a measure of intervention fidelity for a range of clinical interventions that seek to raise the performance of self-management behaviors and improve clinical outcomes. The GET-D may also be a useful tool for measuring self-management in routine care as part of a comprehensive approach to diabetes care. Diabetes educators, clinicians, and a variety of other providers could be trained in the scoring and monitoring of diabetes goal-setting using the GET-D. Future studies should test the use of the GET-D in this context. Finally, the GET-D may serve as a template for assessing the quality of goal-setting and action planning among other chronic conditions, such as asthma and heart failure. Further work is needed to better measure and draw connections between goal setting interventions and outcomes in the setting of chronic illness.
The authors wish to thank Andrea Price, BA, at the UT MD Anderson Cancer Center and Kristin Cassidy, BA, at the Houston Health Services Research and Development Center of Excellence for their assistance with patient recruitment, retention and project support; Jose Polo, MD and Sagar Sardesai, MD, MPH at the UT MD Anderson Cancer Center for serving as project raters; and Annette Walder, MS at the Houston Health Services Research and Development Center of Excellence for assistance with data analysis. Preliminary findings from this study were presented at the 2009 International Conference on Communication in Healthcare, Miami Beach, Florida, October 6, 2009.
The authors acknowledge project support from a Clinical Scientist Development Award from the Doris Duke Charitable Foundation (Naik, PI and Teal, Co-I) for the development and validation of the GET-D. Data for this study arises from a core demonstration project of the Houston Center for Research and Education on Therapeutics (Houston CERT, Suarez-Almazor, PI) supported by a grant from the Agency for Healthcare Research and Quality (#U18HS016093). Additional support and/or resources in the preparation of this manuscript were provided by the Houston Health Services Research and Development Center of Excellence (HFP90-020) at the Michael E. DeBakey VA Medical Center. Dr. Naik receives additional support from the National Institute on Aging (K23AG027144). These sources had no role in the preparation, review, or approval of the manuscript.
- Wagner EH, Austin BT, Von KM: Organizing care for patients with chronic illness. Milbank Q. 1996, 74: 511-544. 10.2307/3350391.View ArticlePubMedGoogle Scholar
- Von Korff M, Gruman J, Schaefer J: Collaborative management of chronic illness. Ann Intern Med. 1997, 127: 1097-1102.View ArticlePubMedGoogle Scholar
- Estabrooks PA, Nelson CC, Xu S: The frequency and behavioral outcomes of goal choices in the self-management of diabetes. Diabetes Educ. 2005, 31: 391-400. 10.1177/0145721705276578.View ArticlePubMedGoogle Scholar
- Lorig KR, Holman H: Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003, 26: 1-7. 10.1207/S15324796ABM2601_01.View ArticlePubMedGoogle Scholar
- Lorig K: Action planning: a call to action. J Am Board Fam Med. 2006, 19: 324-325. 10.3122/jabfm.19.3.324.View ArticlePubMedGoogle Scholar
- MacGregor K, Wong S, Sharifi C: The action plan project: discussing behavior change in the primary care visit. Ann Fam Med. 2005, 3 (Suppl 2): S39-S40.View ArticlePubMedPubMed CentralGoogle Scholar
- Bodenheimer T, Handley MA: Goal-setting for behavior change in primary care: an exploration and status report. Patient Educ Couns. 2009, 76: 174-180. 10.1016/j.pec.2009.06.001.View ArticlePubMedGoogle Scholar
- Glasgow RE, Whitesides H, Nelson CC: Use of the patient assessment of chronic illness care (PACIC) with diabetic patients: relationship to patient characteristics, receipt of care, and self-management. Diabetes Care. 2005, 28: 2655-2661. 10.2337/diacare.28.11.2655.View ArticlePubMedGoogle Scholar
- Locke EA, Latham GP: A theory of goal setting and task performance. 1990, Englewood, NJ: Prentice HallGoogle Scholar
- Strecher VJ, Seijts GH, Kok GJ: Goal setting as a strategy for health behavior change. Health Educ Behav. 1995, 22: 190-200. 10.1177/109019819502200207.View ArticleGoogle Scholar
- Locke EA, Latham GP: Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. Am Psychol. 2002, 57: 705-17.View ArticlePubMedGoogle Scholar
- Schwarzer R: Self-efficacy in the adoption and maintenance of health behaviours: theoretical approaches and a new model. Self-efficacy: thought control of action. Edited by: Schwarzer R. 1992, Washington DC: Hemisphere Publishing Corp, 217-38. 1Google Scholar
- Scobbie L, Wyke S, Dixon D: Identifying and applying psychological theory to setting and achieving rehabilitation goals. Clin Rehabil. 2009, 23: 321-333. 10.1177/0269215509102981.View ArticlePubMedGoogle Scholar
- Bovend'Eerdt TJ, Botell RE, Wade DT: Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide. Clin Rehabil. 2009, 23: 352-361. 10.1177/0269215508101741.View ArticlePubMedGoogle Scholar
- DeWalt DA, Davis TC, Wallace AS: Goal setting in diabetes self-management: taking the baby steps to success. Patient Educ Couns. 2009, 77: 218-223. 10.1016/j.pec.2009.03.012.View ArticlePubMedPubMed CentralGoogle Scholar
- Langford AT, Sawyer DR, Gioimo S, Brownson CA, O'Toole ML: Patient-centered goal setting as a tool to improve diabetes self-management. Diabetes Educ. 2007, 33 (Suppl 6): 139S-144S.View ArticlePubMedGoogle Scholar
- Handley M, MacGregor K, Schillinger D, Sharifi C, Wong S, Bodenheimer T: Using action plans to help primary care patients adopt healthy behaviors: a descriptive study. J Am Board Fam Med. 2006, 19: 224-231. 10.3122/jabfm.19.3.224.View ArticlePubMedGoogle Scholar
- Navicharern R, Aungsuroch Y, Thanasilp S: Effects of multifaceted nurse-coaching intervention on diabetic complications and satisfaction of persons with type 2 diabetes. J Med Assoc Thai. 2009, 92: 1102-1112.PubMedGoogle Scholar
- Naik AD, Palmer N, Petersen NJ: Comparative effectiveness of goal-setting in diabetes group clinics: Randomized clinical trial. Archives Intern Med. 2011, 171: 453-459. 10.1001/archinternmed.2011.70.View ArticleGoogle Scholar
- Brennan RL, Prediger DJ: Coefficient Kappa: Some uses, misuses, and alternatives. Educ Psychol Meas. 1981, 41: 687-699. 10.1177/001316448104100307.View ArticleGoogle Scholar
- Viswanathan M: Measurement error and research design. 2005, Thousand Oaks: Sage PublicationsView ArticleGoogle Scholar
- Polonsky WH, Fisher L, Earles J: Assessing psychosocial distress in diabetes: development of the diabetes distress scale. Diabetes Care. 2005, 28: 626-631. 10.2337/diacare.28.3.626.View ArticlePubMedGoogle Scholar
- Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20: 37-46. 10.1177/001316446002000104.View ArticleGoogle Scholar
- Lorig KR, Ritter P, Stewart AL: Chronic disease self-management program: 2-year health status and health care utilization outcomes. Med Care. 2001, 39: 1217-1223. 10.1097/00005650-200111000-00008.View ArticlePubMedGoogle Scholar
- Glasgow RE, Wagner EH, Schaefer J: Development and validation of the patient assessment of chronic illness care (PACIC). Med Care. 2005, 43: 436-444. 10.1097/01.mlr.0000160375.47920.8c.View ArticlePubMedGoogle Scholar
- Lovibond PF, Lovibond SH: The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behav Res Ther. 1995, 33: 335-343. 10.1016/0005-7967(94)00075-U.View ArticlePubMedGoogle Scholar
- Altman DG: Practical statistics for medical research. 1991, London: Chapman and HallGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/12/152/prepub