A cross-sectional survey assessing the acceptability and feasibility of self-report electronic data collection about health risks from patients attending an Aboriginal Community Controlled Health Service
© Noble et al.; licensee BioMed Central Ltd. 2014
Received: 2 July 2013
Accepted: 11 April 2014
Published: 16 April 2014
Aboriginal Australians experience significantly worse health and a higher burden of chronic disease than non-Aboriginal Australians. Electronic self-report data collection is a systematic means of collecting data about health risk factors which could help to overcome screening barriers and assist in the provision of preventive health care. Yet this approach has not been tested in an Aboriginal health care setting. Therefore, the aim of this study was to examine the acceptability and feasibility of a health risk questionnaire administered on a touch screen laptop computer for patients attending an Aboriginal Community Controlled Health Service (ACCHS).
In 2012, consecutive adult patients attending an ACCHS in rural New South Wales, Australia, were asked to complete a health risk survey on a touch screen computer. Health risk factors assessed in the questionnaire included smoking status, body mass index, and level of physical activity. The questionnaire included visual cues to improve accuracy and minimise literacy barriers and was completed while participants were waiting for their appointment.
A total of 188 participants completed the questionnaire, with a consent rate of 71%. The mean time taken to complete the questionnaire was less than 12 minutes. Over 90% of participants agreed that: the questionnaire instructions were easy to follow; the touch screen computer was easy to use; they had enough privacy; the questions were easy to understand; they felt comfortable answering all the questions.
Results indicate that the use of a touch screen questionnaire to collect information from patients about health risk factors affecting Aboriginal Australians is feasible and acceptable in the ACCHS setting. This approach has potential to improve identification and management of at-risk individuals, therein providing significant opportunities to reduce the burden of disease among Aboriginal Australians.
KeywordsAustralia Aboriginal Touch screen questionnaire Health risk factors Screening
As for other Indigenous populations worldwide, Aboriginal and Torres Strait Islander Australians experience significantly poorer health and younger mortality than other Australians[2, 3]. The high prevalence of modifiable risk factors, such as smoking and high body mass, contributes significantly to this health gap[3–8]. Cancer screening rates are also known to be low[9, 10]. Therefore, the potential to reduce the disease burden experienced by Aboriginal and Torres Strait Islander Australians by targeting change in these common risk and screening behaviours is considerable.
Aboriginal Community Controlled Health Services (ACCHSs) are services designed to provide culturally appropriate health care to Aboriginal communities. Approximately 50% of the Aboriginal population of Australia access ACCHSs for their health care, making ACCHSs an appropriate setting in which to address the risk status of Aboriginal Australians.
The provision of preventive care requires the identification of at-risk patients. However, reliance on medical records to identify at-risk patients may be limited by the accuracy and completeness of such records[14–16]. Significant gaps in the recording of risk factor status in Aboriginal and Torres Strait Islander health settings have been identified[14, 16, 17]. For example, across more than 60 Indigenous community health centres, weight and BMI were not recorded for an average of 45% and 78% of patients respectively, while only 28% of patients were identified as smokers, relative to known higher smoking rates in sampled communities. Such inconsistencies in detecting or recording data for at-risk patients may be due to the time required for screening, and privacy or sensitivity concerns[17, 18]. For example, many Aboriginal health workers are themselves smokers, and may feel uncomfortable assessing the smoking status of their patients and providing cessation advice[19, 20]. The need to prioritise across a complex array of health and other problems facing many Aboriginal patients is a further challenge to achieving regular assessment of modifiable health risks and the provision of preventive health care[14, 21].
Electronic data collection utilising portable devices offers a potentially effective means of collecting self-reported risk factor information from patients. Electronic data collection is preferred by patients[22, 23], reduces missing values compared to paper and pencil methods, allows tailoring of questions to minimise patient burden, and has the potential for automatic entry of data into medical records[23, 25].
The acceptability of computer based approaches to health data collection has been explored in a limited sample of indigenous and/or socially disadvantaged populations worldwide. For example, an audio touch screen computer-assisted self-interviewing questionnaire to collect lifestyle risk data was well accepted by a cohort of American Indians; although lower education levels and infrequent computer use in the past year were predictors of useability problems. A touch screen kiosk providing smoking cessation information was also successful in engaging a sample of low-literacy, underserved, Mexican-American primary care patients.
Studies specifically in the Australian Aboriginal health care setting are uncommon. One study utilised a laptop questionnaire to collect risk and resilience data, and another touch activated hand held computer devices to collect data about condom use, from Aboriginal youth. However neither study reported survey consent or completion rates. Hunter and colleagues reported on the acceptability of a touch-screen kiosk in two Indigenous-specific settings (a health clinic and a Centrelink office serving a discrete Aboriginal community) which provided visual, audio and printed information about musculoskeletal disorders and diabetes. Of note was the importance of including non text-based information and culturally appropriate graphics to promote acceptability in this population.
Electronic data collection therefore holds potential as an efficient and systematic means of collecting data about health risk factors to assist in the provision of preventive health care for Aboriginal people. An electronic approach to health risk data collection would overcome some of the key barriers for health service staff such as limited time and sensitivity restraints. However, it has not been tested for this purpose in an Aboriginal health setting. The aims of this study were therefore to examine the acceptability and feasibility of an electronic health risk questionnaire administered on a touch screen laptop computer for adult patients attending an ACCHS. Feasibility and acceptability were assessed in terms of: i) patient consent rates and consent bias; ii) survey completion rates; iii) time taken to complete the questionnaire; iv) the proportion of patients needing assistance to complete the questionnaire; and v) patient feedback on the survey.
Study design and setting
A health risk questionnaire was administered using a touch screen laptop to patients attending an ACCHS in regional New South Wales (NSW). The acceptability data presented here were part of a larger cross-sectional study about the prevalence of a range of health risk factors and demographics. Questionnaires were completed anonymously to minimise response bias and encourage participant consent. Data collection occurred over approximately nine weeks in early 2012. Ethics approval for the project was granted by the Human Research Ethics Committees of the University of Newcastle and the Aboriginal Health and Medical Research Council of NSW.
All patients attending the ACCHS for a general practice (GP) appointment, aged 18 years or older, not too sick to participate and able to provide informed consent were eligible. All patients including Aboriginal and non-Aboriginal patients were invited to participate and all participants gave informed consent.
Patients were approached by a Research Assistant (RA) and invited to complete the touch screen questionnaire in a quiet section of the waiting room while waiting for their appointment. A non-Aboriginal RA was present to set up and oversee survey administration. An Aboriginal RA assisted with approaching patients for approximately half of the recruitment period (due to logistical recruitment problems and low patient throughput on some days). Participants were able to exit the questionnaire if called in for their appointment prior to completion. Results for interrupted questionnaires were included if at least 75% of the questionnaire was completed (with unanswered responses recorded as missing). A RA offered assistance with questionnaire completion as required, and noted whether participants received assistance (none/some assistance/interview style). A RA also recorded the estimated age and gender of non-consenting patients in order to assess consent bias.
The touch screen questionnaire included demographic questions (age, gender, Indigenous and marital status, highest level of education, source of income, overcrowding and exposure to physical or emotional violence) and items assessing the health risk status of participants (body mass index, smoking status, alcohol consumption, level of physical activity, consumption of fruit and vegetables, alcohol intake, drug use, depression and adherence with screening guidelines). Measures were either previously validated or drawn, where possible, from Indigenous specific surveys such as the National Aboriginal and Torres Strait Islander Health Survey and Social Survey[30–32]. The questionnaire also included five acceptability statements; participants were asked to indicate whether: the instructions were easy to follow; the touch screen was easy to use; they had enough privacy; the questions were easy to understand; they felt comfortable answering all the questions (yes/no/not sure). Participants were also asked whether they would be willing to complete a similar survey at future appointments. The survey was modified for the final 32 participants in order to identify whether for future surveys, participants would be happy for their doctor to see a copy of their questionnaire responses.
Digivey Survey Suite software (CREOSO Digivey Survey Centre, Arizona, USA) was used to design and administer the touch screen questionnaire. The RA demonstrated how to navigate through the questionnaire using the ‘next’ or ‘back’ buttons. Participants could skip questions by touching the ‘next’ button. Branching algorithms were used to tailor questions to individual participants (for example, only females over 50 years of age were asked about breast cancer screening).
Chi-square analysis was used to compare the age groups, gender and Aboriginal status of consenting and non-consenting participants. Aboriginal status of consenting participants was only recorded for participants who completed the questionnaire, and not for non-consenters or those who exited the questionnaire before completion; therefore the Aboriginal status of the final complete sample was compared to the proportion of total active Aboriginal and non-Aboriginal patients usually attending the ACCHS. Aggregate data on the Aboriginal status of all adult patients who had attended the Service at least three times in the last two years was extracted from ACCHS medical records for comparison.
Parametric tests (t- tests and one-way ANOVA) were used to compare the time taken to complete the questionnaire for Aboriginal and non-Aboriginal participants and across age groups. Chi-square and Fisher’s exact test (where cells had small expected frequencies) were used to compare the acceptability of the questionnaire, assistance required to complete the questionnaire, and willingness to complete a similar survey in the future, for Aboriginal status and across age groups.
Consent rates and consent bias
Completion rates and missing data
Demographics of consenting study participants and non-consenting patients
Consenting patients (n = 210)
Non-consenting patients (n = 86)
Total patients (consenting and non-consenting)
Medical record data
Indigenous status a
Time taken to complete the questionnaire
Assistance sought/accepted in completing the questionnaire
Proportion of participants seeking/accepting assistance with the questionnaire by Aboriginal status and age group
No assistance n (%)
Some assistance n (%)
Interview style n (%)
Indigenous status a
Aboriginalb (n = 135)
Non-Aboriginal (n = 53)
<35 yrs (n = 73)
35-54 yrs (n = 82)
≥55 yrs (n = 51)
Participant feedback on the acceptability of the touch screen questionnaire
Ninety-six percent of participants indicated that they would be willing to complete a similar questionnaire at future ACCHS visits, either ‘sometimes’ (44%), ‘most of the time’ (19%) or ‘every time’ (33%). Willingness to complete a future questionnaire did not differ significantly between Aboriginal and non-Aboriginal participants (Fisher’s exact test p = .90) or across age groups (between those aged under 35 yrs, 35-55 yrs and over 55 yrs; Fisher’s exact test p = .94). Finally, of the subsample of participants (n = 32) who were asked whether, for future questionnaires, they would be willing for their doctor to see a copy of their questionnaire answers, 91% (n = 29) indicated ‘yes’.
Study results indicate that a large majority of patients who attended the ACCHS were willing and able to complete the touch screen health risk questionnaire. The consent rate was high (71%), and did not appear to differ according to age or gender, although Aboriginal patients were slightly less likely to consent; missing data was minimal. The majority of patients (80%) were able to complete the questionnaire in the time that they were waiting to see the doctor, and most patients (75%), independent of their Aboriginal status, were able to complete the questionnaire without any assistance, although older participants were more likely to need some help. Results suggest that an electronic screening approach such as the one used here could be readily incorporated in routine clinical practice during appointment waiting times, requiring minimal staff time for gathering risk factor information, provided sufficient staffing resources were available to encourage patients to complete the questionnaire and assist if needed. The potential clinical utility of this approach is further supported by the high degree of acceptability of the questionnaire, and the high proportion of patients who indicated that they would be willing to complete a similar questionnaire at future appointments (96%), and for their doctor to see their results for future questionnaires (91%). Perhaps most encouraging was the high proportion of participants who agreed that they felt comfortable answering all the questions, despite the inclusion of questions about potentially sensitive issues such as smoking, alcohol consumption and illicit drug use.
Several study limitations should be noted. The questionnaire was completed anonymously, and therefore consent rates and acceptability levels may not reflect patients’ responses had the questionnaire results been linked to their medical record or otherwise available to their doctor or health worker. Clearly this is an important consideration if such a system were to be implemented in routine clinical practice. The other major limitation relates to the validity of self-reported health risk factor information. Although validated measures were used wherever possible[33–35], many show only moderate sensitivity and specificity (such as short measures of physical activity and diet) and the validity of most measures for use in the Aboriginal population has not been specifically established. While validation was outside the scope of this study, an exploration of the appropriateness and accuracy of such measures would be an important consideration for the clinical utility of the questionnaire results. Additional study limitations relate to the generalisability of the results given that the study was conducted in a single ACCHS in a rural but non-remote setting. In more remote communities, literacy issues or less computer experience may impact on questionnaire acceptability and utility. However, the use of a touch screen with graphics and multimedia options such as those used in audio computer-assisted self-interviewing methods, or the multimedia Queensland ‘HITnet’ program for Indigenous communities[37, 38] could help to overcome these barriers.
This study confirms that the use of a touch screen laptop survey is both feasible and acceptable for the systematic collection of risk factor status and screening adherence among adult patients attending an ACCHS. The observed consent rate, acceptability of the questionnaire, and willingness to complete similar future questionnaires, suggest that this approach is a potentially sustainable one which could be implemented more widely as part of routine practice in the ACCHS setting, subject to a comprehensive evaluation of the validity of the health risk data collected. If results were linked directly into patient medical records, this would assist health care providers with the systematic identification of at-risk patients, reduce the burden on providers associated with risk assessment, and leave more time available for the provision of preventive care. Provided that collected data are reliable, questionnaire results could provide a starting point for providers to initiate discussion about potentially sensitive issues such as smoking, alcohol or drug use. Screening is also likely to raise personal awareness among patients about their health risks and screening needs.
This study has provided evidence for the potential acceptability and usefulness of an electronic health risk assessment tool for use with patients of ACCHSs. Ultimately, this kind of systematic approach to risk factor assessment has the potential to improve the identification and therefore the management of at-risk individuals, therein providing a significant and much needed opportunity to reduce the burden of disease among Aboriginal Australians.
This study would not have been possible without the generous cooperation and time of the ACCHS staff and patients. Many thanks go also to Dr Kylie Lee for extensive comments on survey wording and presentation. This research was funded by a NSW Health Drug and Alcohol research grant. This manuscript was supported by a Strategic Research Partnership Grant from Cancer Council NSW to the Newcastle Cancer Control Collaborative, and infrastructure support was provided by the Hunter Medical Research Institute. The funding bodies had no role in the design of the study, collection, analysis or interpretation of data, nor in writing the manuscript or the decision to submit the manuscript for publication.
- Ring I, Brown N: The health status of indigenous peoples and others: The gap is narrowing in the United States, Canada, and New Zealand, but a lot more is needed. Br Med J. 2003, 327 (7412): 404-405. 10.1136/bmj.327.7412.404.View Article
- Australian Institute of Health and Welfare: Cat. No. IHW 48. Contribution of Chronic Disease to the Gap in Adult Mortality between Aboriginal and Torres Strait Islander and other Australians. 2011, Canberra: AIHW, [http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=10737418922%26libID=10737418]
- Vos T, Barker B, Stanley L, Lopez A: The Burden of Disease and Injury in Aboriginal and Torres Strait Islander Peoples 2003. 2007, Brisbane: University of Queensland
- Burns J, Thomson N: Summary of overweight and obesity among Indigenous peoples. [http://www.healthinfonet.ecu.edu.au/health-risks/overweightobesity/reviews/our-review]
- Australian Bureau of Statistics: 4714.0 - National Aboriginal and Torres Strait Islander Social Survey, 2008. 2009, Canberra: Australian Bureau of Statistics, [http://www.abs.gov.au/ausstats/abs@.nsf/mf/4714.0/]
- Australian Institute of Health and Welfare: Cat. No. IHW 22. Aboriginal and Torres Strait Islander Health Performance Framework 2008 Report: Detailed Analysis. 2009, Canberra: AIHW, [http://www.aihw.gov.au/publication-detail/?id=6442468199]
- Trewin D: ABS Catalogue No. 4715.0. National Aboriginal and Torres Strait Islander Health Survey 2004–05. 2006, Canberra: Australian Bureau of Statistics, [http://www.abs.gov.au/ausstats/abs@.nsf/mf/4715.0/]
- Wilson M, Stearne A, Gray D, Sherry S: The harmful use of alcohol amongst Indigenous Australians. [http://www.healthinfonet.ecu.edu.au/alcoholuse_review]
- Reath J, Carey M: Breast and cervical cancer in Indigenous women. Overcoming barriers to early detection. Aust Fam Physician. 2008, 37 (3): 178-182.PubMed
- Christou A, Katzenellenbogen J, Thompson S: Australia's national bowel cancer screening program: does it work for Indigenous Australians?. BMC Public Health. 2010, 10: 373-394. 10.1186/1471-2458-10-373.PubMed CentralView ArticlePubMed
- Vos T, Barker B, Stanley L, Lopez A: The Burden of Disease and Injury in Aboriginal and Torres Strait Islander Peoples: Summary Report. 2007, Brisbane: School of Population Health, The University of Queensland
- National Aboriginal Community Controlled Health Organisation: An Aboriginal Medical Service. [http://www.naccho.org.au/aboriginal-health/definitions/]
- Couzos S, Thiele D: Closing the gap depends on ACCHSs. Med J Aust. 2009, 190 (10): 541-PubMed
- Panaretto K, Coutts J, Johnson L, Morgan A, Leon D, Hayman N: Evaluating performance of and organisational capacity to deliver brief interventions in Aboriginal and Torres Strait Islander medical services. Aust N Z J Public Health. 2010, 34 (1): 38-44. 10.1111/j.1753-6405.2010.00471.x.View ArticlePubMed
- Laurence C, Burgess T, Beilby J, Symon B, Wilkinson D: Electronic medical records may be inadequate for improving population health status through general practice: cervical smears as a case study. Aust N Z J Public Health. 2004, 28: 317-320. 10.1111/j.1467-842X.2004.tb00436.x.View ArticlePubMed
- Peiris D, Patel A, Cass A, Howard M, Tchan M, Brady J, De Vries J, Rickards B, Yarnold D, Hayman N, Brown A: Cardiovascular disease risk management for Aboriginal and Torres Strait Islander peoples in primary health care settings: findings from the Kanyini Audit. Med J Australia. 2009, 191 (6): 304-309.PubMed
- Bailie R, Si D, Connors C, Kwedza R, O'Donoghue L, Kennedy C, Cox R, Liddle H, Hains J, Dowden M, Burke H, Brown A, Weeramanthri T, Thompson S: Variation in quality of preventive care for well adults in Indigenous community health centres in Australia. BMC Health Serv Res. 2011, 11: 139-151. 10.1186/1472-6963-11-139.PubMed CentralView ArticlePubMed
- Harris M: Commissioned Paper for the National Preventive Health Taskforce. The Role of Primary Health Care in Preventing the Onset of Chronic Disease, with a Particular Focus on the Lifestyle Risk Factors of Obesity, Tobacco and Alcohol. 2009, [http://www.preventativehealth.org.au/internet/preventativehealth/publishing.nsf/Content/0FBE203C1C547A82CA257529000231BF/$File/commpaper-primary-hlth-care-harris.pdf]
- Ivers R: A review of tobacco interventions for Indigenous Australians. Aust N Z J Public Health. 2003, 27 (3): 294-299. 10.1111/j.1467-842X.2003.tb00398.x.View ArticlePubMed
- Thompson M, Robertson J, Clough A: A review of the barriers preventing Indigenous Health Workers delivering tobacco interventions to their communities. Aust N Z J Public Health. 2011, 35 (1): 47-53. 10.1111/j.1753-6405.2010.00632.x.View ArticlePubMed
- Stewart J, Sanson-Fisher R, Eades S, Fitzgerald M: The risk status, screening history and health concerns of Aboriginal and Torres Strait people attending an Aboriginal Community Controlled Health Service. Drug Alcohol Rev. 2012, 31: 617-624. 10.1111/j.1465-3362.2012.00455.x.View ArticlePubMed
- Velikova G, Wright E, Smith A, Cull A, Gould A, Forman D, Perren T, Stead M, Brown J, Selby P: Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. J Clin Oncol. 1999, 17 (3): 998-1007.PubMed
- Holmes W, Stewart P, Garrow A, Anderson I, Thorpe L: Researching Aboriginal health: experience from a study of urban young people's health and well-being. Soc Sci Med. 2002, 54: 1267-1279. 10.1016/S0277-9536(01)00095-8.View ArticlePubMed
- Aiello E, Taplin S, Reid R, Hobbs M, Seger D, Kamel H, Tufano J, Ballard-Barbash R: In a randomized controlled trial, patients preferred electronic data collection of breast cancer risk factor information in a mammography setting. J Clin Epidemiol. 2006, 59 (1): 77-81. 10.1016/j.jclinepi.2005.07.007.View ArticlePubMed
- Yoong S, Carey M, Sanson-Fisher R, Russell G, Mazza D, Makeham M, Paul C, Inder K, D'Este C: Touch screen computer health assessment in Australian general practice patients: a cross-sectional study protocol. BMJ Open. 2012, 2: e001405-PubMed CentralView ArticlePubMed
- Edwards SL, Slattery ML, Murtaugh MA, Edwards RL, Bryner J, Pearson M, Rogers A, Edwards A, Tom-Orme L: Development and use of touch-screen audio computer-assisted self-interviewing in a study of American Indians. Am J Epidemiol. 2007, 165 (11): 1336-1342. 10.1093/aje/kwm019. 2007View ArticlePubMed
- Andersen S, Andersen P: Multimedia computerized smoking awareness education for low-literacy Hispanics. Comput Informat Nurs. 2011, 29: TC35-TC42.
- Bryant J, Ward J, Worth H, Hull P, Solar S, Bailey S: Safer sex and condom use: a convenience sample of Aboriginal young people in New South Wales. Sex Health. 2011, 8: 378-383. 10.1071/SH10138.View ArticlePubMed
- Hunter E, Travers H, McCulloch B: Bridging the information gap: IT and health in Indigenous populations. Australas Psychiatry. 2003, 11 (Suppl1): S51-S56.View Article
- Australian Bureau of Statistics: 4363.0.55.002 - NHS and NATSISH (non-remote) 2004–05 Questionnaire_2. [http://www.abs.gov.au/ausstats/abs@.nsf/detailspage/4363.0.55.0022004-05]
- Australian Bureau of Statistics: 4363.0.55.002 - NATSIHS Substance Use Form. [http://www.abs.gov.au/ausstats/abs@.nsf/detailspage/4363.0.55.0022004-05]
- Australian Bureau of Statistics: 4720.0 National Aboriginal and Torres Strait Islander Social Survey: Users’ Guide, 2008. [http://www.abs.gov.au/ausstats/abs@.nsf/Products/4720.0~2008~Main+Features~Introduction?OpenDocument]
- Gilligan C, Sanson-Fisher R, Eades S, Wenitong M, Panaretto K, D'Este C: Assessing the accuracy of self-reported smoking status and impact of passive smoke exposure among pregnant Aboriginal and Torres Strait Islander women using cotinine biochemical validation. Drug Alcohol Rev. 2010, 29: 35-40.View ArticlePubMed
- Rose S, Elley C, Lawton B, Dowell A: A single question reliably identifies physically inactive women in primary care. New Zeal Med J. 2008, 121 (1268):
- Werch C: Quantity-frequency and diary measures of alcohol consumption for elderly drinkers. Subst Use Misuse. 1989, 24 (9): 859-865. 10.3109/10826088909047316.View Article
- Islam M, Topp L, Conigrave K, van Beek I, Maher L, White A, Rodgers C, Day C: The reliability of sensitive information provided by injecting drug users in a clinical setting: Clinician-administered versus audio computer-assisted self-interviewing (ACASI). AIDS Care. 2012, 24 (12): 1496-1503. 10.1080/09540121.2012.663886.View ArticlePubMed
- Australian Indigenous HealthInfoNet: HITnet. [http://www.healthinfonet.ecu.edu.au/key-resources/promotionresources/?lid=24385]
- Hunter E, Travers H, Pelham S, Gibson J, Hermawan G, Austin C: Pride and performance: evaluation challenges of a multimedia and information technologies project in remote Aboriginal Australia. Australas Psychiatry. 2009, 17 (Suppl 1): S155-S158.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/14/34/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.