How should risk be communicated to children: a cross-sectional study comparing different formats of probability information
© Ulph et al. 2009
Received: 05 November 2008
Accepted: 05 June 2009
Published: 05 June 2009
Skip to main content
© Ulph et al. 2009
Received: 05 November 2008
Accepted: 05 June 2009
Published: 05 June 2009
Newborn screening, which identifies inherited disorders and sometimes carrier status, will increasingly involve health professionals in the provision of appropriate information and support to children and their families. The ability to understand carrier results relies on an understanding of probabilistic terms. However, little is known about how best to convey probabilistic medical information to children. Research with adult populations suggests information format significantly affects comprehension. This study aimed to explore which presentation format is most effective in conveying probabilistic information to children.
A probabilistic task based on the cup game was used to measure which of five different formats was associated with greatest understanding in children aged 7–11 years old (n = 106). Formats used were verbal labels (e.g. rarely, sometimes), percentages, proportion-word (e.g. 1 in X), proportion-notation (e.g. 1:X) and pie charts. There was also an additional mixed format condition. In each trial a picture was presented of three cups, each with a different probability depicted beneath it, and the child was asked to select which cup was most likely to contain the ball. Three trials were presented per format. Children also rated how certain they were that they had answered correctly.
There was a significant relationship between format and comprehension scores. Post hoc tests showed children performed significantly better when probability was presented as a pie chart, in comparison to percentages, proportion – notation, proportion-word and mixed format trials. Furthermore, most children (84%) got all trials correct for this format and children were significantly more certain that their response was correct in the pie chart trials compared to all the other formats (p < 0.001). Significant positive correlations were found between self-ratings of certainty and comprehension of verbal labels, percentages and pie charts. Older age was also associated with better performance on all formats except percentages. Overall comprehension was calculated by summing the scores for the individual trials and this was independently associated with older age and higher IQ.
The results suggest that 7–11 year olds can understand probability information, but that the format used will significantly affect the accuracy and confidence with which children in this age group make judgements about the likelihood of an event. Of the formats studied, pie charts appear to be the optimal method of presenting probabilistic information to children in this age group. Health professionals and designers of health messages should be cognisant of this when communicating medical information to children aged 7–11 years old.
Historically, children (people below the age of 16) have been regarded as passive recipients of health care, with information, decisions and consultations directed towards their parents . The Gillick Case in the UK , in which the right for a child below the age of 16 to be prescribed contraception without parental knowledge was recognised, challenged this. In doing so it set the precedent that children who could demonstrate Gillick competence should be involved in health care decisions. Subsequently, a number of policies were issued both within the UK and internationally which stipulated that children should, as far as developmentally possible, be encouraged and supported to take an active role in their health care [3, 4]. More recently, the General Medical Council has advocated the inclusion of competent children in their own health care decisions .
Gillick competence has been adopted into law within the UK, Australia and Canada and is based on proving that the child is rational and able to communicate a decision which evidences that they have considered the consequences of such a choice and any alternative options [6, 7]. Thus, a child's competence is determined by their ability to understand the implications of their decision. How effectively the information regarding the risks and likely outcomes of different decisions has been communicated to children will arguably significantly influence their ability to make informed decisions regarding their health care . Such a belief underpins the research interest in how best to communicate health information to children. An omission within this field is an examination of how best to present probability-based information to children.
Risk comprehension is central to many decisions about health  and is key to informed consent to treatment [10, 11]. Research regarding adults' understanding of risk messages suggests the way risk information is conveyed impacts on an individual's ability to appraise different treatment regimens [12–14], change behaviours [15, 16], and choose treatment outcomes . This has lead to a proliferation of research examining how best to convey health risk information to adults [18–23]. Verbal labels [24, 25], proportions [26, 27], percentages , graphical representations [16, 29, 30] and a mixture of formats [31, 32] have all been proposed as optimal formats. What is not clear from the existing research is the most effective way in which to convey probabilistic messages to children and whether they will similarly be affected by the format used.
Studies based on Piaget's theory of cognitive development suggests that children cannot understand probability until approximately 11 years of age  and the UK mathematics curriculum largely reflects this Piagetian staging [34, 35]. Although Piagetian theory provides a framework to explore the development of probability comprehension  an analysis of the evidence and subsequent research indicates this theory may be too simplistic . Indeed, neo-Piagetian research indicated that, with appropriate guidance, children as young as 7 years old can understand probability [36, 38, 39]. Research into probability judgements is now characterised by a focus on the idea that intuitive processes are often used to solve probabilistic tasks and variance in performance is to be attributed to the individuals' ability to select the relevant information from competing stimuli . This work indicates that the ability to solve probabilistic tasks is present early in development and that children also appear to be vulnerable to task biases that affect adults. Thus, it is likely that the ability of children to understand medically related probabilistic information will be influenced by a number of factors, including the presentation of the task.
More recently, a study which compared the ability of children with adults when making expected value judgements concluded that children as young as five or six can understand probability . Children were found to employ similar strategies to adults and also understood that probability was an abstract concept. A cross-sectional survey study of 10–15 year olds and adults found large variation in the percentages attributed to verbal expressions, especially in the 10–15 year olds' responses . Participants had most difficultly when distinguishing between the verbal labels "possibly" and "probably".
The adult literature indicates that visual representations are beneficial for conveying probability to those with low literacy and numeracy skills [29, 41] and for retaining attention . The latter finding has been explained in terms of the information being presented in concrete terms. This may be particularly crucial when communicating with children, particularly if formats which are familiar from school lessons are used (e.g. pie charts).
Although it has been acknowledged that risk communication is central to conveying medical information and patient decisions, the context for the present study was the introduction of newborn screening utilising genetic testing. Effective communication of probability is seen as central in genetics [42–44]. The implementation of newborn genetic screening programmes, which identify inherited disorders and sometimes carrier status in newborns, will result in a generation of children about whom genetic information is known prior to an age at which the individual concerned could understand the implications of being a carrier.
The ability to appreciate the random nature of inheritance and the reproductive implications of carrier status is reliant on probabilistic understanding. For example, a carrier of a gene for an autosomal recessive disease such as cystic fibrosis or sickle cell, (diseases screened for currently in the UK newborn screening programme), has a one in four chance in each pregnancy that their child will be affected with the disease if their partner is also a carrier. Additionally, there are the relative likelihoods of their partner being a carrier as a result of the prevalence in the community, or of their wider family members being carriers as the gene has been identified within the family. Thus, it is likely that any communication of carrier status to these children will necessitate an explanation of probability .
Although some parents will feel confident in conveying information about carrier status to their child, evidence suggests the communication of genetic information within families is limited [44, 46] and problematic . Many parents report that they find it difficult to inform children of their results and to be frank with them about the effects of the illness [47, 48]. Thus, it is likely that health professionals will be called on to support parents with information giving . Recent research suggests that children aged 7–11 years old are in the process of constructing knowledge about genetics and it is at these ages that children could benefit from guidance (Ulph, Glazebrook & Townsend, Children's understanding of genetic concepts, submitted). What is uncertain is whether or how children could understand the probabilistic nature of genetic information and the most effective way to convey this information. The aim of this study was, therefore, to determine whether children aged 7–11 are able to make probabilistic judgements and whether the format of the presentation of probabilistic information affects this ability.
Information about the schools included in sample.
No. pupils in sample
Date of school report
% free school meals (20%)
% ethnic minority
Percentage of pupils achieving level 4 at key stage 2.
Demographic information of participants.
Age 7–9 (N = 32)
Age 10–11 (N = 74)
Mean BPVS score (SD)
Median BPVS Score (range)
Median total score
The median scores and ranges indicate this sample is representative of the population and includes sufficient variation to capture different abilities.
Participants were divided into two groups 7–9 and 10–11 years old based on the Piagetian theoretical assumption that within the ages 7–11 understanding would be most different between these two age groupings . Although all ages of children were important to the study outcomes, more children were recruited into the older age group as probability understanding was hypothesised to be most developed in this group.
The slides also contained a ten point certainty scale depicted as a thermometer. The inclusion of this scale is in keeping with previous probability research  and provided an indication of how comfortable the child was working with each format.
Previous research has illustrated the importance of measuring a child's ability to comprehend verbal task instructions and produce responses when examining children's knowledge . The BPVS is a valid and reliable measure of receptive vocabulary in children and scores equate closely to verbal IQ. Total scores are age standardized to give IQ scores with an expected population mean of 100 (SD 15).
The tasks took approximately 20 minutes to complete. In each trial the child was asked to select the cup which was most likely to have a ball underneath it based on the probability provided under each cup. The children were asked if they recognised each format and whether they required an explanation. A uniform explanation was given if requested and this was recorded on their score sheet. For example, if children indicated they wanted an explanation of percentages they were told that it meant 'how often something would happen out of one hundred'. If the child selected the cup with the highest probability depicted below it the child was given one point. The order in which formats were presented was counterbalanced to minimise the effect of previous formats on performance. The total score a child could achieve for each format was 3 with a maximum total task score of 18. Next the child was asked to indicate how certain they were that their answer was correct by choosing a level on the certainty scale with higher levels reflecting more certainty.
To administer the BPVS, participants are read a series of words. After each word the participant is asked to select the picture which represents the word from a page containing four line drawings. Participants are not required to read or write and responses can be verbal or by gesture.
Children were encouraged throughout the task, but no feedback regarding the accuracy of their answers was provided. Following completion of the tasks, children were asked whether they had any questions about the research or the tasks that they had just completed. After answering their questions they were thanked for their participation.
Data were analysed using SPSS version 11.6. Histograms and significant Kolmogorov-Smirnov test results indicated that the data were not normally distributed. Thus, non-parametric tests were used to analyse the data. Friedman's tests were performed to analyse differences in performance and certainty across formats. Significant differences between formats were identified using post-hoc Wilcoxon signed rank tests applying a p value of 0.003 (Bonferroni correction). The Mann-Whitney U test was used to establish whether performance was affected by verbal ability, age group or the provision of an explanation. Effect sizes for both Mann-Whitney U tests and Wilcoxon signed rank tests were calculated by converting z scores into effect size estimates . A hierarchical multiple regression enabled the assessment of the influences of age, verbal ability and gender.
This study was approved by the University of Nottingham's School of Psychology Ethics Committee.
There were no differences in BPVS scores or gender between the two age groups. Results of a Kruskal-Wallis test showed that the presentation order of formats did not affect performance so order of presentation was not included in analyses. A Mann Whitney U, performed to analyse the effect of high (≥ 100) or low (≤ 99) BPVS scores , found no significant effects of verbal ability on performance scores for any of the formats.
Frequency of explanation required per format for entire sample (n = 106)*.
Frequency of explanation (%)
Relationship to performance
U = 1346.00, p = .67, r = -0.04
U = 234.50, p = .28, r = -0.10
U = 1017.50, p = .46, r = -0.07
U = 1133.00, p = .26, r = -0.11
U = 735.50, p = .78, r = -0.03
Percentage and pie chart formats required explanations least frequently, whilst label and proportions required the most. Two tailed Mann-Whitney analyses found no difference in scores for trials where an explanation had been given compared to those without explanation (see table 3 above).
Comparison of mean scores per format for entire sample on scale of 0–3 (difference, significance value, effect size).
p = .530
p = .001*
p < .001*
p = .005
p < .001*
r = .06
r = .34
r = .35
r = -.27
r = .63
p = .005
p = .002*
p < 001*
p < .001*
r = .27
r = .30
r = -.34
r = .59
Proportion – word
p = .610
p < .001*
p < .001*
r = .05
r = .53
r = .48
Proportion – notation
p < .001*
p < .001*
r = -.50
r = .41
p = .001*
r = .72
Number and percentage of children achieving maximum scores on each format with 95% confidence intervals.
The graphs also show that children in both age groups performed best on the percentage and pie chart formats, with least variation in performance in the pie chart condition. There were no effects of gender.
For each trial presented, children rated how certain they were that their answer was correct on a scale 1–10. Children could score a maximum of 30 per format. These analyses were conducted on 101 children. Scores for five children were omitted from the analyses as they consistently selected maximum scores on all trials, showing no evidence of utilizing the measure to reflect their feelings of certainty.
Median and interquartile ranges of certainty scores per format by age group.
7–9 years old (N = 29)
10–11 years old (N = 72)
The significance of these differences was explored through Wilcoxon signed rank tests using a p value of 0.003 (Bonferroni correction). Children reported feeling significantly more certain of their answers when probability information was presented as pie charts compared to verbal labels (z = -5.72, p < .001, r = -0.57), percentages (z = -3.31, p < .001, r = -0.33), proportion-word (z = -7.04, p < .001, r = - 0.70), proportion-notation (z = -7.17, p < .001, r = - 0.71), and mixed formats (z = - 7.47, p < .001, r = -0.74). Children also felt more certain when making comparisons across percentages compared to verbal labels (z = -4.11, p < .001, r = -0.41), proportion-word (z = -4.84, p < .001, r = -0.48), proportion-notation (z = -5.22, p < .001, r = -0.52), and mixed formats (z = -6.03, p < .001, r = -0.60).
Significant positive correlations were found between self-ratings of certainty and comprehension of labels (rs = .414, df = 100, p =< .001), percentages (rs = .299, df = 100, p = .001) and pie charts (rs = .218, df = 100, p = .014). There were no significant relationships between certainty ratings and proportion-word (p = .137), proportion-notation (p = .286) and mixed formats (p = .302). The three formats that were easiest to comprehend showed a positive correlation between self-ratings of certainty and performance, whereas the formats that were less well understood showed no such relationship.
A hierarchical, multiple regression was conducted to further examine the influences of age, verbal ability and gender on performance. This was conducted on total scores for the probability task ( = 12.63, SD. 3.79). Age was entered as the first determinant based on the results reported above. Age explained 26% of the variance in total score (F1,103 = 36.72, p =< .001) with BPVS scores explaining a further 7% of the variance (F2,102 = 25.46, p = .015). Thus, once age is controlled for higher verbal ability is associated with better understanding of probability. There was no effect of gender on total probability score.
The results of this study highlight two important messages for health professionals and researchers. Firstly, the results indicate that when information is provided in an appropriate format young children show evidence of understanding probability and are more confident about their judgements. This concords with previous research which has illustrated that in experimental conditions children can make probability judgements [61, 38, 40]. It therefore strengthens the argument for children to be included in communications of probabilistic health messages using developmentally appropriate materials.
Secondly, it was found that format significantly affects younger children's ability to understand probabilities. Health professionals should be aware that proportions are poorly understood and misunderstandings may trigger unwarranted concerns in children. For example, if children believe that 1 in 1000 is more likely than 1 in 10 utilising 1:1000 in an attempt to allay concerns is actually likely to make a child more anxious. This concords with previous work conducted with children which warns that they find this format problematic  and with research conducted with adults which demonstrates that misunderstandings arise from their use [61–63]. Despite this, research suggests that proportions are one of the most frequently used formats , specifically when conveying disease risk in genetic counselling sessions .
Research also shows that both genetic counsellors and parents use verbal labels, especially when conveying small probabilities [64, 65]. Although children in both age groups performed well when using this format, the findings from this study warrant caution when using verbal labels as almost half of the participants requested an explanation. Concerns have also been raised regarding the use of verbal labels with adults  and adolescents . Thus, health professionals should ensure that children understand the implications of such words when they are used within medical discussions. In addition, it has been shown that there can be ambiguity in how verbal labels are interpreted [11, 51–55, 67, 68]. This suggests that designers of probabilistic health-related information should extensively research lay understanding of the magnitudes inferred by different verbal labels to ensure the correct message is being conveyed.
These results indicate that, of the formats studied, children are most likely to comprehend probabilistic information presented as either percentages or pie charts with 70% and 84% of children scoring maximally on these formats, respectively. The data suggest pie charts would be preferable as children performed best on this format and were also most confident about their responses, suggesting that this may be a good communication strategy with children. This finding is supported by evidence that graphical formats are optimal for conveying probability information to people with low literacy or numerical skills [29, 30] and for retaining attention . It is likely that these formats were easiest to understand as children can revert to using magnitude judgements to estimate probability. Magnitude judgements are simply the ability to judge which of two objects is largest. It has been argued that this skill precedes the understanding of probability  although even children with the capacity to reason using probabilities have been found to prefer to use magnitude judgements to solve probability tasks . Although the use of percentages has been advocated with adolescents  it should be noted that this when performance was compared to verbal label comprehension. Additionally, research with adults suggests that whilst percentages are often used when discussing treatment options , they can be poorly understood [27, 71].
The child's age was also found to affect performance on all formats with the exception of percentages. Although this is in line with previous research , the present study illustrates that these results should not be taken to indicate that younger children cannot understand probability. Rather it should be acknowledged that they may need more guidance to understand certain probability formats. No differences were found in performance between children who requested an explanation and those who did not require one, suggesting that with minimal guidance children can understand most new formats of probability. There is an important distinction to be made between explanations in relation to verbal labels and explanations for numerical representations of probabilities. Explanations for verbal labels are specific to a particular descriptor and cannot be easily generalized. Thus, explanations were commonly requested for each term in the verbal label format. The provision of explanations in numerical formats (e.g. percentages are how often something happens out of one hundred) could be generalized and therefore children were less likely to require an explanation in subsequent trials of that format. Thus, following the provision of guidance children may be able to make probability decisions using formats such as percentage and pie charts in the future, whilst children may consistently need support to understand the meaning conveyed by verbal labels.
An analysis of factors which contribute to overall probability understanding suggests that verbal IQ also contributes to performance once age has been accounted for, a finding supported by previous research . Self-ratings of certainty showed a positive correlation with percentage, verbal labels, and pie charts. Comprehension, therefore, was linked with defendable estimates of certainty.
The verbal labels in the trials were selected as they are typically used to describe probability in health messages. Despite careful planning, consultation and piloting some children did not know a number of the words. This serves to emphasize that verbal labels may need extensive research to ensure the intended message is conveyed.
We acknowledge that we were not able to calculate response rates. This was not feasible within the ethical and school-based constrictions and it is relatively common that response rates are not reported in this field [37, 72]. There is also a methodological reason why response rates can be potentially misleading in the reporting of school-based samples. Response rates are routinely used to gauge how representative a sample is, as a measure of how closely the sample recruited appropriates the population it was drawn from. As it is school teachers who select the children seen by researchers, a percentage figure may not be an adequate measure of how representative a given sample is. It is possible that teachers tend to select the most intelligent pupils (to present a good image of the school, or because these children have finished their work) or the children who are disruptive to the class. This bias may lead to an over-or underestimation of the abilities of children in general. A strength of this study was that the sample was drawn from a range of schools and was representative of the general population in terms of IQ.
The authors acknowledge that the measure of comprehension used in the cup game was somewhat limited as it was a measure of the ability to select which option was most likely. Clearly further detailed research is necessary to establish whether children can use certain formats more readily. Such studies could be based on modified experiments used with adults, such as asking them to select relevant information from materials to make judgements about treatment, or ascertain whether a test result is in the normal range . The aim of the study, however, was to verify whether children aged 7–11 could make probability judgements and whether the format used would affect their ability to do so.
Further research utilising a modified version of this measure would be beneficial. It would be advantageous to include a wider range of graphical representations to establish whether the effects seen in this study were attributable to pie charts per se or graphical representations more generally. This recognises the mixed findings regarding the utility of pie charts [22, 73–76]. Also, extending the number of trials of each format would enable one to explore more fully the range and extent of children's ability to make judgements utilising these formats and a clearer distinctions between which formats represent optimal communication strategies.
Finally, the results of this work needs to be verified in applied settings. While it can be concluded that children can understand certain probability formats when presented as classroom exercises, it cannot be assumed that children will readily adapt this knowledge to a clinical setting where the probabilistic message has personal implications.
In conclusion these results demonstrate highly significant effects of format on comprehension. A more in-depth exploration indicated that performance across formats was more variable in the younger age group. Asking children of all ages to make judgements across different formats significantly reduced their ability to select the highest probability correctly. Although children performed well when presented with verbal labels, percentage and pie chart formats, we conclude that pie charts were the optimal format to enable children to make decisions about probabilities within this study. We have concluded that pie charts are optimal because, although children performed well on other formats such as percentages and verbal labels, pie charts consistently showed the best levels of performance. This was true regardless of whether one examined mean scores, percentage of children gaining maximum points or median and interquartile ranges. Additionally, children reported that they were most certain of their answers using this format.
These finding have clear implications for health professionals' communication and the involvement of children in health care. Health professionals should be encouraged that our results suggest that children may be able to understand simple risk information and that the use of an appropriate format can enhance their understanding. Although the focus of this study was to establish the best format in which to convey probabilistic information regarding health to children with a specific focus on genetics, the results of this study could clearly also be used in other health and non-health related areas.
We would like to acknowledge the assistance of Prof. Scott Campbell who offered advice on the probability task. We would like to thank the Economic and Social Research Council who provided funding for this study via a PhD studentship for the project "Children's understanding of testing for a genetic illness". The ESRC provided funding but played no active role in the research or publication.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.