Skip to main content

Advertisement

  • Research article
  • Open Access
  • Open Peer Review

An analysis of online health information on schizophrenia or related conditions: a cross-sectional survey

  • 1Email author,
  • 1,
  • 1,
  • 2,
  • 3 and
  • 1, 4
BMC Medical Informatics and Decision Making201313:98

https://doi.org/10.1186/1472-6947-13-98

©  Athanasopoulou et al.; licensee BioMed Central Ltd. 2013

  • Received: 8 March 2013
  • Accepted: 29 August 2013
  • Published:
Open Peer Review reports

Abstract

Background

Around 20% of those who seek health information online, search specifically for mental health. However, little is known about the nature of the online health information offered by two European countries, Finland and Greece, which are characterized by markedly differing levels of Internet access and online health information seeking. This study aims to assess, describe and compare websites, written in two European, non-English languages (Finnish and Greek) that appear first after performing an online search concerning schizophrenia or related conditions.

Methods

The first 20 results from four search terms (searched in Finnish and Greek) in the Web search engine ‘Google’ were screened. A total of 160 websites were retrieved (80 Finnish, 80 Greek) and evaluated using a preformulated coding system which consisted of websites’ indicators, such as: types, characteristics, accountability, interactivity, aesthetics and content. Differences between websites were evaluated with Chi-Square or Fisher’s Exact tests for categorical data and independent t-tests for parametric data.

Results

Twenty-four Finnish and thirty-four Greek websites (36% in total) were included. Almost two-thirds (62%, n=36) were owned by an organization, compared to 17% (n=10) by an individual. In both countries, aesthetics had the highest score (possible range 0–4, mean = 2.6, SD = .62), while interactivity the lowest (range 0–5, mean = 1.79, SD = .87). There were no statistically significant differences among the accountability, interactivity and aesthetics scores of the Finnish and Greek websites.

Conclusions

All assessed indicators suggest there is a need to improve Finnish and Greek online information about schizophrenia or related conditions. The poor website interactivity is of particular concern given the challenges faced by the target group. The findings can be used to guide the development and dissemination of online mental health information aimed at Finnish and Greek online health-seekers.

Keywords

  • Consumer health information
  • Information retrieval
  • Internet
  • Schizophrenia

Background

Schizophrenia is a chronic, severe, debilitating mental disorder [1, 2], which ranks third in global burden among the mental disorders [3]. Approximately 25 million people are diagnosed with schizophrenia globally [4], about 2.5 million in the USA [5] and around 3.7 million in Europe [6]. Schizophrenia affects the lives of those with the disorder and their caregivers [7, 8] due to hallucinations, perceptual and communication difficulties [9]. The illness itself is also connected with high levels of fear, shame, guilt [10], and social isolation [7], which may lead to an unwillingness to adhere to treatment [11], consequent relapse [12] and readmissions [8, 13].

A Cochrane review [14] concluded that psychoeducation may promote adherence to medication, diminish relapses, reduce the length of hospitalization and rates of readmission for those with schizophrenia. Advances in technology allow psychoeducation to be delivered conveniently through the Internet [15]. Such technology is now frequently used by members of the public to access health information online [16] with a substantial percentage of all online health searches being for mental health information [17]. Internet users visit medical websites primarily to acquire information about a health condition, its treatment, symptoms, and to obtain health advice [18].

Recent evidence suggests that the Internet is also an important source of illness-related information for people with schizophrenia [19] who value the availability of reliable, evidence-base information on the Internet [19] and the role it can play in increasing their sense of empowerment by increasing their understanding of their illness and capacity to communicate with their doctors [19]. In addition, web-based psychoeducation for people with schizophrenia shows some promise as a means of improving mental state, providing social support, and supporting medication compliance [20].

Schizophrenia is commonly associated with deficits in attention, concentration, visual perception and interpretation [1, 9]. At the same time, online health information can be easily misinterpreted [21] and online health seekers may be exposed to contradictory medical advice and opinions [22]. As a consequence, it is particularly important that websites providing information about schizophrenia should present simple but high quality and understandable information, in a design format that takes into account the above difficulties [23, 24].

The Internet is a potentially useful tool for retrieving information about mental illness [25, 26]. In the USA, it is estimated that 21% of information health-seekers use the Internet for mental health issues [17]. In the UK, it has been reported that about 18% of all Internet users and 31.5% of Internet users with a past history of mental health problems used the Internet for retrieving mental health information [27]. However, patterns of computer and Internet use vary substantially across countries [28]. Two-thirds of the total population in the European Union (EU) use the Internet at least once a week [29], but there are marked discrepancies in Internet usage between member states of the EU. For example, in Southern Europe and specifically in Greece, 50% of households have Internet access, while the percentage in a Northern European country, such as Finland, is 84% [29]. Further, in 2011, 58% of Finnish citizens used the Internet to search for health-related information (second after Icelanders), whereas Greek citizens (30%) are among the least likely of the European Union members (after Italy, Cyprus and Romania) to use the Internet for health information seeking [30]. While a basic cornerstone of the European agenda is the right of freedom of movement across the EU [31], support of homogeneous rights, quality health services for citizens [32], and intercountry collaboration [33], priority should be given ensuring the availability and universal accessibility of high quality online mental health information [34–36]. The quality of the provided online health or mental health information, worldwide and specifically in Europe [37, 38] still remains unclear. To our knowledge, four studies of the quality of online health information have been conducted in Finland [39, 40], and Greece [41, 42]. Only one of these was related to mental health. It found that Finnish websites providing information about antidepressants did not cover all aspects of treatment [39]. These two European countries differ in population, Internet access and, Information and Communication Technologies (ICT) use and attitudes [28–30]. The objective of the current study was to assess, describe and compare Finnish and Greek websites that first appear after performing an online search concerning schizophrenia or related condition.

Methods

Data collection and sample

On November 30, 2011, the Web search engine ‘Google’ was used to identify online health information on schizophrenia or related conditions. Google was selected because it is the most frequently used search engine [43] and the one of the most likely to be used by someone searching for online health information. Country specific versions for Finland (http://www.google.fi/) and Greece (http://www.google.gr/) were employed.

Search terms in Finnish and Greek language were chosen with the aim of generating a list of websites that might be similar to a search produced by a Finnish or Greek adult with average medical, Internet, and computer expertise [34, 44, 45]. Since searches are often triggered by a particular diagnosis or condition [17, 46], we hypothesized that the four most probable search terms for someone within the spectrum of schizophrenic disorders would be: mental illness (‘mielisairaus’/‘ψυχική ασθένϵια’), mental disorder (’mielenterveyden häiriö’/‘ψυχική διαταραχή’), schizophrenia (‘skitsofrenia’, ‘σχιζφφρένϵια’), and psychosis (‘psykoosi’/‘ψύχωση’) respectively in Finnish and in Greek language.

The first 20 websites returned by the search engine for each of the four search terms were examined for eligibility (N = 160; 80 Finnish and 80 Greek). It was considered unlikely that the typical consumer would click on more than 20 results [47–49] from a single search. The 20 direct links from each ‘Google’ search term were saved. Screenshots of the direct webpages appearing from every ‘Google’ result were taken.

Additionally, within every website five webpages were collected, applying convenience sampling. After opening and saving the first webpage that appeared from Google results, then four additional randomly selected webpages were saved which were linked to the initial page. Convenience sampling was preferred for the selection of webpages [50] because of their convenient accessibility and proximity.

To be included in the study, a valid website was required to satisfy the following criteria: 1) focused on health or mental health issues for adults in the Finnish or Greek language; and 2) was a standard information website, open web-based encyclopaedia (e.g. ‘wikipedia’), discussion forum, blog or wiki. The latter was included since it has been reported that they are favoured online sources among people with schizophrenia [19]. Websites were excluded if they: 1) were not focused on health or mental health issues; 2) targeted educators or special schools’ educators or described courses; 3) primarily involved advertisements or book promotion; 4) were links leading to external files (e.g. .doc, .pdf, .ppt); 5) were invalid addresses or malware; 6) were incidental mental health articles or discussion in a non-health oriented forum or blog; 7) were not written in the Finnish or Greek languages; 8) or provided health information for a non-adult population (e.g. for children or adolescents, or their parents).

A total of 56 Finnish websites and 46 Greek websites failed to satisfy the inclusion criteria and were excluded (Figure 1). This left 24 Finnish and 34 Greek language websites (58 sites in total) for analysis.
Figure 1
Figure 1

Flow diagrams of included websites.

Coding system and instrument

The coding system used for the data categorization consisted of six indicators: 1) type of website; 2) characteristics; 3) accountability; 4) interactivity; 5) aesthetics; and 6) content.

First, websites were categorized in seven types according to an adaptation of Morel et al. [51] (Table 1). Second, characteristics of the sites were evaluated according to criteria used by Griffiths & Christensen [34, 45]. Three additional characteristics were added including other languages available, provision of online services (e.g. video-conferencing), and presence of the Health On the Net (HON) code [52] which is an ethical standard certification of the trustworthiness of a specific health and medical website (Table 1). Third, accountability was evaluated with the adapted version of Silberg et al’s [53] scale [45] (Table 1). The maximum total score of this scale is 9 (possible range 0–9). Fourth, interactivity was evaluated with the adapted version of Khazaal et al. [54, 55] (Table 1). The maximum score on this scale is 5 (range 0–5). Fifth, aesthetics was evaluated with the adapted version of Kisely et al.’s criteria [56] originally introduced by Abbott [55] (Table 1). The maximum score on this scale is 4 (range 0–4).
Table 1

Coding tool for Finnish and Greek websites

Indicators

Items

Types a

Commercial

(only one possible option)

Personal page dev. by professional(s)

 

University website

 

Non-profit organization

 

Governmental

 

Open source

 

Other (e.g. blogs)

Characteristics a

Scope:

(yes=1, no=0)

    Specific (mental health)

No total score

    Broad (health)

 

    Broader (general information)

 

Ownership structure:

 

    Individual

 

    Organization

 

    Unknown

 

Ownership type:

 

    Commercial

 

    Professional

 

    Consumer

 

    Unknown

 

Country of origin:

    Finland

    Greece

    EU

    Other

 

Drug company involved

 

Professional Editorial board involved

 

Health professional involved

 

Promotion of prod/service

 

Disclaimer

 

Other languages available

 

Online services

 

HON certification

Accountability

Authorshipb:

(yes=1, no=0)

    Credited

(score 0–9)

    Affiliations

 

    Credentials

 

Attributionb:

 

    Source given

    Reference given

 

Disclosurea:

 

    Site ownership

    Site sponsorship

 

Currencya:

 

    Modified last 1/12 months

    Last date of mod. specified

Interactivity a

Intra-site search engine

(yes=1, no=0)

Audio/Video support

(score 0–5)

Evaluation quest.

 

Supportive bodies

 

Possibility to contact webmaster

Aesthetics b

Headings/subheadings

(yes=1, no=0)

Diagrams

(score 0–4)

Hyperlinks

 

Absence of ads

Content c

Diagnosis

(yes=1, no=0)

Treatment

No total score

Patient association information

 

Clinics information

aNavigation through website.

bFive random webpages within website.

cDirect webpage.

Lastly, the content of the provided online information was evaluated based on the availability of answers to health-related enquiries frequently generated by people with psychiatric disorders, such as information about diagnosis, treatment options, and medication side-effects [54]. Answers were searched using the screenshots of the direct webpages and not through website navigation. This decision was made because online health-seekers do not spend a lot of time searching for information within a website [47, 57], and people with schizophrenia face difficulties with website navigation [23, 24]. The searched items were: 1) diagnosis; 2) treatment; 3) information about patient associations; and 4) information about clinics (Table 1). If a webpage did not specifically state ‘symptom’ or ‘diagnosis’ of schizophrenia or related mental disorders, the page was considered not to provide information about symptoms or diagnosis, although these may have incorporated an obscure reference to this information. In addition, if the term ‘treatment’ or ‘diagnosis’ was mentioned (e.g. ‘The quicker the psychosis is diagnosed and the treatment is started, the better the recovery’) but a specific treatment option was not mentioned (e.g. ‘The treatment consists of medication and psychotherapy’), then it was not considered to contain treatment information. This decision was taken because people with schizophrenia may require concrete descriptions [23] to understand the text they are reading.

Coding was conducted as follows. First, researchers independently familiarized themselves with the retrieved websites. Second, they undertook an evaluation of website type, characteristics, accountability, interactivity, aesthetics, (CA for Greek and SS for Finnish data) and content of the webpages (CA and CB for Greek and MV and HH for Finnish data), with each website score on each of the criteria with ‘1’ indicating the criterion was satisfied and ‘0’ that it was absent. In addition, type, characteristics, disclosure, currency, interactivity were determined through navigation within the website, while authorship, attribution, and aesthetics were scored according to 5 random webpages within a single website. This approach was adopted, since in many cases, a single website was diverse (e.g. name of author was mentioned on one page but not the author of a text on another page). Content was evaluated only through the direct webpage retrieved from the ‘Google’ search, with the aim of evaluating that part of the website most health-seekers were likely to access (Table 1).

Reliability of the coding was ensured by following actions. First, two raters (CA, SS) critically examined the Greek and Finnish ratings concerning website type, characteristics, accountability, interactivity and aesthetics. The evaluators discussed any discrepancies in the decisions made with the final rating made by agreement. Reliability was investigated by recoding (third independent rater) a random selection of 20% of the websites. The number of scoring errors (n = 65) was then divided by the number of coded cells (N = 2538), yielding an error rate of 2.56%. Second, inter-rater reliability was assessed separately for the Finnish and Greek analysis. The percent agreement was calculated by dividing the number of observations in which the raters agreed by the total observations (97%). Third, any scoring disagreements in content analysis were resolved through discussion between the two same-language raters. Percent agreement for content analysis was 80% and 83% for the Finnish and Greek data respectively [58].

Data analysis

Accountability, interactivity, and aesthetics indicator scores were computed by summing the value of each score of the item (yes = 1; no = 0). Correlations among accountability, interactivity and aesthetics were analyzed using Pearson’s correlation coefficient. Differences between categorical variables was evaluated using Chi-Square tests or Fisher’s Exact test if expected cell counts were <5. Differences in indicator scores between Finnish and Greek websites were analysed using independent t-tests. SPSS version 19.0 (IBM Corporation, Somers, NY, USA) was used for all statistical analyses and in all tests, an alpha of .05 was employed for identifying a statistically significant difference.

Results

Sample

The 58 included websites were: commercial (n = 18), personal pages developed by health professionals (n = 7), university websites (n = 1), non-profit organizations (n = 7), governmental (n = 2), open source (n = 5) websites where anyone could modify the webpage content, for example ‘wikis’ or online encyclopedias, or other sources (n = 18), for example, blogs or patient/professional associations.

Characteristics of the websites

Fifty-five of the websites originated from Finland or Greece (24 Finnish, 31 Greek) and three were maintained by the European Commission. About one third (34%, n = 11) of Finnish and Greek (29%, n = 7) websites provided other language options, typically, English and/or Swedish in Finland and, English and/or French in Greece. Online services, e.g. video-conferencing or web telephony counseling were provided by 6% of Greek websites (n = 2), but not by Finnish websites. Three Greek websites but none of the Finnish websites had the HON certification.

Comparing Finnish and Greek website characteristics, there were statistically significant differences for three factors. First, a greater percentage of the Greek than Finnish websites were owned by a health professional (56% vs. 21%, p = .008). Second, there was a higher probability that a Greek website involved a health professional in the content development (76% vs. 38%, p = .003). Third, Greek websites promoted products or services more often than their Finnish counterparts (50% vs. 21%, p = .024) (Table 2).
Table 2

Characteristics of Finnish and Greek websites

Characteristics

Total

FI

GR

Chi-square

P a

 

N (%)

n (%)

n (%)

(df)

 

Scope of information

     

Specific (mental health)

41 (71)

15 (63)

26 (77)

1.33 (1)

.25

Broad (health)

12 (21)

7 (29)

5 (15)

1.80 (1)

.18

Broader (general information)

5 (8)

2 (8)

3 (8)

.004 (1)

.95

Ownership structure

     

Organization

36 (62)

16 (67)

20 (59)

.37 (1)

.54

Individual

10 (17)

3 (12)

7 (21)

.65 (1)

.42

Unknown

12 (21)

5 (21)

7 (20)

.001 (1)

.98

Ownership type

     

Commercial

11 (19)

6 (25)

5 (15)

.97 (1)

.33

Professional

24 (41)

5 (21)

19 (56)

7.13 (1)

.008

Consumer

5 (9)

4 (17)

1 (3)

3.36 (1)

.07

Unknown

18 (31)

9 (38)

9 (27)

.80 (1)

.37

Drug company involved

     

Yes

5 (9)

3 (13)

2 (6)

.78 (1)

.38

No

53 (91)

21 (88)

32 (94)

  

Presence of Editorial board

     

Yes

5 (9)

1 (4)

4 (12)

1.03 (1)

.31

No

53 (91)

23 (96)

30 (88)

  

Health professional involved

     

Yes

35 (60)

9 (38)

26 (76)

8.92 (1)

.003

No

23 (40)

15 (63)

8 (24)

  

Promotion of products/services

     

Yes

22 (38)

5 (21)

17 (50)

5.08 (1)

.024

No

36 (62)

19 (79)

17 (50)

  

Disclaimer

     

Yes

23 (40)

11 (46)

12 (35)

.65 (1)

.42

No

35 (60)

13 (54)

22 (65)

  

aFisher’s Exact Test.

Accountability of the websites

Most of the websites specified the site ownership (74%, n = 43) and over half (55%, n = 32) provided sources for the content. Eleven websites mentioned the authors’ affiliations and the last date of modification. In general, accountability of the websites was poor: the mean value of the accountability score was 3.33 (SD 1.93) out of a possible maximum 9 (Table 3).
Table 3

Accountability scores of Finnish and Greek websites

 

Total

  

FI

  

GR

    
 

N (%)

Mean

SD

n (%)

Mean

SD

n (%)

Mean

SD

Chi-square (df)

P a

Accountability (Range 0–9)

 

3.33

1.93

 

2.91

1.69

 

3.62

2.06

 

.18

Authors credited

21 (36)

  

5 (21)

  

16 (47)

  

4.19 (1)

.04

Affiliations

11 (19)

  

3 (27)

  

8 (24)

  

1.11 (1)

.29

Credentials

19 (33)

  

5 (26)

  

14 (41)

  

2.64 (1)

.10

Source given

32 (55)

  

15 (47)

  

17 (50)

  

.89 (1)

.35

Reference given

15 (26)

  

7 (47)

  

8 (24)

  

.23 (1)

.63

Site Ownership

43 (74)

  

16 (67)

  

27 (79)

  

1.19 (1)

.28

Site Sponsorship

20 (35)

  

7 (29)

  

13 (38)

  

.51 (1)

.47

Modified last 1–12 months

21 (36)

  

8 (33)

  

13 (38)

  

.14 (1)

.70

Last date of modification specified

11 (19)

  

4 (17)

  

7 (21)

  

.14 (1)

.71

aFisher’s Exact Test.

When accountability of Finnish and Greek websites was compared, only one statistically significant difference was found: authorship was specified more often in Greek than Finnish websites (47% vs. 21%, p = .04) (Table 3).

Interactivity of the websites

Five websites (9%) incorporated evaluation questionnaires, for example, to enable the user to provide feedback about the website or to evaluate his/her health status. About three-quarters (74%, n = 43) of all websites provided the e-mail address of the webmaster and two-third (62%, n = 36) provided an intra-site search engine. The total mean interactivity score was 1.79 (SD .87, maximum 5) which was low with no statistically significant differences between the countries (Table 4).
Table 4

Interactivity scores of Finnish and Greek websites

 

Total

  

FI

  

GR

    
 

N (%)

Mean

SD

n (%)

Mean

SD

n (%)

Mean

SD

Chi-square (df)

P a

Interactivity (Range 0–5)

 

1.79

.87

 

1.17

.99

 

1.85

.78

 

.54

Intra-site search engine

36 (62)

  

17 (71)

  

19 (56)

  

1.34 (1)

.25

Audio/Video support

8 (14)

  

1 (4)

  

7 (21)

  

3.19 (1)

.07

Evaluation questionaires

5 (9)

  

2 (8)

  

3 (9)

  

.004 (1)

.95

Supporting Bodies

12 (21)

  

5 (21)

  

7 (21)

  

.001 (1)

.98

Contact webmaster

43 (74)

  

16 (67)

  

27 (79)

  

1.19 (1)

.28

aFisher’s Exact Test.

Aesthetics of the websites

All the websites used headings or subheadings (n = 58). Almost half of the sites did not incorporate advertisements. Two-thirds of all sites had hyperlinks to external sites, while four sites (7%) included diagrams in their content. The mean score for the total aesthetics indicator was 2.6 (SD .62, maximum 4). There were no statistically significant differences in the aesthetic ratings for the Finnish and Greek websites (Table 5).
Table 5

Aesthetics scores of Finnish and Greek websites

 

Total

  

FI

  

GR

    
 

N (%)

Mean

SD

n (%)

Mean

SD

n (%)

Mean

SD

Chi-square (df)

P a

Aesthetics (Range 0–4)

 

2.6

.62

 

2.71

.55

 

2.53

.66

 

.28

Headings/subheadings

58 (100)

  

24 (100)

  

34 (100)

    

Diagrams

4 (7)

  

1 (4)

  

3 (9)

  

.48 (1)

.49

Hyperlinks to external sites

40 (69)

  

18 (75)

  

22 (65)

  

.70 (1)

.40

Absence of ads

49 (85)

  

22 (92)

  

27 (79)

  

1.61 (1)

.20

aFisher’s Exact Test.

Content of the direct webpages

With respect to the availability of answers to five popular enquiries, the most commonly answered in Finnish direct webpages concerned diagnosis (71%), while in Greek direct webpages information about treatment (32%) was the most common. The only statistically significant difference was in the provided information about diagnosis (p<.001) (Table 6).
Table 6

Content scores between Finnish and Greek direct webpages

 

Total

  

FI

  

GR

    

Content

N (%)

Mean

SD

n (%)

Mean

SD

n (%)

Mean

SD

Chi-square (df)

P a

Diagnosis

23 (40)

.40

.49

17 (71)

.71

.46

6 (18)

.18

.39

16.6 (1)

<.001

Treatment

23 (40)

.40

.49

12 (50)

.50

.51

11 (32)

.32

.47

1.83 (1)

.18

Association

4 (7)

.07

.26

3 (13)

.13

.34

1 (3)

.03

.17

2.00 (1)

.16

Clinic

0 (0)

.00

.00

0 (0)

.00

.00

0 (0)

.00

.00

  

aFisher’s Exact Test.

Overall, proportionate to the potential range of scoring, the highest scoring indicator was aesthetics of the websites (2.6 out of 4), followed by accountability (3.33 out of 9) and interactivity (1.79 out of 5).

Discussion

This study was designed to assess, describe and compare Finnish and Greek websites appearing first on ‘Google’ when using a search term on schizophrenia or related conditions. The websites were analysed with respect to type and characteristics, accountability, interactivity, aesthetics and content of the websites. It seems that first-appearing Finnish and Greek websites, providing mental health-related information were of low quality (reflecting the fact that few of the Silberg criteria, on average, were satisfied) with respect to the assessed indicators. These results are similar to those reported in Reavley and Jorm’s review [38] of 23 studies of the quality of mental disorder information websites. The current findings are valuable because there is evidence that people with schizophrenia perceive the Internet as an important and influential source of information [19]. Although research interest in the quality of online health information has been apparent for at least 17 years [59, 60], little seems to have changed regarding the development and dissemination of online health information.

Although compared to Greek citizens, Finnish citizens are much more likely to seek health information online [61], and to have greater access to the internet [29], and more advanced ICT skills [28, 30], our study found no evidence that the first-returned Finnish websites providing schizophrenia-related information were of better quality than Greek websites. This finding does not exclude the possibility that there are high quality Finnish and Greek mental health websites, but it does demonstrate that if high quality sites exist they are not among the first 20 results when a schizophrenia-related Google search is performed.

In the present analysis, accountability of Greek websites was higher than the Finnish ones. This could be due to the profusion of private doctors and private diagnostic clinics in Greece [62], who use websites to advertise their professional profile and attract consumers. This is supported by the finding that service promotion was more common on the Greek websites than on Finnish websites. In contrast to their Finnish counterparts, most Greek consumers tend to pay privately for their healthcare [63]. The latter may also explain the significantly greater level of health professional ownership and professional content development of mental-health related websites in Greece compared to Finland. Identification of the ownership structure of the Finnish websites was unclear. There were no significant differences between the Finnish and Greek websites with respect to other characteristics of websites such as scope, country and whether a drug company was involved.

Website interactivity was poor in both countries. Interactivity is considered an important website element offering a way to communicate with users and engage them in using the provided services [64]. It is unclear if the present findings reflect the poor interactivity of websites, in general, or if they reflect a more specific limitation of mental health websites in a field where mental health consumers are often inaccurately perceived as passive users of health services [65]. Providing consumers with trustworthy online health information has the potential to lead to better outcomes when given information and choices [65, 66]. Our findings also suggest that the Finnish and Greek websites are primarily designed for passive information delivery, rather than providing interactive tools and support. It is critical to consider consumers’ needs and opinions [24], if the Internet is to be an effective psychoeducation tool [14]. Moreover, supporting the inclusion of vulnerable populations, like people with schizophrenia, into an information society is emphasized by the European Commission [67].

Our analysis demonstrated that the content of the webpages deriving directly from the first 20 ‘Google’ results, and in particular whether they provided answers to common consumer enquiries, was low. It has been reported [25, 54, 68] that online health-seekers search for information related to a disease, symptoms, treatment options, clinics and patients’ associations. In the current study it was found that this information was typically not available within the first webpage of the included websites.

In our study we included ‘wikis’ in the analysis, although their use as a reliable health resource has been criticized [69, 70]. This decision was made on the grounds that web search engines often lead users to Wikipedia [71]. Wikis are favored online sources among consumers with schizophrenia [19]. Large amounts of health information are provided in Wikipedia [69], and there has been some evidence that health professionals believe that popular Wikipedia articles (including those on ‘schizophrenia’) are of ‘good quality’ [70]. Such evaluations are typically focused on the accuracy of the content rather than on the interactivity or aesthetics of the site. While accurate content is necessary [45], it is also crucial to ensure that information is delivered in a way that a person with schizophrenia or a related condition can become informed, since symptoms of these disorders, such as attention deficit or delusional misinterpretations, may compromise Internet use [19]. We attempted to assess all generated websites such as wikis, blogs, forums, etc., regardless of their structure, in order to focus on those websites that are returned in typical online searches for mental health information. However, future research should consider investigating comparative quality across these different types of resources including wikis.

Limitations

There are a number of limitations of this study. First, the online search was performed in November 2011 and considering the changing nature of the Internet, it is unsure that the results of this study will remain the same in the future. Second, there are no studies on how Finnish and Greek people diagnosed with schizophrenia retrieve online mental health information. Hence, they may use a search engine other than ‘Google’ or use different search terms or methods to acquire online health information about their illness. In addition, the conveniece sampling method used for the selection of five webpages for each website, does not ensure that someone could access and read the specific five webpages. Third, the information gathered about Finnish and Greek websites used a limited range of specific quality measures, excluding, for example, readability [26] and quality of content [45, 56, 72]. In Finland, official clinical guidelines for mental disorders are available, but not in Greece. For this reason, the current study did not employ a measure of the quality of content based on evidence-based guidelines. Fourth, the quality indicators of this study could potentially consist of more items. For example, the aesthetics indicator did not measure the presence or not of images or video or other media (only diagrams) in our included webpages, although such material has the potential to assist people to better understand the text they read [73]. Fifth, the availability of answers in common inquiries (diagnosis, treatment, associations, clinics) was assessed from the direct webpages. Therefore, the content description is limited to one webpage only and, thus, does not apply to the content of the whole website. Additionally, only the presence or absence of specific content was assessed (diagnosis, treatment, patient associations, clinics), without evaluating the accuracy or comprehensiveness of the provided information. Thus, even when the webpage achieved a positive rating on the current scoring system, the content of the webpage might have been of low evidence-based quality. Last, inter-rater reliability was only calculated for the content of webpages, since it was the only indicator assessed by two same-language raters. However, the coding of the other indicators was discussed for all data, between the Finnish and the Greek rater.

Conclusions

All assessed indicators of Finnish and Greek websites, appearing first on ‘Google’ when using a schizophrenia-related search term achieved low scores. This is despite the difference in ICT context in the two countries and in particular the greater Internet use and access, and ICT experience in Finland. Regardless of the latter disparities between Finland and Greece, those with schizophrenia and related conditions receive a similar level of online experience when they spontaneously search for schizophrenia-related information via ‘Google’.

Implications

This study provides a foundation for the future development of websites on the topic of schizophrenia, and suggests that improvement in many aspects of website quality is needed. Although the quality of mental health information websites may have improved over the past decade [38], the current findings suggest the need for increased awareness about the various quality indicators among website developers, bloggers, ‘wiki’, forum contributors, and others who upload schizophrenia-related content online.

All developers, including health professionals who are significant online health information contributors [70] should be encouraged to comply with international standards and guidelines before uploading health-related information. Such instruments provide an essential tool to guide developers to produce usable websites including those intended for people with schizophrenia. This could promote homogeneity, easy access, and clear interpretation of the online health information, and thereby, support and educate consumers and their families. Additionally, health professionals should be open to provide guidance on which online health information can be trusted and why, since people diagnosed with a mental disorder are also searching for health information online [27].

Furthermore, the most popular search engines could facilitate the delivery of high quality websites. For example, a search engine might potentially be programmed to return high quality information websites [35, 74] prior to sponsored results and lesser quality websites. Moreover, Google’s country specific versions might follow Google USA’s example [75], where they partnered with the National Institute of Health to generate relevant health-related information in response to consumers’ searches [76].

Abbreviations

ICT: 

Information and communication technologies.

Declarations

Acknowledgements

We gratefully acknowledge the help provided by Christina Boundouvis with data analysis of the Greek webpages. This research was supported by the Academy of Finland (132581), the Finnish Cultural Foundation, and the Operational Program Education and Lifelong Learning of the National Strategic Reference Framework (NSRF) 2007–2013, within the framework of the Program for personalized evaluation process - Horizontal Act project, funded by the European Union (European Social Fund-ESF) and the Public Investment Program (PIP), and implemented by the State Scholarship Foundation (2011‐2‐162; IKY, Greece). The funding sources had no involvement in the study.

Authors’ Affiliations

(1)
Department of Nursing Science, University of Turku, Turku, Finland
(2)
Clinic of Social and Family Medicine, School of Medicine, University of Crete, Heraklion, Greece
(3)
Centre for Mental Health Research, The Australian National University, Canberra, ACT, Australia
(4)
Southwest Hospital District, Turku, Finland

References

  1. Freedman R: Schizophrenia. N Engl J Med. 2003, 349: 1738-1749. 10.1056/NEJMra035458.View ArticlePubMedGoogle Scholar
  2. Chan SW, Hsiung PC, Thompson DR, Chen SC, Hwu HG: Health-related quality of life of Chinese people with schizophrenia in Hong Kong and Taipei: a cross-sectional analysis. Res Nurs Health. 2007, 30: 261-269. 10.1002/nur.20189.View ArticlePubMedGoogle Scholar
  3. Collins PY, Patel V, Joestl SS, March D, Insel TR, Daar AS: Grand challenges in global mental health. Nature. 2011, 475: 27-30. 10.1038/475027a.View ArticlePubMedPubMed CentralGoogle Scholar
  4. Bloom DE, Cafiero ET, Jané-Llopis E, Abrahams-Gessel S, Bloom LR, Fathima S, Feigl AB, Gaziano T, Mowafi M, Pandya A, Prettner K, Rosenberg L, Seligman B, Stein AZ, Weinstein C: The Global Economic Burden of Noncommunicable Diseases. 2011, Geneva: World Economic Forum,http://www3.weforum.org/docs/WEF_Harvard_HE_GlobalEconomicBurdenNonCommunicableDiseases_2011.pdf,Google Scholar
  5. Mental Health America: Schizophrenia: What you need to know. 2012,http://www.nmha.org/go/information/mental-health-info/schizophrenia/schizophrenia-what-you-need-to-know/schizophrenia-what-you-need-to-know,Google Scholar
  6. The European Multi-Centre Association Study of Schizophrenia (EMASS): Bad luck and -the legacy of schizophrenia. [http://ec.europa.eu/research/success/en/med/0285e.html]
  7. Palazzolo J, Brousse G, Favre P, Llorca PM: The information of the schizophrenic patient: actuality. Encéphale. 2005, 31: 227-234.View ArticlePubMedGoogle Scholar
  8. Spaniel F, Vohlídka P, Hrdlicka J, Kozený J, Novák T, Motlová L, Cermák J, Bednarík J, Novák D, Höschl C: ITAREPS: Information Technology Aided Relapse Prevention Programme in Schizophrenia. Schizophr Res. 2008, 98: 312-317. 10.1016/j.schres.2007.09.005.View ArticlePubMedGoogle Scholar
  9. Wible CG, Preus AP, Hashimoto R: A cognitive neuroscience view of schizophrenic symptoms: abnormal activation of a system for social perception and communication. Brain Imaging Behav. 2009, 3: 85-110. 10.1007/s11682-008-9052-1.View ArticlePubMedGoogle Scholar
  10. Miller R, Mason SE: Shame and guilt in first-episode schizophrenia and schizoaffective disorders. J Contemp Psychother. 2005, 35: 211-221. 10.1007/s10879-005-2701-4.View ArticleGoogle Scholar
  11. Goff DC, Hill M, Freudenreich O: Strategies for improving treatment adherence in schizophrenia and schizoaffective disorder. J Clin Psychiatry. 2010, 71 (Suppl 2): 20-26. 10.4088/JCP.9096su1cc.04.View ArticlePubMedGoogle Scholar
  12. Geddes J: Prevention of relapses in schizophrenia. N Engl J Med. 2002, 346: 56-58. 10.1056/NEJM200201033460112.View ArticlePubMedGoogle Scholar
  13. McIntosh A, Conlon L, Lawrie S, Stanfield AC: Compliance therapy for schizophrenia. Cochrane Database Syst Rev. 2006, 3: CD003442Google Scholar
  14. Xia J, Merinder LB, Belgamwar MR: Psychoeducation for schizophrenia. Cochrane Database Syst Rev. 2011, 6: CD002831Google Scholar
  15. Rotondi AJ, Anderson CM, Haas GL, Eack SM, Spring MB, Ganguli R, Newhill C, Rosenstock J: Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes. Psychiatr Serv. 2010, 61: 1099-1105. 10.1176/appi.ps.61.11.1099.View ArticlePubMedGoogle Scholar
  16. Fox S, Duggan M: Health Online 2013. 2013, Pew Internet & American Life Project,http://pewinternet.org/Reports/2013/Health-online.aspx,Google Scholar
  17. Fox S, Jones S: The Social Life of Health Information. 2009, Pew Internet & American Life Project,http://www.pewinternet.org/~/media//Files/Reports/2009/PIP_Health_2009.pdf,Google Scholar
  18. Shuyler KS, Knight KM: What are patients seeking when they turn to the Internet? Qualitative content analysis of questions asked by visitors to an orthopaedics Web site. J Med Internet Res. 2003, 5: e24-10.2196/jmir.5.4.e24.View ArticlePubMedPubMed CentralGoogle Scholar
  19. Schrank B, Sibitz I, Unger A, Amering M: How patients with schizophrenia use the internet: qualitative study. J Med Internet Res. 2010, 12: e70-10.2196/jmir.1550.View ArticlePubMedPubMed CentralGoogle Scholar
  20. Välimäki M, Hätönen H, Lahti M, Kuosmanen L, Adams CE: Information and communication technology in patient education and support for people with schizophrenia. Cochrane Database Syst Rev. 2012, 10: CD007198Google Scholar
  21. Cline RJ, Haynes KM: Consumer health information seeking on the Internet: the state of the art. Health Educ Res. 2001, 16: 671-692. 10.1093/her/16.6.671.View ArticlePubMedGoogle Scholar
  22. Hartzband P, Groopman J: Untangling the Web - patients, doctors, and the Internet. N Engl J Med. 2010, 362: 1063-1066. 10.1056/NEJMp0911938.View ArticlePubMedGoogle Scholar
  23. van der Krieke L, Emerencia AC, Aiello M, Sytema S: Usability evaluation of a web-based support system for people with a schizophrenia diagnosis. J Med Internet Res. 2012, 14: e24-10.2196/jmir.1921.View ArticlePubMedPubMed CentralGoogle Scholar
  24. Valimaki M, Anttila M, Hatonen H, Koivunen M, Jakobsson T, Pitkanen A, Herrala J, Kuosmanen L: Design and development process of patient-centered computer-based support system for patients with schizophrenia spectrum psychosis. Inform Health Soc Care. 2008, 33: 113-123. 10.1080/17538150802127207.View ArticlePubMedGoogle Scholar
  25. Fox S: Online Health Search 2006. 2006, Pew Internet & American Life Project,http://www.pewinternet.org/~/media//Files/Reports/2006/PIP_Online_Health_2006.pdf.pdf,Google Scholar
  26. Kalk NJ, Pothier DD: Patient information on schizophrenia on the internet. Psychiatric Bulletin. 2008, 32: 409-411. 10.1192/pb.bp.107.017004.View ArticleGoogle Scholar
  27. Powell J, Clarke A: Internet information-seeking in mental health: population survey. Br J Psychiatry. 2006, 189: 273-277. 10.1192/bjp.bp.105.017319.View ArticlePubMedGoogle Scholar
  28. Eurostat: Use of ICTs and use of on-line services, 2008–2010 (% of individuals aged 16 to 74). 2010,http://epp.eurostat.ec.europa.eu/statistics_explained/index.php?title=File:Use_of_ICTs_and_use_of_on-line_services,_2008-2010_(%25_of_individuals_aged_16_to_74).png&filetimestamp=20111117095543,Google Scholar
  29. Seybert H: Internet use in households and by individuals in 2011. 2011,http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-SF-11-066/EN/KS-SF-11-066-EN.PDF,Google Scholar
  30. Eurostat: Individuals using the Internet for seeking health-related information - Percentage of individuals aged 16 to 74. 2011,http://epp.eurostat.ec.europa.eu/tgm/table.do?tab=table&plugin=0&language=en&pcode=tin00101,Google Scholar
  31. Eurofound - European Foundation for the Improvement of Living and Working Conditions: Mobility in Europe – The way forward. 2007, European Foundation for the Improvement of Living and Working Conditions,http://www.eurofound.europa.eu/pubdocs/2007/03/en/1/ef0703en.pdf,Google Scholar
  32. Reding V: Commission recommendation on cross-border interoperability of electronic health record systems. 2008,http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2008:190:0037:0043:EN:PDF,Google Scholar
  33. European Commission, Information society and media directorate – General: Report on the public consultation on eHealth Action Plan 2012–2020. 2012,http://www.ehealthnews.eu/images/stories/pdf/ehap2012public-consult-report.pdf,Google Scholar
  34. Griffiths KM, Christensen H: The quality and accessibility of Australian depression sites on the World Wide Web. Med J Aust. 2002, 176: S97-S104.PubMedGoogle Scholar
  35. Theodosiou L, Green J: Emerging challenges in using health information from the internet. Adv Psychiatr Treat. 2003, 9: 387-396. 10.1192/apt.9.5.387.View ArticleGoogle Scholar
  36. America’s Health Literacy: Why We Need Accessible Health Information. An Issue Brief From the U.S. Department of Health and Human Services. 2008,http://www.health.gov/communication/literacy/issuebrief/,Google Scholar
  37. Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 287: 2691-2700. 10.1001/jama.287.20.2691.View ArticlePubMedGoogle Scholar
  38. Reavley NJ, Jorm AF: The quality of mental disorder information websites: a review. Patient Educ Couns. 2011, 85: e16-e25. 10.1016/j.pec.2010.10.015.View ArticlePubMedGoogle Scholar
  39. Prusti M, Lehtineva S, Pohjanoksa-Mäntylä M, Bell JS: The quality of online antidepressant drug information: an evaluation of English and Finnish language Web sites. Res Social Adm Pharm. 2012, 8: 263-268. 10.1016/j.sapharm.2011.03.003.View ArticlePubMedGoogle Scholar
  40. Tallgren M, Bäcklund M: Patient information about general anaesthesia on the internet. Anaesthesia. 2009, 64: 408-415. 10.1111/j.1365-2044.2008.05813.x.View ArticlePubMedGoogle Scholar
  41. Bamidis P, Kerassidis F, Pappas K, Health information on the internet : evaluating greek health portals and depicting users' attitudes in west macedonia, Greece. Stud Health Technol Inform. 2005, 116: 885-890.PubMedGoogle Scholar
  42. Patsioura F, Kitsiou S, Markos A: Evaluation of Greek public hospital websites. In Proceedings of the International Conference on E-business: 7-10 July 2009; Milan. 2009, 223-229. INSTICC Press;Google Scholar
  43. Purcell K, Brenner J, Rainie L: Search Engine Use 2012. 2012,http://pewinternet.org/~/media//Files/Reports/2012/PIP_Search_Engine_Use_2012.pdf,Google Scholar
  44. Khazaal Y, Fernandez S, Cochand S, Reboh I, Zullino D: Quality of web-based information on social phobia: a cross-sectional study. Depress Anxiety. 2008, 25: 461-465. 10.1002/da.20381.View ArticlePubMedGoogle Scholar
  45. Griffiths KM, Christensen H: Quality of web based information on treatment of depression: cross sectional survey. BMJ. 2000, 321: 1511-1515. 10.1136/bmj.321.7275.1511.View ArticlePubMedPubMed CentralGoogle Scholar
  46. Morahan-Martin JM: How internet users find, evaluate, and use online health information: a cross-cultural review. Cyberpsychol Behav. 2004, 7: 497-510.View ArticlePubMedGoogle Scholar
  47. Eysenbach G, Köhler C: How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ. 2002, 324: 573-577.View ArticlePubMedPubMed CentralGoogle Scholar
  48. Eysenbach G, Köhler C: Does the internet harm health? Database of adverse events related to the internet has been set up. BMJ. 2002, 324: 239-10.1136/bmj.324.7331.239.View ArticlePubMedGoogle Scholar
  49. Höchstötter N, Lewandowski D: What users see – structures in search engine results pages. Inform Sciences. 2009, 179: 1796-1812. 10.1016/j.ins.2009.01.028.View ArticleGoogle Scholar
  50. Fricker RD: Sampling methods for web and e-mail surveys. The SAGE handbook of Online Research Methods. Edited by: Fielding NG, Lee RM, Blank G. 2008, London: SAGE, 195-216.View ArticleGoogle Scholar
  51. Morel V, Chatton A, Cochand S, Zullino D, Khazaal Y: Quality of the web-based information on bipolar disorder. J Affect Disord. 2008, 110: 265-269. 10.1016/j.jad.2008.01.007.View ArticlePubMedGoogle Scholar
  52. Health On the Net foundation (HON): The commitment to reliable health and medical information on the internet. 2011,http://www.hon.ch/HONcode/Patients/Visitor/visitor.html,Google Scholar
  53. Silberg WM, Lundberg GD, Mussachio RA: Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor–Let the reader and viewer beware. JAMA. 1997, 277: 1244-1245. 10.1001/jama.1997.03540390074039.View ArticlePubMedGoogle Scholar
  54. Khazaal Y, Chatton A, Cochand S, Hoch A, Khankarli MB, Khan R, Zullino DF: Internet use by patients with psychiatric disorders in search for general and medical informations. Psychiatr Q. 2008, 79: 301-309. 10.1007/s11126-008-9083-1.View ArticlePubMedGoogle Scholar
  55. Abbott VP: Web page quality: can we measure it and what do we find? A report of exploratory findings. J Public Health Med. 2000, 22: 191-197. 10.1093/pubmed/22.2.191.View ArticlePubMedGoogle Scholar
  56. Kisely S, Ong G, Takyar A: A survey of the quality of web based information on the treatment of schizophrenia and Attention Deficit Hyperactivity Disorder. Aust N Z J Psychiatry. 2003, 37: 85-91. 10.1046/j.1440-1614.2003.01107.x.View ArticlePubMedGoogle Scholar
  57. Crespo J: Training the health information seeker: quality issues in health information web sites. Libr Trends. 2004, 53: 360-374.Google Scholar
  58. Lombard M, Snyder-Duch J, Bracken CC: Content analysis in mass communication: assessment and reporting of intercoder reliability. Hum Commun Res. 2002, 28: 587-604. 10.1111/j.1468-2958.2002.tb00826.x.View ArticleGoogle Scholar
  59. Bower H: Internet sees growth of unverified health claims. BMJ. 1996, 313: 381-View ArticlePubMedGoogle Scholar
  60. Pealer LN, Dorman SM: Evaluating health-related Web sites. J Sch Health. 1997, 67: 232-235. 10.1111/j.1746-1561.1997.tb06311.x.View ArticlePubMedGoogle Scholar
  61. The Linked World: Reasearch Report. How ICT Is Transforming Societies, Cultures, and Economies. 2008,http://pressoffice.telefonica.com/documentos/LibroProductividad_VersionIngles.pdf,Google Scholar
  62. Tountas Y, Karnaki P, Pavi E, Souliotis K: The “unexpected” growth of the private health sector in Greece. Health Policy. 2005, 74: 167-180. 10.1016/j.healthpol.2005.01.013.View ArticlePubMedGoogle Scholar
  63. Thompson S, Massialos E: What are the equity, efficiency, cost containment and choice implications of private health-care funding in western Europe?. 2004, WHO Regional Office for Europe’s Health Evidence Network (HEN),http://www.euro.who.int/__data/assets/pdf_file/0003/74694/E83334.pdf,Google Scholar
  64. Koo C, Wati Y, Park K, Lim MK: Website quality, expectation, confirmation, and end user satisfaction: the knowledge-intensive website of the Korean National Cancer Information Center. J Med Internet Res. 2011, 13: e81-10.2196/jmir.1574.View ArticlePubMedPubMed CentralGoogle Scholar
  65. Adams JR, Drake RE, Wolford GL: Shared decision-making preferences with severe mental illness. Psychiatr Serv. 2007, 58: 1219-1221. 10.1176/appi.ps.58.9.1219.View ArticlePubMedGoogle Scholar
  66. Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C: Effect of web-based depression literacy and cognitive–behavioural therapy interventions on stigmatising attitudes to depression. Br J Psychiatry. 2004, 185: 342-349. 10.1192/bjp.185.4.342.View ArticlePubMedGoogle Scholar
  67. COM: Together for Health: A Strategic Approach for the EU 2008–2013. 2007,http://ec.europa.eu/health/ph_overview/Documents/strategy_wp_en.pdf,Google Scholar
  68. Kortum P, Edwards C, Richards-Kortum R: The impact of inaccurate Internet health information in a secondary school learning environment. J Med Internet Res. 2008, 10: e17-10.2196/jmir.986.View ArticlePubMedPubMed CentralGoogle Scholar
  69. Czarnecka-Kujawa K, Abdalian R, Grover SC: The quality of open access and open source Internet material in gastroenterology: is Wikipedia appropriate for knowledge transfer to patients?. Gastroenterology. 2008, 134: A325-A326.View ArticleGoogle Scholar
  70. Heilman JM, Kemmann E, Bonert M, Chatterjee A, Ragar B, Beards GM, Iberri DJ, Harvey M, Thomas B, Stomp W, Martone MF, Lodge DJ, Vondracek A, de Wolff JF, Liber C, Grover SC, Vickers TJ, Meskó B, Laurent MR: Wikipedia: a key tool for global public health promotion. J Med Internet Res. 2011, 13: e14-10.2196/jmir.1589.View ArticlePubMedPubMed CentralGoogle Scholar
  71. Laurent MR, Vickers TJ: Seeking health information online: does Wikipedia matter?. J Am Med Inform Assoc. 2009, 16: 471-479. 10.1197/jamia.M3059.View ArticlePubMedPubMed CentralGoogle Scholar
  72. Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, Billieux J, Zullino D: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns. 2009, 77: 33-37. 10.1016/j.pec.2009.02.016.View ArticlePubMedGoogle Scholar
  73. Johnson-Glenberg MC: Web-based training of metacognitive strategies for text comprehension: focus on poor comprehenders. Read Writ. 2005, 18: 755-786. 10.1007/s11145-005-0956-5.View ArticleGoogle Scholar
  74. Griffiths KM, Tang TT, Hawking D, Christensen H: Automated assessment of the quality of depression websites. J Med Internet Res. 2005, 7: e59-10.2196/jmir.7.5.e59.View ArticlePubMedPubMed CentralGoogle Scholar
  75. Feufel MA, Stahl SF: What do web-use skill differences imply for online health information searches?. J Med Internet Res. 2012, 14: e87-10.2196/jmir.2051.View ArticlePubMedPubMed CentralGoogle Scholar
  76. Andrews J: Google partners with NIH: Government gets top spot. 2010,http://www.contactdd.com/DDDocuments/August_2010.pdf,Google Scholar

    77. Pre-publication history

    1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/13/98/prepub

Copyright

© Athanasopoulou et al.; licensee BioMed Central Ltd. 2013

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us