The development and initial validation of the cyberchondria severity scale (CSS)

https://doi.org/10.1016/j.janxdis.2013.12.007Get rights and content

Highlights

  • Development of the cyberchondria severity scale (CSS).

  • Exploratory factor analysis identified five correlated factors.

  • CSS scores were positively correlated with depression, anxiety and stress.

Abstract

Cyberchondria is a form of anxiety characterised by excessive online health research. It may lead to increased levels of psychological distress, worry, and unnecessary medical expenses. The aim of the present study was to develop a psychometrically sound measure of this dimension. A sample of undergraduate students (N = 208; 64% female) completed a pilot version of the cyberchondria severity scale (CSS) along with the short form version of the depression, anxiety and stress scale (DASS-21). Exploratory factor analysis identified a correlated five factor structure that were labelled ‘Compulsion’, ‘Distress’, ‘Excessiveness’, ‘Reassurance Seeking’ and ‘Mistrust of Medical Professional’. The CSS demonstrated good psychometric properties; the subscales had high internal consistency, along with good concurrent and convergent validity. The CSS may prove useful in a wide variety of future research activities. It may also facilitate the development and validation of interventions for cyberchondria.

Introduction

Due to the rapid developments in information and communications technology the internet has become a popular source of health information amongst the general public. It has been estimated that 80% of Americans use the internet to access health information, making it the fifth most common online activity (Pew Internet & American Life Project, 2012). Health related websites continue to see a steady growth in traffic. For example, WebMD saw user traffic increase by 28% between 2011 and 2012 (Howell, 2013). This equates to 117.4 million unique visitors a month and total page views of 2.57 billion (Howell, 2013). There are numerous reasons why the internet has become such a popular means of accessing health information; it is quick, easy to use, anonymous and relatively inexpensive (Starcevic & Berle, 2013).

Online health research (OHR) may lead to positive and preventative activities such as exercise, healthier eating habits, improved adherence to medication and empowered health decisions (Huberty et al., 2012, Lemire et al., 2008). On the other hand, such practices present a challenge when used as a diagnostic device by laypersons (Aiken, Kirwan, Berry, & O’Boyle, 2012). While the internet provides access to a large body of information it is a crude means of self-diagnosis as it fails to take age, gender, lifestyle and other subtleties into account (White and Horvitz, 2009a, White and Horvitz, 2009b). Research also indicates that the quality of online health information is mixed and that few searchers check the reliability of their sources (Benigeri & Pluye, 2003).

Cyberchondria refers to an increase in anxiety about one's own health status, as a result of excessive reviews of online health information (Muse et al., 2012, Baumgartner and Hartmann, 2011, Bessière et al., 2010, White and Horvitz, 2009a, White and Horvitz, 2009b, Aiken and Kirwan, 2012, White and Horvitz, 2009a, White and Horvitz, 2009b). Although research in this area is still in its infancy, studies have shown that OHR represents a reliable risk factor for heightened anxiety regarding subjective health status. Correlational studies have identified a statistically significant association between OHR and increased medical anxiety (Muse et al., 2012, White and Horvitz, 2009b. Experimental research has also demonstrated that OHR can lead to negative emotional responses such as fear and a sense of being over-whelmed (Lauckner & Hsieh, 2013). A longitudinal study by Bessière et al. (2010) found that health related internet use was associated with a small but reliable increase in depression over an 8 month period. This anxiety may manifest itself in impaired functionality; a large survey study by White and Horvitz, 2009a, White and Horvitz, 2009b found that approximately 60% of respondents reported interruptions to both online and offline activities as a result of worrying health searches.

While it is clear that OHR can have an anxiety provoking effect, cyberchondria is also characterised by an element of excessiveness. This may occur in the form of repeated or lengthy searches for heath information (Starcevic & Berle, 2013). For example, a survey of over 500 people found that 60% of respondents queried a specific health concern over multiple online sessions (White and Horvitz, 2009a, White and Horvitz, 2009b). An analysis of thousands of online interaction logs found that 13.5% of searchers entered the exact same health related terms into a search engine on more than one occasion over an 11 month period (White and Horvitz, 2009a, White and Horvitz, 2009b). It has been suggested that these excessive searches only serve to fuel a person's original anxiety (Starcevic & Berle, 2013).Aside from causing unwarranted levels of worry and distress, there may also be economic costs to cyberchondria. While no studies have examined the costs directly related to online health searches, there is evidence that those who are generally health anxious represent a significant economic burden. Healthcare costs and productivity losses associated with medically unexplained symptoms cost the UK economy an estimated £ 3 billion in 2008 alone (Bermingham, Cohen, Hague, & Parsonage, 2010). Cyberchondria is likely responsible for a significant proportion of this amount as an analysis of anonymised search logs found that those who searched for health information on line frequently ended their search sessions with queries about local healthcare services (White & Horvitz, 2010). Research has also suggested that OHR can lead to a deterioration in the doctor–patient relationship (Ravdin, 2008, Keller et al., 2008, Lamberty, 2008). This in turn may lead to further healthcare costs (e.g. visits to multiple doctors, known as ‘doctor shopping’). It is important, therefore, that our understanding of this new trend is increased in order to inform strategies to minimise its negative consequences.

Cyberchondria appears to be a multi-dimensional construct, reflecting both anxiety and an element of compulsiveness. While there are a number of validated scales used to measure similar forms of anxiety, such as health anxiety and general anxiety. However such instruments are not appropriate to assess the unique anxieties that occur as a result of OHR. Indeed, much of the early research has relied on single items to measure cyberchondria. Single item scales have questionable reliability and do not take the multidimensional nature of a construct into account (Gliem and Gliem, 2003, McCormack et al., 1988). The aim of this study was to develop a reliable, multidimensional measure of cyberchondria. The development of such a scale will have important implications in both the research and treatment of cyberchondria.

The primary aim of this study was to develop and evaluate the psychometric properties of a self-report measure of anxiety as a result of online searches for health information, the cyberchondria severity scale (CSS). It was predicted that the CSS would be multidimensional, reflecting anxiety and excessive searching behaviours. This study also aimed to assess the initial validity of the CSS. To this end, the concurrent and convergent validity of the CSS were examined. Concurrent validity was assessed by correlating CSS scores with a validated measure of anxiety, depression and stress and it was predicted that the CSS would correlate positively and significantly with these scores. Convergent validity is demonstrated when scores on a measure correlate with scores from other established measures, to varying degrees, depending on how theoretically similar the constructs are (Lamping et al., 2002). It was predicted that the CSS would demonstrate good convergent validity; i.e. total scores on the CSS will correlate highest with an established measure of anxiety, and with lower correlation for depression and stress. Also, it was predicted that any identified subscales would correlate in a theoretically predictable manner with established measures of depression, anxiety and stress.

Section snippets

Respondents

An opportunity sample of university undergraduate students (N = 208) was recruited (133 females, 73 males, 2 unspecified). The majority of the sample (67%) were Psychology students, while the remainder (33%) were Business Studies students. The age range of respondents was between 18 and 60 years (M = 24.19, SD = 8.2).

Measures

Cyberchondria was measured by the preliminary version of the cyberchondria severity scale (CSS). The baseline version of the CSS consisted of 43 items. Each item consisted of a 5 point

Initial item elimination

No items were removed as a result of the first and second exclusion criteria (missing data; floor and ceiling effects).

Exploratory factor analysis

Prior to the EFA, a parallel analysis (PA) was conducted in order to determine the number of factors to retain. Although rarely used in scale development, research indicates that parallel analysis is the most robust method for determining the number of factors to retain (Matsunaga, 2010, Williams et al., 2010, Henson and Roberts, 2006, Heaton et al., 2004). PA involves the

Discussion

The aim of this study was to develop and validate a measure of anxiety regarding subjective health status as a result of excessive online health research (OHR) called the cyberchondria severity scale (CSS). Preliminary analysis indicated that the sample data were suitable for factor analysis and the results suggested that the CSS scores have good psychometric properties. There was also evidence of good concurrent and convergent validity, as demonstrated by moderate correlations with an

References (34)

  • J.R. Crawford et al.

    The Depression Anxiety Stress Scales (DASS): Normative data and latent structure in a large non-clinical sample

    British Journal of Clinical Psychology

    (2003)
  • J. de Winter et al.

    Exploratory factor analysis with small sample sizes

    Journal of Mutivariate Behavioural Research

    (2009)
  • J. Gliem et al.

    Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales

    Midwest research to practice conference in adult, continuing, and community education

    (2003)
  • J.C. Heaton et al.

    Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis

    Organizational Research Methods

    (2004)
  • J.D. Henry et al.

    The short-form version of the depression anxiety stress scales (DASS-21): construct validity and normative data in a large non-clinical sample

    British Journal of Clinical Psychology

    (2005)
  • R.K. Henson et al.

    Use of exploratory factor analysis in published research: common errors and some comment on improved practice

    Educational and Psychological Measurement

    (2006)
  • D. Howell

    Why WebMD tops stock gains with Aruba, Shutterstock

    Investors business daily

    (2013)
  • Cited by (189)

    • Is cyberchondria specific to hypochondriasis?

      2024, Journal of Anxiety Disorders
    View all citing articles on Scopus
    View full text