Elsevier

Psychiatry Research

Volume 205, Issue 3, 28 February 2013, Pages 247-252
Psychiatry Research

The extent and origin of discordance between self- and observer-rated depression in patients with psychosis

https://doi.org/10.1016/j.psychres.2012.08.024Get rights and content

Abstract

It is assumed that patients with psychosis have difficulties indicating clinical symptoms accurately in self-reported measures. The present study investigated the ability of self-rating scales to detect symptoms of depression in patients with psychosis and aimed at identifying demographic, clinical and neurocognitive factors that predict the discordance between self-ratings and observer ratings. Inpatients and outpatients with psychosis (n=118) were assessed for depression by applying two observer rating and two self-rating scales. We found reasonable correlation scores between the ratings by patients and observers (range: r=0.50–0.57). In half of the patients (49.2%) the self-ratings corresponded well with the ratings of clinicians. Patients who rated their depressive symptoms as less severe than the clinicians demonstrated more negative symptoms such as blunted affect and poor affective rapport. Patients who rated their depression symptoms as being more severe were characterized by more self-reported general psychopathology. The concordance rates indicate that self-ratings of depression can be a valid additional tool in clinical assessment of patients with psychosis. However, clinicians should be attentive to the fact that some patients might have a general tendency to over-report symptoms and that patients with negative symptoms tend to be rated as more depressed in observer ratings compared with self-assessments.

Introduction

Symptoms of depression are common in patients with psychosis and can occur in every phase of the disorder (Heald et al., 2008). Reported prevalence rates range from 30% (Siris, 1991) to 70% in an acute phase of psychosis (Birchwood et al., 2000). Previous studies have demonstrated that depressive symptoms in patients with psychosis are associated with low subjective quality of life or well-being (Reine et al., 2003, Schennach-Wolff et al., 2011), in higher symptomatology (Chemerinski et al., 2008, Rocca et al., 2005), increased risk of relapse (Johnson, 1988) and increased suicidal ideation (Heilä et al., 1997).

It is therefore important to be able to identify depressive symptoms via a reliable and valid diagnostic procedure. In patients without psychosis, symptoms of depression are typically assessed via self-rating scales (e.g., Beck Depression Inventory (BDI); Beck et al., 1961). However, it is assumed that patients with psychosis have difficulties in describing their symptoms accurately that might be due to denial, shame, poor insight and information processing deficits in attention, concentration, memory, abstraction and concept formation (Hamera et al., 1996). As a consequence, observer-rated symptom scales are a common method of assessing the severity of depressive symptoms in patients with psychosis and most of the assessment research has focused on observer-rating scales (Addington et al., 1996, Collins et al., 1996, Kontaxakis et al., 2000, El Yazaji et al., 2002). However, observer ratings are time-consuming, require intensive training, are costly as well as prone to socially desirable answers and may be observer-biased. In contrast, self-ratings are efficient and could enhance therapeutic outcome and alliance (Liraud et al., 2004, McCabe et al., 2007) because they provide a means to assess and value the subjective well-being in therapy which might render improvement of depressive symptomology more likely (Schennach-Wolff et al., 2011).

So far, two studies have compared self-rating with observer-rating scales and found them to correlate moderately to highly (range from r =0.53 to r =0.84) (Addington et al., 1993, Kim et al., 2006). These studies have not, however, provided answers to the question of which factors might be responsible for the remaining discordance between clinicians’ and patients’ estimates of symptoms. Such factors have only been investigated in non-psychotic patients with depression (Domken et al., 1994, Enns et al., 2000). Both studies found several patient characteristics such as age, specific personality factors such as high neuroticism, and low self-esteem, to predict the disparities between self-ratings and observer ratings. With regard to patients with psychotic disorders, factors that explain discrepancies are likely to be found in the specific characteristics of these patients. Patients with psychosis might either under- or overestimate their symptoms due to lack of insight (Lincoln et al., 2007), higher levels of interpersonal distrust (Andreasen and Flaum, 1991), low self-esteem (Kesting et al., 2011), lack of cognitive flexibility (Beck et al., 2004) or cognitive impairment (Heinrichs and Zakzanis, 1998). On the other hand, the discrepancy could also be caused by biases on the side of the clinicians. For example, clinicians might underestimate symptoms of depression in patients with higher levels of positive symptoms, in particular those who appear agitated or aggressive. Similarly, clinicians might incorrectly interpret the diminished emotional expressions that are associated with negative symptoms or medication side effects (e.g., extrapyramidal effects; Müller et al., 2002) as symptoms of depression. However, it needs pointing out that the phenomenological similarity of negative and depressive symptoms makes it difficult to differentiate these syndromes. This makes it difficult to attribute an overlap of self- and observer-reported symptoms entirely to a rating bias (Chemerinski et al., 2008).

The present study therefore aims at identifying the clinical and neurocognitive variables as well as measurement-related factors that are likely to be responsible for self-observer discrepancies in the assessment of depression in patients with psychosis.

Section snippets

Participants

All included participants (n=118) had a diagnosis of acute or remitted delusions according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV; American Psychiatric Association, 1994). The DSM-IV criteria for schizophrenia were fulfilled by 92 participants (78.0%), for schizoaffective disorder by 11 participants (9.3%), for psychotic depression by 1 participant (0.8%) and 14 participants met the criteria for other psychotic disorders (11.9%).

Concordance of self-ratings and observer ratings

The correlation scores of the four depression scales are depicted in Table 2. Correlations ranged from 0.50 to 0.82 (all p≤0.01). The difference between the association of observer and observer (r=0.82) and self- and observer ratings (r=0.50) was significant (p≤0.01). The difference between the association of self- and self- (r=0.75) and self- and observer ratings (r=0.50) was also significant (p≤0.01).

According to the definition described above, participant ratings within the range of y=1x

Discussion

The present study examined the association between self- and observer-rated depression and patient characteristics associated with self-observer rating discrepancies. The degree of concordance between observer ratings and self-ratings was comparable with the concordance rates found for depression in two non-psychotic and two psychotic samples (Addington et al., 1993, Domken et al., 1994, Enns et al., 2000, Kim et al., 2006). The rate of concordance and the absence of extreme discrepancies

References (52)

  • D. Addington et al.

    A depression rating scale for schizophrenics

    Schizophrenia Research

    (1990)
  • D. Addington et al.

    A psychometric comparison of the Calgary Depression Scale for Schizophrenia and the Hamilton Depression Rating Scale

    Schizophrenia Research

    (1996)
  • D. Addington et al.

    Rating depression in schizophrenia

    The Journal of Nervous and Mental Disease

    (1993)
  • American Psychiatric Association., 1994. Diagnostic and Statistical Manual of Mental Disorders, 4th ed. APA,...
  • N.C. Andreasen et al.

    Schizophrenia: the characteristic symptoms

    Schizophrenia Bulletin

    (1991)
  • A.T. Beck et al.

    An inventory for measuring depression

    Archives of General Psychiatry

    (1961)
  • A.T. Beck et al.

    Cognitive Therapy of Personality Disorders

    (2004)
  • M. Birchwood et al.

    Cognitive approach to depression and suicidal thinking in psychosis

    British Journal of Psychiatry

    (2000)
  • J.J. Blanchard et al.

    Toward the next generation of negative symptom assessments: the collaboration to advance negative symptom assessment in schizophrenia

    Schizophrenia Bulletin

    (2011)
  • E. Chemerinski et al.

    Depression in schizophrenia: methodological artifact or distinct feature of the illness?

    Journal of Neuropsychiatry and Clinical Neurosciences

    (2008)
  • J. Cohen

    Statistical Power Analysis for the Behavioral Sciences

    (1988)
  • A.A. Collins et al.

    Depression in schizophrenia: a comparison of three measures

    Schizophrenia Research

    (1996)
  • A. Cedro et al.

    Alexithymia in schizophrenia: an exploratory study

    Psychological Reports

    (2001)
  • L.R. Derogatis

    SCL-90-R. Administration, Scoring & Procedures Manual for the (Revised) Version

    (1977)
  • M. Domken et al.

    What factors predict discrepancies between self and observer ratings of depression?

    Journal of Affective Disorders

    (1994)
  • M. El Yazaji et al.

    Validity of the depressive dimension extracted from principal component analysis of the PANSS in drug-free patients with schizophrenia

    Schizophrenia Research

    (2002)
  • M.W. Enns et al.

    Discrepancies between self and observer ratings of depression. The relationship to demographic, clinical and personality variables

    Journal of Affective Disorders

    (2000)
  • D. Ferring et al.

    Messung des Selbstwertgefühls: Befunde zu Reliabilität, Validität und Stabilität der Rosenberg-Skala

    Diagnostica

    (1996)
  • Franke, G., 1995. Die Symptom-Checkliste von Derogatis – Deutsche Version – SCL-90-R. Beltz Test,...
  • E.K. Hamera et al.

    Validity of self-administered symptom scales in clients with schizophrenia and schizoaffective disorders

    Schizophrenia Research

    (1996)
  • M. Hautzinger et al.

    Das Beck Depressions-Inventar (BDI)

    (1994)
  • A. Heald et al.

    Characterisation of depression in patients with schizophrenia

    Indian Journal of Medical Research

    (2008)
  • H. Heilä et al.

    Suicide and schizophrenia: a nationwide psychological autopsy study on age- and sex-specific clinical characteristics of 92 suicide victims with schizophrenia

    American Journal of Psychiatry

    (1997)
  • R.W. Heinrichs et al.

    Neurocognitive deficit in schizophrenia: a quantitative review of the evidence

    Neuropsychology

    (1998)
  • J.D. Henry et al.

    Alexithymia in schizophrenia

    Journal of Clinical and Experimental Neuropsychology

    (2010)
  • Cited by (9)

    • Measurement of negative and depressive symptoms: Discriminatory relevance of affect and expression

      2019, European Psychiatry
      Citation Excerpt :

      There is evidence for deficits in self-assessment, with mainly positive symptoms and cognitive symptoms negatively affecting the ability to self-assess correctly [30–32]. However, Hartmann, Fritzsche [22] assessed patients with psychosis for depression with two observer ratings (CDSS and PANSS) and two self-rating scales (BDI and Symptom-Checklist Revised (SCL-90-R) and found self-ratings to correspond well with observer ratings. Since the CAINS “expression” subscale seems to play the decisive role, the MAP-SR’s failure to differentiate the psychiatric samples could be because it doesn’t measure expression.

    • Concordance of self- and observer-rated motivation and pleasure in patients with negative symptoms and healthy controls

      2017, Psychiatry Research
      Citation Excerpt :

      To compute the concordance of self- and observer-ratings for negative symptoms, we defined optimal concordance by the regression equation (y=1x+0), which means that each point on the z-distribution of the self-rated scale (MAP-SR) corresponded to the same point in the z-distribution of the observer-rated scale (CAINS experience scale). To allow for a certain amount of discrepancy due to differences in scales and scoring, we followed previous research on concordance (Hartmann et al., 2013; Lincoln et al., 2010) and defined an area of acceptable concordance within the range of y=1xMAP-SR+/−0.5, which means that each point on the z-distribution of the MAP-SR corresponded to a point within the range of +/−0.5 in the z-distribution of the CAINS experience scale. To identify predictors of high or low concordance between observer- and self-rating scales, individuals of both the healthy and the patient sample were divided into three groups (relatively lower, equal or higher self-ratings in relation to the observer-ratings).

    • Motivation and Pleasure Scale-Self-Report (MAP-SR): Validation of the German version of a self-report measure for screening negative symptoms in schizophrenia

      2016, Comprehensive Psychiatry
      Citation Excerpt :

      Another explanation is that the BDI-II, which was used in our study, has more content overlap with negative symptoms (e.g., loss of interest in other people) than the Calgary Depression Scale for Schizophrenia (CDSS) [37] which was used by Llerena et al. [22] and Park et al. [23]. However, this explanation seems less likely because Hartmann et al. [38] did not find a significant correlation between the BDI-II and negative symptoms (as rated with the PANSS) in a sample of patients with psychosis. Thus, discriminating negative symptoms from depression in schizophrenia seems to remain a challenge.

    • An Investigation of Module-Specific Effects of Metacognitive Training for Psychosis

      2018, Zeitschrift fur Psychologie / Journal of Psychology
    View all citing articles on Scopus
    View full text