Norm values and psychometric properties of the brief symptom inventory-18 regarding individuals between the ages of 60 and 95

Internationally, the Symptom Check List with 90 items (SCL-90) [1, 2] and its revised version (SCL-90-R) [3] are the most applied questionnaires for the assessment of psychological distress, especially in clinical practice [1]. Nevertheless, they are very long and time-consuming rating scales. As short versions of the Symptom-Checklist 90 [2], two Brief Symptom Inventory versions were developed [4, 5]. Since the SCL-90 and the SCL-90-R were implemented mainly in clinical settings for the evaluation of clinical effects with repeated implementations before and after treatment, a short version was necessary to prevent a stress overload of the patients and false ratings.

A short form of the Brief Symptom Inventory (BSI) with 53 items was developed by Derogatis and Melisaratos [6] using a factor analysis and maintaining the scale structure with a reduced item number of the SCL-90 (somatization, obsessive-compulsive, interpersonal sensitivity, depression, anxiety, anger-hostility, phobic anxiety paranoid ideation, and psychoticism). In Germany, the BSI is predominantly used for quality management in psychotherapy (e.g. [7]) or other health interventions such as transplantations, chemotherapy, etc. [8‐11].

In order to reduce and prevent a stress overload of the patients, and to ensure an easy screening-tool, the BSI-18 [12‐14], which measures psychological distress, was developed with highest clinical relevance. The BSI-18 contains only the three six-item scales somatization (SOMA), anxiety (ANX), and depression (DEPR) as well as the global scale General Symptom Index (GSI). Several studies demonstrated that the BSI-18 is a suitable instrument for measuring psychological distress and comorbidities in patients with different mental and somatic illnesses, e.g., organ transplantations [8, 9], cancer [10, 11], and psychotherapy [15, 16]. The instrument was also used in longitudinal studies (e.g. [17, 18]).

The international psychometric properties of the BSI-18 have been discussed in more than ten publications. However, most of the studies examined a broad age range and did not solely focus on the elderly [10‐13, 15, 16, 18‐22]. Only Petkus et al. [23] (2010 - M = 74.4 ± 8.3 years) focused on their subjects’ age by investigating homebound elderly people, however, without examining the psychometric properties and norm values of this specific age group.

In individuals from 18 to 60 years of age the reliability (Cronbach’s α) ranged between the different scales α_min = .61 [22] and α_max = .94 [24]. Since the reliability in most of the scales ranged above .80, the reliability can be evaluated as good. The reliability for the American norm sample (N = 1134; α-SOMA = .74, α-DEPR = .84, α-ANX = .79, α -GSI = .89; [13]) must be rated as satisfactory. The retest-reliability in psychologically distressed patients after 15 days without intervention (n = 102) was satisfactory with values between r_tt = .68 and r_tt = .82 [17].

For factor validity, a strong first factor was discussed (e.g.[25]) – similar to the SCL-90, SCL-90-R, and the BSI-53 [24]. The original three-scale structure was replicated in hospitalized psychosomatic patients (n = 638; [15]), and the original scale structure was tested as well by a confirmatory factor analysis (CFA) [8, 26]. The convergent validity of test scores could be shown by several studies [17, 21, 27] likewise sensitivity and specificity [11]. The one existing investigation focusing on elderly people [23] examined only a small sample and ought to be consolidated by further studies.

Considering that populations are growing older and the specific psychological disorders this entails [28], a valid assessment of psychological distress and depressive symptoms is crucial. In the German representative population ranging in age from 50 to 92, between 10 and 16% were classified as depressed ([28] - M = 64.4 ± 9.2 years). In order to specify clinically relevant depression, the BSI-18 and the structured clinical interview for Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV) (SCID; [29]) were implemented in a small sample of homebound elderly individuals (n = 142; [23]). The factor analysis confirmed the three-scale system (depression, anxiety, and somatization) of the BSI-18 (S-B χ² = 136.17; p = 0.36). Specifically, the depression and anxiety subscales showed high internal consistency (α = 0.69). Furthermore, the DSM-IV based diagnoses could be predicted in receiver operator curve (ROC) analyses by the BSI depression and anxiety scale (Depression AUC¼ 0.89 (area under the curve), p < .001; Anxiety AUC¼ 0.80, p < .001).

Besides age, an affiliation with a lower social class plays a crucial role in the prevalence of psychological distress [30]. The age-specific social inequalities and the physical as well as mental health status were examined by using a two-factor analysis of covariance (N = 2222; [31]). Next to the decrease in the physiological and mental health status at a higher age, significant differences between the social classes determined a higher occurrence of health problems in the lower social classes [30].

A meta-analysis [32] based on 300 empirical studies evaluated subjective well-being (SWB) in respect to gender. Although other instruments than the BSI-18 (e.g. the Life-Satisfaction Index or Rosenberg’s Self-Esteem Scale) were used – elderly women showed significantly lower subjective well-being than elderly men [30].

Even though the BSI-18 is internationally one of the most implemented instruments for the assessment of psychological distress, norm values and psychometric properties of a representative sample at older age respective gender and social class have not yet been published. Based on Petkus et al. [23], we are proposing good item and scale characteristics along with a factor structure for the BSI-18 (H1). Since clear specificities for gender are described [30], a measurement invariance across age and gender groups must be present (H2). A further aim of this study was to test the relationship between sociodemographic variables (specifically people ranging between 60 and 95 in age) and psychological distress (H3). Based on Schmidt et al. [31], we expected that older respondents and also those with a lower socio-economic status would report more distress (H3).

Item- and scale characteristics and exploratory factor structure (H1).

The item- and scale statistics, the reliability of test scores, and the results of the exploratory three-factorial factor analysis are shown in Table 2. Herein, the mean values and standard deviations of the three scales are listed in the third column. Item no. 16: “Feeling weak in parts of your body” reached the maximum with 0.57 ± 0.82 whereas item no. 1: “Faintness or dizziness” represented the minimum with 0.31 ± 0.62 (scale 1 “Somatization” in total: ∑ 2.36 ± 3.07 and a ω -value of .826). The maximum mean value of the second scale (“Depression”) was measured by item no. 5: “Feeling lonely” (0.55 ± 0.92) whereas the minimum was in item no. 17: “Thoughts of ending your life” (0.08 ± 0.34). This scale reached a ω-value of .890 and a total sum of ∑2.04 ± 3.34.

The third scale (“Anxiety”) reached the maximum mean value in item no. 6: “Feeling tense or keyed up” (0.45 ± 0.74) and its minimum in item no. 12: “Spells of terror or panic” (0.13 ± 0.43). The total mean value sum and its standard deviation for the third scale is ∑1.55 ± 2.72, the ω-value .857. The Global Severity Index reached a sum mean value of ∑5.96 ± 8.08 and an ω of .929.

Looking at the exploratory factor analysis, it is noteworthy that all the items of the Somatization scale are allocated to f2 while the Depression scale is assigned to f1. Only the item “Thoughts of ending your life” is allocated to f3. In the anxiety scale the items “Nervousness or shakiness inside” (f2) and “Feeling tense or keyed up” (f1) were differently assigned than the rest of the scale (f3).

All the items of all three subscales evidenced good item-total correlations in excess of .50 – with the exception of item 17, which still had an acceptable value. In no case did the deletion of an item lead to a higher reliability coefficient than what was found for the full subscale (Table 2).

We assessed the Brief Symptom Inventory-18 as a measure regarding psychological distress for elderly individuals. This is the first study investigating a representative sample at an age range of 60 to 95. Two earlier studies with samples at a younger age range examined the psychometric properties and benefits of the instrument [8, 16]. However, the psychometric properties, norm values, and factorial structure of individuals between the ages of 60 and 95 have never been reported so far.

The present study aims to address this lacuna by examining a sample of older individuals. First based on Petkus et al. [23], we proposed good item and scale characteristics, along with factor structure for the BSI-18 (H1). The item and scale properties of the BSI-18 were found to be satisfactory, as was the reliability of test scores as assessed by McDonalds’s ω. We tested several potential models and found that a three-factor-model would suit the data best. Therefore for best fit, the model of three factors loading on a general GSI factor was chosen.

Since clear specificities for gender are described [30], measurement invariance across age and gender groups must be present (H2). The present results confirm strict measurement invariance for this model across gender and age, allowing for comparisons between the groups. When considering the CFI, the configural model evinced unacceptable fit for some groups. The GH index, on the other hand, presented evidence for acceptable, even good fit, in all groups. The results can, thus, not be considered entirely unambiguous, and researchers should keep this in mind, when comparing the BSI-18 between groups.

Based on Schmidt et al. [31], we expected that older respondents and those with a lower socio-economic status would report more distress (H3). In the present cross-sectional study, the individuals from 65 to 69 years of age showed significantly higher values for somatization, depression, and the General Symptom Index compared to individuals aged 60–64. Subsequently, the individuals of 70–74 years of age also showed significant higher values for somatization, depression, and the General Symptom Index compared to individuals at 60–64 years of age. This fits to the well-described link between psychological distress and physical symptoms or somatoform disorders [43‐48]. The age group of 75–79 years of age reported the highest values for depression. In this age group, social contacts are diminishing, and concerns about needing care in old age may be an influencing factor. Although the highest values of somatization and the General Symptom Index were reported at the age of 80, and older, for this age range, the depression values are lower compared to individuals 75–79 years of age (Table 3). Possibly, people of this age have resigned themselves to life and common daily problems so that there is less psychological distress. In contrast, anxiety symptoms did not differ significantly between the age groups.

Considering the results of the gender-related BSI-18 differences (Table 3), women consistently have higher values, with a statistical significant variation in the Depression-scale (p < 0.03). This confirms the results by Pinquart and Sörensen [32] who analyzed significantly lower subjective well-being and a less positive self-concept in women than in men. A possible reason may be the loss of a male life partner: in our subjects, the percentage of widowed women was more than double that of the male group (47% widows and 17% widowers). Glaesmer and colleagues [28] (M = 64.4 ± 9.2 years, age range: 50–92) found a link between psychological distress and elderly people living by themselves. Even in the present sample, more women than men lived alone (57% women to 26% men). Although a partnership may have a potentially protective effect on psychological distress [28], the effect size measured in this context, however, is regarded as low.

In respect to social class, the higher the social class, the fewer symptoms are present in all four scales. These are in line with the results by Schmidt and colleagues [31]. There may be more health and financial problems connected to the lower social class associated with elevated psychological distress [30, 49].

Even though it is a representative German sample, it has the limit that neither a physician nor an fMRI evaluated possible cognitive impairment or mild dementia.

The item and scale properties as well as the reliability of the test scores of the BSI-18 were found to be satisfactory. The three-factor-model fits the data the best. The measurement invariance for this model across gender and age was confirmed, allowing comparisons between these groups. Individuals older than 60 years of age, women, and individuals from a lower social class showed significantly increasing values for somatization, depression, and the General Symptom Index.

Thus, the findings underline the need for preventive mechanisms for elderly people such as (re)activating their social networks or strengthening their physical and psychological well-being, for example, by involving them in physical group activities [50, 51].