Background
Common mental disorders refer to two main diagnostic categories: depressive disorders and anxiety disorders. These disorders impact on the mood or feelings of affected persons; symptoms range in terms of their severity (from mild to severe) and duration (from months to years). These disorders are diagnosable health conditions, and are distinct from feelings of sadness, stress or fear that anyone can experience from time to time in their lives. Anxiety disorders involve generalized mood condition involving feelings of uneasiness, being fearful or feeling nervous whereas depressive disorders have emotions that involve feeling low, sad, fed up or miserable [
1,
2].
Untreated mental disorders result in poor outcomes for co-morbid physical illness commonly seen in the primary health care settings. Moreover, patients with mental disorders have a heightened risk of suffering from physical illness because of diminished immune function, poor health behavior, non-compliance with prescribed medical regimens and barriers to obtaining treatment for physical disorders.
The fundamental mental health facts report has underscored the seriousness and increasing prevalence of mental health problems, highlighting that, every week, one in six adults experience symptoms of a mental health problem [
3]. Moreover, a recent index of 301 diseases found mental health problems to account for 21.2% of years lived with disability worldwide, indicating mental health diseases are becoming important contributors to the global burden of disease [
4]. The consequences of mental disorders in terms of lost health are significant. Depression is ranked by WHO as the single largest contributor to global disability (7.5% of all years lived with disability in 2015) while anxiety disorders are ranked 6th (3.4%) [
5].
Mental illness is considered a silent epidemic throughout most parts of Africa. Because of structural and systemic barriers such as inadequate health care infrastructure, insufficient number of mental health specialists, and lack of access to all levels of care, mental illness has been characterized as a neglected and increasingly burdensome problem affecting all segments of the population throughout Africa. Prioritizing mental health has also been difficult due to lack of resources, limited funding coupled with absent or ineffective mental health policies [
6].
A recent national mental health survey conducted in Eritrea reports a common mental disorder prevalence rate of 14.5% in the general population [
7]. The 2015 global burden of disease study reports 219, 549 cases of depressive disorders (4.3% of the total population) and 156, 599 cases of anxiety disorders (3.1%) in the country [
8]. The consequences of these disorders in terms of lost health are also considerable. The 2015 global health estimate for Eritrea attributes 40, 426 total years lived with disability for depressive disorders (8.2% of years lived with disability) and 14, 474 total years lived with disability for anxiety disorders (2.9%) [
9].
In Eritrea, inequitable distribution of psychotropic drugs, highly centralized mental health care services to urban centers and lack of trained psychiatric personnel at primary health care units are some of the challenges the mental health program is facing [
10]. According to the study of assessment of mental health system in Eritrea, similar drawbacks as in the majority of developing countries are prevalent. These include absence of revision of the mental health policy, very low financial expenditure on mental health and lack of access to mental health facilities for in the country there is only one mental health hospital with its only outpatient unit and the only community residential facility; all concentrated in the capital city, Asmara [
11]. It is estimated that the treatment gap (defined as the number of people not receiving treatment despite their need), for Eritrea is nearly 97%. Moreover, there is an acute shortage of skilled mental health professionals and mental health services in large parts of the country [
12]. There is also inadequate budget for primary mental health services as most of the budget is used by the only tertiary level psychiatric hospital (St. Mary Psychiatric Hospital).The recent national mental health survey posits that the St. Mary Psychiatric Hospital does not have the capacity to care for all the mentally ill in Eritrea and recommends establishment of mental health care wings, prioritizing the zonal referral hospitals for initial action. The study also underscored the care of the mental ill should be integrated as part of comprehensive primary health care service and be considered with the routine health service delivery activities [
7].
The problems of low financial expenditure and inequity in distribution of mental health facility can be minimized by introducing psychosocial interventions especially screening program for mental disorder in the primary health care settings which are accessible and affordable to the general population. Considering the understaffed and undertrained personnel in primary health care settings of the country, the SRQ would play an important role in improving community’s mental health. The WHO SRQ-20 is not functional and has never been used in Eritrea. The culturally sensitive nature of the questionnaire and the language difference of settings necessitate adaption of the instrument locally. The SRQ is expected to help because it is a simple instrument, poverty friendly, timely and does not need a professional to administer; which is feasible in our country.
There are many psychiatric screening instruments developed by the World health Organization (WHO). Nevertheless, these instruments are time-consuming and require trained personnel for administration either through interview or through self-administered questionnaire, being infeasible for use in the primary health care, which, often, are the target settings for screening and early detection of CMDs. This gives rise to the need of the self-reporting questionnaire (SRQ-20), a 20-item mental disorder screening instrument developed by WHO to be applied in patients attending primary health care settings [
13]. Trudy Harpham et al. reviewed the performance and use of this questionnaire and concluded that the SRQ-20 as a cost-effective instrument to measure mental health at community level with high face and criterion validity, ease of use and suitability to administer it by a lay health worker [
14]. Several comparative and validation Studies also found the SRQ-20 to be preferred from many other screening questionnaires [
15‐
18].
The SRQ-20 is an instrument with twenty simple to understand items which question respondents about symptoms and problems likely to be present in those with neurotic disorder. It includes binary (yes/no) questions only, with codes “1” which represents the presence of a symptom, and “0” if the symptom is absent. The SRQ-20 item questions reflect depression, anxiety and psychosomatic complaints, which are all together, grouped under the common mental disorder (CMD) and have been found to detect probable cases of it with satisfactory accuracy [
19]. However, the validity, reliability and cut-off of the SRQ-20 vary in different settings across variety of populations (with different culture, language, setting and gender) [
15‐
19]. For this reason, adapting the SRQ-20 in one’s community setting or population primarily requires validating the screening instrument in one’s own setting. Many developing countries have validated and have been using the SRQ-20 in many community-based screening programs. In Eritrea, the SRQ is not functional to use as screening instrument in PHC, for its validity is not yet assessed.
Therefore, this study aimed to assess the validity of the WHO self-reporting questionnaire 20 (SRQ-20) item in Tigrigna version in Eritrean setting. Specifically, this study evaluated the psychometric properties, optimal gender specific cut-off points for detecting CMDs using SRQ as a screening tool and assessed the SRQ-20 items’ capacity to screen for mental disorder relative to the gold standard (BPRS).
Methods
Study design
This study was carried out using a cross-sectional study design.
Study settings and population
This study was conducted from September to December 2017 in two urban health facilities selected using purposive sampling. The selected health facilities were Semienawi Asmara Health Centre (SAHC) and Godaif Community Hospital (GCH). The health facilities were selected purposively because they serve large number of population and are relatively representative of PHCs in Asmara in terms their location and socio economic diversity. Both health facilities provide primary health care services to their local population and refer to higher health services for specialized care and services.
Sample size and sampling method
Sample size determination was done on the basis of an estimated common mental disorder prevalence of 50%, as there was no local study done before. At a 95% confidence interval, a total sample of 266 participants were selected using the Daniel and Macfarlane single proportion formula for finite population, n = Z2 × P × Q/E2. The study respondents were recruited using a simple random sampling. Eligible participants included both male and female who were in the age range of 18–65 years and who were attending the selected health facilities at the time of data collection. Individuals were excluded from the study if they were medically unstable, if they required referral to a higher level of care, or were not willing to participate in the study.
Data collection instruments
In addition to the demographic characteristics of the respondents such as age, gender, ethnicity, educational level and marital status, the measures utilized in our study include the WHO self-reporting questionnaire and Brief Psychiatric Rating Scale.
The self-reporting questionnaire
The self-reporting questionnaire is based on the original 20 yes/no questions translated to Tigrinya which consists of 20 items indicative of non-psychotic mental disorders. The questions are related to certain pains and problems that may have bothered the participant in the last 30 days. If the participant thinks the question applies to him/her, then will answer as yes and the other ways it will be no. The translation of these questions included language experts. It was translated in the standard back and forth translation format.
The Brief Psychiatric Rating Scale
The Brief Psychiatric Rating Scale is a 24-item questionnaire that provides a clinical assessment of the interviewee’s psychiatric status and leads to a psychiatric diagnosis. Although yet to be validated, the BPRS item is frequently used in primary health care settings of Eritrea. However, the instrument has been used in a number of countries with similar context to Eritrea and its factor structure remains to be similar across studies [
20]. BPRS requires well-trained professionals to administer it; consequently it is not feasible to use it as a large scale screening instrument limiting its utility [
21]. In our study, we used the instrument as the gold standard for detecting common mental disorders in primary health care settings in Eritrea.
Instrument translation
The WHO SRQ-20 was not functional and has never been used in Eritrea in Tigrigna version. The culturally sensitive nature of the questionnaire and the language difference of settings necessitate adaption of the instrument locally. Prior application of the SRQ-20, cross-cultural adaption (which includes translation into local language) and determination of optimal cut-off scores should be performed [
14]. For this study, first all the twenty items of the WHO SRQ-20 were translated to Tigrigna, a widely spoken local language in Eritrea by a psychiatrist and language experts. For the purpose of conceptual meaning adjustment, the instrument was blindly back translated by other language experts and psychiatrists who were not familiar with the purpose of the study. Any inconsistency in language meaning and translation differences were resolved through a focus-group discussion.
Study procedure
Prior to the interview, each participant was informed about the confidentiality of the data collection process. They were assured that participation was voluntary, and could withdraw from the interview at any time. After fully describing the study objectives in a private room, consented respondents were separately interviewed from other patients for health related questions. The interview was conducted during day time to the patients in the waiting room for outpatient treatment. During the interview, the data collector explained that they will be asked health related questions but not exactly about mental health in order to reduce misleading answers. If the participant was required by the medical personnel in the OPD then the interviewer would temporarily suspend the interview and continue after the patient completed OPD visit.
Data analysis
All data were analysed using SPSS (Statistical Package for Social Sciences) version 20.
Reliability
Reliability (internal consistency) of the SRQ-20 questionnaire was calculated using a reliability coefficient (Cronbach’s alpha).
Face validity
Face validity of the Tigrigna version of SRQ-20 in the pilot study through asking the respondents to guess the aim of the questionnaire at the end of each interview.
Content and semantic validity
In this study, content validity was done through mental health professionals, psychiatric nursing experts and language experts to judge the content and semantic validity of the instrument after its translation to the local language, Tigrigna.
Construct validity
To assess factorial validity, we used principal component analysis technique with varimax rotation to investigate whether SRQ-20 items measure properly the underlying dimensions of mental illness. The Kaiser–Guttman criterion was employed to extract factors with Eigen values above one [
22,
23]. The scree plots were examined to identify the optimal number of factors for extraction. The Kaiser–Meyers–Olkin (KMO) test was calculated to determine the sampling adequacy for the procedure. Bartlett’s test of sphericity was calculated to confirm if it was significant to perform a PCA.
Criterion validity
The relationship between the testing instrument, the SRQ and the criterion (the BPRS) was assessed using Pearson’s correlation coefficient. Moreover, sensitivity, specificity and the predicative values of the screening instrument were used to assess how well the results of SRQ-20 correspond with the criterion instrument (BPRS).
The optimum cut-off scores were chosen with maximum sensitivity and reasonable specificity at various cut off points. The Receiver Operating Characteristics (ROC) analysis was performed to evaluate the screening properties of the SRQ-20, using BPRS as the gold standard. The Area under Curve (AUC) statistic was calculated as a measure of accuracy of the SRQ-20.
Discussion
This study aimed to validate the SRQ-20 item in Eritrean primary health care settings. In the overall sample, male to female ratio was almost proportional. Most of the respondents were in the age range of 18–25 years, married, Tigrigna ethnicity and middle-schooled. As can be inferred from the findings, the SRQ-20 item was found to have a substantial capacity for screening of common mental disorders in Eritrean primary health care settings. The cut-off scores for the SRQ-20 differed by gender.
In the present study, the prevalence of CMDs in the overall sample was found to be 23%. Many epidemiological studies conducted in primary health settings identify mental disorder using screening instruments or clinical diagnosis [
24]. Since the SRQ20 cannot be a substitute for, or equivalent to, a clinical diagnosis [
14], we used the BPRS results to measure the prevalence rate of CMDs in our country. As per cross-sectional studies conducted by WHO at 14 sites found out, about 24% of all patients in PHC settings had a mental disorder [
24]. The prevalence of CMDs in this study as measured by the gold standard, was higher (23%) than the previous prevalence of mental health disorders in the country, 14.5% in 2014 [
25]. The higher prevalence rate attained from the current study with respect to former national prevalence rate, may be associated with a steady increment in the prevalence rate of mental disorders globally especially for the low-income countries as justified by sustained population growth and poverty as strong risk factors [
26]. As this study was conducted in PHC settings, where respondents came chiefly to address their underlying health problems, over-reported symptoms of CMDs may had pathologic origin related to it and hence might have contributed to high rate of prevalence. The result from this study appeared to be lower when compared to prevalence of two towns in Ethiopia, 33.6% in Jimma and 32.4% in Kombolcha [
27,
28]. According to the WHO reports from 14 countries worldwide, the prevalence of CMD in PHC settings is 24% [
24], which is almost similar to the finding in this study. In 2013, a study done in Malawi also reported that CMD prevalence in PHC was 20.1% [
29].
Majority of the CMD cases in our study were females when compared to their male counterparts. This is similar to findings from other studies done in Ethiopia and Malawi [
27‐
29]. The reason for this could be as a result of gender disadvantages like social burden and maternity issues. There is also tendency of over-reporting mental problems by females.
In our study, we found good internal consistency of α = 0.78, almost similar with findings in China (α = 0.79) [
30], but slightly lower than that of South Africa (α = 0.84) [
17].
Similar with other studies, the findings from the present study indicates that the SRQ-20 item is a useful tool in Eritrean primary health care settings. In this study, the area under the ROC curve statistic was 0.87. This result is consistent with findings from other countries’ primary health care settings where the area under the ROC curve ranged from 0.76 in Rwanda to 0.92 in Uganda [
31,
32]. In this study, the AUC for women and men were 0.871 and 0.879 respectively. This indicates that the SRQ-20 was just as effective in distinguishing between cases and non-cases in both groups. This screening tool has never been validated in our country’s primary health care settings. But now since the results confirm the performance of the instrument in detecting CMDs, the SRQ-20 can be a suitable tool for measuring CMD in PHC settings of Eritrea.
In this study, the balanced sensitivity and specificity was achieved at the higher cut-off score of 5/6 for women, as compared to the 4/5 cut-off score for men. For overall sample, an optimal local cut-off, 5/6 was found to balance the trade-off between sensitivity and specificity at 78.6% and 81.5% respectively. This is almost similar with a study conducted in the UAE were a cut-off score of 5/6 produced a balanced combination of sensitivity and specificity of 78.3% and 75.2%, respectively [
33]. Studies conducted in other countries like Rwanda and South Africa also reported gender differences in SRQ scores with higher cut-off scores for women than men [
29,
34]. However, there are few studies conducted in other countries like Zambia and the United Kingdom that have found no differences in the optimal cut-off scores for both sexes [
35,
36].
Although the study has come up with important findings, due to some limitations, the findings should be interpreted with caution. As the translated version of SRQ-20 is in Tigrigna, other language speakers from different ethnic groups may not be beneficiaries of the instrument and limited diversity in the ethnicity of the participants may not represent and generalize the result of the current study to all Eritrean communities.
The findings of the study have good implication for addressing the issue of screening for common mental disorders in primary health care settings. Here, the SRQ-20 item has been found to be suitable in primary a health care setting which is simple, easy to administer and with a yes/no questionnaire which is convenient for the interviewer and the respondents. Due to resource-poor conditions with ineffective means of detecting CMDs in Eritrea, the Tigrigna-version SRQ-20 item is expected to contribute in reducing the prevalence and burden of CMDs through its simplicity, acceptability and feasibility.
Authors’ contributions
TBN and MMK wrote the article. TBN, MMK, RBT, SGH, YKW, OZT participated in study design, data collection and analysis. All authors read and approved the final manuscript.