Background
The prevalence of diabetes mellitus is increasing worldwide. It is estimated that 8.2% of adults aged 20 to 79 years have diabetes, for a total of 387 million people globally [
1]. This number is predicted to rise to more than 592 million in 2035 [
2]. Diabetes and its complications are a principal cause of morbidity (e.g. cardiovascular disease, renal disease, retinopathy, and neuropathy) and premature death [
3]. Promoting self-care can improve this dismal picture in those with type 1 (T1DM) or type 2 (T2DM) diabetes [
4,
5].
Self-care of diabetes includes eating in a healthy manner, being physically active, monitoring blood glucose, taking medications, solving problems as they occur, reducing risks, and coping in a healthy fashion [
6]. Blood pressure monitoring, weight monitoring, and activities intended to manage the symptoms of hyper- and hypoglycaemia are also needed [
4,
6]. Adequate self-care improves metabolic control [
7] and quality of life [
8], and reduces cardiovascular risk [
9], hospitalizations [
10] and disease related complications [
11].
The availability of valid and reliable tools to assess diabetes self-care is fundamental to identifying patients at risk of poor outcomes [
5]. At least 16 tools assessing diabetes self-care or self-care related constructs are available [
12]. Ten are unidimensional, focusing exclusively on diet, physical activity, blood glucose monitoring, oral care or insulin management [
13]. Another six multidimensional tools are available to measure diabetes self-care [
14‐
19]. The two most commonly used with adults are the Summary of Diabetes Self-Care Activities (SDSCA) and the Self-Care Inventory Revised (SCI-R) [
15,
16]. Both instruments were developed before 2005 and have not been updated with recent clinical information [
12,
13]. Only 2 of the 6 instruments used an explicit theoretical framework and they are not intended to measure diabetes self-care behaviours (diabetes-related distress and diabetes self-efficacy) [
20,
21]. Although all 6 instruments used exploratory factor analysis, internal consistency reliability did not account for dimensionality of the tools [
12]. Criterion validity was mostly estimated using scores from other scales rather than clinical indicators [
12,
13]. These limitations have been noted in recent systematic reviews noting that none of the instruments available to measure diabetes self-care have evidence of a strong validation process or a theoretical grounding [
12,
13]. This picture illustrates the need for a theoretically grounded, psychometrically-sound instrument measuring diabetes self-care.
The purpose of this study was to develop and test the psychometric properties of a new instrument based on the middle range-theory of self-care of chronic illness [
22]: the
Self-Care of Diabetes Inventory (SCODI). According to that theory, self-care is defined as a process of maintaining health through health promoting practices and managing illness. Self-care is performed in both healthy and ill states. The key concepts addressed in the theory include self-care maintenance, self-care monitoring, and self-care management. Confidence in the ability to perform self-care is important in each stage of the self-care process [
22‐
24]. Consistent with methodological recommendations, specific objectives of this study were to evaluate SCODI: 1) content validity; 2) dimensionality and internal coherence; and 3) construct validity [
25].
Methods
First, SCODI items were developed using the theoretical framework. Then, content validity of items was evaluated by a multidisciplinary panel of experts. Next, a multicentre cross-sectional study was conducted to test the psychometric properties of the SCODI. The Institutional Review Boards of ASST Grande Ospedale Metropolitano Niguarda and Policlinico di Monza approved the study. General, Health and Nursing Directors of the two centres authorized patient recruitment and data collection. All participants provided written informed consent. Participants were asked to think about their self-care during the prior month. Details about both development and testing are described below.
Theoretical framework
Self-care maintenance reflects those behaviours used to preserve health, maintain physical and emotional stability, or improve well-being. Self-care maintenance includes illness-related behaviours, such as adherence to follow-up visits and examinations, and health promoting behaviours, such as eating a healthy diet or engaging in physical activity. Healthy behaviours performed to avoid disease and complications are included in self-care maintenance as well [
22].
Self-care monitoring is a process of routine, vigilant body monitoring, surveillance, or “body listening” [
22]. Self-care monitoring includes symptom recognition and interpretation. The goal of self-care monitoring is recognition that a change has occurred (e.g. symptoms) and the correct interpretation about when to take action. Patients who are skilled in self-care monitoring know when to communicate with a healthcare professional to obtain timely and appropriate care. Self-care monitoring is the link between self-care maintenance and self-care management [
22].
Self-care management is a process of responding with appropriate behaviours to health changes and problems to avoid an exacerbation. Self-care management entails treatment implementation and evaluation of treatment. Based on the required skills, the response can be simple or complex. Self-care management behaviours may be implemented directly by the patient (autonomous) or in consultation with a health care provider (consultative) [
22].
Self-care confidence is not an element of self-care but a factor that strongly influences self-care maintenance, self-care monitoring, and self-care management [
22]. Self-care confidence reflects the degree of confidence that a patient has about his or her ability to perform a specific self-care-related task. As such, self-care confidence reflects self-efficacy or the ability to perform a specific action and persist in performing that action or behaviour, despite barriers or challenges [
22].
Scale development and content validity
A literature review was performed to identify best practice recommendations about self-care behaviours of T1DM and T2DM diabetes patients. Recent international clinical guidelines were reviewed [
4,
5] and the main evidence-based recommendations were used to develop the 40 SCODI items. According to the theoretical framework, SCODI items were grouped to reflect self-care maintenance (12 items), self-care monitoring (8 items), self-care management (9 items) and self-care confidence (11 items). A multidisciplinary panel of experts (
n = 15) with diabetologists (
n = 5), diabetes nurses (
n = 6), a psychologist (
n = 1) and academic researchers (
n = 3) evaluated content validity.
Content validity is the extent to which the domain of interest is comprehensively sampled by items in the questionnaire [
25]. The content of a questionnaire is valid when a clear description is provided for the measurement aim, the target population and the concepts being measured, and when experts were involved in item selection [
25]. For content validity of the SCODI, the theoretical framework was used to clarify the measurement aim and concepts. Experts evaluated the relevance of each SCODI item using a 4-point Likert scale. Content validity index was calculated for each item as the proportion of experts who rated it as relevant or very relevant (3 or 4). Content validity for the 4 scales was calculated as the proportion of items rated as relevant or very relevant (3 or 4) within the total items of each separate scale. Minor changes and revisions suggested by the panel of experts were incorporated. Content validity index of the final version of each item and each scale was 100%. The full final SCODI English Version is available as Additional file
1
.
Sample and setting
A consecutive sample of adults with diabetes was recruited from diabetes outpatient services of ASST Grande Ospedale Metropolitano Niguarda and Policlinico di Monza in two provinces of northern Italy. Inclusion criteria were: confirmed diagnosis of T1DM or T2DM diabetes diagnosed according to guideline criteria [
4]; age ≥ 18 years. Exclusion criteria were: screening or first visit to the diabetes centre; time from the diagnosis of diabetes < 1 year; illiteracy; documented cognitive impairment. A sample of 7 patients per item was needed to allow adequate inference in exploratory or confirmative factor analysis [
25]. As noted above, the SCODI was not intended to provide an overall measure of self-care; it was designed as an inventory with 4 separate scales measuring 4 different constructs. Self-care maintenance was the longest scale with 12 items. Thus, a sample of 84 patients would have been adequate to address the main study objective (dimensionality and internal consistency); however, we enrolled 200 participants to support a more stable analysis [
25,
26].
Data collection
Participants completed the
Self-Care of Diabetes Inventory by self-report during an outpatient visit. Socio-demographic data including age, gender, education, marital status, family income, employment status and caregiver support were collected using a survey developed by the researchers. Clinical data such as medications taken, body mass index (BMI), glycated haemoglobin (HbA1c), presence of diabetes micro-vascular complications (diabetic foot, diabetic kidney disease, diabetic retinopathy, diabetic neuropathy), and presence of co-morbidities, were collected from the medical record by nurse research assistants. Complications were judged by established criteria [
4]. To assure the quality of data, data collectors were trained carefully and random data monitoring was performed to verify collected data. Data monitoring involved comparing case report forms used for the study with the patients’ original medical records.
Data analysis
Sociodemographic and clinical characteristics were described using means, frequencies and percentages. As dimensionality testing must precede reliability testing [
27], we began the analysis with factor analysis and then assessed reliability. Factor analyses were conducted using Mplus 7.4 [
28] within the Exploratory Structural Equation Modeling approach (ESEM) [
29‐
31]. Compared to confirmatory factor analysis (CFA), ESEM does not require that all or most cross-loadings in the factorial pattern be fixed at zero. This requirement is often too stringent, causing loss of fit and extensive re-specifications with modification indices. Like exploratory factor analysis (EFA), ESEM does not require that the factor pattern be specified in advance, since all indicators depend on all factors [
31]. However, as opposed to EFA, ESEM provides all the usual SEM parameters (e.g. residual variances and co-variances) and factor loadings, standard errors, and tests of goodness of fit. Since the SCODI has never undergone factor analysis before and the number of participants in the analysis was limited, we examined dimensionality using the more exploratory approach of ESEM.
The SCODI uses a 5 point Likert type scale where higher scores indicate better self-care. Since the SCODI item response format uses only 5 ordered categories and the data are not normally distributed, we used a Weighted Least Square method, WLS-MV estimator [
28], which is recommended for ordinal or dichotomous variables [
32]. Using a multifaceted approach to assessment of model fit [
33], we considered the following goodness of fit indices. Comparative Fit Index (CFI) .90–.95 indicates acceptable fit, > .95 indicates good fit. Root Mean Square Error of Approximation (RMSEA) ≤ .05 indicates a well-fitting model, .05–.08 indicates moderate fit, ≥.10 indicates poor fit. RMSEA with 90% confidence intervals (≤ .05 to ≤.08) indicates good fit. The test of close-fit examines the probability that the approximation error is low (
p-values > .05 indicate good fit). Standardized Root Mean Square Residual (SRMR) ≤ .08 indicates good fit [
34]. Additionally, traditional chi-square statistics are reported. However, due to the sample size and the sensitivity of the chi-square likelihood ratio test to sample size, chi-square test results were not used in interpreting model fit.
Consistent with recent developments [
27], reliability was computed with the composite reliability or omega coefficient [
35]. Alpha assumes that the items reflect a unidimensional structure. Knowing that there are several dimensions represented in a scale, a more appropriate reliability coefficient that takes into account the multidimensionality of the scale is the
global reliability index for multidimensional scales [
36]. Although the dimensionality of a scale is complex, as noted by Bentler [
37] “every multidimensional coefficient implies a particular composite with maximal unidimensional reliability” (p. 343). Thus, the final reliability estimates derived with appropriate methods “can be interpreted to represent a unidimensional composite” [
37] (p. 341).
For aim 3 we estimated construct validity following Terwee’s recommendations [
25]. We tested these theoretical hypotheses: 1) if SCODI measures the concepts described in the theoretical framework, self-care confidence will be significantly associated with self-care maintenance, self-care monitoring, and self-care management; 2) if SCODI measures the self-care behaviors of diabetic patients, significant associations will exist between self-care maintenance, self-care monitoring, and self-care management scores and one or more clinical indicators theoretically influenced by patients’ self-care behaviors. A set of external clinical indicators was identified from the literature describing clinical outcomes associated with diabetes self-care [
4]: BMI, HbA1c, and microvascular diabetes complications (diabetic foot, diabetic kidney disease, diabetic retinopathy, diabetic neuropathy).
To test the first hypothesis, the Pearson correlation coefficient was estimated and three quantile regression models were run to explain the effect of self-care confidence, adjusting for type of diabetes, age, gender, education, family income, caregiver support and time from diagnosis of diabetes on self-care maintenance, self-care monitoring and self-care management.
To test the second hypothesis, linear (BMI and HbA1c) and logistic (presence of microvascular diabetes complications) regression models were run on self-care maintenance, self-care monitoring and self-care management scores, adjusting for gender, age at enrolment, type of diabetes, time from the diagnosis of diabetes (<10 and ≥10 years), and presence of comorbidities.
Discussion
The purpose of this study was to develop and to test the psychometric properties of a new instrument measuring the self-care of persons with diabetes mellitus. Using the middle range theory of chronic illness, we developed an instrument to measure self-care maintenance, monitoring, and management, and demonstrated content validity, reliability and construct validity. An additional scale measuring self-care confidence, a factor shown to predict successful self-care in other populations and to be important in predicting outcomes, is also available. Although this study was conducted in Italy, the sociodemographic and clinical profile of the enrolled patients aligns with the international literature [
38], suggesting that the SCODI may be useful in other contexts. Overall, the results of this study suggest that SCODI is a valid and reliable instrument that can be useful to others wishing to measure self-care in persons with diabetes.
The SCODI addresses the limitations of other available instruments. To our knowledge, this is the first theory-based instrument measuring self-care behaviors of diabetic patients—the most important limitation of previous tools [
12,
13]. Use of the most recent clinical recommendations in the development process and the high content validity index suggest that the SCODI is up-to-date clinically, addressing a second major problem of other tools [
12,
13]. Construct validity was estimated using strong clinical indicators, addressing another limitation—the failure to validate against clinical criteria. The results of this study provide support for the middle range theory of self-care of chronic illness [
22]. To our knowledge, this is the first time that the middle-range theory of chronic illness has been used in diabetes.
The factorial structure and the low inter-factor correlations of the self-care maintenance scale are not surprising because theoretically, self-care maintenance is known to be a complex and multifaceted dimension of self-care [
22,
23]. The self-care maintenance factors reflect the theoretical framework, as we found health promoting self-care maintenance behaviours, disease prevention self-care maintenance behaviors, and illness-related behaviors as described in the theory [
22]. Health promoting behaviors addressed: diet (item 3 and 4), foot care (item 8), oral hygiene (item 9) and adherence to prescribed medications (item 12). In essence, this factor includes adherence to all the main diabetes treatments.
In a diabetes population, it is not surprising that exercise behaviors (Factor 1, including being active and exercise) aggregated into a unique factor, even though these are “health promoting behaviors” as well. Previous studies show that physical activity in diabetes patients is particularly poor and dependent on complex psychological and social factors [
39,
40]. That is why we found two dimensions of self-care maintenance health promoting behaviors: one addressing physical activity and one addressing all the other recommended behaviors. Logically, it is easy to anticipate that patients may attend to diet and medicine-taking without engaging in physical activity, even if both are necessary elements of self-care. The factors that motivate exercise probably differ from those that motivate the other health promotion behaviors.
Disease prevention behaviors related to alcohol consumption, smoking habits, hand hygiene and vaccinations clustered as a separate factor in the self-care maintenance scale. This factor matches with both the theory and diabetes self-management education standards, where all these behaviors are described as fundamental to avoid complications, disease exacerbation, and severe co-morbidities [
5]. Items addressing adherence to follow-up visits and check-up examinations grouped into the illness-related self-care maintenance factor. These behaviors are needed only if requested by a healthcare provider [
4].
The factorial structure and the low inter-factor correlation of the self-care monitoring scale represented the two main areas of self-care monitoring: body listening and symptom recognition. This dimension had adequate but unsatisfying fit indices. The 2-factor solution represented the main elements of self-care monitoring as described theoretically [
22], so a 2-factor solution was chosen. The body listening factor included items about: glucose monitoring and record keeping, weight monitoring, blood pressure monitoring, and foot monitoring. The second factor included items asking about the attention paid to symptoms and the time needed to recognize them.
The self-care management scale split into autonomous and consultative behaviors that patients with diabetes need to do when responding to changes and problems [
22]. Behaviors such as checking blood sugar if a symptom is recognized (item 21), eating sugar when blood sugar is low (item 24), and re-checking blood sugar after a remedy is tried (item 27) represents the basic recommendations given to patients with diabetes [
5]. These items grouped together and were labeled autonomous self-care management behaviors. Other behaviors such as taking notes about the events that can alter blood glucose levels (item 22), asking for advice from formal or informal caregivers (item 23 and 28), modifying diet, exercise and/or insulin to adjust blood sugar levels represent complex, reflective and skilled activities of self-care management often performed in consultation with a provider. These items as a group were named consultative self-care management behaviors.
Self-care confidence is the degree of confidence that a person has about his or her ability to perform a specific self-care task and to persist in performing an action despite barriers, consistent with accepted definitions of self-efficacy [
22]. The factorial structure of the self-care confidence scale displayed two factors representing confidence about specific tasks (item 30, 34, 35, 36, 38, 39) and persistence (item 31, 32, 33, 37, 40). Based on this, we labeled these two factors as task specific self-care confidence and persistence self-care confidence.
The theoretical hypotheses tested to assess construct validity were both supported. Patients with higher self-care confidence performed better self-care maintenance, self-care monitoring and self-care management and good correlations were found between self-care confidence and the other three scales. These results confirms the theoretical relationships expressed in the theoretical framework [
22]. Furthermore, the same associations were found in previous studies using a diabetes self-efficacy scale to estimate the impact of self-efficacy on behaviors and outcomes of diabetes patients [
41]. Higher self-care maintenance was associated with better HbA1c levels. Previous studies found significant associations between adherence to medications, diet or exercise and glycemic control in diabetes patients [
7]. All these behaviors are addressed in the self-care maintenance scale and clinically they are known to improve glycemic control in diabetes patients [
4]. Higher self-care monitoring was associated with more diabetes complications. People feeling severely ill or having a more compromised health status are more likely to perform better self-care [
42]. Previous studies found similar results studying blood glucose monitoring in diabetes [
38]. Finally, higher self-care management was associated with fewer diabetes complications and lower BMI [
4]. The association of self-care with objective clinical indicators is one of the most important criteria for the external validity of a health instrument [
25], thus these results provide strong evidence of the validity of the SCODI. As we adjusted for the main confounding variables, including the type of diabetes, these associations also support the usefulness of the SCODI measures in both type 1 and type 2 diabetes patients.
Overall, the high single factor and global model-based internal reliabilities of the 4 self-care scales allow researchers and clinicians to use overall scales scores (e.g. self-care maintenance) or to calculate a specific score for each of the subscales (e.g., health promoting behaviors). In fact, the single factors reliability of each subscale (i.e. health promoting exercise behaviors in the self-care maintenance scale) were all good enough (all ≥ 0.77) to allow single factor scoring. Thus, single factor scores can be used to allow researchers and clinicians to look at specific aspects (i.e. body listening, symptom recognition) and to tailor individualized self-care promotion interventions. Scores for each scale and subscale should be standardized to a 0–100 scale to facilitate comparisons. We strongly discourage users from calculating a total SCODI score. Instead, the data will be far more useful if scores are calculated for each individual scale (self-care maintenance, self-care monitoring, self-care management and self-care confidence).
This study has several limitations. The sample was enrolled in one country and the sample size, although adequate for the study objectives, was relatively limited. Thus, usefulness of the SCODI in other settings cannot be assumed. However, high content validity was estimated by a panel of experts, multiple centers were represented and the patient characteristics are aligned with the global diabetes population, suggesting that the SCODI may be useful elsewhere. SCODI testing is ongoing in Europe, in China and both in South and North America. The inclusion of both T1DM and T2DM patients represents both a strength and a limitation of this study. On one side, this is coherent with the study population (patients with DM) and type of diabetes was used to adjust all the construct validity associations. This supports our conclusion that the SCODI is valid and reliable in the population of patients with DM. On the other side, psychometric performances could show specificities in the two subgroups (T1DM and T2DM). Thus, future research should include confirmatory factor analysis focusing on T1DM and T2DM samples.