The aim of this work was to develop a mapping algorithm for estimating EuroQoL 5 Dimension (EQ-5D) utilities from responses to the Long-Term Conditions Questionnaire (LTCQ), thus increasing LTCQ’s potential as a comprehensive outcome measure for evaluating integrated care initiatives.
Methods
We combined data from three studies to give a total sample of 1334 responses. In each of the three datasets, we randomly selected 75% of the sample and combined the selected random samples to generate the estimation dataset, which consisted of 1001 patients. The unselected 25% observations from each dataset were combined to generate an internal validation dataset of 333 patients. We used direct mapping models by regressing responses to the LTCQ-8 directly onto EQ-5D-5L and EQ-5D-3L utilities as well as response (or indirect) mapping to predict the response level that patients selected for each of the five EQ-5D-5L domains. Several models were proposed and compared on mean squared error and mean absolute error.
Results
A two-part model with OLS was the best performing based on the mean squared error (0.038) and mean absolute error (0.147) when estimating the EQ-5D-5L utilities. A multinomial response mapping model using LTCQ-8 responses was used to predict EQ-5D-5L responses levels.
Conclusions
This study provides a mapping algorithm for estimating EQ-5D utilities from LTCQ responses. The results from this study can help broaden the applicability of the LTCQ by producing utility values for use in economic analyses.
Hinweise
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
In the global context of ageing populations who are likely to experience multi-morbidity, there is an increasing drive towards integrated models of care that bring together formal health services, social care provision, and community-based services to support local population needs [1, 2]. The dual aims of integrated care are to implement a person-centred approach for supporting people with complex care needs, and to ensure the sustainability of health systems over the long term. Economic evidence is an essential component of integrated care evaluation, but the evidence must be relevant to all involved stakeholders. For example in England, the economic impacts of integrated care initiatives (including pooled budgets) between Clinical Commissioning Groups responsible for health care planning and Local Authorities responsible for social care provision need to be assessed via outcomes relevant for both health and social care (e.g. well-being, independence).
Most existing outcome measures for economic evaluation, such as the EQ-5D [3], are based on the construct of Health-Related Quality of Life (HRQoL). HRQoL focuses mainly on functional status and symptom burden, for example the extent to which someone is physically mobile or experiences depression. Research highlights the limitations of this for understanding what matters to those living with long term conditions [4, 5]. Alternatively, Social Care Related Quality of Life (SCRQoL), as measured by the Adult Social Care Outcomes Toolkit (ASCOT) [6], focuses on wider aspects of well-being such as safety, personal comfort, and social participation. However, HRQoL and SCRQoL are each arguably too narrow for evaluating integrated health and social care interventions, which will simultaneously seek to minimise symptom burden (and associated use of health resources) and to maximise the efficacy of social support for ‘living well’ in its broadest sense.
Anzeige
The Long-Term Conditions Questionnaire (LTCQ) is a 20-item patient-reported outcome measure (PROM) designed to measure ‘living well with long-term conditions’ across health and social care domains. It enables patients to self-report on the overall impact of living with one or multiple long-term conditions (LTCs), including physical and/or mental health conditions of varying severity. LTCQ was initially validated amongst a diverse sample of health and social care users in England [7], demonstrating strong psychometric properties of internal consistency, construct validity, and test-retest reliability. It has since been validated for use in memory clinics by patients with mild cognitive impairment or dementia [8], and it is being used to evaluate clinical interventions for schizophrenia [9]. LTCQ’s person-centred construct of ‘living well’ captures outcomes that are relevant for integrated care initiatives, e.g. sense of control over daily life, safety, confidence to self-manage illness. Further psychometric analysis using Rasch modelling was undertaken to identify 8 candidate items for a Short-Form LTCQ (LTCQ-8), which correlates strongly with the 20-item version and maintains unidimensionality of its core construct [10].
The Social Care Institute for Excellence in the United Kingdom advocates three types of outcomes for evaluating integrated care: personal improvement of health and well-being (measured by PROMs), service improvement of care quality (measured by patient experience measures and process indicators), and value and sustainability of the system (e.g. cost-effectiveness and timely delivery of services to those in greatest need) [11]. A generic PROM such as EQ-5D is advantageous for its concurrent use in quality-of-life and cost-effectiveness analyses - the EQ-5D remains the National Institute for Clinical and Care Excellence’s (NICE) preferred measure of health-related quality of life [12] - but it is conceptually limited in capturing outcomes of importance for integrated care. The content of LTCQ is potentially more appropriate in this context, but LTCQ currently has no associated utility values for economic analyses. The aim of this work was to develop a mapping algorithm for estimating EQ-5D utilities from LTCQ-8 responses, thus increasing LTCQ’s potential as a comprehensive outcome measure for evaluating integrated care initiatives.
Methods
This mapping study has been conducted following the MAPS (MApping onto Preference-based measures reporting Standards) statement [13]. The approach was also informed by ISPOR guidance on mapping from non-preference based outcome measures [14]. The valuation of the EQ-5D-5L was based on the UK value set [15] and the cross-walk to derive EQ-5D-3L utilities [16] following the latest position of National Institute for Health and Care Excellence (NICE) [12].
Datasets
Three different datasets were used in this study. The first dataset was derived from the validation study of the LTCQ, where 1211 patients with at least one of 11 specified LTCs (cancer, chronic back pain, COPD, diabetes, depression, irritable bowel syndrome, ischemic heart disease, multiple sclerosis, osteoarthritis, severe mental health conditions including schizophrenia, stroke) were recruited from geographically diverse regions in England representing urban and rural communities, as well as areas of high and low deprivation [7]. Approximately three-quarters of the participants (health care cohort) were recruited through 15 primary care (GP) practices in 3 regions (South East, North West, Yorkshire and Humber), and the remaining quarter (social care cohort) were recruited through 4 Local Authorities (in North West, East of England, South West, and Greater London). In addition to the 20-item LTCQ participants completed several established PROMs including the EQ-5D (5-level version), the Disease Burden Impact Scale (DBIS) through which participants indicated the name and perceived impact of each long-term condition that they had, and a range of demographic questions [17]. The version of the DBIS used allows for up to 25 LTCs to be reported, each on an impact scale from 0 (does not have the condition) to 5 (high daily impact of the condition), for a theoretical maximum impact score of 125. From the 1211 participants, 37 were removed from the mapping study because of missing observations in the EQ-5D-5L questionnaire and 48 patients due to missing observations in LTCQ responses, leaving 1126 patients included in the estimation data set.
Anzeige
The second dataset (n = 115) included the baseline data from the Feeling Safe Study, a randomised controlled trial of a psychological intervention that recruited people with schizophrenia in South East England (Oxfordshire, Northamptonshire, and Berkshire) between February 2016 and July 2019 [9]. Three patients were excluded from the 118 patients in the Feeling Safe Study dataset because of missing LTCQ items. The third dataset (n = 93) stemmed from further validation work to test LTCQ’s psychometric properties amongst people with cognitive impairment, who were minimally represented in the original validation study. From the 102 respondents with dementia or mild cognitive impairment recruited in 14 memory clinics in South East England between February and August 2018, 9 were excluded because of missing observations in EQ-5D-5L and/or LTCQ.
In all three datasets, participants completed the full 20-item LTCQ. Responses for the 8 short-form items were extracted for the analyses below. A reduced number of LTCQ items facilitated model convergence, and these items were identified through modern psychometric methods as the best-performing, conceptually independent items for representing LTCQ’s general construct of ‘living well with long-term conditions’ [10]. As LTCQ-8 may be used as a stand-alone measure for larger-scale studies in the future, we based the mapping models on these items only (Table 1).
Table 1
The LTCQ-8 questionnaire
The 8 items of LTCQ-8
4. Felt in control of daily life
7. Felt safe at home
8. Felt safe outside the home
10. Felt more dependent on others than you wanted
11. Felt lonely due to health conditions
12. Worried about being treated differently
15. Felt that your health conditions made you unhappy
19. Felt confident in managing health conditions
Estimation dataset and internal validation
In the LTCQ validation sample, only 7% of respondents reported a severe mental health condition, and only 9 respondents reported dementia. Considering that the LTCQ is an instrument for all long-term conditions, including mental health conditions and dementia, we combined the three datasets to ensure that the estimation and validation samples for EQ-5D utilities mapping were representative of the wider LTCQ population. The inclusion of the mental health dataset allowed us to map LTCQ to low EQ-5D utilities, taking account of the major impact that severe mental conditions such as schizophrenia have on HRQoL [18, 19]. The dementia dataset was included in the estimation dataset to include the utilities of older people with affected memory problems and complex needs.
In each of the three datasets, we randomly selected 75% of the sample and combined the selected random samples to generate the estimation dataset, which consisted of 1001 patients (845 from LTCQ, 86 from mental health, 70 from dementia). The unselected 25% observations from each dataset were combined to generate an internal validation dataset of 333 patients.
Statistical analysis
We used direct mapping models by regressing responses to the LTCQ-8 directly onto EQ-5D-5L and EQ-5D-3L utilities as well as response (or indirect) mapping to predict the response level that patients selected for each of the five EQ-5D-5L domains. The predictor variables in each fitted model were 32 dummy variables indicating whether or not a patient had a particular response on each LTCQ-8 question. We performed a complete case analysis because imputation introduces an additional source of error that can affect the precision of the algorithms [20]. Considering also the low missing data (i.e. 3%) in the estimation dataset, imputation was unlikely to affect the comparison of the mapping models. No patient characteristics (e.g. gender) were added as covariates in the best performing model because missing observations could reduce prediction accuracy. We also wanted to ensure that the mapping algorithm can be applied to datasets that do not include patient characteristics. All statistical analyses were performed in STATA version 15.
Direct mapping models
Ordinary least square (OLS) regression is the most frequently used mapping method [21]. However, several theoretical limitations have been highlighted in the context of HRQoL data [22]. Most particularly the assumption under OLS that the data is continuously distributed means the likelihood of having being in full health, a value of 1, is low, whereas in practice this is a relatively common response (10% of all responses considered in this study report perfect health). Despite this, recent work has shown that OLS performs well in mean prediction [23]. Tobit models have been used in EQ-5D mapping studies as an alternative to OLS to better deal with the bounded nature of EQ-5D utilities [24, 25]. Thus, the lower and upper limits for a Tobit model were specified as the minimum and maximum possible score on the EQ-5D-5L scale (i.e. -0.285 and 1 respectively) and on the EQ-5D-3L scale (i.e. -0.594 and 1 respectively). In the presence of heteroscedasticity, non-normality, and censoring, censored least absolute deviations (CLAD) models provide consistent estimates [23] and thus, it has been used extensively in HRQoL mapping literature [21, 26]. The limits and dependent variable in this model were specified as in the Tobit model. The observed EQ-5D-5L utility was used as the dependent variable in the OLS, Tobit and CLAD models.
Generalised Linear Model (GLM) allows for the skewed distribution of EQ-5D utility data and prevents prediction of utilities higher than 1 [27]. We specified two GLMs, one with Gamma family and log link and another with Gaussian family and log link, to predict EQ-5D-5L disutility. To fit these models, the dependent variable was transformed as 1 − Utility. Furthermore, fractional logistic regression was used to constrain utility predictions between − 0.281 and 1 for EQ-5D-5L utilities, and between − 0.594 and 1 for EQ-5D-3L utilities. The dependent variable in the regression with the EQ-5D-5L utility was
Two-part models have been used in utility mapping studies to allow for a relatively large proportion of observations reporting perfect health on EQ-5D (i.e. utility of 1) [22]. We therefore, specified two two-part models. In the first part of these models, a logistic regression was used to estimate the probability an individual to report perfect health (i.e. EQ-5D-5L utility = 1). The second part applied OLS regression in one two-part model and binomial beta regression in another two-part model to utilities less than 1. Binomial beta regression was performed because of its ability to deal with left and right skewed HRQoL data [28]. The dependent variable in the binomial beta regression was specified similar to the fractional logistic regression.
Response mapping models
Several models have been proposed in the literature to predict responses to EQ-5D dimensions [22], the most frequently used are multinomial and ordinal logistic regressions [21]. A multinomial logit and an ordinal logit were specified to estimate responses based on the expected value method [22, 29]. These regression models were applied to each dimension of the EQ-5D-5L and used to calculate the probabilities of responding to each of the five levels. The expected dis-utilities (inverse of utility) in each dimension were calculated by using the estimated response probabilities and the EQ-5D-5L UK valuation set [15].
Assessment of model performance
Predicted EQ-5D-5L utilities were estimated for each mapping model with back-transformation applied to the GLM models, fractional logistic regression, and binomial beta regression. For the two-part models, expected utility was estimated as:
$$ Utility=\Pr \left( Utility=1\right)+\Big(1-\Pr \left( Utility=1\right)\ast U $$
(2)
where U is the utility conditional on imperfect health (i.e. < 1) estimated in the second part of the models.
The mapping models were compared in terms of their ability to accurately predict EQ-5D-5L utility based on common metrics of predictive performance. Mean squared error (MSE) indicated goodness-of-fit and mean absolute error (MAE) measured individual-level prediction accuracy. These metrics were calculated in the estimation sample as well as in the two external validation models separately and jointly. Scatterplots with the observed and predicted EQ-5D-5L and EQ-5D-3L utility were created for each mapping model.
After the best performing model was selected, we investigated whether it performed equally well across different levels of morbidity and between males and females. This was done by plotting MSE across the deciles of the DBIS Score by gender. This was done using only the original LTCQ validation dataset because the DBIS Score was not available in the other two datasets.
Anzeige
Results
The mean EQ-5D-5L utility in the dataset from the validation study of the LTCQ was 0.616 (SD: 0.320). A similar mean utility was recorded in the baseline dataset from the Feeling Safe study among a sample with mental health conditions (mean: 0.605, SD: 0.219) and a higher utility recorded in the sample with dementia or mild cognitive impairment from the additional validation of the LTCQ (mean: 0.785, SD: 0.205). In our combined estimation sample of 1001 participants from across the datasets, the mean score was 0.623 (SD: 0.312). The mean DBIS score, only recorded for the full LTCQ validation sample, was 15.936 (SD: 12.814).
Table 2 provides the responses for the EQ-5D-5L and LTCQ-8 questions by dataset. Figure 1 provides the distribution of scores on the EQ-5D-5L and the EQ-5D-3L by dataset. This illustrates the bounded and skewed distribution of the utilities.
Table 2
Responses on EQ-5D-5L and LTCQ-8 questions by dataset
Model
LTCQ validation dataset
(n = 1126)
Mental health dataset
(n = 115)
Dementia dataset
(n = 93)
Estimation dataset
(n = 1001)
EQ-5D Mobility
No Problems
367 (32%)
61 (53%)
48 (52%)
360 (36%)
Slight Problems
202 (18%)
23 (20%)
13 (14%)
176 (18%)
Moderate Problems
223 (20%)
20 (17%)
24 (26%)
200 (20%)
Severe problems
231 (21%)
10 (9%)
8 (8%)
185 (19%)
Unable
103 (9%)
1 (1%)
0 (0%)
80 (8%)
EQ-5D Self-care
No Problems
655 (58%)
62 (54%)
71 (77%)
593 (59%)
Slight Problems
154 (14%)
23 (20%)
13 (14%)
142 (14%)
Moderate Problems
144 (13%)
23 (20%)
3 (3%)
126 (13%)
Severe problems
83 (7%)
7 (6%)
4 (4%)
68 (7%)
Unable
90 (8%)
0 (0%)
2 (2%)
72 (7%)
EQ-5D Usual activities
No Problems
352 (31%)
18 (16%)
50 (54%)
311 (31%)
Slight Problems
236 (21%)
27 (24%)
17 (18%)
206 (21%)
Moderate Problems
245 (22%)
42 (37%)
17 (18%)
232 (23%)
Severe problems
152 (14%)
22 (19%)
5 (6%)
135 (13%)
Unable
141 (12%)
5 (5%)
4 (4%)
117 (12%)
EQ-5D Pain/Discomfort
No Problems
258 (23%)
38 (33%)
42 (45%)
256 (25%)
Slight Problems
331 (29%)
31 (27%)
22 (24%)
290 (29%)
Moderate Problems
294 (26%)
33 (28%)
25 (27%)
266 (26%)
Severe problems
183 (16%)
12 (10%)
3 (3%)
146 (15%)
Unable
60 (5%)
1 (1%)
1 (1%)
43 (4%)
EQ-5D Anxiety/depression Anxiety/Depression
No Problems
471 (42%)
5 (4%)
37 (40%)
396 (40%)
Slight Problems
301 (27%)
17 (15%)
32 (34%)
247 (25%)
Moderate Problems
232 (20%)
49 (43%)
20 (22%)
224 (22%)
Severe problems
77 (7%)
29 (25%)
4 (4%)
90 (9%)
Unable
45 (4%)
15 (13%)
0 (0%)
44 (4%)
LTCQ4. Control of daily life
Never
94 (8%)
9 (8%)
3 (3%)
83 (8%)
Rarely
142 (13%)
51 (44%)
9 (10%)
140 (14%)
Sometimes
242 (21%)
36 (31%)
22 (24%)
232 (23%)
Often
236 (21%)
19 (17%)
17 (18%)
205 (20%)
Always
412 (37%)
0 (0%)
42 (45%)
341 (34%)
LTCQ7. Safe at home
Never
19 (2%)
4 (4%)
2 (2%)
18 (2%)
Rarely
38 (3%)
24 (21%)
1 (1%)
49 (5%)
Sometimes
109 (10%)
43 (37%)
3 (3%)
120 (12%)
Often
212 (19%)
31 (27%)
14 (15%)
188 (19%)
Always
748 (66%)
13 (11%)
73 (79%)
626 (62%)
LTCQ8. Safe outside home
Never
95 (8%)
20 (17%)
7 (8%)
86 (8%)
Rarely
116 (11%)
44 (38%)
7 (8%)
128 (13%)
Sometimes
251 (22%)
35 (30%)
15 (16%)
227 (23%)
Often
212 (19%)
10 (9%)
20 (21%)
174 (17%)
Always
452 (40%)
6 (5%)
44 (47%)
386 (38%)
LTCQ10. Dependant
Always
292 (26%)
17 (15%)
12 (13%)
242 (24%)
Often
224 (20%)
49 (43%)
28 (30%)
228 (23%)
Sometimes
226 (20%)
32 (28%)
25 (27%)
215 (21%)
Rarely
155 (14%)
13 (11%)
16 (17%)
131 (13%)
Never
229 (20%)
4 (3%)
2 (13%)
185 (18%)
LTCQ11. Lonely
Always
126 (11%)
39 (34%)
5 (5%)
133 (13%)
Often
162 (14%)
40 (35%)
11 (12%)
155 (15%)
Sometimes
264 (23%)
24 (21%)
20 (22%)
233 (23%)
Rarely
167 (15%)
4 (4%)
15 (16%)
131 (13%)
Never
407 (36%)
8 (7%)
42 (45%)
349 (35%)
LTCQ12. Stigma
Always
77 (7%)
28 (24%)
3 (3%)
77 (8%)
Often
116 (10%)
44 (38%)
21 (23%)
121 (12%)
Sometimes
281 (25%)
30 (26%)
22 (24%)
243 (24%)
Rarely
198 (18%)
10 (9%)
47 (50%)
182 (18%)
Never
454 (40%)
3 (3%)
0 (0%)
378 (38%)
LTCQ15. Unhappy
Always
148 (13%)
31 (27%)
4 (4%)
139 (14%)
Often
203 (18%)
48 (42%)
14 (15%)
195 (19%)
Sometimes
350 (31%)
28 (24%)
33 (35%)
301 (30%)
Rarely
185 (17%)
5 (4%)
22 (24%)
164 (16%)
Never
240 (21%)
3 (3%)
20 (22%)
202 (20%)
LTCQ19. Confident
Never
59 (5%)
5 (4%)
6 (6%)
53 (5%)
Rarely
84 (8%)
27 (24%)
2 (2%)
82 (8%)
Sometimes
254 (23%)
60 (52%)
17 (18%)
252 (25%)
Often
252 (22%)
18 (16%)
25 (26%)
223 (22%)
Always
477 (42%)
5 (4%)
43 (46%)
391 (39%)
Fig. 1
Distribution of EQ-5D-5L and EQ-5D-3L (using crosswalk) utility in each dataset
×
Direct mapping
Table 3 shows the performance of the various models when estimating EQ-5D-5L and EQ-5D-3L utilities within the estimation dataset. The two-part model with OLS was the best performing model based on the mean squared error (0.038) and mean absolute error (0.147) when estimating the EQ-5D-5L, as well for EQ-5D-3L utilities (MSE: 0.052, MAE: 0.172). The order of rank was largely consistent based on either the mean squared error or mean absolute error and between utilities. The mean squared error was consistently lower for the 5 L utility compared to the 3 L. Of the possible response mapping models, the multinomial logit was the better performing (MSE: 0.045; MAE: 0.155).
Table 3
Model performance based on the estimation sample (n = 1001)
EQ-5D-5L utility
Model rank
EQ-5D-3L utility
Model rank
Model
MSE (MAE)
MSE
MAE
MSE (MAE)
MSE
MAE
1. OLS
0.0390 (0.1486)
2
2
0.0525 (0.1732)
2a
3
2. Tobit
0.0397 (0.1490)
4
3
0.0536 (0.1744)
5
5
3. CLAD
0.0436 (0.1566)
7
9
0.0574 (0.1808)
7
7
4. GLM (Gamma; Log link)
0.0414 (0.1515)
6
5
0.0540 (0.1742)
6
4
5. GLM (Gaussian; Log link)
0.0399 (0.1527)
5
6
0.0533 (0.1747)
4
6
6. Fractional logit
0.0392 (0.1492)
3
4
0.0525 (0.1724)
2a
2
7. Two-part model with OLS
0.0384 (0.1474)
1
1
0.0516 (0.1716)
1
1
8. Two-part model with beta regression
0.0473 (0.1575)
10
10
0.0903 (0.2157)
10
10
9. Multinomial logit
0.0451 (0.1550)
8
7
0.0675 (0.1972)
8
8
10. Ordered logit
0.0458 (0.1563)
9
8
0.0705 (0.1999)
9
9
OLS Ordinary Least Square, GLM Generalised Linear Model, MSE Mean Squared Error, MAE Mean Absolute Error
atied
Figure 2 shows the performance of the two-part OLS model as measured by the mean squared error across deciles of the DBIS scores. This confirms, as per Table 3, that the model performs better on the EQ-5D-5L compared to the 3 L. It also shows that model performance deteriorates among those with higher DBIS scores, representing high severity and/or multiple conditions, especially among males.
Fig. 2
Mean Squared Errors across deciles of the DBIS score by gender based on the LTCQ validation dataset (n = 1126). Notes: Bars show the standard deviation of the mean Mean Squared Error in each decile; Dashed lines show the outer fence of 2 standard deviations from the mean Mean Squared Error in each decile; Dots show outliers with Mean Squared Error larger than one Standard Deviation of the mean Mean Squared Error in each decile
×
Anzeige
Table 4 provides regression coefficients for the best performing model, the two-part model with OLS. The results can be used to estimate the EQ-5D utilities based on a set of responses to the Short-Form LTCQ according to Eq. 2:
$$ Utility=\Pr \left( Utility=1\right)+\Big(1-\Pr \left( Utility=1\right)\ast U $$
(2)
Table 4
Regression coefficients for the best model: two-part with OLS
EQ 5D-5L utilities
EQ 5D-3L utilities using crosswalk
Part 1- Logit
Part 2- OLS
Part 2- OLS
Reference category in brackets
Odds Ratio (se)
b (se)
b (se)
LTCQ4. Control of daily life (Never)
Rarely
1.240 (2.0123)
0.167 (0.030)*
0.220 (0.034)*
Sometimes
−0.448 (2.091)
0.174 (0.030)*
0.233 (0.034)*
Often
−0.045 (1.866)
0.209 (0.034)*
0.273 (0.039)*
Always
1.145 (1.831)
0.235 (0.037)*
0.286 (0.042)*
LTCQ7. Safe at home (Never)
Rarely
−31.701 (3435.388)
0.017 (0.060)
0.027 (0.068)
Sometimes
−31.103 (3295.443)
−0.016 (0.056)
− 0.017 (0.064)
Often
−16.537 (1488.793)
−0.031 (0.056)
− 0.033 (0.064)
Always
−17.518 (1488.793)
0.014 (0.056)
−0.010 (0.064)
LTCQ8. Safe outside home (Never)
Rarely
−0.674 (2939.661)
0.013 (0.031)
0.010 (0.035)
Sometimes
14.568 (1488.792)
0.191 (0.023)
0.075 (0.034)*
Often
13.895 (1488.792)
0.225 (0.028)*
0.109 (0.038)*
Always
15.067 (1488.792)
0.235 (0.029)*
0.166 (0.039)*
LTCQ10. Dependant (Always)
Often
−0.738 (0.842)
0.138 (0.021)*
0.162 (0.024)*
Sometimes
−0.483 (0.611)
0.191 (0.023)*
0.221 (0.026)*
Rarely
0.070 (0.616)
0.225 (0.028)*
0.258 (0.032)*
Never
0.263 (0.587)
0.235 (0.029)*
0.268 (0.033)*
LTCQ11. Lonely (Always)
Often
0.015 (1.017)
−0.028 (0.028)
−0.016 (0.031)
Sometimes
−1.439 (0.920)
−0.035 (0.028)
−0.030 (0.032)
Rarely
−0.915 (0.814)
−0.015 (0.032)
− 0.006 (0.036)
Never
−0.410 (0.700)
− 0.024 (0.031)
− 0.016 (0.036)
LTCQ12. Stigma (Always)
Often
−26.818 (2169.424)
−0.017 (0.032)
−0.002 (0.036)
Sometimes
−0.516 (1.373)
− 0.033 (0.031)
− 0.009 (0.035)
Rarely
−0.737 (1.366)
0.006 (0.033)
0.020 (0.037)
Never
−0.845 (1.337)
−0.034 (0.033)
− 0.020 (0.038)
LTCQ15. Unhappy (Always)
Often
16.502 (2105.194)
0.084 (0.025)*
0.084 (0.028)*
Sometimes
17.163 (2105.194)
0.149 (0.027)*
0.138 (0.031)*
Rarely
18.324 (2105.194)
0.155 (0.032)*
0.121 (0.037)*
Never
18.952 (2105.194)
0.152 (0.033)*
0.140 (0.039)*
LTCQ19. Confident (Never)
Rarely
−15.296 (3063.957)
0.020 (0.038)
0.014 (0.043)
Sometimes
−1.553 (1.622)
0.018 (0.035)
0.034 (0.040)
Often
−0.167 (1.169)
0.034 (0.038)
0.062 (0.043)
Always
0.315 (1.082)
0.070 (0.039)
0.120 (0.044)*
Constant
−16.994 (2105.193)
0.061 (0.058)
−0.130 (0.066)*
n
1001
896
896
SE standard error
* p-value< 0.005
For instance, in a set of responses for an individual responding “living well” throughout the LTCQ, the probability of being in perfect health (utility of 1) is given by the sum of the constant and the coefficients for “living well” across each domain for part 1 – note, this needs to be transformed by taking the inverse of the logistic function. The predicted second-part utility is given by the sum of the constant and respective domain coefficients from the part 2 estimates. Finally, the predicted EQ-5D utility is given by substituting the above values into Eq. 2, producing a utility estimate of 0.93 for the EQ-5D-5L (see Appendix 2 for a detailed calculation).
Out-of-sample prediction
When we fitted the coefficients to the validation sample (n = 333), the mean predicted EQ-5D-5L utility from the two-part OLS model was 0.64 (SD: 0.25), compared to the recorded mean of 0.63 (SD: 0.30). The mean predicted EQ-5D-3L was 0.55 (SD: 0.28), compared to a recorded 0.53 (SD: 0.34). The mean squared error of our predicted value was 0.040 for the EQ. 5D-5L and 0.0582 for the EQ. 5D-3L; the mean absolute error was 0.1520 and 0.1848, respectively.
Response mapping
Appendix 3 reports the multinomial logit results for each of the EQ-5D questions with the 8 items of the short-form LTCQ as the predictor variables. The McFadden pseudo-R2 indicates that the models perform fairly well, particularly in the self-care, usual activity and anxiety/depression domains. The results were broadly intuitive. In several instances, the result for a given LTCQ-8 question most related to an EQ-5D domain is significant; for example, the LTCQ-8 question on feeling dependent is significant across a number of EQ-5D domains but particularly for usual activities and less so for anxiety and depression.
Anzeige
Discussion
This study provides a mapping algorithm for estimating EQ-5D utilities from LTCQ-8 responses. We have shown that our approach produces estimated utility scores that closely approximate what would have been recorded had the EQ-5D been administered, particularly for individuals outside of the most severe health states. The results from this study can help extend the applicability of the LTCQ by estimating utility values for use in economic analyses.
In this paper, we presented a broad range of potential models. Consistent with previous studies, a simple OLS model performed well for predicting average utilities, but the two-part model with OLS emerged as the best-performing model. The two-part model was proposed to better reflect the bounded nature of EQ-5D scores. The mean squared errors and mean absolute errors recorded in our models were similar to that reported elsewhere [30]. The small differences in performance between several models is consistent with research elsewhere [22, 31], as well as with the finding that the validity of mapping algorithms is more strongly a function of the particular instrument and disease or patient group rather than the specific technique employed [32].
We mapped our results onto both EQ-5D-5L and EQ-5D-3L utilities. The NICE position statement from November 2018 affirms the present need to use the EQ-5D-3L for reference-case analyses and recommends mapping to the EQ-5D-3L if EQ-5D-5L data had been collected [12]. EQ-5D-3L values in this study were thus derived using the recommended crosswalk [16]. Our models performed better on the EQ. 5D-5L than the 3 L, implying that the greater sensitivity afforded by the additional levels in the EQ-5D-5L helped achieve improved model fit.
In addition, we mapped a response model (multinomial logit) that indicates how responses to questions from the LTCQ-8 impact across the dimensions of the EQ-5D-5L. This mainly provided intuitive results, with responses to particular questions affecting appropriate domains. For instance, feeling more in control of daily life was significantly associated with being in a less severe state in the mobility domain. Although, there were also some seemingly counter-intuitive signs, for instance ‘always feeling safe at home’ was a positive and significant predictor of being in the most severe state in the mobility domain relative to the least severe. Albeit, this could reflect the person being in adjusted accommodation where they do feel safe. A larger validation dataset would help to clarify this.
Similarly, a validation dataset with more severe health states (lower utilities) would help assess model performance where it was weakest, although worsening predictive performance for patients in severe states is consistent with other research [30]. Similarly, since utilities are often required for specific subgroups of patients, further validation could occur with populations dissimilar from those featured in this paper.
Conclusions
As a result of the mapping algorithm produced in this study, surveys that include the LTCQ, or the short form LTCQ-8, can now be used to estimate utility values for economic analyses. Although the existence of a mapping algorithm is not an argument against the inclusion of direct preference-based measures in prospective studies - mapping is a second-best solution to direct measurement [33] - the ability to generate estimated utilities should increase the potential of the LTCQ for use as a comprehensive outcome measure for evaluating integrated care initiatives.
Acknowledgements
This work was supported by a Pump Priming grant from the Nuffield Department of Population Health, University of Oxford. Apostolos Tsiachristas, Stephen Rocks, Caroline Potter, and Ray Fitzpatrick received funding from the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care Oxford (NIHR CLAHRC Oxford), now recommissioned as NIHR Applied Research Collaboration Oxford and Thames Valley, at Oxford Health NHS Foundation Trust. Apostolos Tsiachristas would also like to acknowledge financial support from the NIHR Oxford Biomedical Research Centre. Julien Forder and Karen Jones acknowledge funding for this independent research from the National Institute for Health Research (NIHR) Policy Research Programme – for the NIHR Policy Research Unit on Quality, Safety and Outcomes of Health and Social Care (PR-PRU-1217-20,702). Daniel Freeman is supported by an NIHR Research Professorship (NIHR-RP-2014-05-003). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.
Ethics approval
Data was de-identified and no ethics approval was required for this mapping exercise.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Scatter plots of the observed EQ-5D-5L utility versus predicted EQ-5D-5 L utility
×
Appendix 2
Estimating utilities based on responses to the short form LTCQ
EQ 5D utilities can be estimated for the best-fitting model according to Eq. 2:
$$ Utility=\Pr \left( Utility=1\right)+\Big(1-\Pr \left( Utility=1\right)\ast U $$
(2)
Based on Table 3, the utility for someone responding “living well” throughout the survey is estimated as follows:
Part one estimate
To estimate the probability of being in perfect health, we sum the constant and domain coefficients and use the inverse of the logistic function to re-transform the data. The inverse logistic function is exp(x)/(1 + exp (x)) and can be calculated using the Stata command “invlogit”.
Estimating EQ-5D utilities based on the Short-Form Long Term Conditions Questionnaire (LTCQ-8)
verfasst von
Apostolos Tsiachristas Caroline M. Potter Stephen Rocks Michele Peters Maureen Cundell Rupert McShane Laurie Batchelder Diane Fox Julien E. Forder Karen Jones Felicity Waite Daniel Freeman Ray Fitzpatrick
