Background
As of January, 12th 2021, more than 88.3 million confirmed cases of the corona virus disease 2019 (COVID-19) causing approximately 1.900.000 deaths were reported globally [
1]. Nevertheless, the total number of subjects with COVID-19 is probably higher due to insufficient testing capacity and/or difficulties in identifying mild cases [
2‐
4]. Previous severe acute respiratory syndrome (SARS) outbreaks showed to affect the survivors’ lung function, exercise capacity, health-related quality of life (HrQoL), mental health, and lead to increased symptoms of fatigue and dyspnea from 6 months to 2 years after symptom onset [
5‐
7]. Due to the increasing number of subjects recovering from the infection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the need for tools to measure and monitor the course of the disease and its impact on functional status has been raised as essential [
8].
Klok and colleagues proposed the “Post-COVID-19 Functional Status (PCFS) Scale” to be used as a patient-reported outcome measure to evaluate the consequences of COVID-19 and their effect on functional status [
8]. The PCFS Scale can be used both at the time of hospital discharge, and to monitor functional status post discharge [
8]. The scale was designed to cover the entire range of functional limitations from: grade 0, “No functional limitations” to grade 4, “Severe functional limitations” and grade 5, “Death”. Notably, the scale was derived for measuring functional outcomes after venous thromboembolism (VTE), by use of a Delphi method among international VTE experts and patient focus groups [
9,
10]. It was found to have good to excellent interobserver agreement between self-reported scale assessment and a structured interview by a trained physician [
10]. Since COVID-19 represents an acute cardiopulmonary disease, and has been shown to be frequently complicated by VTE [
11], the scale was assumed to be relevant and useful in the clinical course of COVID-19 too [
8]. The scale and supporting information such as a manual and various translations are freely accessible via
https://osf.io/qgpdv/ (CC-BY 4.0). To date, however, no study has investigated any measurement property of the PCFS Scale in post-COVID-19 subjects.
The aim of the present study was, therefore, to assess the construct validity of the PCFS Scale among adult subjects with confirmed and presumed COVID-19 by testing the hypothesis that this simple tool is associated with the number and intensity of symptoms, HrQoL and impairment in work and usual activities due to health.
Methods
Study design, setting and participants
This cross-sectional, survey study was conducted in the Netherlands and Flanders (Belgium) between June 4th and June 11th 2020. Members of two Facebook groups for COVID-19 subjects with persistent complaints [
12,
13] and subjects who registered at a website of the Lung Foundation Netherlands (
www.coronalongplein.nl) received a web link with an invitation to fill out questionnaires.
Subjects were asked one-off to provide information regarding anthropometric/sociodemographic characteristics and medical history (gender, age, height, body weight, date of onset of symptoms, hospitalization at the time of the infection, type of COVID-19 diagnosis, number of pre-existing comorbidities, marital and smoking status). Subjects were stratified into four groups according to the type of COVID-19 diagnosis: (1) hospitalized with confirmed COVID-19 (regular ward, no admission to intensive care unit (ICU); (2) non-hospitalized with confirmed COVID-19 (based on reverse transcription polymerase chain reaction (RT-PCR) test and/or computed tomography (CT) scan of the thorax); (3) non-hospitalized with symptom-based diagnosis of COVID-19 (established by a doctor, no formal COVID-19 testing); and (4) non-hospitalized with presumed COVID-19 (no formal diagnosis at the time of the presumed infection).
The medical ethics committee of Maastricht University stated that the Medical Research Involving Human Subjects Act (WMO) does not apply for this study and that an official approval of this study by the committee was not required (METC2020-1978). The medical ethics committee of Hasselt University formally judged and also approved the study (MEC2020/041). All subjects gave digital informed consent at the start of the survey. Data from this study on persistent symptoms and care dependency have been published before [
14‐
16].
Construct validity
The present study adopted the definition of one of the three domains of validity (construct validity) described in the COSMIN study—which aimed to clarify and standardize terminology and definitions of measurement properties that are relevant and should be evaluated for health-related patient-reported outcomes (HR-PRO) [
17]. Construct validity is defined as the degree to which the scores of a HR-PRO instrument are consistent with hypotheses (for instance with regard to relationships to scores of other instruments) based on the assumption that the HR-PRO instrument validly measures the construct to be measured [
17]. For this reason, we opted to investigate the construct validity of the PCFS Scale by testing whether the PCFS Scale is a simple tool that can be used for measuring the impact of symptoms on the functional status of subjects. Our hypothesis is that the PCFS Scale is related with instruments used to assess the number and intensity of symptoms as well as with instruments which assess the impairment in HrQoL and in work and usual activities. In order to test this hypothesis, we explored the level of impairment in these outcomes (see below) after stratifying subjects according to the PCFS Scale.
Measures
To assess the level of impairment in functional status subjects were asked to fill in the PCFS Scale [
8]. The PCFS Scale stratification is composed of five scale grades: grade 0 (No functional limitations); grade 1 (Negligible functional limitations); grade 2 (Slight functional limitations); grade 3 (Moderate functional limitations) and grade 4 (Severe functional limitations). The final scale grade 5 ‘death’, which is required to be able to use the scale as outcome measure in clinical trials, was left out for this self-administered questionnaire. Additionally, the following questionnaires were completed: the Utrecht Symptom Diary (USD), an adapted Dutch version of the Edmonton Symptom Assessment System [
18,
19], to assess symptom intensity ranging from 0 (no symptom) to 10 points (worst possible); the 5-level version of the EQ-5D questionnaire (EQ-5D-5L) to assess HrQoL [
20]. This questionnaire is composed by five domains (mobility, self-care, usual activities, pain/discomfort and anxiety/depression) and a visual analogue scale (VAS) ranging from 0 (the worst imaginable health) to 100 points (the best imaginable health). From the scores of each domain, an index can be calculated (ranging from − 0.329 to 1) with higher scores representing a better HrQoL [
21]; and the Work Productivity and Activity Impairment (WPAI) questionnaire from which four main outcomes can be generated and expressed in percentages: (1) percent work time missed due to health (absenteeism); (2) percent impairment while working due to health (presenteeism); (3) percent overall work impairment due to health; (4) percent activity impairment due to health. The recall period is 7 days and higher scores represent more impairment in outcomes, the questionnaire has shown to be valid and reproducible and has been extensively used in different common chronic diseases [
22,
23].
Statistical analyses
Continuous variables are presented as mean and standard deviation or median and interquartile range, as appropriate. Categorical variables are presented as absolute and relative frequency. The comparisons of continuous variables between subjects with different levels of impairment in functional status were performed with Kruskal–Wallis test, as the dependent variables were not normally distributed for each group of the PCFS Scale. The comparisons of categorical variables between subjects with different level of impairment in functional status were performed with a Chi-square test of independence or Mantel–Haenszel test of trend, as appropriate. The tests were followed by Bonferroni adjustments for multiple comparisons. An ordinal logistic regression was performed to determine which of the baseline characteristics were associated with a higher odd of being in a higher grade of the PCFS Scale. Statistics and visualization were performed using SPSS (version 25, IBM Corporation, Armonk, NY, USA) and GraphPad Prism 9.0 (GraphPad Software Inc., USA). A priori, the level of significance was set at P < 0.05.
Discussion
This is the first study to describe the PCFS Scale in a large sample of adult hospitalized and non-hospitalized subjects with confirmed and presumed COVID-19. The present results confirm the hypothesis that the PCFS Scale can be used to measure the impact of symptoms on the functional status of subjects after COVID-19, especially in slight to severe categories. We found gradual differences in the number and intensity of symptoms, reduction in HrQoL and impairment in work and usual activities between subjects with slight, moderate and severe functional limitation status (≥ grade 2) while no differences between subjects with no functional limitation (grade 0) and negligible functional limitation (grade 1) were found when comparing these outcomes, although a lack of power to detect small but meaningful differences among the latter groups might have affected these results.
The majority of the included subjects was not formally tested during the infection (78%), whereas a minority was hospitalized with confirmed diagnosis of COVID-19 (5%). These findings are expected, as early data showed that the proportion of critical cases of COVID-19 is 5% [
2] and the number of undocumented infections have been estimated at 86% of all infections [
3]. When proposing the PCFS Scale, Klok and colleagues underlines the relevance of the assessment of functional status in the weeks and months following acute care of COVID-19 subjects [
8]. Our findings describe that, despite the inclusion of a middle aged sample of subjects without multiple comorbidities and with diagnosis of ‘mild’ COVID-19 (
i.e. non-hospitalized during the infection), the majority of them (85%) report slight-to-moderate functional limitations during course of COVID-19, 3 months after the onset of symptoms, supporting the existence of a ‘post-COVID-19 syndrome’ [
14] which may be a target for deciding on referral of non-hospitalized subjects to expert (outpatient) clinics, facilitate selection of subjects who may benefit from rehabilitation programs as well as measuring the efficacy of such programs.
Of note, one of the strong points of the scale is that it intentionally does not specify why subjects are functionally impaired, i.e. if the impairment is caused by dyspnoea, fatigue, pain, anxiety or otherwise. This is crucial for the scale to be useful in a condition that may cause symptoms in many organ systems. However, it does not rule out the fact that the reported functional limitations are (partly) pre-existent. This is no issue when the scale is measured repeatedly or used as outcome measure in studies comparing two or more groups, especially in randomized controlled trials. The manual to the scale describes the possibility to assess pre-COVID-19 functional status, which would allow for determination of the causality of functional impairment in observational studies [
10]. Importantly, since the aim of the current study was to assess the associations between measures of symptoms intensity, HrQoL, impairment in work and usual activities due to health and the PCFS Scale, these considerations do not pose an issue for the correct interpretation of the presented data, nor does the fact that COVID-19 was not confirmed by objective testing in all subjects.
As most of the included subjects in our study were highly symptomatic and the PCFS Scale has shown to be associated with number and intensity of symptoms, the groups of subjects stratified as presenting no functional limitations (grade 0) and negligible functional limitations (grade 1) were relatively small (3% and 8% of total sample, respectively) likely due to a selection bias arising from the self-selection nature of the data. Also, the lack of statistically significant differences between these groups could be a direct consequence of this limited number of subjects. It is also possible that there is, in fact, not a clinically relevant difference in outcomes between these two grades of the PCFS Scale, future studies with inclusion of less symptomatic subjects are necessary to investigate this issue. After all, both a scale grade of 0 and 1 indicate no functional limitations. The clinical relevance between the 2 grades is possibly to differentiate full recovery (grade 0) from incomplete recovery and persistent symptoms (grade 1).
The groups of subjects stratified as presenting slight and moderate functional limitations (grade 2 and 3) present similar baseline characteristics, however with a gradual increase in number/intensity of symptoms, reduction in HrQoL and impairment in work and usual activities. Despite presenting significantly lower BMI, the relatively small group of subjects with severe functional limitations (grade 4) was found to be highly symptomatic and presenting worse HrQoL. This could be partially explained by the higher proportion of subjects with multimorbidity included in this group, since previous studies have found that multimorbidity is an independent factor associated with HrQoL [
24,
25]. Furthermore, this group of subjects also presented a higher proportion of subjects with other factors that are associated with poorer functional status such as living alone and presenting a ‘symptom-based’ COVID-19 diagnosis.
The main limitation of the present study is the inclusion of a self-selected sample of subjects with confirmed and presumed COVID-19 who are still symptomatic after the infection, it is possible that the frequency and intensity of symptoms reported by non-hospitalized subjects is overestimated due to selection bias and due to the inclusion of a relatively high proportion of women, who usually report more symptoms than men [
26]. Moreover, if COVID-19 ICU survivors and other hospitalized subjects would have been included, the distribution of the PCFS could have shifted towards more symptoms and functional impairment. Future studies should investigate the distribution of the scale grades in less selected cohorts of COVID-19 subjects, as well as confirm the identified associations in other samples including a higher proportion of men, less symptomatic subjects and in sequential assessment of the scale during the course of disease (e.g. at the time of hospital discharge, more than 3 months after the onset of symptoms). In addition, we did not include any objective measure of physical functioning that could be related to functional status, however the strong association with the domain ‘usual activities’ of the EQ-5D-5L and WPAI and the ability to discriminate subjects with higher number/intensity of symptoms demonstrate the construct validity of the PCFS Scale.
Conclusion
In conclusion, we demonstrated the construct validity of the PCFS Scale in highly-symptomatic adult subjects with confirmed or presumed COVID-19 3 months after the onset of symptoms. The fact that the PCFS Scale can be easily used is a major advantage of the scale, potentially facilitating its widespread implementation. We propose that this tool could be used to discriminate between subjects with higher number and intensity of symptoms which is related with reduced HrQoL and impairment in work and usual activities. Therefore, the scale could be used to guide follow-up procedures such as referral to expert (outpatient) clinics or rehabilitation programs. Also, this shows that the PCFS Scale could be considered as a main outcome in clinical trials as well as observational studies, as it captures symptom intensity and HrQoL in one meaningful scale. The construct validity is a first step towards the validation of the PCFS Scale and more studies assessing other measurement properties are recommended.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (
http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.