Less healthy, but more active: Opposing selection biases when recruiting older people to a physical activity study through primary care

Physical activity studies on older people often recruit through primary care, such studies usually report low participation, both for surveys (46% [1], 57% [2]) and more markedly for intervention studies (26% [3], 32% [4], 35% [2]). Information about non-participants is lacking, but higher activity levels have been associated with increased recruitment [4, 5], leading to potential selection bias and difficulties in generalizing results [6]. Unfortunately, these studies did not report on non-participants' health status. Whilst older people with higher activity levels tend to be healthier [7], recruiting through primary care could encourage those with more illnesses and primary care contact to respond, leading to bias in an opposing direction. Our objective was to compare the self-reported health status and physical activity levels of participants and non-participants in a primary care based physical activity study.

As part of a randomized controlled trial of different recruitment strategies to a physical activity study, 560 patients ≥ 65 years registered with a primary health care centre (general practice) in Oxfordshire, UK were randomly selected by household [8]. Those living in care homes, those with dementia, terminal illness, poorly controlled cardiac failure or unstable angina and those housebound due to disability were first excluded by computer record search and by general (family) practitioner and district (community) nurse examination of registered patient lists. All 560 patients were invited to take part in a study measuring customary physical activity levels objectively for a 7-day period using motion sensors (accelerometers and pedometers). A random half (280) also received a 12-page questionnaire with their study information, asking details about physical health (general health, limiting longstanding illness [9], disability [10], pain [11], chronic disease [12], smoking status, weight and height), depressive symptoms [13], self-reported physical activity levels [14, 15] and attitudes towards physical activity [16] (See Additional file 1). Subjects were encouraged to return the questionnaire, whether or not they participated in the physical activity study, thus allowing a comparison of participants and non-participants. Those participating who had not been randomized to receive a questionnaire, completed one at their baseline assessment.

Recruitment rate to the physical activity study was 43%(240/560). Comparison overall of participants (n = 240) and non-participants (n = 320), adjusted for age, sex and household clustering, showed that males were more likely to participate OR 1.4(95% C.I. 1.1–1.8). There was no statistically significant association between age and participating, baseline age 65–69 OR = 1, age 70–79 OR 0.8(95% C.I. 0.5–1.1), age = 80 OR 0.8(95% C.I. 0.5–1.4).

Of the 280 people sent a postal questionnaire, 116 were recruited to the study and 164 were not, of these non-participants 76/164(46%) completed the questionnaire (see Figure 1). Table 1 shows the comparison of participants (n = 240) (116 from the postal questionnaire group, 124 who completed the questionnaire at baseline assessment) and non-participants (n = 76) who returned the questionnaire. The results for age and sex are very similar to those for participants and non-participants overall.

After adjusting for age, sex and household clustering, participants tended to report more health problems than non-participants for most variables, (but no differences were statistically significant at p = 0.05). The exceptions were: use of a walking aid which showed a non-significant effect in the opposite direction; and depression score which was unrelated to participation. Adjusting for self-reported physical activity levels strengthened the associations between poorer health and participating such that those reporting limiting longstanding illness, disability, chronic pain, chronic disease and a fall in the last year were more likely to participate.

After adjusting for age, sex and household clustering, participants reported more physical activity than non-participants for all measures and more positive attitudes towards physical activity. Apart from cycling and dog-walking, where numbers were small, these differences were all statistically significant and several showed dose-response effects. Adjusting these estimates for self-reported health strengthened these effects still further.

Analyses restricted to participants (116) and non-participants (76) who returned the postal questionnaire showed very similar findings in terms of effect estimates to those presented, based on all questionnaire completers. Although the confidence intervals were wider due to smaller numbers, several associations with participation reached statistical significance at p = 0.05 for both health, e.g. disability, adjusted OR 2.4 (05% C.I. 1.1–5.5) and physical activity variables, e.g. higher activity levels than others, adjusted OR 3.1 (95% C.I. 1.1–8.7).

Recruitment to our motion sensor activity study was 43%, higher than for physical activity intervention studies in this age group [2‐4], but lower than for surveys [1, 2]. With this recruitment level, estimation of potential non-response bias is important.

Our findings suggest two separate issues leading to potential bias. Firstly, participants were more physically active than non-participants (consistent with men being more likely to participate). This has been reported in other physical activity studies in older people [3‐5]. Secondly, participants reported more health problems than non-participants. This effect opposes the physical activity effect, and was much clearer after controlling for self-reported physical activity. At first, these findings seem counter-intuitive. Other studies in older people have reported that participants have better health than non-participants [18‐20], suggesting a "healthy volunteer" effect, although Ives et al found participants were more likely to have a disease history and use health services more [21]. However, it seems plausible that recruiting older people to studies through primary care may lead to those with increased contact with primary care (ie more illnesses) to be more likely to take part. This fits with other work showing that older primary care patients with poorer physical and psychological health and greater primary care service use were more likely to give consent for their health records to be accessed for research [22]. Unfortunately, the other primary care based studies showing differences in physical activity levels between participants and non-participants did not report on health or functional ability [3‐5].

An important weakness of our study was that self-reported health and physical activity details were only available on those non-participants who completed the questionnaire. The similarities seen in age and sex comparisons between participants and non-participants overall and in those responding to the questionnaire is reassuring and suggests that the non-participant questionnaire responders are representative of non-participants, at least in terms of age and sex, although they could still differ in other important ways (such as activity level or health) that we lack information on. The similarities found when restricting analyses to only those sent postal questionnaires, confirms that it was reasonable to include participants in the analysis who completed the questionnaire at their baseline assessment.

Physical activity studies on older people recruited from primary care settings may be biased by two opposing issues which need consideration when generalizing the results: a strong bias towards participants being more physically active, and a weaker bias towards participants having more health problems and therefore likely primary care contact. This latter bias could be used to advantage when considering interventions to increase physical activity, where those who are least active and those with more physical health problems need targeting most.