Background
Participation in physical activities is associated with an increase in quality of life [
1], enhanced academic performance [
2‐
4], a positive impact on behavior [
5‐
7], better mental health [
8], better physical health [
9,
10], and decreased obesity [
11]. Despite its benefits, an increase in physical activity is also associated with an increased injury risk. An estimated 20.6 million children are injured each year in the USA [
12], and 559,000 in Canada [
13]. Of those receiving medical attention for sports and recreation related injuries in the US, one fifth of schoolchildren and more than one quarter of working adults experience one or more days of lost time from school or work [
14]. In addition to these short-term effects, injured athletes may have an increased risk of long-term sequelae such as osteoarthritis with concomitant reduction of physical capacity [
15‐
17]. A better understanding of the causes of sport injuries and their recurrences can therefore have a significant impact on athlete health and associated care costs.
In addition to physical, equipment, or procedural causes of activity-related injuries, psychological risk factors may play an important role. Although early psychological research was often limited to theoretical tests of single variables (e.g., personality) more recent work has utilized a multi-variable stress and sport injury model [
18]. Some findings indicate the experience of stressful life events can increase injury rates [
18,
19], although its impact varies across sports [
20] and is often moderated by social support and coping styles [
20,
21]. Subsequently, other researchers amended the theory and utilized a variety of different scales to assess life events and coping, focusing on either sport or athletes [
22].
Despite this work, a literature review found only “limited scientific knowledge” [
20] while suggesting that situational-dependent emotional states can also influence injury. Although high anxiety may worsen performance and increase the risk of injury, its impact is quite variable among athletes, even among those with similar skills competing in the same event [
23,
24]. Studies based on Hanin’s Individual Zones of Optimal Functioning (IZOF) [
23] have found that 25-45% of athletes actually require high anxiety to achieve good or optimal performances, yet to date no prospective research has examined sport injury using this perspective (one study used a retrospective design [
25]).
Unpleasant moods are also associated with increased injury risk [
20,
26]. However, these authors utilized a single baseline assessment of mood, often with a considerable lag time between psychological assessment and injury. Assessment of mood at regular intervals would be far more efficacious given the dynamic nature of athletic training load, mood disturbance [
27], and overtraining syndrome [
27,
28]. Depression, irrespective of whether it is the consequence of a negative life event (e.g., divorce) or is sport related (e.g., overtraining), would be expected to compromise the ability to concentrate and focus [
29], and therefore increase injury risk [
30].
Other psychological variables associated with injury include bodily self-perceptions (e.g., fatigue) [
31], coping skills and life events [
32], again assessed with only limited longitudinal research. Fawkner and colleagues [
33] assessed daily hassles in 98 athletes weekly over a 13-week season. Injured athletes reported increased hassles in the week prior to injury compared with uninjured athletes, but the analysis grouped participants by outcome and then observed exposures without considering that both exposure and covariates varied over time, a known source of potential bias [
34,
35]. Ivarsson and colleagues conducted two studies that included assessing whether the Daily Hassles Questionnaire predicted injury in Swedish Division 4–6 (competitive) and Premier League (professional) soccer players who completed the questionnaire weekly over a three-month period [
36,
37]. Unfortunately biases may have been introduced because the analyses could not account for time-varying nature of exposure or other covariates, and did not assess any state constructs aside from the Daily Hassles Questionnaire. In a third study on elite junior soccer players [
38], the same group found differences in a trajectory analysis comparing Daily Hassles and Uplifting events among injured and non-injured subjects.
These initial studies have been informative, but there are important limitations to the methods that were used to address the role of psychological states that are believed to change frequently over time when the outcome is injury. These are explained below in more depth but in brief, analyses that compare scores for injured versus non-injured subjects address the question whether psychological factors differ between these two groups, rather than whether the varying psychological states within an individual affect injury risk. Because psychological states will correlate with psychological traits (and psychological traits are risk factors for injury), the above analyses did not address the question we are posing. If the psychological state is truly a risk factor within an individual, then psychological interventions on the day of competition would be promising to explore. Otherwise, one should focus on longer-term interventions that address the more stable psychological traits that have already been identified as risk factors (although differentiating causal from non-causal risk factors remains to be determined).
Injury research strategies to minimize bias
When time-varying exposures and covariates are considered important, one could use two general approaches to minimize bias. First, one could ask patients to recall how they felt before the injury. The control group could consist of non-injured participants at the time of injury (case–control study, where control participants are sampled at the time a case is diagnosed, and therefore can later be considered cases), or the same participants recalling their “states” a few days earlier (i.e., case-crossover study) [
35]. However, these study designs are subject to potential recall biases.
Alternatively in a prospective design one measures psychological variables regularly (e.g. daily or weekly), where the analytical approach could be a longitudinal repeated-measures design (e.g. time-series) or a nested case-crossover analysis. In this approach sample size requirements are dependent on both the frequency of injury events and the correlation of psychological states over time (higher sample sizes if states are relatively stable because there is less information on the changing exposures). However, this option involves logistical challenges associated with frequent collection of psychological data. Some psychological questionnaires may evoke scepticism among athletes, staff and coaches [
39], and there may be variations due to translation [
40], need to minimize time commitment [
40,
41], sport context, and participants’ understanding for the need to avoid response distortion (either faking good or bad) [
42]. Completing daily questionnaires may result in fatigue, with answers provided in an unvarying or random manner [
43], or drop-out. There are also challenges in managing daily data collection, and transmitting it to a central data management unit in any sport setting. Therefore, it is paramount to establish procedures and practices that facilitate these processes.
As a consequence, the primary objective of this pilot study was to test the feasibility of a prospective study specifically designed to test if psychological states are predictive of injury. More specifically, our objectives were to determine 1) time required to complete psychological questionnaires distributed at baseline (assessing traits), daily (assessing states), and once per week (assessing states including an additional questionnaire to assess mood); 2) optimal distributing and collecting of questionnaires to be completed daily or once per week; 3) questionnaire comprehension and acceptability and; 4) intra-individual correlation for daily psychological states necessary for sample size calculations in a larger longitudinal repeated-measures investigation.
The study population were artists from the show “O” produced by Cirque du Soleil (CDS). These artists come from a variety of athletic backgrounds including swimming, diving, gymnastics and acrosport, as well as performing arts including dancers and musicians. We chose this population because injury records and exposures are stored electronically, and conducting the study appeared feasible. Overall injury rates have been estimated to be 9.7 injuries per 1000 artist-exposures (similar to Men’s NCAA Basketball [
44]), with 4.4% of injuries resulting in missing 15 or more performances (approximately equivalent to 10 days) [
45]. We therefore expect these results to be useful in other athletic contexts involving regular psychological assessments for an extended period.
Methods
Preliminary study development
The McGill University Institutional Review Board approved this pilot study. The questionnaires could only cover a limited number of constructs because participants were required to complete them daily. To determine which constructs we should investigate in our context (see Table
1), we used an iterative process. We first individually interviewed CDS personnel that were familiar with circus-related injuries: Director of Performance Medicine responsible for shows that change location, Director of Performance Medicine responsible for shows that don’t change location, the head coach, a choreographer, a supervising physiotherapist for one show, and the Senior Performance Psychologist. Following these meetings, we outlined areas of interest, their potential mechanisms of action, and identified corresponding psychological constructs. These variables and constructs were later verified with the same CDS personnel.
Table 1
Constructs and associated questionnaires used to measure traits and states
Traits
|
Anxiety | STAI-Y2 [ 46]: A validated 20-item questionnaire. | Baseline |
STAI-Y1 Best [ 40]: A validated 20-item questionnaire measuring state anxiety relative to the time the artist had their best performance. |
Ability to cope, Frustration | Ways of Coping [ 47]: A validated 66-item questionnaire to identify the thoughts and acts used to cope in a specific stressful event. There are eight sub-scales in the student-sample scoring we used (problem focused, wishful thinking, detachment, seek social support, focusing on the positive, self blame, tension reduction and keeping to oneself). We chose the student sample scoring system because we felt that the problems associated with a production company environment (e.g. changeover of personnel, deadlines, new training) are more closely related to what students experience compared to a sample of stable community workers. | Baseline |
Complainers, Unhappiness | Profile of Mood States (POMS) [ 48]: A validated 65-item questionnaire that includes subscales for tension, depression, anger, vigour, fatigue and confusion. There is considerable evidence that this global measure of mood disturbance is closely associated with the stress of athletic training [ 49] as well as relative success in athletics and other realms of performance with a significant physical component [ 30]. | Baseline |
States
|
Conflicts, Anger, Frustration | Training Distress Scale [ 41]: A validated 7-item 5-point Likert scale questionnaire assessing specific and general mood states. Items generally come from the Profile of Mood States [ 48] Other items related to the construct of anger/frustration (identified by CDS management identified as potentially important) include “bad-tempered” and “peeved”. | Weekly |
Anxiety | STAI-Y1 [ 50]: A validated 20-item questionnaire measuring state anxiety. | Weekly |
Anxiety | Single-item Likert question [ 51]. | Daily |
Self-Confidence | Single-item 7-point Likert question [ 52]: This question examines an artist’s confidence about their upcoming performances that day. Variations of this single item are considered valid alternatives to more time consuming assessments of self-confidence [ 53], and are associated with anxiety and performance [ 52]. | Daily |
Poor sleep | Single-item Likert question [ 49]. | Daily |
Physical capacity | Fatigue: We used a 1-item validated question [ 54]. | Daily |
General well-being: We used a 7-item Likert scale question (from Very very good to Very very bad) [ 49]. |
Sleep: 1-item questionnaire about the amount and quality of sleep [ 49]. |
Sickness within the last 24 hours. |
Muscle soreness: 7-item Likert scale questions from Very Very Good to Very Very Sore [ 42, 49] for whole body, legs and arms. The responses to these items have been found to be correlated to both more comprehensive psychological questionnaires [ 49], biological markers of stress such as cortisol [ 42] and objective measures of athletic performance [ 55]. |
Table
1 illustrates the constructs identified as most likely to be important through the interviews with CDS personnel and a review of the literature, questionnaires chosen from the literature where they existed, and timing/frequency for questionnaire distribution. The constructs included trait and state anxiety, trait ability to cope, trait and state mood, and state confidence, where traits were measured at baseline and states were measured daily. We also included questions related to several state behavioural habits believed to influence injury risk. Our objective was to have artists complete the baseline questionnaires within 15 min, weekly questionnaires within 2 min and daily questionnaires within 1 min. Details of the specific questionnaires are described below.
Recruitment
Approximately one month prior to the study, we approached all CDS artists ≥ 18 years of age working at the show “O” located in Las Vegas, Nevada. During a regular weekly meeting, we gave a brief 10-min presentation explaining the general principles of the study, and distributed consent forms. We emphasized that we could prepare reports for each individual showing how their daily profiles changed over time. In addition, because artists often rely on each other (e.g. catcher and flyer in a trapeze act), we emphasized that the information may be important to the team, even if the individual did not feel it was personally important (which would be analogous in some team sport contexts). Artists were asked to submit signed consent forms within one week if they were interested in participating.
Questionnaire timing and processes
We provided the questionnaires in the four principal languages of the artists: English, French, Japanese and Russian. We used existing translations where available, and used the professional CDS translation service when necessary. At least one artist with conversational English language skills and whose first language was the translated language reviewed all translated questionnaires. Although we recognize that cultural differences exist between populations using these languages that might increase the heterogeneity of responses between participants, this should not affect our ability to reach our primary objectives of determining feasibility, and variance estimates for sample size calculations of a definitive study.
After discussions with the stage manager and artistic directors, baseline questionnaires including State-Trait Anxiety Inventory (STAI) [
50], Ways of Coping [
40,
47] and Profile of Mood States (POMS) [
48] were distributed at the time the artist provided informed consent, and were completed at home over the ensuing 2–4 weeks. On each working day, we placed a short “states” questionnaire (see Additional file
1) that included either 7 or 9 items (i.e. 2 additional questions included on the “weekly” questionnaire) at each artist’s make-up station (each had their own station). The items included in these questionnaires came from validated questionnaires where possible and included the constructs conflicts, anxiety, self-confidence, sleep and physical capacity (Table
1). Artists completed the questionnaire prior to the day’s performances, and dropped them into a locked drop-box or handed them to the supervising therapist. To minimize missing data, distributed questionnaires included the date and the artist’s identification number. Completed forms were scanned and emailed to the primary investigator for data entry.
Artists were encouraged to provide feedback throughout the study, with special reference to the time required to complete questionnaires, undesirable questions, logistical problems, workload, and possible duration for a definitive study.
Injury and exposure data
To track injury and exposure data, we used the same methods as our previous studies [
45]. In brief, CDS therapists use electronic charting for all injuries and treatments (provided free of charge to artists) through in-house injury tracking software. We classified injuries according to commonly used criteria in the sport injury literature [
56‐
58] and we have used in the past with the same company [
45] and are common in sport medicine epidemiology: Medical Attention (injury reported to a show therapist) and Time-Loss-1 (TL-1) if the injury resulted in at least one missed performance. Anytime an artist misses a performance, it must be documented as either a work-related injury (included in our analyses and for which the artist is covered by health insurance), or a personal health condition (excluded from our analyses). Exposure data were obtained from in-house software that keeps track of when artists are performing.
Analyses
As a pilot study designed primarily to assess feasibility, we provide descriptive statistics only. For continuous variables, we report the median and interquartile region (IQR) because the data were skewed, and we report percent for categorical variables. In addition, we report the direct feedback elicited during weekly meetings. Our sample size was determined by the number of artists within the show and was not modifiable. For practical considerations due to vacation time, we used an 8-week period that began one week after a vacation and ended within two weeks of the next vacation.
To calculate sample sizes for the definitive study, we used linear mixed models and generalized estimating equations (GEE) to account for the intra-participant correlations for the psychological variables over days (stability of states across time), and took a precision-based approach for the estimate via simulations based on psychological daily data that corresponded to our observed data. The observed injury rates (shown in results) were much less than previous studies in the general CDS population. Given the short time frame of the pilot study, we felt the results from our previous study would provide a more reliable estimate. We estimated a baseline TL-1 injury rate of 1.6 injuries per 1000 artist-exposures for the company [
45], and a minimal important difference (MID) of 25% (i.e. 1.2 injuries per 1000 artist-exposures). We calculated sample sizes based on at least a 2-category change in an ordinal scale (all daily questions used essentially ordinal data). We varied the number of artists (between 180–1000) and the number of observation days (40–250) to explore different assumptions (always setting alpha to 0.05, 2-sided). All simulations and calculations were conducted in the open-software R [
59] with the lme4 [
60] and geepack [
61] libraries. In addition, we estimated sample size for a case-crossover study using a matched case–control design using free open source statistical software [
62] and the following parameter values: 2-sided alpha = 0.05, power = 0.8, 10:1 ratio of controls to cases, risk of exposure (categorized dichotomously) in controls at 0.3, and an MID of 25% and 50% increased risk of exposure in cases.
Results
Of the 82 artists approached, 42 initially expressed interest. However, three declined after receiving the baseline questionnaires, and two took personal leave of absences before the study began, leaving 16 females and 21 males recruited for the study (45.1% recruitment). Artists’ region of origin included Canada, United States, Australia, Europe, Russia, and Asia. One of our four translations represented the first language of the artist in 31/37 artists, second language in 5/37 artists, and third language in 1/37. The median age was 32.4 (IQR: 29.2 to 37.9). We received feedback evaluations from 31/37 participating artists. The mean values for the baseline psychological questionnaires are provided in Table
2 for the 33 participants where there were no missing answers.
Table 2
Mean (sd) for each of the psychological questionnaires administered at baseline*
STAI-Y1 | | 37.5 (12.4) |
STAI-Y1 (Best) | | 31.6 (10.2) |
STAI-Y2 | | 38.8 (10.8) |
POMS | Tension-Anxiety | 14.7 (6.6) |
Depression-Dejection | 7.9 (9.1) |
Anger-Hostility | 8.8 (7.9) |
Vigor | 20.0 (5.4) |
Fatigue | 9.1 (5.7) |
Confusion-Bewilderment | 12.2 (4.4) |
Ways of coping | Problem focused | 20.2 (5.2) |
Wishful thinking | 7.1 (3.7) |
Detachment | 8.3 (3.8) |
Seek social support | 10.9 (4.7) |
Focusing on the positive | 7.9 (2.6) |
Self blame | 4.7 (2.1) |
Tension reduction | 3.6 (1.5) |
Keep to self | 3.9 (1.8) |
Distributing and collecting questionnaires
To facilitate the process, identification numbers on questionnaires were numbered in the same order as the participating artists’ make-up tables, but were not sequential (i.e. two proximal artists might be 63 and 66) in order to enhance confidentiality. Distributing the questionnaires required ~10 min and was usually done ~2 hours before the night’s first performance. In general, feedback from the artists suggested the ability to simply drop completed questionnaires in a locked box located near the door was well received.
Time to complete questionnaires
The baseline questionnaire was completed in the targeted time (<15 min) by more than 60% of artists but required more than 30 min by two artists. We expected the weekly questionnaire to be completed in <2 min and the daily questionnaire to be completed in <1 min, but ~20% of artists required more time. That said, 45-50% of the artists required less than half the expected time. When we cross-correlated the results from the different questionnaires, the two participants requiring >30 min for the baseline questionnaire were not the same participants requiring longer periods for the weekly or daily questionnaires. Of the seven participants requiring >2 min for the weekly questionnaire, the time required for the daily questionnaire was <30 s for two artists, between 31–120 s for three artists, and >2 min for two artists.
Acceptability and comprehension of the questionnaires
There were no questions that artists felt should not be asked. No artist felt the workload onerous, but a couple of artists felt it was bothersome to answer the same questions daily. Of the 26 participants who answered how much longer they would be willing to continue completing the questionnaires if the study was repeated, five responded as long as needed, five responded ~2-3 months, two responded one month, two simply said they would continue for now, three were unsure and nine said they would no longer continue.
Based on artist feedback, we made important changes to the text and format of the daily questionnaire within the first couple of weeks (see Additional file
1). The original versions of questions 5 and 6 were re-worded to clearly indicate they referred to the upcoming performance not yet done. We also added “current role” to question 6 to clearly indicate we were interested in the optimal level of anxiety relevant to their current role at CDS.
Despite our encouragement for feedback, the first question of the daily questionnaire (overall well-being, “How do you feel today?” with 7-point Likert response from Very very good to Very very bad) was left unanswered on 68/1297 collected questionnaires; several artists provided feedback saying it was difficult to give an “overall” assessment. The question regarding sleeping was left unanswered 42/1297 times, likely due to questionnaire formatting because we did not receive any comments. We believe adding a dotted line from the question to the answer choices might draw the artists’ eyes to the question-answer group.
Injuries during pilot study
Over 2660 artist-performances, there were a total of nine Medical Attention injuries (3.4 injuries per 1000 artist-performances) and three TL-1 injuries 1.1 TL-1 injuries per 1000 artist-performances.
Sample size calculations
Intra-participant correlations were higher than expected, and three artists had no variability within the study for some psychological factors. With the low TL-1 injury rate and low variability, sample size calculations for both the linear mixed and GEE models were very high, with the linear mixed model predictably showing slightly less power than the GEE results. For example, using 180 artists measured over 100 days would provide only 13% power under a GEE model. Increasing the number of artists to 1000 only increases power to 30%. Increasing the number of days of observation increases power as well, but following 750 artists for 250 days yields only 30% power, and following 1000 artists for 250 days yields only 61% power.
Based on these results, we consider it infeasible to reliably follow participants daily for so long. Therefore, we also calculated the sample size for a case-crossover study where we would measure artists only once or twice per week, and then again post-injury. Based on the parameters discussed in the methods, and the estimated intra-participant correlations ranging from 0.16 to 0.58 for the different variables measured (Table
3), we would need between 828 and 1301 cases (injuries) if the MID is 25% increased risk. The number of artist-performances needed to occur is equal to the required number of cases divided by the injury rate per 1000 artist exposures. With an expected TL-1 injury rate of ~1.5 per 1000 performances one would need to follow between 550,000 (for “ill past 24 hours”) to 870,000 artist-performances (for “confidence”). With recruitment similar to our pilot study of 35 artists per show on six shows (210 artists) and assuming an average of 470 performances per year, we would need to follow the artists between 67–105 months. If the MID is 50% increased risk, the number of cases and artist-exposures is greatly decreased (to ~30% of the above values), but we would still need to follow artists for 20–32 months.
Table 3
Estimated Intra-class correlations (ICC)
1
and calculated sample sizes
2
for variables measured daily over the entire study
Feeling today | 0.35 | 950 |
Hours slept | 0.34 | 941 |
Ill past 24 hours | 0.16 | 828 |
Whole body soreness | 0.41 | 1011 |
Art soreness | 0.46 | 1075 |
Leg soreness | 0.40 | 1000 |
Confidence | 0.58 | 1301 |
Anxiety | 0.56 | 1254 |
Fatigue | 0.32 | 924 |
If instead one were interested in medical attention injuries, the estimated injury rate from previous studies is ~10 per 1000 performances. In this context, we would need to follow 210 artists for ~10-16 months (82,800 to 130,1000 artist performances) for an increased risk of 25%, but only ~ 3–5 months (24,200 to 38,900 artist performances) for an increased risk of 50%. Increasing the number of artists through improved recruitment per show, or by including additional shows would further decrease the amount of time required to complete the study.
Competing interests
This study did not receive any funding. Ian Shrier is funded by the Lady Davis Institute for Medical Research, Jewish General Hospital. Ian Shrier is Consulting Medical Director for Cirque du Soleil. He did not receive any funding or payment for work related to this study. Janette Powell is a supervising physiotherapist at the Cirque du Soleil show “O”. No other authors have any other professional relationships.
Authors’ contributions
IS conceived the study, and was involved with data collection, analysis and writing the manuscript. JSR was involved in the study design and writing the manuscript. EBL and MAM helped conceive the study, guide the analyses, and participated in writing the manuscript. RJS was involved in the study design, supervised the analyses and participated in writing the manuscript. JP was involved in the study design, data collection and in writing the manuscript. All authors read and approved the final manuscript.