Study design
This is an uncontrolled before-after study performed at two surgical wards. First, the JH-HLM scale was implemented at both surgical wards between March and June 2018, after which the JH-HLM scale was used during routine clinical care from July 2018 until January 2019. Second, the JH-HLM was extended into the AMEXO scale where after the AMEXO scale was implemented in routine care between February 2019 and June 2019 to assess mobilization and set daily mobilization goals during routine care instead of the JH-HLM scale. Data were extracted from the electronic medical records in January 2019 (before extending the JH-HLM into the AMEXO scale) and January 2020 (after extending the JH-HLM into the AMEXO scale) to quantify and compare both tools when used to assess mobilization in gastrointestinal surgical patients.
This study has been conducted according to the principles of the Declaration of Helsinki. The Medical Ethical Review Committee of the Amsterdam UMC, location Academic Medical Center, assessed and approved this study (reference number W19_034 # 19.053). As the dataset was supplied by the medical center and included only de-identified (anonymous) data; the Medical Ethical Review Committee waived the need for individual informed consents. The study was reported following the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for cohort studies [
16].
Study population
All adult patients who were admitted to one of the two surgical wards between July and December 2018 (before) or July and December 2019 (after extending the JH-HLM into the AMEXO scale), underwent gastrointestinal and oncological surgery and had a JH-HLM or AMEXO score on the first postoperative day were included. Moreover, every patient was only included once, meaning that all subsequent hospital admissions were excluded from the analysis.
JH-HLM and AMEXO mobility scales
The JH-HLM scale is a 1-item ordinal scale with eight response categories and is used by healthcare professionals to assess mobilization, set mobilization goals and discuss mobilization success during inter-professional meetings [
13]. Each category is numbered consecutively from 1 = lying passively in bed to 8 = walking approximately 250 ft or more [
13]. Initially, the JH-HLM scale has been developed to assist healthcare professionals caring for hospitalized general medicine patients [
12]; however, the JH-HLM scale has also been used more recently in hospitalized adults at acute care units[
17], hospitalized geriatric patients[
18], hospitalized adults at a neuroscience/brain rescue unit[
19,
20], surgical unit[
21] or intensive care unit[
22]. Using a convenience sample of hospitalized adults, Hoyer et al. showed that the test–retest reliability values for physical therapists and nurses (Intraclass Correlation Coefficients 0.94 and 0.95, respectively) and interrater reliability values between physical therapists and nurses (Intraclass Correlation Coefficient 0.99) were excellent [
13]. Furthermore, the Standard Error of Measurement was 0.2, the Minimal Detectable Change (MDC
95) was 0.6, and evidence was provided that the JH-HLM measured constructs of the ICF domain ‘mobility’ [
13,
23]. To ensure clarity and ease of use for patients and healthcare professionals in our hospital, 25 and 250 ft was rounded to 7.5 and 75 m, respectively, instead of 7.62 and 76.2.
At first, the JH-HLM was implemented at our hospital and we placed meter markings on the walls to facilitate healthcare professionals in estimating the achieved JH-HLM score and in setting mobilization goals together with hospitalized adult patients. The highest JH-HLM score (i.e., 8 = 250 ft) represents a functional household ambulation distance and is estimated as 4 metabolic equivalents [
12]. In three team discussions in January 2019, a multidisciplinary team involving surgeons, physicians, nurses, physical therapists and researchers evaluated the distribution of JH-HLM scores and extended it into the new AMEXO scale using additional response categories. These additional response categories had to present an incremental increase in mobilization, taking highest possible JH-HLM score as the starting point and a walking distance of approximately 1 km as the ceiling. The goal of 1 km after gastrointestinal and oncological surgery was based on our clinical observations and our previous experience of what is achievable after gastrointestinal and oncological surgery [
24]. Walking seemed the most appropriate activity to increase mobilization given the context. Other conditions that the new response categories had to meet were that they should be easy to understand for patients and could be easily assessed by healthcare professionals. In between team discussions the additional response categories were pilot tested by a varying composition of nurses, physical therapists and patients to ensure clarity, face validity, and ease of use.
In summary, the AMEXO scale is an extended version of the JH-HLM scale, in which four additional categories (category 9–12) have been added on top of the already existing eight ordinal response categories. Each of the four additional categories presents an incremental increase in mobilization using the highest possible JH-HLM score (i.e., 8 = 250 ft) as a starting point (Additional file
1). This resulted in the following response categories: 9 = 750 ft/225 m (i.e., + 2 times highest possible JH-HLM), 10 = 1500 ft/450 m (i.e., + 3 times highest possible JH-HLM), 11 = 2500 ft/750 m (i.e., + 4 times highest possible JH-HLM) and 12 = 3750 ft/1125 m (i.e., + 5 times highest possible JH-HLM). Using this incremental approach, only four additional response categories were needed to achieve the distance of at least 1 km. Also, each response category could be calculated back to JH-HLM score = 8, providing patients and healthcare professionals with a reference standard to determine the achieved AMEXO score and set mobilization goals together. The AMEXO scale was implemented at the start of February 2019 to replace the JH-HLM in facilitating healthcare professionals in assessing mobilization, setting mobilization goals and discussing mobilization success during inter-professional meetings.
Ceiling effect
Based on previous research, a ceiling effect was considered to be present if more than 15% of patients achieved the highest possible score [
25]. The presence of a ceiling effect when using the JH-HLM and AMEXO scales to assess mobilization was therefore determined by evaluating the percentage of patients with the highest possible mobility score on the first postoperative day before (i.e., JH-HLM score = 8) and after extending the JH-HLM into the AMEXO scale (i.e., AMEXO score = 12). Moreover, the presence of a ceiling effect was also determined by evaluating the percentage of patients with the highest possible mobility score on each of the first three postoperative days. Because a ceiling effect might also affect the responsiveness of the measurement tool[
25], the percentage of patients who showed a change in mobility score during the first three postoperative days before and after was evaluated. A change was defined as a difference in mobility score of at least one point during one of the first three postoperative days. Whether this may have been related to the four additional response categories 9 to 12 was evaluated by assessing the number of patients that showed both a change in mobility score and scored 9 to 12 using the AMEXO scale during one of the first three postoperative days.
Procedures
Routine care data registration procedures before and after were the same. All mobility scores were based on a patient’s mobilization (i.e., what a patient has actually done) over a fixed observation period (e.g. nurse shifts or physical therapist session) [
13]. Nurses were instructed to document the mobilization, at the end of each day and evening shift, using the mobility scale implemented at that time. The highest level of mobilization that the nurse observed during her shift was documented in the patient’s electronic medical record and used to set mobilization goals and discuss mobilization success inter-professionally and with the patient [
17]. All patients who were admitted to one of the surgical wards received a leaflet with information about the JH-HLM scale or AMEXO scale. Additionally, patients were informed by the nurses on the use of mobility scale and were asked to keep track of their mobility scores in addition to the health care professionals. In correspondence with the study performed by Hoyer et al. [
12], the JH-HLM and AMEXO scale were used by nurses, physicians, and physical therapists to discuss mobilization success, barriers to mobilizing patients, set mobilization goals and facilitate discharge planning in routine clinical care.
The following patient characteristics were collected: age, sex, surgical area, acute admission and hospital length of stay. Furthermore, the Katz Activities of Daily Living (Katz-ADL) score[
26] and the John Hopkins Fall Risk Assessment Tool (JHFRAT)[
27] were collected and used to provide insight into the independence in physical functioning.
Data analysis
All analysis were conducted using IBM-SPSS Statistics version 26 (IBM Corp, Armonk, New York) and R (R core team, Vienna, Austria). A two-tailed p-value of 0.05 was considered statistically significant. Normality of data was evaluated by visually inspecting continuous and ordinal data using Q-Q plots. Patient characteristics were described descriptively and differences in patient characteristics before-after extending the JH-HLM into the AMEXO scale were assessed using independent t-tests, Mann–Whitney U tests or Fisher’s Exact tests, depending on normality and type of data. Due to low number of patients having Katz-ADL score 1 to 6, we recoded this variable to a binary variable (i.e., number of patients scoring 1 to 6 vs number of patients scoring 0).
Due to the fact that > 15% of the mobility scores on the second and third postoperative days were missing a multiple-imputation model with 10 imputed sets was applied to both variables and pooled using Rubin’s rules [
28,
29]. Missing data were imputed using all patient characteristics, the mobility score of the first postoperative day, and if available, mobility scores of the second or third postoperative day. Because of the non-normal distribution of missing data predictive mean matching was used [
28]. Evaluation of the ceiling effect was performed on both the dataset before imputation as well as after imputation; results were presented separately.
Only the highest mobility score on each postoperative day was used for analysis, as has been in previous studies using the JH-HLM scale to assess mobilization [
17]. First, the percentage of patients scoring the highest possible mobility score on the first three postoperative days and the percentage of patients who showed a change in mobility score during the first three postoperative days were analyzed descriptively. Univariable and multivariable logistic regression analyses with backward selection were used to assess the before-after differences with respect to (1) the percentage of patients scoring the highest possible mobility score on the first postoperative day, (2) the percentage of patients scoring the highest possible mobility score during one of the first three postoperative days, and (3) the percentage of patients who showed a change in mobility score during the first three postoperative days. Odds-ratio’s (ORs) and their associated 95% confidence intervals (CIs) were calculated to describe the before-after differences. Patient characteristics that differed significantly before-after extending the JH-HLM into the AMEXO scale were considered as covariates.