Skip to main content
Erschienen in: Trials 1/2020

Open Access 01.12.2020 | Study protocol

Pragmatic cluster randomized trial to evaluate effectiveness and implementation of enhanced EHR-facilitated cancer symptom control (E2C2)

verfasst von: Lila J. Finney Rutten, Kathryn J. Ruddy, Linda L. Chlan, Joan M. Griffin, Jeph Herrin, Aaron L. Leppin, Deirdre R. Pachman, Jennifer L. Ridgeway, Parvez A. Rahman, Curtis B. Storlie, Patrick M. Wilson, Andrea L. Cheville

Erschienen in: Trials | Ausgabe 1/2020

insite
INHALT
download
DOWNLOAD
print
DRUCKEN
insite
SUCHEN

Abstract

Background

The prevalence of inadequate symptom control among cancer patients is quite high despite the availability of definitive care guidelines and accurate and efficient assessment tools.

Methods

We will conduct a hybrid type 2 stepped wedge pragmatic cluster randomized clinical trial to evaluate a guideline-informed enhanced, electronic health record (EHR)-facilitated cancer symptom control (E2C2) care model. Teams of clinicians at five hospitals that care for patients with various cancers will be randomly assigned in steps to the E2C2 intervention. The E2C2 intervention will have two levels of care: level 1 will offer low-touch, automated self-management support for patients reporting moderate sleep disturbance, pain, anxiety, depression, and energy deficit symptoms or limitations in physical function (or both). Level 2 will offer nurse-managed collaborative care for patients reporting more intense (severe) symptoms or functional limitations (or both). By surveying and interviewing clinical staff, we will also evaluate whether the use of a multifaceted, evidence-based implementation strategy to support adoption and use of the E2C2 technologies improves patient and clinical outcomes. Finally, we will conduct a mixed methods evaluation to identify disparities in the adoption and implementation of the E2C2 intervention among elderly and rural-dwelling patients with cancer.

Discussion

The E2C2 intervention offers a pragmatic, scalable approach to delivering guideline-based symptom and function management for cancer patients. Since discrete EHR-imbedded algorithms drive defining aspects of the intervention, the approach can be efficiently disseminated and updated by specifying and modifying these centralized EHR algorithms.

Trial registration

ClinicalTrials.gov, NCT03892967. Registered on 25 March 2019.
Begleitmaterial
Hinweise

Supplementary information

Supplementary information accompanies this paper at https://​doi.​org/​10.​1186/​s13063-020-04335-w.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
AIM
Acceptability of Intervention Measure
CAT
Computer adaptive test
ED
Emergency department
EHR
Electronic health record
ePRO
Electronic patient-reported outcome
E2C2
Enhanced, electronic health record–facilitated cancer symptom control
FIM
Feasibility of Intervention Measure
IAM
Intervention Appropriateness Measure
IMPACT
Improving the Management of Symptoms During and Following Cancer Treatment
IRB
Institutional Review Board
IRT
Item response theory
MCHS
Mayo Clinic Health System
MCR
Mayo Clinic in Rochester, Minnesota
NCI
National Cancer Institute
NPI
National Provider Identifier
NRS
Numerical rating scale
PROMIS
Patient-Reported Outcomes Measurement Information System
RE-AIM
Reach, Effectiveness, Adoption, Implementation, and Maintenance
RN
Registered nurse
SCM
Symptom care manager
SPADE
Sleep disturbance, pain, anxiety, depression, and energy deficit

Administrative information

Note: the numbers in curly brackets in this protocol refer to SPIRIT checklist item numbers. The order of the items has been modified to group similar items (see http://​www.​equator-network.​org/​reporting-guidelines/​spirit-2013-statement-defining-standard-protocol-items-for-clinical-trials/​).
Title {1}
Pragmatic Cluster Randomized Trial to Evaluate Effectiveness and Implementation of Enhanced EHR-Facilitated Cancer Symptom Control (E2C2)
Trial registration {2a and 2b}.
Trial Registration: NCT03892967 (ClinicalTrials.gov)
Protocol Version 1.0, June 3, 2019.
Registered at clinicaltrials.gov.
Protocol version {3}
Protocol Version 1.0, June 3, 2019
Funding {4}
This research is supported by the National Cancer Institute of the National Institutes of Health (telephone 1–800–422-6237; award No. UM1 CA 233033).]
Author details {5a}
Department of Health Sciences Research (Drs Rutten, Griffin, and Storlie, and Mr. Wilson), Division of Medical Oncology (Dr Ruddy), Department of Nursing (Dr Chlan), Knowledge and Evaluation Research Unit (Dr Leppin), Division of Community Palliative Medicine (Drs Pachman and Cheville), and the Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery (Drs Rutten, Griffin, Ridgeway, and Cheville, and Mr. Rahman), Mayo Clinic, Rochester, Minnesota, and Yale University School of Medicine (Dr Herrin), New Haven, Connecticut.
Name and contact information for the trial sponsor {5b}
This research is supported by the National Cancer Institute of the National Institutes of Health (telephone 1-800-422-6237; award No. UM1 CA 233033)
Role of sponsor {5c}
The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health

Introduction

Background and rationale {6a}

Cancer and cancer therapy are associated with severe, disabling symptoms that have been causally linked to diminished survival, increased use of healthcare, reduced quality of life, unemployment, and non-adherence to recommended cancer treatments. The prevalence of inadequate management of symptoms has been reported to be as high as 90% [1], despite the availability of definitive evidence-based care guidelines and accurate and efficient assessment instruments, and is especially high among elderly patients and patients in rural areas. This disjuncture is needless because most symptoms can be mitigated [2, 3]. In response to this critical need, the National Cancer Institute (NCI) developed a funding opportunity announcement (No. RFA-CA-19-035) associated with the Beau Biden Cancer Moonshot Initiative to encourage research on implementation and evaluation of symptom monitoring and management systems for patients with cancer and survivors.
Patient-reported measures of symptom presence and severity are available, but meta-analyses and high-quality trials have failed to show that solely providing clinicians with such scores improves symptom management and associated outcomes [47]. Symptoms are challenging to manage. Successful management often requires diligent monitoring; multimodal care plans spanning behavioral, pharmacologic, and rehabilitative domains; and ongoing adjustment. These demands are particularly salient for the five most prevalent and destructive symptoms: sleep disturbance, pain, anxiety, depression, and energy deficit (fatigue) (SPADE). Emerging research demonstrates the substantial co-occurrence of cancer-related symptoms and, consequently, the artificiality of evaluating and treating symptoms in isolation [815]. Although guidelines exist for each symptom class, their enactment by disease-focused clinicians, who may lack both the training and the time necessary to coordinate symptom treatments, has proved infeasible. A more integrated approach would seek to manage commonly clustered symptoms (e.g. the SPADE pentad) in an integrated or sequenced manner [8, 10, 11, 13, 1621].
Collaborative care approaches have proved difficult to implement at scale, yet recent advances in information technology permit their core components to be embedded in the generation of electronic health records (EHRs). This includes capabilities to leverage the EHR for remote and point-of-care electronic patient-reported outcomes (ePROs). EHR-driven approaches that include patient-care strategies with aligned symptom-specific goals, support for self-management training, and decision support for medication changes have considerable potential to improve the management of symptoms in patients with cancer [2235]. Here we describe a randomized study to assess such an EHR-driven approach.

Objectives {7}

Our institution is one of three research centers funded by the NCI as part of the Improving the Management of Symptoms During and Following Cancer Treatment (IMPACT) consortium [36]. The consortium consists of three research centers and a coordinating center that lends operational and scientific support to coordinate research activities across the consortium. We will evaluate a guideline-informed, enhanced, EHR-facilitated cancer symptom control (E2C2) system that uses two empirically supported levels of stepped care: level 1 provides low-touch, automated, self-management support for patients reporting moderate SPADE symptoms or limitations in physical function (or both). Level 2 provides nurse-managed collaborative care for patients reporting more intense (severe) symptoms or functional limitations (or both). We will conduct a hybrid type 2 stepped wedge pragmatic cluster randomized clinical trial among teams of clinicians who care for patients with solid tumors across all phases of cancer care in community care settings and clinics within an academic medical center [37]. Patients with hematologic malignancies will also be included in community practices.
The E2C2 intervention uses critical insights from the current evidence base to overcome barriers that have limited previous attempts to develop scalable, pragmatic approaches to symptom monitoring and management [4, 27, 3853]. Specifically, E2C2 proposes to overcome historic challenges through three validated strategies that capitalize on increased EHR penetration and capabilities:
1.
EHR-imbedded algorithms will deliver validated symptom-matched, self-management education at the point of symptom reporting for patients with moderate symptoms (level 1). This will enable registered nurse (RN) symptom care managers (SCMs) to focus their collaborative care efforts on patients with severe symptoms (level 2).
 
2.
EHR clinical decision support tools that have been proved to improve the frequency of evidence-based care in other contexts [54, 55] will be used to enable oncologic clinicians to initiate needs-matched and validated symptom management approaches.
 
3.
E2C2 will train and deploy designated RN SCMs in an EHR-based collaborative care environment. Cultivation of dedicated niche practitioners to achieve economies of scale has proved effective in both primary care and specialty care [56].
 
We will assess the impact of the E2C2 intervention on patient-reported symptoms and experience, use of the intervention, and experience of the care team over time through pursuit of the following aims:

Aim 1

To conduct a cluster randomized pragmatic trial with a stepped wedge design to test the hypothesis that a symptom-control–focused, collaborative-care–based E2C2 intervention will significantly reduce SPADE symptoms and improve physical function scores, reduce unplanned hospitalizations and visits to the emergency department (ED), improve adherence to cancer therapies, enhance quality of life, and extend survival.

Aim 2

To evaluate the hypothesis that use of a multifaceted, evidence-based implementation strategy to support adoption and use of the E2C2 technologies will improve patient and clinical outcomes.

Aim 3

To conduct a mixed methods evaluation to detect and identify disparities in the adoption and implementation of the E2C2 intervention among elderly and rural-dwelling patients with cancer, two groups that have had disproportionately more cancer symptoms and worse outcomes.
Successful completion of this trial will provide evidence for the impact of the E2C2 intervention on the management of SPADE symptoms and functional limitations and for various additional outcomes, including use of healthcare, adherence to cancer treatment, and survival.

Trial design {8}

E2C2 will be evaluated through a pragmatic cluster randomized stepped wedge trial in which clinics and disease-specific teams are randomized in multiple steps. All patients receiving care for solid tumors in the Cancer Center at Mayo Clinic in Rochester, Minnesota (MCR) will be included in the study sample irrespective of type or stage of cancer. A similar sample will include patients receiving care from Mayo Clinic Health System (MCHS) community clinics in Minnesota and Wisconsin for solid tumors and for hematologic malignancies. The trial’s stepped wedge design randomizes the order of E2C2 implementation among 15 clusters. Clusters are defined at the level of the cancer-care team or clinic and are randomly assigned to one of five tranches to receive the implementation at staggered intervals. This design will allow data to be collected sequentially from all clusters for a minimum of 6 months of usual care before E2C2 and a minimum of 8 months during the implementation phase.
The intervention will begin according to assessments completed by patients for symptoms (SPADE) and physical function (ePRO). SPADE symptom scores from these assessments will be transformed into a graphic and narrative presentation for patients and clinicians that will include tools and clinical support for SPADE symptom management. To promote clinicians’ use of the EHR-based tools that support the intervention, we will apply validated implementation strategies, including practice alerts, audit and feedback, and practice facilitation.
The primary outcome for our trial is average SPADE symptom scores and physical function scores derived from patient-reported ePROs before medical oncology clinic appointments. The primary analysis will test whether any SPADE scores significantly improved after introduction of the intervention. Process measures will reflect stakeholders’ use of the EHR graphic and clinical decision support tools and will be abstracted from the EHR. In parallel with conduct of the E2C2 hybrid type 2 trial, mixed methods will be used to comprehensively assess engagement, system utility, and barriers and facilitators to implementation among key stakeholders and E2C2 users, including providers and patients. Specifically, we will assess the impact of implementation strategies (practice alerts, audit and feedback, and practice facilitation) on key study outcomes, including SPADE symptom scores and functional status. We will also use mixed methods to identify disparities in the adoption and implementation of the E2C2 intervention among elderly and rural-dwelling patients with cancer.

Methods: participants, interventions, and outcomes

Study setting {9}

The present study will be performed at MCHS sites in Minnesota and Wisconsin and at MCR. These practices provide cancer care to > 70,000 patients each year, 15,000 of whom have newly diagnosed cancers (approximately 10,000 of which are solid tumors) and hundreds of which are patients who have hematologic malignancy and receive care at MCHS sites, which serve 70 local communities in predominantly rural areas of Minnesota and Wisconsin. Figure 1 illustrates the locations of the participating sites; a complete list of sites is available from the corresponding author upon request.
MCR will be the primary research site. The patient populations served at MCHS sites tend to be older and more economically disadvantaged than those at MCR. Among the roughly 2500 patients who receive new cancer diagnoses annually and are treated in Mayo Clinic practices, 50% are rurally situated, 50% are elderly, and 18% are covered by Medicaid, which is comparable to the population of the upper Midwest [57]. The population’s ethnic and racial characteristics are also representative of the upper Midwest, with the exception that the population includes a higher percentage of Native Americans (about 3.8%). The expected distribution of types and stages of cancer in the study population parallels those described in the American Cancer Society 2018 summary [58], except that higher proportions of patients had melanoma, neuroendocrine tumors, and sarcomas, which reflect MCR subspecialties.

Eligibility criteria {10}

This is a population-based study that will enroll all eligible adult patients served by clinicians in the Division of Medical Oncology at MCR and in hematology-oncology services at MCHS sites. This inclusive enrollment approach substantially increases the generalizability and external validity of our real-world pragmatic trial. Specifically, the E2C2 pragmatic trial will include all adult patients being treated or monitored for cancer or receiving survivorship care for cancer at the MCR medical oncology practice and the MCHS hematology-oncology practices. MCR patients in this trial will have solid tumors, and MCHS patients may have solid or liquid tumors. Data will not be used from patients who have indicated that they do not want their EHR data used for research according to the Minnesota Health Records Act [59].
The Mayo Clinic Institutional Review Board (IRB) waived the requirement to obtain individual patient consent and deemed the effort a standard of care study.
The protocol described herein was approved as a minimal risk study by the Mayo Clinic IRB on 1 November 2018 (IRB No. 18–007779). The IRB waived the requirement to obtain informed consent in accordance with 45 CFR 46.116 and waived Health Insurance Portability and Accountability Act (HIPAA) authorization in accordance with applicable HIPAA regulations. All changes to the protocol will be submitted to the IRB for review and approval. Persons who participate in the planned interviews will be asked to provide oral consent (see example in Additional file 1).

Interventions

Explanation for the choice of comparators {6b}

The stepped wedge design will allow us to compare outcomes at each clinic both across intervention groups and with historical controls at the same clinic, providing a rigorous assessment of the impact of E2C2 on managing SPADE symptoms among patients with cancer while also exploring factors relevant to its implementation across all sites.

Intervention description {11a}

The intervention will consist of both a symptom control bundle and an implementation bundle, which will be introduced simultaneously. The E2C2 intervention will include patient- and clinician-directed elements designed to increase the frequency with which patients receive individualized, preference-concordant, and guideline-based care for their symptoms and to increase rates of symptom control. These bundles are summarized in Fig. 2 and described below.

Automated symptom monitoring

After the transition from pre-E2C2 to the E2C2 intervention, the ePROs used to assess SPADE symptoms and physical function will not change; however, assessment frequency will increase, particularly for patients reporting severe symptoms. After initiating E2C2, the symptom control bundle will be activated and clinicians will be able to access EHR clinical decision support tools for SPADE symptom management, including score tracking. Patients will be able to enter ePRO symptom and physical function assessment data through telephonic interactive voice response, web portal, smart phone, or tablet.

Symptom management bundle

Presentation of symptom data to patients and clinicians
To facilitate intuitive ePRO interpretation, dedicated views will be available in the clinician-accessible Synopsis section of the EHR [60]. The views will be specified according to the findings of Snyder et al. [60] to optimize accurate interpretation. Data collected on symptom intensity and context will be presented to clinicians in brief, autogenerated text that will populate their clinical notes with a patient’s longitudinal SPADE symptom scores and a hyperlink to the graphic Synopsis view.
Patient assignment to collaborative care level
Algorithms will be populated by automatically abstracted ePRO EHR data and used to determine the level of collaborative care that patients will receive. The triage algorithm will be based on the following: patient-reported SPADE symptom intensity; patient preference for RN SCM contact; and clinician referral. With the triage algorithm, patients will be initially assigned to one of three levels according to the severity of their symptoms: none or mild; moderate (level 1); or severe (level 2). Symptom intensity levels will be assessed with an 11-point numerical rating scale (NRS) and operationalized as follows: mild (0–3 points); moderate (4–6 points); or severe (7–10 points). Consideration was given to increasing the lower threshold for severe symptoms to 8; however, the decision was made to recognize that pain or depression rated 7 warranted RN SCM attention. Additionally, consideration was given to assigning patients with multiple, moderate symptoms to level 2 RN SCM. However, owing to ease of EHR specification and eventual dissemination, we ultimately chose to base the level assignment solely on intensity rather than number of symptoms. Patients may move between levels depending on treatment response and onset or worsening of symptoms.
Automated provision of guideline concordant, self-management education, and resource information to patients
All patients, irrespective of symptom level, will receive educational modules on SPADE symptom and physical function self-management. The modules will be paper booklets with site-specific inserts describing institutional, web-based, and community resources. The booklet will be mailed to all patients scheduled to see a specific provider after the provider’s cluster has begun the E2C2 intervention. At this appointment or subsequent appointments, if patients endorse moderate to severe SPADE symptoms or physical dysfunction, they will receive a portal-based link to videos and additional written content modules matched to any symptoms endorsed at a moderate or higher level. This digital content will be stored on a responsive website that can be accessed by phone, computer, or tablet. The web-based resource will be freely available to all patients in the intervention at any time. All module information is based on National Comprehensive Cancer Network guidelines, Mayo Clinic expert opinion, and the Oncology Nursing Society Putting Evidence Into Practice guides [6163]. The content of the symptom modules will be cross-referenced annually against current guidelines. For each symptom, indications are provided for when and for what reasons the oncology team should be contacted.
Order preconfiguration for first-line symptom-directed medications to clinicians
The preconfigured medication or referral orders will be presented to clinicians caring for patients who are triaged to level 1 or 2. The order sets will be presented through Epic SmartSet (Epic Systems Corp Verona, Wisconsin) and will offer clinicians an efficient means of prescribing symptom-directed medications, specialist referrals, and allied health referrals that patients may request from the modules. Presenting preconfigured orders has been shown to have a small to moderate effect in improving patient outcomes [64, 65].
RN SCM–facilitated collaborative care (level 2 patients)
In addition to the interventions included for level 1 patients, the RN SCM will provide symptom-specific medication management, specialist referrals, integrative health approaches, and reinforced self-management for patients who express that they would like assistance with severe symptoms or functional impairment. Additionally, if providers in activated clusters believe that their patients with moderate symptoms may benefit from RN SCM care, they can advance patients to symptom level 2. RN SCM involvement is designed to optimally align treatment with each patient’s specific symptoms, preferences, and responses to therapy or interventions; thus, the frequency and content of nurse calls will vary with our treat-to-target approach. We will systematically document in detail the frequency, duration, and content of all RN SCM telephone calls. This will allow us to secondarily examine the independent effect of the intensity and content of RN SCM contacts as mediators of outcomes.
The RN SCM will contact patients in response to ePRO symptom-triggered alerts and trend reports. The RN SCMs will monitor trend reports weekly, respond to automated monitoring clinical alerts and patient calls daily, configure orders for the oncology care team through the EHR, and serve as the coordinator between patients and the oncology care team. For E2C2, the RN SCMs will have weekly case management sessions with the palliative care physician and additional clinical specialists as needed to review new level 2 patients and any patients not responding to therapy or suggested interventions.

Criteria for discontinuing or modifying allocated interventions {11b}

Although interventions will be allocated at the site level and introduced to individual patients as clinical care, patients always have the option of refusing care or declining participation in certain aspects of care.

Strategies to improve adherence to interventions {11c}

We will support uptake of E2C2 with an implementation bundle, a multifaceted strategy to encourage clinicians’ adoption of the EHR-based clinical decision support tools that combines three evidence-based implementation strategies: practice facilitation; point-of-care best practice prompts; and audit and feedback [66]. For practice facilitation, we will recruit clinical champions (physicians, nurse practitioners, or physician assistants) from each cluster and train them to support adoption and use of the E2C2 EHR clinical decision support tools; we will also familiarize clinicians with the RN SCM role [6668]. The facilitator will also provide hands-on training and support to clinicians to foster understanding of and engagement with the symptom monitoring and management system [6668]. Point-of-care computer alerts will be embedded within the EHR as Epic Best Practice Advisories, which will appear as alerts on the clinician EHR interface [69, 70]. Audit and feedback clinical performance data will be collected through automated Epic EHR tracking [70]. Clinical champions will be responsible for developing their own cluster-level engagement strategies and, with support from the research team, reporting on the educational and engagement strategies they deploy. Additionally, they will provide feedback to the research team on the utility and function of the algorithms.

Relevant concomitant care permitted or prohibited during the trial {11d}

The trial is being conducted as an embedded pragmatic trial and will therefore occur within the context of routine care delivery.

Provisions for post-trial care {30}

No special provisions for ancillary or post-trial care or compensation for harm were developed since the trial is an embedded pragmatic trial occurring within the context of routine care delivery.

Outcomes {12}

Primary outcomes

NRS scores used to assess SPADE symptoms and physical function will serve as both the E2C2 primary outcome and the critical component of the E2C2 intervention since NRS scores populate the EHR algorithms that determine whether patients are triaged to level 1 or level 2, and whether patients are offered specific intervention components (e.g. education or medications).

Secondary outcomes

In addition to our primary outcomes, we will assess secondary outcomes including depression, anxiety, pain, and additional measures of physical function. We will also assess use of healthcare, including hospitalizations, visits to the ED, visits to the outpatient clinic , and calls to the oncology care team. Vital status will also be assessed.

Participant timeline {13}

The timeline for this effort is illustrated, in part, in Fig. 3, which shows the timeline for each step in our trial. The overall effort is funded as a 5-year project with 6 months of planning and preparation time at the start of the 5-year period and 6 months for analysis and dissemination at the end of the 5-year period.

Sample size {14}

Stepped wedge cluster randomized trials typically have more statistical power than other cluster randomized designs [71] because each cluster can serve as its own control, accounting directly for the within-cluster correlation of outcomes. Because of the complex nature of the design and statistical model, we will estimate statistical power with simulation [72].
The sample size will be determined by the number of patient visits to the disease groups in the oncology practice at MCR and in the clinical practice sites included in the surrounding community practices in the MCHS as well as by the number of clusters included in our trial (15 clusters). As noted above, we estimate 40,000 newly diagnosed cancers over the study period. Since the present study also includes patients with existing tumors diagnosed in the past, if the patients are still receiving care from a medical oncologist at MCR or a hematologist-oncologist at MCHS, we expect the true sample size to be much larger than 40,000. According to NRS responses to pain and fatigue assessments that are currently imbedded in the MCR medical oncology clinic intake work flow, we expect that roughly two-thirds of patients will report at least one moderately intense symptom during treatment.
From these conservative estimates, a version of the statistical model above was fit to 79 weeks of preliminary baseline data (i.e. with no intervention effect Xkt) to estimate the parameters (e.g. νA, ΣA) needed to simulate longitudinal data for the 15 clusters. Clusters were randomly allocated to the five steps in Fig. 4, and treatment effects due to intervention were generated on a grid of eight values ν1B = 0.00, 0.01, 0.02, 0.03, 0.05, 0.10, 0.15, 0.20, with the remaining ν2B = ν3B = ν4B = ν5B = 0 to assume the most conservative case (i.e. only a single symptom is affected by the intervention). The cluster effects were then generated according to \( {\boldsymbol{B}}_k\sim N\left({\boldsymbol{\nu}}_B,\sqrt{\nu_{1B}}{\boldsymbol{\varSigma}}_A\right) \). This data generation process was used to simulate 100 datasets under each of the eight grid values for ν1B. The full model above was then used to estimate νB and test the hypothesis that all νjB = 0, through simultaneous credible bounds [73]. The results of the simulation are provided in Fig. 5. As can be seen in Fig. 5, the test results are close to the nominal level (i.e. α = 0.01, α = 0.05, or α = 0.10) when there is no effect. However, the power increases quickly for detection of a small average score difference of 0.10 with 70% power (at α = 0.05) and a difference of 0.20 with nearly 100% power.
For evaluation of the implementation bundle, we will summarize patient characteristics (sex and age) by intervention status (baseline and intervention). We will also summarize all survey responses by cluster implementation status, including clinician characteristics (age, sex, and years of practice). Analyses will be based on intention to treat at the patient level and at the cluster level [74]. All methods will account for correlation of outcomes across patients and within clusters.
We will also assess the effect of process measures on SPADE scores and other clinical outcomes. To assess the effect of clinician experience on implementation processes, we will assess the relationship between clinician scores and implementation outcomes by modeling each outcome as dependent on clinician scores. For count data, we will use appropriate models and select standard or zero-inflated Poisson or negative binomial models according to the Akaike information criterion. For binary measures, we will use logit models. For each outcome we will estimate bivariate models, including only one survey score, a model with all scores, and a final model that also includes clinician characteristics.
To evaluate the impact of the implementation bundle on patient outcomes, we will use similar assumptions as in Aim 1 to estimate the power to detect a meaningful difference in SPADE symptoms. To evaluate the impact of the intervention on clinician experience scores, according to prior response rates, we assume that 104 (95%) clinicians will complete surveys during both time periods; thus, the study will have 80% power to detect a change in scores of 0.27 standard deviations, a standardized effect that is conventionally considered small [75].

Recruitment {15}

Our estimated sample size and power estimates were based on actual patient volumes to ensure the feasibility of planned enrollment. It is presumed that patient volumes will remain relatively stable over the enrollment period. Our design has five steps with three clusters randomized to the intervention at each tranche (Fig. 4). Each step will begin with a baseline assessment period (pre-E2C2), and initiation of the E2C2 intervention in each tranche will occur 8 months apart. During the pre-E2C2 before the first step, no intervention will be implemented; data collected during this period will provide a within-site control group for each cluster.

Assignment of interventions: allocation

The SPIRIT diagram is shown in Fig. 3. The diagram illustrates the allocation of physician clusters into steps for a cluster randomized trial with a stepped wedge design. Clinical team members included in the study will be grouped into clusters. In the MCR practice, each cluster will be for a type of cancer (e.g. breast or colorectal cancer). In MCHS practices, each cluster will include site-specific oncology providers. These clusters will be the units for randomization for the intervention.

Sequence generation {16a}

Random assignment was stratified by site (MCR or MCHS), patient volume, and, for teams caring for the same cancers, type of cancer. As a proxy for total patient volume, we estimated from pilot data in our cancer registry that 10,000 patients with newly diagnosed cancer would provide data in each of the 4 years of the grant cycle (a total of 40,000 patients). Counting annual visits for these patients in the most recent year, we stratified clusters into three groups: < 4000 visits annually; 4000–8000 visits annually; and > 8000 visits annually.

Concealment mechanism {16b}

Clusters were allocated for all five steps in a single randomization generated by our lead statistician. Only the principal investigator and the lead statistician have knowledge of the randomization plan. Leadership at each allocated site will be alerted to the randomization several months before the start date. During the month before the intervention start date, randomly assigned care teams will be informed of the intervention and provided information and training.

Implementation {16c}

The plan for implementation of allocation is illustrated in the SPIRIT diagram (Fig. 3) and in Fig. 4. To balance cluster characteristics, we stratified randomization on cluster size, type of cancer, and site.

Assignment of interventions: blinding

Who will be blinded {17a}

Since the intervention is occurring as part of clinical care and patients are therefore not asked to consent to participate in research, they will remain blinded to their participation in a research study.

Procedure for unblinding if needed {17b}

No circumstances have been delineated under which unblinding would occur, nor have procedures for doing so been developed because the intervention will occur in this embedded pragmatic trial as clinical care.

Data collection and management

Plans for assessment and collection of outcomes {18a}

We will use multiple data sources for the E2C2 study analyses and identify patients and clinicians for qualitative data collection. The majority of data will be electronically abstracted either directly from the Epic EHR or from the Mayo Clinic data warehouse, the Unified Data Platform, which includes Epic and other legacy EHR and departmental systems and administrative billing data.

Demographic, clinical, clinician, and site data

Patient characteristics abstracted from the EHR will include sociodemographic and clinical variables. Potentially time-varying characteristics (e.g. regional and systemic cancer treatments) will be abstracted at monthly intervals. Validated natural language processing algorithms will be used to ascertain unstructured data elements [76, 77]. Clinician characteristics will be captured from departmental records, publicly accessible curricula vitae, and the EHR. Site-level data will include setting (community hospital, free-standing clinic, multispecialty group, or primary care clinic), available on-site cancer treatment services (e.g. surgical and radiation oncology), available on-site supportive care (e.g. pain management and psychology) and allied health services (e.g. physical therapy), location, and annual patient volume.

Primary outcomes

SPADE symptoms and physical function
Patients will complete NRSs for SPADE symptoms and physical function before medical oncology clinic appointments at all stages of the trial (i.e. before and after E2C2 initiation). ePROs will be more frequently administered to patients cared for by clinicians in activated E2C2 clusters, outside their appointment-linked assessments (at least monthly) and to symptomatic patients as part of the intervention. To avoid potential bias from oversampling of symptomatic patients, only SPADE symptom NRSs collected in association with clinic appointments will be included in the primary analysis.
Simple 11-point NRSs have been used for decades in the assessment of diverse latent traits among patients with cancer of all types and stages [7880]. These single-item assessments have been the measures used most often for quality of life and symptoms in NCI cancer control clinical trials [81]; they feature prominently in the most reliable and valid symptom assessment tools, both generic and cancer-specific [82, 83]. The NRS used in E2C2 to assess the SPADE symptoms and physical function will be patterned on the extensively validated MD Anderson Symptom Inventory and the Edmonton Symptom Assessment System for the 24-h recall period and the verbal anchors (e.g. from no pain to worst possible pain) [84, 85], NRSs have been shown to be more responsive than either Likert or verbal rating scales [86] and to be preferred by patients over visual analogue scales [87].

Secondary outcomes

Patient-Reported Outcomes Measurement Information System computer adaptive tests
Depression, anxiety, pain, and physical function will be assessed with the Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive tests (CATs) (http://​www.​healthmeasures.​net/​explore-measurement-systems/​promis) up to every 4 months (before medical oncology or hematology-oncology visits either at the visit with a tablet or before the visit through the patient portal). In addition to strong endorsement by the National Institutes of Health [88, 89], use of CATs is justified because item response theory (IRT)-based instruments generally have better discrimination across the entire trait range than legacy patient-reported outcomes because they are less prone to floor and ceiling effects [90, 91]. Moreover, administering IRT-modeled banks with CATs enhances the efficiency and precision of measurement compared with short forms [92, 93]. The PROMIS item banks used in E2C2 have been validated, with robust IRT calibration across different clinical populations [9496]. Each of the research centers participating in IMPACT is planning to use the PROMIS CATs to facilitate data harmonization and comparisons across practice settings.
Use of healthcare
Use of healthcare for E2C2 will consider healthcare encounters, including hospitalizations, visits to the ED, visits to the outpatient clinic, and calls to the oncology care team. EHR entries and administrative billing data will be aggregated to construct a comprehensive dataset of all clinical encounters. Data collected for hospitalizations will include admission and discharge diagnoses, length of stay, admission or transfer to the intensive care unit, and whether admission was planned for cancer treatment or unplanned (and if unplanned, whether admission was initiated from the ED or an office visit). For ED encounters, we will record diagnoses and whether an encounter resulted in admission to hospital or the intensive care unit. Clinic visits will be identified from billing data, which will include Current Procedural Terminology codes, International Classification of Diseases, Tenth Revision codes, location, and clinician National Provider Identifier (NPI) numbers. We will be able to ascertain clinician discipline and specialty from the NPI numbers. Calls to the oncology care team are not billed but are reliably captured in the EHR. A recent audit established that 87% of calls to medical oncology practitioners were recorded in the EHR and that rates of capture did not vary systematically across physicians and mid-level providers. However, call characteristics (e.g. duration) were not reliably recorded. Therefore, we will use count data in analyses to model call frequency.
The majority of patients’ use of healthcare will occur at Mayo Clinic facilities. Established patterns suggest that 75%–80% of patients’ care will occur at a Mayo Clinic facility and that this frequency will not vary across E2C2 clusters or during phases of the E2C2 intervention (e.g. pre-E2C2). However, we will use imputation methods and sensitivity analyses to assess the impact of mis-ascertainment of utilization data.
Vital status
Vital status will be verified through death certificates, the Mayo Clinic EHR, next-of-kin reports, the Mayo Clinic Tumor Registry, and the Social Security Death Index website.

Implementation evaluation and outcomes

Context assessment
We will use a 12-item Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM) to assess system-level context during the time frame before implementation. Approximately 20 system-level stakeholders (e.g. administrators, practice leadership, and information technology specialists) will be recruited during the pre-E2C2 stage to complete the AIM-IAM-FIM survey. System-level stakeholders will be invited to complete an individual interview at the time of their pre-E2C2 survey. Interviews will comprise 15- to 30-min elaborations of the same AIM-IAM-FIM constructs, with prompts informed by the Consolidated Framework of Implementation Research [97].
Immediately before the E2C2 intervention is begun, all care team members within a given cluster will be invited to complete the same 12-item AIM-IAM-FIM survey. Participants will be recruited at cluster engagement kick-off meetings and data will be used to ascertain cluster-level readiness for implementation. The aim of this survey is to assess implementation context; the aim of the data collection is to understand and track implementation context. The survey will be re-administered 2–4 months after the intervention is initiated and 12 months after that assessment.
Process assessment
To characterize the work for stakeholders to implement E2C2, cluster care team members will also complete a 23-item NoMAD survey immediately before intervention is initiated, 4 months after intervention initiation, and 12 months after that assessment. The NoMAD survey, based on normalization process theory [98], includes assessment of users’ perceptions of intervention leadership, integrated workflow, training adequacy, organizational understanding, perceptions of the value of the intervention, and its impact on working relationships. The NoMAD instrument is treated as an ordinal scale and an average score within each construct can be calculated for individuals and clusters.
Care teams will also be invited to participate in focus groups in coordination with scheduled site visits and survey assessments (two focus groups per care team cluster). Focus groups will function like reflective team meetings and will be recorded with permission and transcribed for analysis. Additional interviews and focus groups may also be scheduled with key stakeholders and care team members to explore insights from the survey findings. Finally, implementation documents, including executive team meeting minutes, project correspondence and materials, and study logs maintained by study team members will be collected for textual analysis of how the intervention unfolded in practice.
Patient ePRO use
We will follow a mixed-methods sequential explanatory design to evaluate patient variation in the implementation of the intervention among rurally based, elderly, and rurally based elderly patients. Our evaluation will be guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework [99, 100]. We will evaluate the following:
1.
Reach—the intervention is accessed across age groups and patients in rural and urban areas
 
2.
Effectiveness—whether the intervention reduces disparities in symptom control among the elderly and those living in rural areas
 
3.
Implementation and maintenance—whether the intervention and its components are implemented consistently with these groups
 
For each step, we will extract data from the EHR to assess quantitative outcomes (response rates and changes in SPADE symptom scores) and follow analysis of the quantitative data with qualitative inquiries to help explain and elaborate on the quantitative findings.

Plans to promote participant retention and complete follow-up {18b}

Adoption, fidelity, and penetration

Measures of actual adoption, fidelity, and penetration will be abstracted from administrative data and utilization tracking data mined with the EHR. Process measures reflecting patients’ and clinicians’ use of the E2C2 EHR tools will be captured automatically by the EHR. Process measures for patients will include the following:
1.
Frequency and duration of accessing the SPADE symptom self-management educational modules through the web portal
 
2.
Frequency of requesting print versions of the modules
 
3.
Frequency of accessing the designated SPADE symptom graphs through the portal
 
Process measures for clinicians will include the following:
1.
Retention of autogenerated text in clinical notes
 
2.
Frequency of accessing the SPADE Synopsis view
 
3.
Frequency of issuing preconfigured orders for SPADE treatments
 
4.
Frequency of issuing orders configured by the level 2 RN SCMs
 
5.
Clinician responses to Best Practice Advisory alerts
 
6.
Frequency of clinician links from the alerts to the SPADE symptom Synopsis view and the preconfigured SmartSet orders
 
7.
Duration and frequency with which clinicians view the audit and feedback dashboard
 
8.
Frequency with which clinicians use the dashboard to gain further information about their performance
 
Individual and group quarterly performance data will be provided to clinicians as feedback through the dashboard. Upon initiation of the E2C2 intervention, individual performance data will be collected and a dashboard will be presented weekly on the clinician’s landing page at first login to the EHR. The EHR will record the frequency, duration, and detail of dashboard access and use. These data will be used to assess the impact of audit and feedback on outcomes.

Patient interviews

We will complete individual interviews with patients in E2C2—especially those who live in rural areas or are elderly—to understand their experience with E2C2 and symptom management. We will use a stratified, purposeful sample of patients or proxies for interviews. Starting with the first clusters randomly assigned to the E2C2 intervention, we will identify patients who are aged < 65 years and living in rural areas, as defined by the 2013 US Department of Agriculture’s Rural-Urban Continuum Codes [101], and patients aged ≥ 65 years who live in urban and rural areas. We will then identify high and low ePRO reporters during the first 3 months of the intervention and recruit from both groups for interviews to be conducted in months 4–6. Our second set of interviews will be conducted during months 18 and 19 and will assess barriers and facilitators to symptom control and the effectiveness of the E2C2 intervention in promoting symptom control. The semi-structured interview guide will be based on domains consistent with the RE-AIM framework. The interview schedule will follow an iterative process of data collection and analysis to ensure the identification and testing of analytic categories.

Data management {19}

All patient and medical records data are securely stored behind an electronic firewall. Patient and medical records data will not be released outside the institution without specific data-sharing agreements. Additional study data will be stored on separate, password-protected, secure servers; only study personnel will have access to these data. All results will be reported in aggregate; no individual-level patient or provider data will be identifiable in study reports.

Confidentiality {27}

Confidentiality and security of patient data will be ensured through adherence to institutional policies and procedures for secure storage and maintenance of medical records data. Patients will participate in the study only through their engagement in routine care; thus, the institutional clinical policies and procedures for maintaining patient privacy and confidentiality with respect to communications, paperwork, and EHR documentation and access will ensure patient privacy.

Plans for collection, laboratory evaluation, and storage of biological specimens for genetic or molecular analysis in this trial/future use {33}

Plans for collection, laboratory evaluation, and storage of biological specimens for genetic or molecular analysis are not applicable to the current trial.

Statistical methods

Statistical methods for primary and secondary outcomes {20a}

We will summarize patient characteristics (e.g. sex and age) by intervention status (pre-E2C2 or E2C2). Analyses will be based on intention to treat at the patient level and at the cluster level [74]. All methods will account for correlation of outcomes within clusters and across patients. To test the primary hypotheses, we will use generalized models to assess the effects of the interventions [74]. Our main model will be a mixed-effects (i.e. multilevel) generalized linear model specified as follows: let Yjkt be the average of the jth SPADE score among eligible patients in the kth cluster (k = 1, …,21) during step time period t (t = 1, …,T). In this analysis, weekly time periods (i.e. weekly averages) will be used over 4 years, so that T = 208. The SPADE score model is then
$$ {Y}_{jk t}={\mu}_{jt}+{A}_{jk}+{B}_{jk}{X}_{kt}+{\delta}_{jk t}, $$
where
1.
μjt is a common mean trend for the jth SPADE score across t, shared among all 15 clusters. The multivariate vector μt = [μ1t, …, μ5t]′ is modeled as a multivariate autoregressive process of order 2, AR (2), to allow for more efficient estimation through smoothing of the trend over time.
 
2.
Ak = [A1k, …, A5k]′ is a vector of random effects (1 for each SPADE score) for cluster k, Ak ∼ N(νA, ΣA).
 
3.
Xkt is equal to 0 during the control period for cluster k and is equal to 1 when the intervention begins.
 
4.
Bk = [B1k, …, B5k]′ is a vector of random effects (1 for each SPADE score) for the effect of the intervention on cluster k, Bk ∼ N(νB, ΣB), so that νB = [ν1B, …, ν5B]′ is the average effect that the E2C2 intervention had on the five SPADE scores.
 
5.
δkt = [δ1kt, …, δ5kt]′ are error terms that are treated as a multivariate autoregressive process of order 1, AR (1), with Gaussian noise independently for each cluster.
 
It can be critical to allow for this correlation in time in longitudinal data [102], which is often ignored in analysis of stepped wedge designs. This primarily results from the complication of fitting the above model, which has several random effects (in both time and across clusters). This is further complicated with five responses due to the multivariate nature of the random effects. However, the Markov chain Monte Carlo method is effective at fitting such models [103] and will be used here. We will assess whether there are any large imbalances in patient characteristics among clusters between the baseline period and intervention period and include any variables wherein large imbalances are detected in the model. The primary aim can be tested with the joint hypotheses that ν1B = ν2B = ν3B = ν4B = ν5B = 0. For secondary outcomes, we will estimate a model similar to the main model as well. For all models, we will report measures of fit, such as predictive R2 values and between-cluster variance estimates.
A secondary objective of the first aim is to better understand the effectiveness of different components of the E2C2 intervention in managing symptoms, so we will perform a separate set of analyses incorporating only the E2C2 intervention period. For these secondary analyses, we will assess the impact of specific process measures on SPADE scores and other clinical outcomes. We will first examine the distribution of values (frequency or duration) for each process measure and, if the values are highly skewed, we will categorize them into two or more categories. We will then estimate for each outcome a mixed-effects linear model with a random cluster effect, where the outcome is the dependent variable and the main independent variable is the continuous or categorized process measure and adjust for patient covariates as described above. By testing for an overall process measure effect, we can assess which processes contribute most to reducing outcomes; we will also report measures of variance explained to enable relative comparison of process measure effects.
We will use the measures of adoption, fidelity, and penetration (described above) to assess the differential impact of E2C2 components on patient and clinician outcomes. Formally, we will undertake a mediation analysis with structural equation modeling to assess the extent to which each component of E2C2 mediates the intervention.

Model estimation

For all models, we will use Bayesian methods to estimate credible intervals for parameters of interest. Bayesian models are appropriate for randomized studies, including cluster randomized stepped wedge studies [104, 105]. Tests will be based on credible intervals for parameters and their combinations.

Interim analyses {21b}

No interim analyses are planned for this minimal-risk standard of care pragmatic trial. Therefore, no stopping rules have been explicated; analyses will not occur until all sites have been allocated and have completed the planned intervention period.

Methods for additional analyses (e.g. subgroup analyses) {20b}

For each step, we will first calculate ePRO response rates (the number of ePROs returned divided by the number sent) three times during the pre-E2C2 usual care period (first month, midpoint, and end of pre-E2C2; then again during the first month, midpoint, and end of the E2C2 study period). We will compare rates by age, urban or rural residence, and age or rural residence. To analyze response rate data, we will use both simple unadjusted descriptive statistics and generalized regression models. We will calculate simple proportions of response rates for the total population and subgroups of interest. We will then create regression models to determine predictors of being a high responder. Additional explanatory variables will include patient demographics (e.g. employment status, insurance status, and sex), type and stage of cancer, cluster, and preferred mode of response (ePRO or interactive voice response). Response rates at each time point (early, middle, and late) will be calculated for analyses and models will include a random intercept to account for repeated measures over patients. For each step, we will aggregate data and examine trends over time to determine whether response rates have increased significantly.
We will examine the bivariate relationship between patient, clinician, and utilization characteristics and response with the use of generalized linear regression models testing for interaction effects. Factors that have non-zero interaction effects in this bivariate analysis will be retained; we will use variance decomposition to eliminate collinear variables [106] and enter the remaining factors and their interactions with exposure included in the model. This multistep approach has been used previously in mixed-methods studies to identify the most important predictors [107]. Finally, we will undertake secondary analyses examining the impact of process measures (adoption, fidelity, and penetration) on primary and secondary clinical outcomes among the older and rural subgroups. We expect approximately 20,000–24,000 rurally based patients, 20,000–24,000 elderly patients, and 10,000–12,000 rurally based elderly patients.

Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data {20c}

Our approach to data collection, which is designed to ensure complete and balanced collection of primary and secondary measures, is detailed elsewhere (in the “Data collection and management” section). However, we expect that we may be missing some patient or clinician characteristics, which, if otherwise imbalanced across intervention groups, we will need to adjust for; to account for these missing data, we will use multiple imputation, a technique that has been extended to Bayesian models [108].

Plans to give access to the full protocol, participant level-data, and statistical code {31c}

Given concerns about confidentiality and waiver of consent, datasets generated for the present study will not be made publicly available. Access to the full final protocol, deidentified data, and statistical data will be made available from the study principal investigator upon reasonable request after publication of primary trial results.

Oversight and monitoring

Composition of the coordinating center and trial steering committee {5d}

The E2C2 Steering Committee, consisting of the principal investigator, co-investigators, and other study staff, has weekly steering committee meetings to regularly review protocol compliance and to discuss and record study progress.

Composition of the data monitoring committee, its role, and reporting structure {21a}

The risks posed by the proposed intervention do not exceed the threshold of minimal risk; therefore, an independent data management and monitoring committee is not required. Risks of this study to patients are no different from those encountered during routine clinical care. The principal investigator will monitor the safety of the patients and the integrity of the data. Patient safety will be maintained through the clinical staff adhering to the standards of clinical care.

Data integrity

Using best practices in data integrity recommended by the Mayo Clinic Division of Biomedical Statistics and Informatics in the Department of Health Sciences Research, we will use real-time data validation and developed and standardized checklists to ensure data integrity and quality.

Adverse event reporting and harms {22}

The principal investigator (ALC) will work with the team to develop and submit annual progress reports summarizing study progress to the Mayo Clinic IRB. All unexpected or serious adverse events will be reported by the principal investigator to the IRB. The principal investigator and study team will adhere to IRB policies and procedures related to unanticipated issues involving risk to participants and will immediately report any protocol violations.

Frequency and plans for auditing trial conduct {23}

This embedded pragmatic trial is being conducted as a minimal-risk standard of care study; therefore, standard operating procedures for auditing trial conduct have not been developed. However, as previously described, we are conducting a rigorous process evaluation involving survey research, focus groups, and key informant interviews, which will provide feedback on trial conduct.

Plans for communicating important protocol amendments to relevant parties (e.g. trial participants, ethical committees) {25}

All protocol modifications will be submitted as amendments to the approved IRB protocol and communicated to the study team and clinical teams as appropriate.

Dissemination plans {31a}

Potential for impact and implications and plans for dissemination

The E2C2 trial is clinically and methodologically significant because it will comprehensively evaluate the use of ubiquitous EHR functionalities to enhance symptom control. While these capabilities are increasingly EHR agonistic, our use of an Epic system may be particularly beneficial because the systems are used in 250 US healthcare organizations, 65% of the US population has an Epic record, and 69 million Americans have an Epic MyChart account [109]. The proposed trial will have an important impact on the delivery of cancer care, leveraging evidence-based implementation strategies to enhance the adoption, implementation, and sustainability of the intervention in clinical practice. The infrastructural, information technology, economic, and organizational requirements for dissemination on a large scale are integral determinants of the E2C2 approach, which aggressively leverages inexpensive, universally available EHR-based clinical and implementation strategies. Results of the trial will be reported by members of our research team for publication in peer-reviewed scientific journals, and the team will follow authorship requirements as specified in those journals.
During the E2C2 trial, we will develop and refine manuals with specific information for the symptom control– and implementation-focused EHR elements of the E2C2 intervention. These manuals will permit easy dissemination of the approach to builders in other health systems that use the Epic EHR. Epic build manuals will be distributed through several well-established mechanisms, including: (1) Epic online build instruction and support resources; (2) annual Epic Users Group Meetings and online archives of these meetings; and (3) the Cancer Control P.L.A.N.E.T. (plan, link, act, network with evidence-based tools) web platform (https://​cancercontrolpla​net.​cancer.​gov/​planet/​). Since Epic’s market foothold has consistently expanded for the past decade, the potential near-term impact of an Epic-based approach is high.
The E2C2 intervention offers a pragmatic, scalable approach to delivering patient-preferred, guideline-based symptom management that can be easily amended to reflect the dynamic and evolving evidence base. Since discrete EHR-imbedded algorithms drive defining aspects of the intervention, the approach can be efficiently updated by modifying these centralized algorithms. The approach integrates the treatment of psychologic and somatic symptoms in a manner that accords with real-life clinical practice and incorporates treatments spanning different classes—pharmaceutical, rehabilitative, and behavioral. The E2C2 approach can be easily customized to reflect the available services, resources, and organizational structure of specific healthcare systems.

Discussion

Administrative challenges

Institutional engagement will be vital for the successful execution of the proposed work and the potential for a lack of engagement inevitably raises concern. We have proactively obtained the support of influential, strategically placed representatives from relevant stakeholder groups throughout MCHS.
The scope of the proposed project requires engagement of a large E2C2 grant team, which may be challenging to coordinate. Diverse stakeholder engagement will be critical for the success of the proposed trial. In planning the grant, we have been strategically inclusive in developing the research and administrative teams.

Information technology and clinical workflow challenges

Timely creation of E2C2 clinical decision support tools is also a concern; however, the principal investigator and several members of the study team have been certified by Epic to build and update the E2C2 intervention EHR components.
CAT capabilities are available through all ePRO administration modes: web; smart phone; and tablet. However, CAT administration requires real-time interface with an Epic-based server for item selection. In the event of transient interface compromise, a backup system will administer fixed-length short forms for the domains.

Provider challenges

EHR alert fatigue among clinicians has been widely documented in diverse contexts and is an important potential limitation. We will use several strategies to proactively address this concern, including: (1) engaging clinicians in alert design; (2) multi-stakeholder usability testing; (3) site- and cluster-specific vetting of alerts; and (4) qualitative interviews to comprehensively document experiences of end users to improve future iterations.

Patient challenges

Access to electronic sources for data collection among patient subgroups is an expected limitation that is central in our mixed methods study design. We will characterize the experiences of patients who may have limited or no information technology access or familiarity, especially rurally dwelling and elderly patients.
Patient engagement is foundational to the success of the proposed system. Patients must actively participate in completion of the ePRO measures and must adhere to recommendations for treatment and self-care for the E2C2 system to be of benefit. We propose to seek input from patients to understand and address barriers to participation and iteratively improve strategies to optimize their engagement.

Trial status

Ethics approval for this pragmatic trial was obtained on 1 November 2018; the current protocol (version 6) was approved on 16 October 2019. Collection of baseline data (before the intervention) was initiated on 29 March 2019; the intervention was implemented in the clinical practices randomly assigned to tranche 1 on 1 October 2019. The planned field period for this trial extends until 31 January 2023. Thus, the first date of recruitment to the intervention component of this pragmatic trial was 29 March 2019 and the final date of recruitment will be 31 July 2022.

Supplementary information

Supplementary information accompanies this paper at https://​doi.​org/​10.​1186/​s13063-020-04335-w.

Acknowledgements

None.
The protocol for this study was approved as a minimal risk study by the Mayo Clinic IRB (No. 18–007779).
Not applicable.

Competing interests {28}

LJFR, LLC, JMG, JH, ALL, DRP, JLR, PAR, CBS, PMW, and ALC have no competing interests to declare. KJR inherited and then sold (in February 2018) stock in Merck and Co, Inc. and Pfizer, Inc.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
insite
INHALT
download
DOWNLOAD
print
DRUCKEN
Anhänge

Supplementary information

Literatur
1.
Zurück zum Zitat Cheville AL, Shen T, Chang M, Basford JR. Appropriateness of the treatment of fatigued patients with stage IV cancer. Support Care Cancer. 2013;21(1):229–33.PubMedCrossRef Cheville AL, Shen T, Chang M, Basford JR. Appropriateness of the treatment of fatigued patients with stage IV cancer. Support Care Cancer. 2013;21(1):229–33.PubMedCrossRef
2.
Zurück zum Zitat Barsevick AM, Sweeney C, Haney E, Chung E. A systematic qualitative analysis of psychoeducational interventions for depression in patients with cancer. Oncol Nurs Forum. 2002;29(1):73–84 quiz 5-7.PubMedCrossRef Barsevick AM, Sweeney C, Haney E, Chung E. A systematic qualitative analysis of psychoeducational interventions for depression in patients with cancer. Oncol Nurs Forum. 2002;29(1):73–84 quiz 5-7.PubMedCrossRef
3.
Zurück zum Zitat Laoutidis ZG, Mathiak K. Antidepressants in the treatment of depression/depressive symptoms in cancer patients: a systematic review and meta-analysis. BMC Psychiatry. 2013;13:140.PubMedPubMedCentralCrossRef Laoutidis ZG, Mathiak K. Antidepressants in the treatment of depression/depressive symptoms in cancer patients: a systematic review and meta-analysis. BMC Psychiatry. 2013;13:140.PubMedPubMedCentralCrossRef
4.
Zurück zum Zitat Boyce MB, Browne JP. Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review. Qual Life Res. 2013;22(9):2265–78.PubMedCrossRef Boyce MB, Browne JP. Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review. Qual Life Res. 2013;22(9):2265–78.PubMedCrossRef
5.
Zurück zum Zitat Mooney KH, Beck SL, Friedman RH, Farzanfar R, Wong B. Automated monitoring of symptoms during ambulatory chemotherapy and oncology providers’ use of the information: a randomized controlled clinical trial. Support Care Cancer. 2014;22(9):2343–50.PubMedPubMedCentralCrossRef Mooney KH, Beck SL, Friedman RH, Farzanfar R, Wong B. Automated monitoring of symptoms during ambulatory chemotherapy and oncology providers’ use of the information: a randomized controlled clinical trial. Support Care Cancer. 2014;22(9):2343–50.PubMedPubMedCentralCrossRef
6.
Zurück zum Zitat Carpenter JS, Rawl S, Porter J, Schmidt K, Tornatta J, Ojewole F, et al. Oncology outpatient and provider responses to a computerized symptom assessment system. Oncol Nurs Forum. 2008;35(4):661–9.PubMedPubMedCentralCrossRef Carpenter JS, Rawl S, Porter J, Schmidt K, Tornatta J, Ojewole F, et al. Oncology outpatient and provider responses to a computerized symptom assessment system. Oncol Nurs Forum. 2008;35(4):661–9.PubMedPubMedCentralCrossRef
7.
Zurück zum Zitat Yount SE, Rothrock N, Bass M, Beaumont JL, Pach D, Lad T, et al. A randomized trial of weekly symptom telemonitoring in advanced lung cancer. J Pain Symptom Manag. 2014;47(6):973–89.CrossRef Yount SE, Rothrock N, Bass M, Beaumont JL, Pach D, Lad T, et al. A randomized trial of weekly symptom telemonitoring in advanced lung cancer. J Pain Symptom Manag. 2014;47(6):973–89.CrossRef
8.
Zurück zum Zitat Barsevick AM. The elusive concept of the symptom cluster. Oncol Nurs Forum. 2007;34(5):971–80.PubMedCrossRef Barsevick AM. The elusive concept of the symptom cluster. Oncol Nurs Forum. 2007;34(5):971–80.PubMedCrossRef
9.
Zurück zum Zitat Barsevick AM, Whitmer K, Nail LM, Beck SL, Dudley WN. Symptom cluster research: conceptual, design, measurement, and analysis issues. J Pain Symptom Manag. 2006;31(1):85–95.CrossRef Barsevick AM, Whitmer K, Nail LM, Beck SL, Dudley WN. Symptom cluster research: conceptual, design, measurement, and analysis issues. J Pain Symptom Manag. 2006;31(1):85–95.CrossRef
10.
11.
Zurück zum Zitat Dodd MJ, Miaskowski C, Paul SM. Symptom clusters and their effect on the functional status of patients with cancer. Oncol Nurs Forum. 2001;28(3):465–70.PubMed Dodd MJ, Miaskowski C, Paul SM. Symptom clusters and their effect on the functional status of patients with cancer. Oncol Nurs Forum. 2001;28(3):465–70.PubMed
12.
Zurück zum Zitat Fox SW, Lyon DE. Symptom clusters and quality of life in survivors of lung cancer. Oncol Nurs Forum. 2006;33(5):931–6.PubMedCrossRef Fox SW, Lyon DE. Symptom clusters and quality of life in survivors of lung cancer. Oncol Nurs Forum. 2006;33(5):931–6.PubMedCrossRef
13.
Zurück zum Zitat Given BA, Given CW, Sikorskii A, Hadar N. Symptom clusters and physical function for patients receiving chemotherapy. Semin Oncol Nurs. 2007;23(2):121–6.PubMedCrossRef Given BA, Given CW, Sikorskii A, Hadar N. Symptom clusters and physical function for patients receiving chemotherapy. Semin Oncol Nurs. 2007;23(2):121–6.PubMedCrossRef
14.
Zurück zum Zitat Ferreira KA, Kimura M, Teixeira MJ, Mendoza TR, da Nobrega JC, Graziani SR, et al. Impact of cancer-related symptom synergisms on health-related quality of life and performance status. J Pain Symptom Manag. 2008;35(6):604–16.CrossRef Ferreira KA, Kimura M, Teixeira MJ, Mendoza TR, da Nobrega JC, Graziani SR, et al. Impact of cancer-related symptom synergisms on health-related quality of life and performance status. J Pain Symptom Manag. 2008;35(6):604–16.CrossRef
15.
Zurück zum Zitat Hadi S, Fan G, Hird AE, Kirou-Mauro A, Filipczak LA, Chow E. Symptom clusters in patients with cancer with metastatic bone pain. J Palliat Med. 2008;11(4):591–600.PubMedCrossRef Hadi S, Fan G, Hird AE, Kirou-Mauro A, Filipczak LA, Chow E. Symptom clusters in patients with cancer with metastatic bone pain. J Palliat Med. 2008;11(4):591–600.PubMedCrossRef
17.
Zurück zum Zitat Donovan KA, Jacobsen PB. Fatigue, depression, and insomnia: evidence for a symptom cluster in cancer. Semin Oncol Nurs. 2007;23(2):127–35.PubMedCrossRef Donovan KA, Jacobsen PB. Fatigue, depression, and insomnia: evidence for a symptom cluster in cancer. Semin Oncol Nurs. 2007;23(2):127–35.PubMedCrossRef
18.
Zurück zum Zitat Fleishman SB. Treatment of symptom clusters: pain, depression, and fatigue. J Natl Cancer Inst Monogr. 2004;(32):119–23. Fleishman SB. Treatment of symptom clusters: pain, depression, and fatigue. J Natl Cancer Inst Monogr. 2004;(32):119–23.
19.
Zurück zum Zitat So WK, Marsh G, Ling WM, Leung FY, Lo JC, Yeung M, et al. The symptom cluster of fatigue, pain, anxiety, and depression and the effect on the quality of life of women receiving treatment for breast cancer: a multicenter study. Oncol Nurs Forum. 2009;36(4):E205–14.PubMedCrossRef So WK, Marsh G, Ling WM, Leung FY, Lo JC, Yeung M, et al. The symptom cluster of fatigue, pain, anxiety, and depression and the effect on the quality of life of women receiving treatment for breast cancer: a multicenter study. Oncol Nurs Forum. 2009;36(4):E205–14.PubMedCrossRef
20.
Zurück zum Zitat Yamagishi A, Morita T, Miyashita M, Kimura F. Symptom prevalence and longitudinal follow-up in cancer outpatients receiving chemotherapy. J Pain Symptom Manag. 2009;37(5):823–30.CrossRef Yamagishi A, Morita T, Miyashita M, Kimura F. Symptom prevalence and longitudinal follow-up in cancer outpatients receiving chemotherapy. J Pain Symptom Manag. 2009;37(5):823–30.CrossRef
21.
Zurück zum Zitat Brown LF, Kroenke K. Cancer-related fatigue and its associations with depression and anxiety: a systematic review. Psychosomatics. 2009;50(5):440–7.PubMedPubMedCentralCrossRef Brown LF, Kroenke K. Cancer-related fatigue and its associations with depression and anxiety: a systematic review. Psychosomatics. 2009;50(5):440–7.PubMedPubMedCentralCrossRef
22.
Zurück zum Zitat Katon W, Guico-Pabia CJ. Improving quality of depression care using organized systems of care: a review of the literature. Prim Care Companion CNS Disord. 2011;13(1):PCC.10r01019blu.PubMedPubMedCentral Katon W, Guico-Pabia CJ. Improving quality of depression care using organized systems of care: a review of the literature. Prim Care Companion CNS Disord. 2011;13(1):PCC.10r01019blu.PubMedPubMedCentral
23.
Zurück zum Zitat Katon W, Unutzer J, Wells K, Jones L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. Gen Hosp Psychiatry. 2010;32(5):456–64.PubMedCrossRef Katon W, Unutzer J, Wells K, Jones L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. Gen Hosp Psychiatry. 2010;32(5):456–64.PubMedCrossRef
24.
Zurück zum Zitat Coventry PA, Hudson JL, Kontopantelis E, Archer J, Richards DA, Gilbody S, et al. Characteristics of effective collaborative care for treatment of depression: a systematic review and meta-regression of 74 randomised controlled trials. PLoS One. 2014;9(9):e108114.PubMedPubMedCentralCrossRef Coventry PA, Hudson JL, Kontopantelis E, Archer J, Richards DA, Gilbody S, et al. Characteristics of effective collaborative care for treatment of depression: a systematic review and meta-regression of 74 randomised controlled trials. PLoS One. 2014;9(9):e108114.PubMedPubMedCentralCrossRef
25.
Zurück zum Zitat Sighinolfi C, Nespeca C, Menchetti M, Levantesi P, Belvederi Murri M, Berardi D. Collaborative care for depression in European countries: a systematic review and meta-analysis. J Psychosom Res. 2014;77(4):247–63.PubMedCrossRef Sighinolfi C, Nespeca C, Menchetti M, Levantesi P, Belvederi Murri M, Berardi D. Collaborative care for depression in European countries: a systematic review and meta-analysis. J Psychosom Res. 2014;77(4):247–63.PubMedCrossRef
26.
Zurück zum Zitat Craven MA, Bland R. Better practices in collaborative mental health care: an analysis of the evidence base. Can J Psychiatr. 2006;51(6 Suppl 1):7S–72S. Craven MA, Bland R. Better practices in collaborative mental health care: an analysis of the evidence base. Can J Psychiatr. 2006;51(6 Suppl 1):7S–72S.
27.
Zurück zum Zitat Archer J, Bower P, Gilbody S, Lovell K, Richards D, Gask L, et al. Collaborative care for depression and anxiety problems. Cochrane Database Syst Rev. 2012;10:CD006525.PubMed Archer J, Bower P, Gilbody S, Lovell K, Richards D, Gask L, et al. Collaborative care for depression and anxiety problems. Cochrane Database Syst Rev. 2012;10:CD006525.PubMed
28.
Zurück zum Zitat van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med. 2015;45(2):231–46.PubMedCrossRef van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med. 2015;45(2):231–46.PubMedCrossRef
29.
Zurück zum Zitat Hudson JL, Bower P, Archer J, Coventry PA. Does collaborative care improve social functioning in adults with depression? The application of the WHO ICF framework and meta-analysis of outcomes. J Affect Disord. 2016;189:379–91.PubMedCrossRef Hudson JL, Bower P, Archer J, Coventry PA. Does collaborative care improve social functioning in adults with depression? The application of the WHO ICF framework and meta-analysis of outcomes. J Affect Disord. 2016;189:379–91.PubMedCrossRef
30.
Zurück zum Zitat Tully PJ, Baumeister H. Collaborative care for comorbid depression and coronary heart disease: a systematic review and meta-analysis of randomised controlled trials. BMJ Open. 2015;5(12):e009128.PubMedPubMedCentralCrossRef Tully PJ, Baumeister H. Collaborative care for comorbid depression and coronary heart disease: a systematic review and meta-analysis of randomised controlled trials. BMJ Open. 2015;5(12):e009128.PubMedPubMedCentralCrossRef
31.
Zurück zum Zitat Panagioti M, Bower P, Kontopantelis E, Lovell K, Gilbody S, Waheed W, et al. Association between chronic physical conditions and the effectiveness of collaborative care for depression: an individual participant data meta-analysis. JAMA Psychiatry. 2016;73(9):978–89.PubMedCrossRef Panagioti M, Bower P, Kontopantelis E, Lovell K, Gilbody S, Waheed W, et al. Association between chronic physical conditions and the effectiveness of collaborative care for depression: an individual participant data meta-analysis. JAMA Psychiatry. 2016;73(9):978–89.PubMedCrossRef
32.
Zurück zum Zitat Kroenke K, Krebs EE, Wu J, Yu Z, Chumbler NR, Bair MJ. Telecare collaborative management of chronic pain in primary care: a randomized clinical trial. JAMA. 2014;312(3):240–8.PubMedCrossRef Kroenke K, Krebs EE, Wu J, Yu Z, Chumbler NR, Bair MJ. Telecare collaborative management of chronic pain in primary care: a randomized clinical trial. JAMA. 2014;312(3):240–8.PubMedCrossRef
33.
Zurück zum Zitat Cheville AL, Moynihan T, Basford JR, Nyman JA, Tuma ML, Macken DA, et al. The rationale, design, and methods of a randomized, controlled trial to evaluate the effectiveness of collaborative telecare in preserving function among patients with late stage cancer and hematologic conditions. Contemp Clin Trials. 2018;64:254–64.PubMedCrossRef Cheville AL, Moynihan T, Basford JR, Nyman JA, Tuma ML, Macken DA, et al. The rationale, design, and methods of a randomized, controlled trial to evaluate the effectiveness of collaborative telecare in preserving function among patients with late stage cancer and hematologic conditions. Contemp Clin Trials. 2018;64:254–64.PubMedCrossRef
34.
Zurück zum Zitat Mooney KH, Beck SL, Wong B, Dunson W, Wujcik D, Whisenant M, et al. Automated home monitoring and management of patient-reported symptoms during chemotherapy: results of the symptom care at home RCT. Cancer Med. 2017;6(3):537–46.PubMedPubMedCentralCrossRef Mooney KH, Beck SL, Wong B, Dunson W, Wujcik D, Whisenant M, et al. Automated home monitoring and management of patient-reported symptoms during chemotherapy: results of the symptom care at home RCT. Cancer Med. 2017;6(3):537–46.PubMedPubMedCentralCrossRef
35.
Zurück zum Zitat Cleeland CS, Wang XS, Shi Q, Mendoza TR, Wright SL, Berry MD, et al. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol. 2011;29(8):994–1000.PubMedPubMedCentralCrossRef Cleeland CS, Wang XS, Shi Q, Mendoza TR, Wright SL, Berry MD, et al. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol. 2011;29(8):994–1000.PubMedPubMedCentralCrossRef
37.
Zurück zum Zitat Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.PubMedPubMedCentralCrossRef Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.PubMedPubMedCentralCrossRef
39.
Zurück zum Zitat Kroenke K, Unutzer J. Closing the false divide: sustainable approaches to integrating mental health services into primary care. J Gen Intern Med. 2017;32(4):404–10.PubMedPubMedCentralCrossRef Kroenke K, Unutzer J. Closing the false divide: sustainable approaches to integrating mental health services into primary care. J Gen Intern Med. 2017;32(4):404–10.PubMedPubMedCentralCrossRef
40.
Zurück zum Zitat Mularski RA, White-Chu F, Overbay D, Miller L, Asch SM, Ganzini L. Measuring pain as the 5th vital sign does not improve quality of pain management. J Gen Intern Med. 2006;21(6):607–12.PubMedPubMedCentralCrossRef Mularski RA, White-Chu F, Overbay D, Miller L, Asch SM, Ganzini L. Measuring pain as the 5th vital sign does not improve quality of pain management. J Gen Intern Med. 2006;21(6):607–12.PubMedPubMedCentralCrossRef
41.
Zurück zum Zitat Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res. 2008;17(2):179–93.PubMedCrossRef Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res. 2008;17(2):179–93.PubMedCrossRef
42.
Zurück zum Zitat Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.PubMedPubMedCentralCrossRef Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211.PubMedPubMedCentralCrossRef
43.
Zurück zum Zitat Huang H, Tabb KM, Cerimele JM, Ahmed N, Bhat A, Kester R. Collaborative care for women with depression: a systematic review. Psychosomatics. 2017;58(1):11–8.PubMedCrossRef Huang H, Tabb KM, Cerimele JM, Ahmed N, Bhat A, Kester R. Collaborative care for women with depression: a systematic review. Psychosomatics. 2017;58(1):11–8.PubMedCrossRef
44.
Zurück zum Zitat Nierenberg AA, McIntyre RS, Sachs GS. Improving outcomes in patients with bipolar depression: a comprehensive review. J Clin Psychiatry. 2015;76(3):e10.PubMedCrossRef Nierenberg AA, McIntyre RS, Sachs GS. Improving outcomes in patients with bipolar depression: a comprehensive review. J Clin Psychiatry. 2015;76(3):e10.PubMedCrossRef
45.
Zurück zum Zitat Atlantis E, Fahey P, Foster J. Collaborative care for comorbid depression and diabetes: a systematic review and meta-analysis. BMJ Open. 2014;4(4):e004706.PubMedPubMedCentralCrossRef Atlantis E, Fahey P, Foster J. Collaborative care for comorbid depression and diabetes: a systematic review and meta-analysis. BMJ Open. 2014;4(4):e004706.PubMedPubMedCentralCrossRef
46.
Zurück zum Zitat Jacob V, Chattopadhyay SK, Sipe TA, Thota AB, Byard GJ, Chapman DP, et al. Economics of collaborative care for management of depressive disorders: a community guide systematic review. Am J Prev Med. 2012;42(5):539–49.PubMedCrossRef Jacob V, Chattopadhyay SK, Sipe TA, Thota AB, Byard GJ, Chapman DP, et al. Economics of collaborative care for management of depressive disorders: a community guide systematic review. Am J Prev Med. 2012;42(5):539–49.PubMedCrossRef
47.
Zurück zum Zitat Boland L, Bennett K, Connolly D. Self-management interventions for cancer survivors: a systematic review. Support Care Cancer. 2018;26(5):1585–95.PubMed Boland L, Bennett K, Connolly D. Self-management interventions for cancer survivors: a systematic review. Support Care Cancer. 2018;26(5):1585–95.PubMed
48.
Zurück zum Zitat Bennett S, Pigott A, Beller EM, Haines T, Meredith P, Delaney C. Educational interventions for the management of cancer-related fatigue in adults. Cochrane Database Syst Rev. 2016;11:CD008144.PubMed Bennett S, Pigott A, Beller EM, Haines T, Meredith P, Delaney C. Educational interventions for the management of cancer-related fatigue in adults. Cochrane Database Syst Rev. 2016;11:CD008144.PubMed
49.
Zurück zum Zitat Kobleder A, Raphaelis S, Glaus A, Fliedner M, Mueller MD, Gafner D, et al. Recommendations for symptom management in women with vulvar neoplasms after surgical treatment: an evidence-based guideline. Eur J Oncol Nurs. 2016;25:68–76.PubMedCrossRef Kobleder A, Raphaelis S, Glaus A, Fliedner M, Mueller MD, Gafner D, et al. Recommendations for symptom management in women with vulvar neoplasms after surgical treatment: an evidence-based guideline. Eur J Oncol Nurs. 2016;25:68–76.PubMedCrossRef
50.
Zurück zum Zitat Hammer MJ, Ercolano EA, Wright F, Dickson VV, Chyun D, Melkus GD. Self-management for adult patients with cancer: an integrative review. Cancer Nurs. 2015;38(2):E10–26.PubMedCrossRef Hammer MJ, Ercolano EA, Wright F, Dickson VV, Chyun D, Melkus GD. Self-management for adult patients with cancer: an integrative review. Cancer Nurs. 2015;38(2):E10–26.PubMedCrossRef
51.
Zurück zum Zitat Te Boveldt N, Vernooij-Dassen M, Leppink I, Samwel H, Vissers K, Engels Y. Patient empowerment in cancer pain management: an integrative literature review. Psychooncology. 2014;23(11):1203–11.CrossRef Te Boveldt N, Vernooij-Dassen M, Leppink I, Samwel H, Vissers K, Engels Y. Patient empowerment in cancer pain management: an integrative literature review. Psychooncology. 2014;23(11):1203–11.CrossRef
52.
Zurück zum Zitat Howell D, Harth T, Brown J, Bennett C, Boyko S. Self-management education interventions for patients with cancer: a systematic review. Support Care Cancer. 2017;25(4):1323–55.PubMedCrossRef Howell D, Harth T, Brown J, Bennett C, Boyko S. Self-management education interventions for patients with cancer: a systematic review. Support Care Cancer. 2017;25(4):1323–55.PubMedCrossRef
53.
Zurück zum Zitat Lovell MR, Luckett T, Boyle FM, Phillips J, Agar M, Davidson PM. Patient education, coaching, and self-management for cancer pain. J Clin Oncol. 2014;32(16):1712–20.PubMedCrossRef Lovell MR, Luckett T, Boyle FM, Phillips J, Agar M, Davidson PM. Patient education, coaching, and self-management for cancer pain. J Clin Oncol. 2014;32(16):1712–20.PubMedCrossRef
54.
Zurück zum Zitat Goldzweig CL, Orshansky G, Paige NM, Miake-Lye IM, Beroes JM, Ewing BA, et al. Electronic health record-based interventions for improving appropriate diagnostic imaging: a systematic review and meta-analysis. Ann Intern Med. 2015;162(8):557–65.PubMedCrossRef Goldzweig CL, Orshansky G, Paige NM, Miake-Lye IM, Beroes JM, Ewing BA, et al. Electronic health record-based interventions for improving appropriate diagnostic imaging: a systematic review and meta-analysis. Ann Intern Med. 2015;162(8):557–65.PubMedCrossRef
55.
Zurück zum Zitat Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54.PubMedCrossRef Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54.PubMedCrossRef
56.
Zurück zum Zitat Eastaugh SR. Health economics: efficiency, quality, and equity. Westport: Auburn House; 1992. Eastaugh SR. Health economics: efficiency, quality, and equity. Westport: Auburn House; 1992.
59.
Zurück zum Zitat MN Disclosure Of Health Records For External Research, Statute. 144.295. 2018. MN Disclosure Of Health Records For External Research, Statute. 144.295. 2018.
60.
Zurück zum Zitat Snyder CF, Smith KC, Bantug ET, Tolbert EE, Blackford AL, Brundage MD, et al. What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer. 2017;123(10):1848–59.PubMedPubMedCentralCrossRef Snyder CF, Smith KC, Bantug ET, Tolbert EE, Blackford AL, Brundage MD, et al. What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer. 2017;123(10):1848–59.PubMedPubMedCentralCrossRef
64.
Zurück zum Zitat Miller K, Mosby D, Capan M, Kowalski R, Ratwani R, Noaiseh Y, et al. Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support. J Am Med Inform Assoc. 2018;25(5):585–92.PubMedCrossRef Miller K, Mosby D, Capan M, Kowalski R, Ratwani R, Noaiseh Y, et al. Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support. J Am Med Inform Assoc. 2018;25(5):585–92.PubMedCrossRef
65.
Zurück zum Zitat Main C, Moxham T, Wyatt JC, Kay J, Anderson R, Stein K. Computerised decision support systems in order communication for diagnostic, screening or monitoring test ordering: systematic reviews of the effects and cost-effectiveness of systems. Health Technol Assess. 2010;14(48):1–227.PubMedCrossRef Main C, Moxham T, Wyatt JC, Kay J, Anderson R, Stein K. Computerised decision support systems in order communication for diagnostic, screening or monitoring test ordering: systematic reviews of the effects and cost-effectiveness of systems. Health Technol Assess. 2010;14(48):1–227.PubMedCrossRef
66.
Zurück zum Zitat Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.PubMedPubMedCentralCrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.PubMedPubMedCentralCrossRef
67.
Zurück zum Zitat Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.PubMedPubMedCentralCrossRef Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.PubMedPubMedCentralCrossRef
68.
Zurück zum Zitat Taylor EF, Machta RM, Meyers DS, Genevro J, Peikes DN. Enhancing the primary care team to provide redesigned care: the roles of practice facilitators and care managers. Ann Fam Med. 2013;11(1):80–3.PubMedPubMedCentralCrossRef Taylor EF, Machta RM, Meyers DS, Genevro J, Peikes DN. Enhancing the primary care team to provide redesigned care: the roles of practice facilitators and care managers. Ann Fam Med. 2013;11(1):80–3.PubMedPubMedCentralCrossRef
69.
Zurück zum Zitat Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;8(3):CD001096. Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;8(3):CD001096.
70.
Zurück zum Zitat Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J. Effect of point-of-care computer reminders on physician behaviour: a systematic review. CMAJ. 2010;182(5):E216–25.PubMedPubMedCentralCrossRef Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J. Effect of point-of-care computer reminders on physician behaviour: a systematic review. CMAJ. 2010;182(5):E216–25.PubMedPubMedCentralCrossRef
71.
Zurück zum Zitat Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8.PubMedCrossRef Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8.PubMedCrossRef
73.
Zurück zum Zitat Storlie CB, Fugate ML, Higdon DM, Huzurbazar AV, Francois EG, McHugh DC. Methods for characterizing and comparing populations of shock wave curves. Technometrics. 2013;55(4):436–49.CrossRef Storlie CB, Fugate ML, Higdon DM, Huzurbazar AV, Francois EG, McHugh DC. Methods for characterizing and comparing populations of shock wave curves. Technometrics. 2013;55(4):436–49.CrossRef
74.
Zurück zum Zitat Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91.PubMedCrossRef Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91.PubMedCrossRef
75.
Zurück zum Zitat Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988.
76.
Zurück zum Zitat Soysal E, Wang J, Jiang M, Wu Y, Pakhomov S, Liu H, et al. CLAMP - a toolkit for efficiently building customized clinical natural language processing pipelines. J Am Med Inform Assoc. 2018;25:331–6.PubMedCrossRef Soysal E, Wang J, Jiang M, Wu Y, Pakhomov S, Liu H, et al. CLAMP - a toolkit for efficiently building customized clinical natural language processing pipelines. J Am Med Inform Assoc. 2018;25:331–6.PubMedCrossRef
77.
Zurück zum Zitat Kaggal VC, Elayavilli RK, Mehrabi S, Pankratz JJ, Sohn S, Wang Y, et al. Toward a learning health-care system - knowledge delivery at the point of care empowered by big data and NLP. Biomed Inform Insights. 2016;8(Suppl 1):13–22.PubMedPubMedCentral Kaggal VC, Elayavilli RK, Mehrabi S, Pankratz JJ, Sohn S, Wang Y, et al. Toward a learning health-care system - knowledge delivery at the point of care empowered by big data and NLP. Biomed Inform Insights. 2016;8(Suppl 1):13–22.PubMedPubMedCentral
78.
Zurück zum Zitat Aktas A, Walsh D, Kirkova J. The psychometric properties of cancer multisymptom assessment instruments: a clinical review. Support Care Cancer. 2015;23(7):2189–202.PubMedCrossRef Aktas A, Walsh D, Kirkova J. The psychometric properties of cancer multisymptom assessment instruments: a clinical review. Support Care Cancer. 2015;23(7):2189–202.PubMedCrossRef
79.
Zurück zum Zitat Locke DE, Decker PA, Sloan JA, Brown PD, Malec JF, Clark MM, et al. Validation of single-item linear analog scale assessment of quality of life in neuro-oncology patients. J Pain Symptom Manag. 2007;34(6):628–38.CrossRef Locke DE, Decker PA, Sloan JA, Brown PD, Malec JF, Clark MM, et al. Validation of single-item linear analog scale assessment of quality of life in neuro-oncology patients. J Pain Symptom Manag. 2007;34(6):628–38.CrossRef
80.
Zurück zum Zitat Paice JA, Cohen FL. Validity of a verbally administered numeric rating scale to measure cancer pain intensity. Cancer Nurs. 1997;20(2):88–93.PubMedCrossRef Paice JA, Cohen FL. Validity of a verbally administered numeric rating scale to measure cancer pain intensity. Cancer Nurs. 1997;20(2):88–93.PubMedCrossRef
81.
Zurück zum Zitat Singh JA, Satele D, Pattabasavaiah S, Buckner JC, Sloan JA. Normative data and clinically significant effect sizes for single-item numerical linear analogue self-assessment (LASA) scales. Health Qual Life Outcomes. 2014;12:187.PubMedPubMedCentralCrossRef Singh JA, Satele D, Pattabasavaiah S, Buckner JC, Sloan JA. Normative data and clinically significant effect sizes for single-item numerical linear analogue self-assessment (LASA) scales. Health Qual Life Outcomes. 2014;12:187.PubMedPubMedCentralCrossRef
82.
Zurück zum Zitat Kumar SP. Utilization of brief pain inventory as an assessment tool for pain in patients with cancer: a focused review. Indian J Palliat Care. 2011;17(2):108–15.PubMedPubMedCentralCrossRef Kumar SP. Utilization of brief pain inventory as an assessment tool for pain in patients with cancer: a focused review. Indian J Palliat Care. 2011;17(2):108–15.PubMedPubMedCentralCrossRef
83.
84.
Zurück zum Zitat Cleeland CS, Mendoza TR, Wang XS, Chou C, Harle MT, Morrissey M, et al. Assessing symptom distress in cancer patients: the M.D. Anderson Symptom Inventory. Cancer. 2000;89(7):1634–46.PubMedCrossRef Cleeland CS, Mendoza TR, Wang XS, Chou C, Harle MT, Morrissey M, et al. Assessing symptom distress in cancer patients: the M.D. Anderson Symptom Inventory. Cancer. 2000;89(7):1634–46.PubMedCrossRef
85.
Zurück zum Zitat Richardson LA, Jones GW. A review of the reliability and validity of the Edmonton Symptom Assessment System. Curr Oncol. 2009;16(1):55.PubMedPubMedCentral Richardson LA, Jones GW. A review of the reliability and validity of the Edmonton Symptom Assessment System. Curr Oncol. 2009;16(1):55.PubMedPubMedCentral
86.
Zurück zum Zitat Hjermstad MJ, Fayers PM, Haugen DF, Caraceni A, Hanks GW, Loge JH, et al. Studies comparing Numerical Rating Scales, Verbal Rating Scales, and Visual Analogue Scales for assessment of pain intensity in adults: a systematic literature review. J Pain Symptom Manag. 2011;41(6):1073–93.CrossRef Hjermstad MJ, Fayers PM, Haugen DF, Caraceni A, Hanks GW, Loge JH, et al. Studies comparing Numerical Rating Scales, Verbal Rating Scales, and Visual Analogue Scales for assessment of pain intensity in adults: a systematic literature review. J Pain Symptom Manag. 2011;41(6):1073–93.CrossRef
87.
Zurück zum Zitat Jeter K, Blackwell S, Burke L, Joyce D, Moran C, Conway EV, et al. Cancer symptom scale preferences: does one size fit all? BMJ Support Palliat Care. 2018;8(2):198–203.PubMedCrossRef Jeter K, Blackwell S, Burke L, Joyce D, Moran C, Conway EV, et al. Cancer symptom scale preferences: does one size fit all? BMJ Support Palliat Care. 2018;8(2):198–203.PubMedCrossRef
88.
Zurück zum Zitat Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63(11):1179–94.PubMedPubMedCentralCrossRef Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63(11):1179–94.PubMedPubMedCentralCrossRef
89.
Zurück zum Zitat Garcia SF, Cella D, Clauser SB, Flynn KE, Lad T, Lai JS, et al. Standardizing patient-reported outcomes assessment in cancer clinical trials: a patient-reported outcomes measurement information system initiative. J Clin Oncol. 2007;25(32):5106–12.PubMedCrossRef Garcia SF, Cella D, Clauser SB, Flynn KE, Lad T, Lai JS, et al. Standardizing patient-reported outcomes assessment in cancer clinical trials: a patient-reported outcomes measurement information system initiative. J Clin Oncol. 2007;25(32):5106–12.PubMedCrossRef
90.
Zurück zum Zitat Fries JF, Krishnan E, Rose M, Lingala B, Bruce B. Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther. 2011;13(5):R147.PubMedPubMedCentralCrossRef Fries JF, Krishnan E, Rose M, Lingala B, Bruce B. Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther. 2011;13(5):R147.PubMedPubMedCentralCrossRef
91.
Zurück zum Zitat Fries J, Rose M, Krishnan E. The PROMIS of better outcome assessment: responsiveness, floor and ceiling effects, and Internet administration. J Rheumatol. 2011;38(8):1759–64.PubMedCrossRef Fries J, Rose M, Krishnan E. The PROMIS of better outcome assessment: responsiveness, floor and ceiling effects, and Internet administration. J Rheumatol. 2011;38(8):1759–64.PubMedCrossRef
92.
Zurück zum Zitat Rose M, Bjorner JB, Gandek B, Bruce B, Fries JF, Ware JE Jr. The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency. J Clin Epidemiol. 2014;67(5):516–26.PubMedPubMedCentralCrossRef Rose M, Bjorner JB, Gandek B, Bruce B, Fries JF, Ware JE Jr. The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency. J Clin Epidemiol. 2014;67(5):516–26.PubMedPubMedCentralCrossRef
93.
Zurück zum Zitat Choi SW, Reise SP, Pilkonis PA, Hays RD, Cella D. Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Qual Life Res. 2010;19(1):125–36.PubMedCrossRef Choi SW, Reise SP, Pilkonis PA, Hays RD, Cella D. Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Qual Life Res. 2010;19(1):125–36.PubMedCrossRef
94.
Zurück zum Zitat Pilkonis PA, Yu L, Dodds NE, Johnston KL, Maihoefer CC, Lawrence SM. Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS) in a three-month observational study. J Psychiatr Res. 2014;56:112–9.PubMedPubMedCentralCrossRef Pilkonis PA, Yu L, Dodds NE, Johnston KL, Maihoefer CC, Lawrence SM. Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS) in a three-month observational study. J Psychiatr Res. 2014;56:112–9.PubMedPubMedCentralCrossRef
95.
Zurück zum Zitat Amtmann D, Kim J, Chung H, Bamer AM, Askew RL, Wu S, et al. Comparing CESD-10, PHQ-9, and PROMIS depression instruments in individuals with multiple sclerosis. Rehabil Psychol. 2014;59(2):220–9.PubMedPubMedCentralCrossRef Amtmann D, Kim J, Chung H, Bamer AM, Askew RL, Wu S, et al. Comparing CESD-10, PHQ-9, and PROMIS depression instruments in individuals with multiple sclerosis. Rehabil Psychol. 2014;59(2):220–9.PubMedPubMedCentralCrossRef
96.
Zurück zum Zitat Junghaenel DU, Schneider S, Stone AA, Christodoulou C, Broderick JE. Ecological validity and clinical utility of Patient-Reported Outcomes Measurement Information System (PROMIS(R)) instruments for detecting premenstrual symptoms of depression, anger, and fatigue. J Psychosom Res. 2014;76(4):300–6.PubMedPubMedCentralCrossRef Junghaenel DU, Schneider S, Stone AA, Christodoulou C, Broderick JE. Ecological validity and clinical utility of Patient-Reported Outcomes Measurement Information System (PROMIS(R)) instruments for detecting premenstrual symptoms of depression, anger, and fatigue. J Psychosom Res. 2014;76(4):300–6.PubMedPubMedCentralCrossRef
97.
Zurück zum Zitat Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef
99.
Zurück zum Zitat Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44(2):119–27.PubMedCrossRef Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44(2):119–27.PubMedCrossRef
100.
Zurück zum Zitat Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.PubMedPubMedCentralCrossRef Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.PubMedPubMedCentralCrossRef
102.
Zurück zum Zitat Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309.PubMedCrossRef Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309.PubMedCrossRef
103.
Zurück zum Zitat Storlie CB, Branda ME, Gionfriddo MR, Shah ND, Rank MA. Prediction of individual outcomes for asthma sufferers. Biostatistics. 2018;19(4):579–93.PubMedCrossRef Storlie CB, Branda ME, Gionfriddo MR, Shah ND, Rank MA. Prediction of individual outcomes for asthma sufferers. Biostatistics. 2018;19(4):579–93.PubMedCrossRef
104.
Zurück zum Zitat Cunanan KM, Carlin BP, Peterson KA. A practical Bayesian stepped wedge design for community-based cluster-randomized clinical trials: The British Columbia Telehealth Trial. Clin Trials. 2016;13(6):641–50.PubMedPubMedCentralCrossRef Cunanan KM, Carlin BP, Peterson KA. A practical Bayesian stepped wedge design for community-based cluster-randomized clinical trials: The British Columbia Telehealth Trial. Clin Trials. 2016;13(6):641–50.PubMedPubMedCentralCrossRef
105.
Zurück zum Zitat Ma J, Thabane L, Kaczorowski J, Chambers L, Dolovich L, Karwalajtys T, et al. Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: the Community Hypertension Assessment Trial (CHAT). BMC Med Res Methodol. 2009;9:37.PubMedPubMedCentralCrossRef Ma J, Thabane L, Kaczorowski J, Chambers L, Dolovich L, Karwalajtys T, et al. Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: the Community Hypertension Assessment Trial (CHAT). BMC Med Res Methodol. 2009;9:37.PubMedPubMedCentralCrossRef
106.
Zurück zum Zitat Belsley DA, Kuh E, Welsch RE. Regression diagnostics: identifying influential data and sources of collinearity. New York: Wiley; 1980.CrossRef Belsley DA, Kuh E, Welsch RE. Regression diagnostics: identifying influential data and sources of collinearity. New York: Wiley; 1980.CrossRef
107.
Zurück zum Zitat Bradley EH, Curry LA, Spatz ES, Herrin J, Cherlin EJ, Curtis JP, et al. Hospital strategies for reducing risk-standardized mortality rates in acute myocardial infarction. Ann Intern Med. 2012;156(9):618–26.PubMedPubMedCentralCrossRef Bradley EH, Curry LA, Spatz ES, Herrin J, Cherlin EJ, Curtis JP, et al. Hospital strategies for reducing risk-standardized mortality rates in acute myocardial infarction. Ann Intern Med. 2012;156(9):618–26.PubMedPubMedCentralCrossRef
108.
Zurück zum Zitat Luo S, Lawson AB, He B, Elm JJ, Tilley BC. Bayesian multiple imputation for missing multivariate longitudinal data from a Parkinson’s disease clinical trial. Stat Methods Med Res. 2016;25(2):821–37.PubMedCrossRef Luo S, Lawson AB, He B, Elm JJ, Tilley BC. Bayesian multiple imputation for missing multivariate longitudinal data from a Parkinson’s disease clinical trial. Stat Methods Med Res. 2016;25(2):821–37.PubMedCrossRef
109.
Zurück zum Zitat Epic: past accomplishments and futures challenges. Annual Epic Users’ Group Meeting; September 25–28, 2017; Verona, WI. Epic: past accomplishments and futures challenges. Annual Epic Users’ Group Meeting; September 25–28, 2017; Verona, WI.
Metadaten
Titel
Pragmatic cluster randomized trial to evaluate effectiveness and implementation of enhanced EHR-facilitated cancer symptom control (E2C2)
verfasst von
Lila J. Finney Rutten
Kathryn J. Ruddy
Linda L. Chlan
Joan M. Griffin
Jeph Herrin
Aaron L. Leppin
Deirdre R. Pachman
Jennifer L. Ridgeway
Parvez A. Rahman
Curtis B. Storlie
Patrick M. Wilson
Andrea L. Cheville
Publikationsdatum
01.12.2020
Verlag
BioMed Central
Erschienen in
Trials / Ausgabe 1/2020
Elektronische ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-04335-w

Weitere Artikel der Ausgabe 1/2020

Trials 1/2020 Zur Ausgabe