Skip to main content
Erschienen in: BMC Health Services Research 1/2011

Open Access 01.12.2011 | Study protocol

The effectiveness of the Liverpool care pathway in improving end of life care for dying cancer patients in hospital. A cluster randomised trial

verfasst von: Massimo Costantini, Simona Ottonelli, Laura Canavacci, Fabio Pellegrini, Monica Beccaro, the LCP Randomised Italian Cluster Trial Study Group

Erschienen in: BMC Health Services Research | Ausgabe 1/2011

Abstract

Background

Most cancer patients still die in hospital, mainly in medical wards. Many studies in different countries have shown the poor quality of end-of-life care delivery in hospitals. The Program "Liverpool Care Pathway for the dying patient" (LCP), developed in the UK to transfer the hospice model of care into hospitals and other care settings, is a complex intervention to improve the quality of end-of-life care. The results from qualitative and quantitative studies suggest that the LCP Program can improve significantly the quality of end-of-life care delivery in hospitals, but no randomised trial has been conducted till now.

Methods and design

This is a randomized cluster trial, stratified by regions and matched for assessment period. Pairs of eligible medical wards from different hospitals will be randomized to receive the LCP-I Program or no intervention until the end of the trial. The LCP-I Program will be implemented by a Palliative Care Unit.
The assessment of the end-points will be performed for all cancer deaths occurred in the six months after the end of the LCP-I implementation in the experimental wards and, in the same period of time, in the matched control wards. The primary end-point is the overall quality of end-of-life care provided on the ward to dying cancer patients and their families, assessed using the Global Scale of the Italian version of the Toolkit "After-death Bereaved Family Member Interview".

Discussion

This study can be interpreted as a Phase III trial according to the Medical Research Council Framework. In this study, the effectiveness of a fully defined intervention is assessed by comparing the distribution of the endpoints in the experimental and in the control arm.

Research ID

RFPS-2006-6-341619

Trial registration

ClinicalTrials.gov Identifier: NCT01081899
Hinweise

Electronic supplementary material

The online version of this article (doi:10.​1186/​1472-6963-11-13) contains supplementary material, which is available to authorized users.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MC is the principal investigator and the guarantor of this work. We include as co-authors all the members of the Steering group, distinguishing those who wrote significant parts of the paper (in the head of the manuscript) by the others (at the end of the paper as member of the study group). More specifically, MC, SO and MB designed the study protocol and the first draft of this paper; LC and MC wrote the Ethical considerations. MC and FP wrote the statistical aspects of the article. This paper was revised, discussed and emended by all the authors that approved the final version of the manuscript.

Background

Despite the development of palliative care services worldwide [1] and numerous studies showing that most cancer patients would prefer to die at home [2, 3], most cancer patients still die in hospital [3, 4]. Official Italian statistics on place of death are not available for Italy, but according to ISDOC survey [3], it is estimated that one third (34.6%) of cancer patients die in hospital, with broad geographical differences (from 60.2% in the North East to 4.6% in the South and islands). According to the ISDOC survey it is also possible to estimate that about 50% of all hospital cancer deaths occur on medical wards [3].
A number of studies carried out in different countries [58] have shown the poor quality of end-of-life care delivery in hospitals. Inappropriate end-of-life care may result in the continuation of invasive treatments that, in addition to having negative consequences in terms of resource management, negatively impact the quality of life of patients [9, 10]. The results of two Italian studies conducted in patients who died in hospital from cancer (ISDOC) and other conditions (EOLO) confirm what observed for other countries [11, 12].
Since the second half of the 90 s, research groups in the UK and the USA, have developed, implemented and started to evaluate the effect of the introduction of "Care Pathway" for end-of-life care in hospitals [1315]. The aim of these programs was to introduce the skills necessary to address the complex needs of dying patients and their families into the hospital setting, in an attempt to transfer the "hospice expertise" into a non-specialist context.
A "Care Pathway" is a set of evidence-based, medical and care practices aimed at specific groups of patients. The Care Pathway defines the expected course of events in patient care on an established timeline. Care pathways documentation becomes an integral part of the clinical documentation and allows outcomes assessment [16]. In the healthcare setting, Care Pathways have proved to be useful in improving efficiency and effectiveness of the process of care for various pathologies [17].
Among the different Care Pathways proposed at international level, the most structured and proficient seems to be the "Liverpool Care Pathway for the dying patient" (LCP) [13]. Developed in the UK to transfer the hospice model of care into hospitals and other care settings, it is currently in use in over 20 countries [18]. The implementation of the LCP Program, after an intensive training phase, revolves around the introduction of the LCP medical chart and other specific documentation for patients who have been assessed by a multidisciplinary team to be at the end of their life. The LCP documentation provides recommendations on different aspects of care including comfort measures, anticipatory prescription of medication and the assessment of nonessential medical treatments. It also provides guidance for the psychological and spiritual support of patients and their families. The LCP documentation allows the monitoring of results and supports the implementation of audit procedures.
The Italian version of the LCP - Un percorso integrato per le cure di fine vita in ospedale (LCP-I) - has been developed by the Regional Palliative Care Network of the National Cancer Research Institute of Genoa (Italy) in compliance with the original format. The final version has been endorsed by the Central Team UK, Marie Curie Palliative Care Institute Liverpool (MCPCIL).
In Italy, the LCP-I Program has been successfully piloted in 2007 in the Medical Ward of "Villa Scassi Hospital" in Genoa. The implementation process has been evaluated using a combined qualitative and quantitative approach. Focus groups, performed on sample of doctors and nurses before and after the implementation of the LCP-I, showed a perception of effectiveness of the Program, particularly in pain management and in communication with patients and their families.
The availability of an effective quality improvement program for the care of dying patients in hospitals is particularly relevant to the healthcare scenario. The LCP-I Program has provided enough evidence to justify a randomized trial to evaluate its effectiveness. Although the core objective of the LCP-I is improving the quality of end of life care for dying patients, the Program targets the healthcare professionals working on the hospital ward. The only feasible method of assessing the effectiveness of this Program is by performing a cluster trial, where hospital wards are randomized to receive (or not to receive) the implementation of the LCP-I Program.

Methods/Design

Study design

This is a randomized cluster trial, stratified by regions and matched for assessment period. Pairs of eligible medical wards from different hospitals will be randomized to receive the experimental intervention (the LCP-I Program) or no intervention until the end of the trial (Figure 1). In each experimental ward, the LCP-I Program will be implemented by a Palliative Care Unit (PCU) responsible for the implementation of the Program on the ward.

Primary aim

To evaluate the effectiveness of the LCP-I Program in improving the quality of end-of-life care provided to cancer patients who die on hospital medical wards as compared to standard healthcare practices.

Secondary aims

To evaluate the effectiveness of the LCP-I Program in terms of:
  • quality of communication between the healthcare professionals, patients and families;
  • quality of emotional support to family members before and after the patients' death;
  • coordination of care;
  • provision of care focusing on patient's individual needs;
  • patient's physical well-being through a better control of physical symptoms;
  • appropriateness of therapeutic and diagnostic procedures performed during the last days of the patient's life;
  • quality of communication between hospital staff and General Practitioners (GPs).

General procedures of the cluster trial

Pairs of eligible medical wards from different hospitals will be randomized to receive the experimental intervention (the LCP-I Program) or no intervention at all for the duration of the study (Figure 2). To avoid the risk of contamination, each hospital will be allowed to select only one eligible ward.
Immediately after randomization the PCU responsible for LCP-I implementation on the experimental ward will complete, as quickly as possible, all the organizational procedures required for the implementation of the Program. At the same time the Regional Coordination Structure will start baseline assessment in the experimental and control wards.
Baseline assessment will be performed by evaluating the quality of end-of-life care in each pair of randomized wards for all eligible cancer deaths in the 3 months before the randomization date (months -1 to -3 in Figure 2).
The LCP-I Program will be implemented in the experimental ward by the PCU (t1 to t6, Figure 2). The LCP-I Program has a duration of 6 months from the beginning of the intensive training (months 1-6 in the figure). No intervention will be implemented in the control ward until the end of the evaluation.
Effectiveness assessment (t7 to t12, Figure 2) will be performed by evaluating the quality of end-of-life care in each pair of randomized wards for all eligible cancer deaths occurring in the six months after the conclusion of the LCP-I Program in the experimental ward (months 7 to 12 in Figure 2).

End-points

Primary and secondary end-points will be evaluated using the same procedure for all eligible cancer deaths, in the baseline and in the effectiveness assessment.
The primary end-point of this trial is the overall quality of end-of-life care provided on the ward to dying cancer patients and their families. The quality of end-of-life care will be assessed using the Global Scale of the Italian version of the Toolkit "After-death Bereaved Family Member Interview" [19, 20]. The Toolkit is a semi-structured interview with the nonprofessional caregiver closest to the dying patient during the last days of life in hospital. The interview is focused on the patient's last week of life (or less for patients with shorter hospital stays) and on care provided to the caregivers before and after the patients' death.
The secondary aims will be assessed through an analysis of:
1.
other six scales from the Toolkit "After-death Bereaved Family Member Interview".
a.
Informing and promoting shared decision-making
 
b.
Encouraging advance care planning
 
c.
Focus on individual
 
d.
Attending to the emotional and spiritual needs of the family
 
e.
Providing coordination of care
 
f.
Supporting the self-efficacy of the family
 
 
2.
Symptom scales from the Italian version of VOICES [21]
a.
Pain
 
b.
Breathlessness
 
c.
Nausea and vomiting
 
 
3.
Diagnostic and therapeutic procedures effectively performed during the last 3 days of life
 
4.
The outcome of an interview with the GPs of patients who died on the wards and who are eligible for the assessment
 
Furthermore, the evaluation of two leaflets included in the LCP-I Program and delivered to family members after the patient's death is foreseen:
a.
"Some useful information", a leaflet delivered to the family members immediately after patient's death.
 
b.
"Facing the loss" a leaflet delivered to bereaved family members during a meeting after the patient's death.
 
The evaluation of the two leaflets is limited to the families of patients hospitalized in the experimental wards.

Eligibility criteria

Ward level

The inclusion criteria for each medical ward are:
  • classified in the regional records as "Medical", "General Medical" or "Internal Medical";
  • at least 25 cancer deaths on the ward per year. The data can be estimated from a review of deaths occurring on the ward over a minimum 6 month period during the two years preceding the start of the trial
  • consent from the Hospital Management to participate to the trial
  • consent from the Head of the Medical Ward to participate to the trial
  • consent from an expert and skills-trained PCU to implement the LCP-I Program
Exclusion criteria:
  • if in the same hospital another Medical Ward has already been randomly selected to participate in the research program (regardless of which arm was randomized).

Individual level

For the two assessment periods (baseline and effectiveness assessment) all cancer patients deceased in the ward during the evaluation period will be considered eligible. ICD- IX criteria will be used to identify cases from the original death certificate. If the patient was a relative of a doctor or a nurse working in the hospital where the ward is located the patient will be considered ineligible.

Procedures of assessment (Figure 3)

Primary and secondary end-points will be evaluated for all eligible cancer deaths as follows:
1.
Identification of eligible cancer deaths from the ward: the cancer deaths in the ward will be identified through the hospital's deaths documentation (which lists all deaths regardless of cause). Cancer deaths will be identified by the International Classification of Diseases-Ninth Revision (ICD-IX) criteria, applied to the causes of death as reported in the death certificate of the Italian National Institute of Statistics (ISTAT).
 
2.
Access to medical and nursing documentation for the assessment of care procedure
 
3.
Assessment of care procedures
 
4.
GP identification: name, address and telephone number of the GPs will be obtained by medical documentation. However, all information are available in the Regional Health records.
 
5.
5. Caregiver identification: information regarding the patients' principal caregiver (name, relationship, address and telephone number), as reported in the medical documentation, must be acquired. The principal caregiver is the person who was closest to the patient during his/her last week of life in hospital. It can be a family member (most frequent) or a friend. If the patient had no caregiver, the interview cannot be performed and the circumstances should be described in detail.
 
6.
Letter to GPs: an official letter, signed by the Regional Coordinator, describing the survey and announcing the telephone interview is sent to the deceased' GPs.
 
7.
GPs telephone Interview: this must take place within 4 months of the patients death and focuses on two aspects:
  • communication between ward staff and GPs
  • confirmation or integration of information regarding the patient's caregiver (name, relationship, address and telephone number).
 
8.
Final Caregiver identification: obtained from two main sources: medical documentation and/or patients' GPs.
 
9.
Caregiver Letter: an official letter, signed by the Regional Coordinator, introducing the study and announcing the telephone interview is sent to the caregiver.
 
10.
Phone contact with caregiver: it occurs 4-5 days after the letter is sent out. The interviewer refers to the contents of the letter and invites the caregiver to participate in an interview at a location of their choice.
 
11.
Caregiver Interview: the Caregiver Interview must take place between 2 and 4 months after the patients' death. it should be a face to face interview in a location chosen by the caregiver. Only in exceptional cases where the caregiver is unable to attend the face to face interview (i.e. the caregiver lives in inaccessible location) then the interview may be conducted by phone. When the caregiver is obviously distressed and unable to complete the interview, priority should be given to the section of the Toolkit relative to the overall evaluation (the 6 summary questions).
 

Randomisation

Randomization is centralized at the Trial Center of the National Cancer Research Institute (IST) of Genoa. The Regional Coordinators contact the IST Center for the randomization of coupled wards. Randomization lists for each region participating in the trial will be compiled by the Trial Center. The randomization will be carried out for pairs of wards. The sequence of each list will be defined by blocked 1:1 allocation. The randomization of the wards will be conducted by the Regional Coordinators by telephone or fax.
For each request, the trial center:
  • verifies the eligibility of the coupled wards
  • assigns a numerical code to the two wards
  • records the allocation of the wards

The LCP-I Program

The LCP-I Program is a continuous quality Improvement Program of end-of-life care implemented by a Palliative Care Unit (PCU) in a hospital Medical Ward. The Program is articulated in 10 steps.

Step 1-3: Development of the implementation project on the ward

  • Step 1: Establishing the project - preparing the environment
    • Identify and describe the characteristics of the ward
    • Identify and describe the characteristics of the PCU
    • Obtain consent from the subjects involved
    • Present the general outlines of the LCP-I Program to the ward staff
    • Outline the LCP-I Program on the ward
    • Begin the approval procedure for the training program
    • Register the Project at the National Center for LCP-I
  • Step 2: Developing the Documentation
    • Acquire educational materials for training
    • Prepare the necessary documentation for the ward
  • Step 3: Base review - Retrospective evaluation of variances related to end of life care on the ward
    • Review the medical documentation of the patients who died on the ward
    • Investigate the variances with the ward staff

Step 4-8: Implementation of the Program on the ward

The implementation of the LCP-I Program, following an intensive training phase, revolves around the introduction of the LCP-I medical chart and other specific documentation for patients who have been assessed by a multi-professional team to be approaching the end of their life. The LCP-I documentation provides recommendations on different aspects of care including comfort measures, anticipatory prescription of medication and the assessment of not appropriate medical and nursing interventions. It also provides guidance for the psychological and spiritual support of patients and their families. The LCP-I documentation allows the monitoring of results and supports the implementation of audit procedures.
  • Step 4: Induction of the Program. Intensive Education Program (duration less than a month)
    • 3 modules of 4 hours (12 hours total) repeated twice to allow the participation of all clinical ward staff (doctors and nurses).
  • Step 5: Clinical implementation of the LCP-I documentation. Intensive support to the ward staff (6 weeks)
    • the ward staff, closely supported (coaching, telephone and direct guidance, discussion of clinical cases) by the PCU team overseeing the implementation process, starts using the LCP-I documentation for dying patients.
  • Step 6: Semi-intensive support to the ward staff (6 weeks)
    • the ward staff, accompanied by the PCU team overseeing the implementation process, learns to use the LCP-I documentation as standard procedure for dying patients. Clinical audits are planned for difficult cases.
  • Step 7: Evaluation and further Training (end of the 4° month)
    • the PCU team evaluates the outcome of the preliminary steps with the aim of developing an appropriate training strategy for the ward staff during the subsequent stages of the implementation process.
  • Step 8: Consolidation phase (2 months)
    • the LCP-I documentation is established in the ward as an indicator of the quality of end of life care for all dying patients. The PCU team supports the ward staff using the most suitable tools for consolidation of the changes introduced by the LCP-I Program.

Step 9-10: sustainability of high standards of quality of end of life care on the ward

If the ward staff evaluates positively the use of the LCP-I documentation for dying patients, the PCU responsible for the implementation process, actively supports the development of a sustainable policy for the ward and hospital management. The strategy revolves around the institutionalization of the LCP-I documentation. A feasible approach is the development of a care strategy that guarantees and documents the maintenance of high standards in the quality of end of life care provided.
  • Step 9: Initiation of a strategy for sustainability
    • the LCP-I is established as routine procedure on the ward and in the hospital
    • develop an end-of-life care strategy for the ward.
  • Step 10: Regional and national strategy
    • use the outcome of the trial study to stimulate discussions at a regional and national level regarding issues linked to the quality of end-of-life care

Statistical methods

Primary end-point

The primary end-point of this trial is the overall quality of the end-of-life care provided by the ward staff to dying cancer patients and their families. The quality of end-of-life care will be assessed using the Global Scale of the "Toolkit After-death Bereaved Family Member Interview".
The Global Scale of the Toolkit is a combination of 6 items that are evaluated at the end of the interview on a 0-10 scale (see page 15 of the Toolkit). The scores of the 6 items are added up and linearized on a 0-100 scale where 0 equals poor quality and 100 equals high quality of care. Where answers are missing for one or more of the 6 items, the score is estimated for the item for which valid answers are available. To calculate the score on the Global Scale a minimum of 4 valid answers out of 6 are necessary.
The quality of the end-of-life care provided to dying patients, assessed with the Global Scale of the Toolkit, is expressed on a 0-100 scale where 0 equals poor quality and 100 equals excellent quality of care.

Sample size

An absolute increase of average scores on the Global Scale of the Toolkit of 10-15 points (in experimental wards compared to control wards) can be considered the minimum difference of clinical interest which justifies the implementation of the LCP -I Program. This increase, based on the results of the pilot study corresponds to an Effect Size (ES) of about 0.4. In order to estimate sample size in a cluster trial, along with Type I and II errors, two elements are essential: the intra-cluster correlation coefficient and the average size of the cluster (number of cluster deaths) [22]. So, for this trial:
  • the intraclass correlation coefficient can be estimated between 0.01 and 0.05 [23]
  • according to the review of cancer deaths on the Medical Wards potentially involved, we can expect an average number of cancer deaths in the 6 months of the assessment ranging between 15 and 20.
  • it is foreseen that the regions participating will be able to randomize 10 pairs of Medical Wards (20 clusters overall).
Data in the Table 1 intersect three ICC scenarios (from 0.01 to 0.1) with 4 scenarios of average cluster size (from 10 to 25). In the corresponding sections the total cluster required to achieve a cluster trial with a coefficient of 80% are reported to a two-tailed alpha error of 0.5 and an a hypothetical ES of 0.4. Table 1 reports different sample size scenarios necessary to detect an ES of 0.4 with alpha = 0.05 and a power of 80% conditional to the hypothesized levels of ICC (from 0.01 to 0.10) and average size of the clusters (from 10 to 25). According to the information reported in the previous paragraphs, it seems realistic to assume that the study is feasible with a total number of clusters no greater than 20 [22].
Table 1
Total number of clusters required according to different cluster sizes and ICC (ES = 0.4, alpha = 0.05, power = 0.80).
 
Average size of the clusters
Intraclass Correlation Coefficient
10
15
20
25
0.01
22
16
12
10
0.05
30
24
20
18
0.10
38
32
30
28

Statistical analysis

The centers and patients characteristics will be reported as mean and standard deviation (SD) or frequency and percentage, respectively, for continuous and categorical variables. The distribution of variables of clusters allocated as experimental or control wards will be compared with the t-Student test or one way ANOVA (for ordinal or continuous variables) and with the Pearson Chi-square (for binary or nominal variables).
The assessment of the primary end-point will take into account the clustered design of the trial through the use of hierarchical linear models [24, 25]. These models will be adjusted for the average level of quality of care provided to the baseline assessment. The results will be expressed in terms of beta coefficients of regression or in estimated marginal means, 95% Confidence Intervals (IC 95% CI) and level of significance. P-value < 0.05 will be considered statistically significant. The same approach will be used for the assessment of the continuous secondary end-points where there are continual variables. For the assessment of categorical secondary end-points with categorical variables, the hierarchical logistical model will be used.
All the analysis will be conducted using the SAS Statistical Package Release 9.1 (SAS Institute, Cary, NC, USA).

Ethical issues

Clinical guidelines for the care of dying patients are available but research promoting the acquisition of valid knowledge in this area is still lacking. This can be attributed, in part, to the ethical issues which inevitably arise when carrying out research in this field. The vulnerability of the individuals involved, often aggravated by physical and psychological conditions related to elevated levels of stress, poses serious ethical dilemmas. In addition, dying patients are often unaware of the diagnosis or the gravity of their illness or may be incapacitated. These circumstances, plus difficulties encountered in obtaining valid patient informed consent, constitute barriers which discourage research in the end-of-life care context.
Only a fraction of the above mentioned barriers affects this study. The LCP-I Program is not aimed at increasing knowledge about end-of-life care but at improving the quality of end-of-life care delivered in hospitals. The LCP-I Program introduces in a medical ward effective procedures currently practiced in hospices worldwide onto the hospital ward. Hence, this trial is not aimed at consolidating scientific knowledge regarding the clinical and non-clinical recommendations contained in the Program but rather at assessing the effectiveness of the entire Program as a tool for improving care delivery. In other words, the aim of this study is to assess if the Program succeeds in its intent of improving the quality of end-of-life care delivery on the hospital ward by shifting the attitudes and actions of clinical staff towards better care practices. The study population is the clinical ward staff and not the patients: the involvement of patients and their families is only necessary to verify the efficacy of the change toward a better quality of care delivery.
It is now widely recognized that healthcare institutions, and the medical workforce, have a moral obligation to promote and support interventions for improving medical practices. Although quality improvement activities share some of the characteristics of clinical research and the boundary between these two areas often overlap (in both cases the effectiveness of an intervention is measured) there are, nonetheless, fundamental differences between the two areas that justify the adoption of different procedures for guaranteeing ethical conduct. With consideration to these differences (the minimal risk for the patients involved in quality improvement programs, the demonstrable and immediate benefit to those directly concerned, the introduction of existing evidence-based practices, the flexible and not rigidly formalized protocols, the necessity and obligation for health care institutions to improve the of the quality of care practices, the indirect use of personal data, the absence of sponsors, the clear public interest, etc.), the related international literature highlights the inadequacy of applying the strict protection procedures of clinical research, particularly informed consent, to quality-improvement programs, and favors the adoption of different informative/consent procedures and, where possible, a responsible and informed participation of patients [26].
For the above mentioned reasons, it is evident that it is not feasible to request informed consent from the patients as, in this study, the target population is the clinical staff. However, in order to guarantee confidentiality to patients whose data could be used as indicators to verify the validity of the Program, certain procedures are recommended:
  • the ethics committee is required not only to express an opinion on the study, but also to carry out monitoring activities. More precisely, every 3 months the Scientific Coordinator will send to the Ethical Committee of the National Cancer Research Institute of Genoa and to the Ethical Committees of each trust involved in the trial a detailed progress report highlighting all variances, in particular with regards to the relations with the family. For any further clarification, each Ethical Committee can request the Scientific Coordinator's participation.
As far as ethical issues regarding the proper handling of data is concerned it is necessary to distinguish two different phases of the trial:
1.
collection and elaboration of data in the patients' medical documentation
 
2.
contact and interview with the caregivers
 
Regarding collection and elaboration of data from patients' medical documentation:
  • the processing of data included in medical documentation is considered of significant public interest, to that purpose, in agreement with Articles 20 and 21 of the Italian Confidentiality Laws, it is accessible to the National Health Service and other Public Health organizations for the planning, management, monitoring and evaluation of healthcare;
  • in theory the evaluation could be subject to informed consent of the terminal cancer patients (patients who might die of cancer). In fact, the patients involved in the Program evaluation, who are nearly always incapable of giving valid consent, are identified after death (as cancer deaths), regardless of whether they were hospitalized in a ward where it LCP-I Program was implemented;
  • in all cases, where the patients are competent and aware of their health status (parameters previously assessed independently in the LCP-I Program) and where there is considered no risk to the patient, the clinical ward staff will be trained to deliver information to the patient and to ask them the consent to the use of personal data. This procedure will be recorded in the medical records;
  • during the study and in subsequent publications, any personal data will be disaggregated and made anonymous.
Regarding contact with the caregivers, the initial contact will be made through a personal letter which includes detailed information and requests their permission to be contacted by telephone. The caregiver will be contacted by phone after at least 3 days and will be invited to participate in the interview. The interview will be conducted by specifically trained staff.
This procedure has been used successfully in the ISDOC survey [21], with very satisfactory results:
  • sampling of 2,000 cancer deaths in 30 Italian Local Healthcare Authorities' areas.
  • caregiver identification in 95% of cases (N = 1900)
  • realization of 1271 valid interviews (64% of the sample).
  • reasons for non-completion of the interviews: no caregiver identified (5%), refusal (20%), caregiver not contactable (8%), other (3%).
As described in a published article [21], the interviewers did not encounter particular resistance in the realization of the interviews. Many caregivers found the letter respectful of their circumstances and the information provided about the procedures and the objectives of the study relatively comprehensive. In only one case (out of 1900), a cancer patient's daughter complained that a letter, specifying the cause of her father's death, had been sent to her mother who had not been aware of the nature of her husband illness. Following this observation, the cause of death is not specified in the letter used in this study.
In conclusion, the cluster design of the study and the randomization of wards to receive or not LCP-I Program is necessary for a scientifically based assessment of the effectiveness of the Program. However, to ensure that all the wards involved can benefit from the improvement brought by the Program, unless it proves to be not effective, at the conclusion of the trial the implementation of the LCP-I Program will be proposed also to the control wards.

Approvals

The study was approved by the Ethics Committee of the National Cancer Research Institute of Genoa (Italy) on September 14th, 2009 (Reference number: CCP09.001).

Discussion

Although it is now widely shared that clinical practice should be, wherever possible, evidence-based, programs to improve the quality of care are often implemented without an evaluation of their effectiveness [27].
Assessing these interventions is a challenge for their complexity, due to the presence of different types of components, activities, interventions and outcomes to be achieved [27], and for specificity of the context of development and application.
The "Medical Research Council's Framework for the Development and Evaluation of Complex Interventions to Improve Health (MRC Framework) [28] is a promising and innovative approach aimed at providing a robust methodological basis to the evaluation of complex interventions. The MRC Framework has been used to develop and evaluate different treatments, services or public health interventions, including programs to improve the quality of care [2931].
As for as the evaluation of drugs, the MRC Framework is divided into five stages, from "pre-clinical" Phase to Phase IV. Each phase suggests the uses of appropriate quantitative and/or qualitative methodologies for the specific objectives of the phases, and requires a specific study design taking into account the theoretical basis, any evidence on the issue and the context's specificity [29]. More recently, it has been underlined that the MRC Framework is flexible and adaptable approach, and the five phases has not to be clearly separated [32]. For example, "pre-clinical phase" and phases I and II may be part of a unique approach that includes the study and understanding of the problem and context, the construction of models of intervention and the feasibility of assessment [32].
The LCP Program can be defined as a complex intervention to improve the quality of end-of-life care independently of diagnosis and place of death. The results from qualitative studies [3335] and from experimental assessments in non-randomized trials [36, 37] seem to suggest that the LCP Program can improve significantly, and over long-term, the quality of end-of-life care delivery in hospitals and other care settings. According to the MRC Framework, published research on the LCP completed the first three phases, from preclinical phases to phase II.
This study can be interpreted as a Phase III trial according to the MRC framework. In this study, the effectiveness of a fully defined intervention is assessed by comparing the distribution of the endpoints in the experimental arm and in the control arm. Although not all dying patients will be supported by the LCP Program, the assessment is planned on the whole sample of patients deceased in the experimental ward and in the correspondent control ward.
Cluster trial are often used for assessing interventions directed at a hospital team [22]. The validity of this protocol is supported by the results of a recent Cochrane Review [38] on the effectiveness of end-of-life pathways. The review did not find any randomised controlled trials, quasi-randomised trial or high quality controlled before and after studies, to include in the analysis. The authors concluded that there is a lack of evidence supporting such practice [38], and recommend the use of cluster randomised trials as the most effective study design in evaluating this approach [38].

Acknowledgements

We would like to acknowledge the following members of the LCP Randomised Italian Cluster Trial Study Group for their contributions to project design: Silvia Di Leo (Regional Palliative Care Network, National Cancer Research Institute, Genoa, Italy); Gabriella Morasso (Psychology Service, National Cancer Research Institute, Genoa, Italy); Guido Miccinesi (ISPO, Florence, Italy); Cinzia Brunelli, Cinzia Martini (Palliative Care Unit, National Cancer Institute, Milan, Italy); Carlo Peruselli, Sergio Grubich (Palliative Care Unit, Biella, Italy); Claudia Borreani (Psychology Service, National Cancer Institute, Milan, Italy); Danila Valenti, Catia Franceschini (Maria Teresa Chiantore Seragnoli Hospice Foundation, Bologna, Italy); Irene J Higginson (Department of Palliative Care, Policy & Rehabilitation, Cicely Saunders Institute, London, United Kingdom); John Ellershaw (Marie Curie Palliative Care Institute Liverpool, University of Liverpool, United Kingdom); Stein Kaasa (Palliative Medicine Unit, Trondheim, Norway).
This work was supported by the grant from the Italian Minister of Health (Progetto di Ricerca Finalizzata - RFPS-2006-6-341619) and from the Maruzza Lefebvre D'Ovidio Foundation-Onlus, Rome.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MC is the principal investigator and the guarantor of this work. We include as co-authors all the members of the Steering group, distinguishing those who wrote significant parts of the paper (in the head of the manuscript) by the others (at the end of the paper as member of the study group). More specifically, MC, SO and MB designed the study protocol and the first draft of this paper; LC and MC wrote the Ethical considerations. MC and FP wrote the statistical aspects of the article. This paper was revised, discussed and emended by all the authors that approved the final version of the manuscript.
Anhänge

Authors’ original submitted files for images

Literatur
1.
Zurück zum Zitat EAPC: Atlas of Palliative Care in Europe. 2007, European Association for Palliative Care: IAHPC Press; Milano EAPC: Atlas of Palliative Care in Europe. 2007, European Association for Palliative Care: IAHPC Press; Milano
2.
Zurück zum Zitat Higginson IJ, Sen-Gupta GJA: Place of care in advanced cancer: a qualitative systematic literature review of patients preferences. J Palliat Med. 2000, 3: 287-300. 10.1089/jpm.2000.3.287.CrossRefPubMed Higginson IJ, Sen-Gupta GJA: Place of care in advanced cancer: a qualitative systematic literature review of patients preferences. J Palliat Med. 2000, 3: 287-300. 10.1089/jpm.2000.3.287.CrossRefPubMed
3.
Zurück zum Zitat Beccaro M, Costantini M, Giorgi Rossi P, Miccinesi G, Grimaldi M, Bruzzi P, ISDOC Study Group: Actual and preferred place of death of cancer patients. Results from the Italian Survey of the Dying of Cancer. J Epidemiol Comm Health. 2006, 60: 412-416. 10.1136/jech.2005.043646.CrossRef Beccaro M, Costantini M, Giorgi Rossi P, Miccinesi G, Grimaldi M, Bruzzi P, ISDOC Study Group: Actual and preferred place of death of cancer patients. Results from the Italian Survey of the Dying of Cancer. J Epidemiol Comm Health. 2006, 60: 412-416. 10.1136/jech.2005.043646.CrossRef
4.
Zurück zum Zitat Davies E, Higginson IJ: Palliative care: the Solid Facts. 2004, WHO Regional Office for Europe, Copenhagen Davies E, Higginson IJ: Palliative care: the Solid Facts. 2004, WHO Regional Office for Europe, Copenhagen
5.
Zurück zum Zitat Middlewood S, Gardner G, Gardner A: Dying in Hospital: Medical Failure or Natural Outcome?. J Pain Symptom Manage. 2001, 22, 6: 1035-1041. 10.1016/S0885-3924(01)00362-1.CrossRef Middlewood S, Gardner G, Gardner A: Dying in Hospital: Medical Failure or Natural Outcome?. J Pain Symptom Manage. 2001, 22, 6: 1035-1041. 10.1016/S0885-3924(01)00362-1.CrossRef
6.
Zurück zum Zitat Teno JM, Clarridge BR, Casey V, Welch LC, Wetle T, Shield R, Mor V: Family perspective on end of life care at the last place of care. JAMA. 2004, 291: 88-93. 10.1001/jama.291.1.88.CrossRefPubMed Teno JM, Clarridge BR, Casey V, Welch LC, Wetle T, Shield R, Mor V: Family perspective on end of life care at the last place of care. JAMA. 2004, 291: 88-93. 10.1001/jama.291.1.88.CrossRefPubMed
7.
Zurück zum Zitat Eriksson E, Arve S, Lauri S: Informational and emotional support received by relatives before and after the cancer patient's death. Eur J Oncol Nurs. 2006, 10: 48-58. 10.1016/j.ejon.2005.04.003.CrossRefPubMed Eriksson E, Arve S, Lauri S: Informational and emotional support received by relatives before and after the cancer patient's death. Eur J Oncol Nurs. 2006, 10: 48-58. 10.1016/j.ejon.2005.04.003.CrossRefPubMed
8.
Zurück zum Zitat Sato K, Miyashita M, Morita T, Sanjo M, Shima Y, Uchitomi Y: Quality of end-of-life treatment for cancer patients in general wards and the palliative care unit at a regional cancer centre in Japan: a retrospective chart review. Support Care Cancer. 2008, 16: 113-122. 10.1007/s00520-007-0332-x.CrossRefPubMed Sato K, Miyashita M, Morita T, Sanjo M, Shima Y, Uchitomi Y: Quality of end-of-life treatment for cancer patients in general wards and the palliative care unit at a regional cancer centre in Japan: a retrospective chart review. Support Care Cancer. 2008, 16: 113-122. 10.1007/s00520-007-0332-x.CrossRefPubMed
9.
Zurück zum Zitat Lynn J, Teno J, Phillips R: Perceptions by family members of the dying experience of older and seriously ill patients. SUPPORT Investigators. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatments. Ann Intern Med. 1997, 126: 97-106.CrossRefPubMed Lynn J, Teno J, Phillips R: Perceptions by family members of the dying experience of older and seriously ill patients. SUPPORT Investigators. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatments. Ann Intern Med. 1997, 126: 97-106.CrossRefPubMed
10.
Zurück zum Zitat Sean STA, Low JA, Chan YH: Symptoms and care of dying elderly patients in an acute hospital. Singapore Med J. 2005, 46: 210-214. Sean STA, Low JA, Chan YH: Symptoms and care of dying elderly patients in an acute hospital. Singapore Med J. 2005, 46: 210-214.
11.
Zurück zum Zitat Toscani F, Di Giulio P, Brunelli C, Miccinesi G, Laquintana D, End-of-Life Observatory Group: How people die in hospital general wards: a descriptive study. J Pain Symptom Manage. 2005, 30: 33-40. 10.1016/j.jpainsymman.2005.01.013.CrossRefPubMed Toscani F, Di Giulio P, Brunelli C, Miccinesi G, Laquintana D, End-of-Life Observatory Group: How people die in hospital general wards: a descriptive study. J Pain Symptom Manage. 2005, 30: 33-40. 10.1016/j.jpainsymman.2005.01.013.CrossRefPubMed
12.
Zurück zum Zitat Beccaro M, Caraceni A, Costantini M: End-of-life care in Italian hospitals: quality of and satisfaction with care from the caregivers' point of view--results from the Italian Survey of the Dying of Cancer. J Pain Symptom Manage. 2010, 39: 1003-15. 10.1016/j.jpainsymman.2009.11.317.CrossRefPubMed Beccaro M, Caraceni A, Costantini M: End-of-life care in Italian hospitals: quality of and satisfaction with care from the caregivers' point of view--results from the Italian Survey of the Dying of Cancer. J Pain Symptom Manage. 2010, 39: 1003-15. 10.1016/j.jpainsymman.2009.11.317.CrossRefPubMed
14.
Zurück zum Zitat Bailey FA, Burgio KL, Woodby LL, Williams BR, Redden DT, Kovac SH, Durham RM, Goode PS: Improving processes of hospital care during the last hours of life. Arch Intern Med. 2005, 165: 1722-27. 10.1001/archinte.165.15.1722.CrossRefPubMed Bailey FA, Burgio KL, Woodby LL, Williams BR, Redden DT, Kovac SH, Durham RM, Goode PS: Improving processes of hospital care during the last hours of life. Arch Intern Med. 2005, 165: 1722-27. 10.1001/archinte.165.15.1722.CrossRefPubMed
15.
Zurück zum Zitat Bookbinder M, Blank A, Arney E, Wollner D, Lesage P, McHugh M, Indelicato RA, Harding S, Barenboim A, Mirozyev T, Portenoy RK: Improving end of life care: development and pilot test of a clinical pathway. J Pain Symptom Manage. 2005, 29: 529-543. 10.1016/j.jpainsymman.2004.05.011.CrossRefPubMed Bookbinder M, Blank A, Arney E, Wollner D, Lesage P, McHugh M, Indelicato RA, Harding S, Barenboim A, Mirozyev T, Portenoy RK: Improving end of life care: development and pilot test of a clinical pathway. J Pain Symptom Manage. 2005, 29: 529-543. 10.1016/j.jpainsymman.2004.05.011.CrossRefPubMed
19.
Zurück zum Zitat Teno JM, Casey VA, Welch LC, Edgman-Levitan S: Patient-Focused, Family- Centered End-of-Life Medical Care: Views of the Guidelines and Bereaved Family Members. J Pain Symptom Manage. 2001, 22: 738-751. 10.1016/S0885-3924(01)00335-9.CrossRefPubMed Teno JM, Casey VA, Welch LC, Edgman-Levitan S: Patient-Focused, Family- Centered End-of-Life Medical Care: Views of the Guidelines and Bereaved Family Members. J Pain Symptom Manage. 2001, 22: 738-751. 10.1016/S0885-3924(01)00335-9.CrossRefPubMed
20.
Zurück zum Zitat Teno JM, Clarridge B, Casey V, Edgman-Levitan S, Fowler J: Validation of Toolkit After-Death Bereaved Family Member Interview. J Pain Symptom Manage. 2001, 22: 752-758. 10.1016/S0885-3924(01)00331-1.CrossRefPubMed Teno JM, Clarridge B, Casey V, Edgman-Levitan S, Fowler J: Validation of Toolkit After-Death Bereaved Family Member Interview. J Pain Symptom Manage. 2001, 22: 752-758. 10.1016/S0885-3924(01)00331-1.CrossRefPubMed
21.
Zurück zum Zitat Costantini M, Beccaro M, Merlo F: The last three months of life of Italian cancer patients. Methods, sample characteristics and response rate of the Italian survey of the dying of cancer (ISDOC). Palliative Med. 2005, 19: 628-638. 10.1191/0269216305pm1086oa.CrossRef Costantini M, Beccaro M, Merlo F: The last three months of life of Italian cancer patients. Methods, sample characteristics and response rate of the Italian survey of the dying of cancer (ISDOC). Palliative Med. 2005, 19: 628-638. 10.1191/0269216305pm1086oa.CrossRef
22.
Zurück zum Zitat Campbell M: Sample size calculations for cluster randomised trial. J Health Serv Res & Policy. 2000, 5 (1): 12-16. Campbell M: Sample size calculations for cluster randomised trial. J Health Serv Res & Policy. 2000, 5 (1): 12-16.
23.
Zurück zum Zitat Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed
24.
Zurück zum Zitat Snijders TAB, Bosker RJ: Multilevel analysis: an introduction to basic and advanced multilevel modeling. 1999, London: SAGE Publications Snijders TAB, Bosker RJ: Multilevel analysis: an introduction to basic and advanced multilevel modeling. 1999, London: SAGE Publications
25.
Zurück zum Zitat Sullivan LM, Dukes KA, Losina E: Tutorial in biostatistics: an introduction to hierarchical linear modelling. Stat Med. 1999, 18: 855-88. 10.1002/(SICI)1097-0258(19990415)18:7<855::AID-SIM117>3.0.CO;2-7.CrossRefPubMed Sullivan LM, Dukes KA, Losina E: Tutorial in biostatistics: an introduction to hierarchical linear modelling. Stat Med. 1999, 18: 855-88. 10.1002/(SICI)1097-0258(19990415)18:7<855::AID-SIM117>3.0.CO;2-7.CrossRefPubMed
26.
Zurück zum Zitat Baily MA, Bottrell M, Lynn J, Jennings B: The ethics of using QI methods to improve health care quality and safety. Hastings Cent Rep. 2006, 36 (4): S1-40. 10.1353/hcr.2006.0054.CrossRefPubMed Baily MA, Bottrell M, Lynn J, Jennings B: The ethics of using QI methods to improve health care quality and safety. Hastings Cent Rep. 2006, 36 (4): S1-40. 10.1353/hcr.2006.0054.CrossRefPubMed
28.
Zurück zum Zitat Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321 (7262): 694-6. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321 (7262): 694-6. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
29.
Zurück zum Zitat Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral
30.
Zurück zum Zitat Higginson IJ, Vivat B, Silber E, Saleem T, Burman R, Hart S, Edmonds P: Study protocol: delayed intervention randomised controlled trial within the Medical Research Council (MRC) Framework to assess the effectiveness of a new palliative care service. BMC Palliat Care. 2006, 2: 5-7. Higginson IJ, Vivat B, Silber E, Saleem T, Burman R, Hart S, Edmonds P: Study protocol: delayed intervention randomised controlled trial within the Medical Research Council (MRC) Framework to assess the effectiveness of a new palliative care service. BMC Palliat Care. 2006, 2: 5-7.
31.
Zurück zum Zitat Sampson EL, Thuné-Boyle I, Kukkastenvehmas R, Jones L, Tookman A, King M, Blanchard MR: Palliative care in advanced dementia; A mixed methods approach for the development of a complex intervention. BMC Palliat Care. 2008, 7: 8-10.1186/1472-684X-7-8.CrossRefPubMedPubMedCentral Sampson EL, Thuné-Boyle I, Kukkastenvehmas R, Jones L, Tookman A, King M, Blanchard MR: Palliative care in advanced dementia; A mixed methods approach for the development of a complex intervention. BMC Palliat Care. 2008, 7: 8-10.1186/1472-684X-7-8.CrossRefPubMedPubMedCentral
32.
Zurück zum Zitat Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-9. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-9. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral
33.
Zurück zum Zitat Jack BA, Gambles M, Murphy D, Ellershaw JE: Nurses' perceptions of the Liverpool Care Pathway for the dying patient in the acute hospital setting. International Journal of Palliative Nursing. 2003, 9: 375-381.CrossRefPubMed Jack BA, Gambles M, Murphy D, Ellershaw JE: Nurses' perceptions of the Liverpool Care Pathway for the dying patient in the acute hospital setting. International Journal of Palliative Nursing. 2003, 9: 375-381.CrossRefPubMed
34.
Zurück zum Zitat Jack BA, Gambles M, Saltmarsh P, Murphy D, Hutchinson T, Ellershaw JE: Enhancing hospital nurses knowledge of palliative care: a network nurse programme. International Journal of Palliative Nursing. 2004, 10: 502-506.CrossRefPubMed Jack BA, Gambles M, Saltmarsh P, Murphy D, Hutchinson T, Ellershaw JE: Enhancing hospital nurses knowledge of palliative care: a network nurse programme. International Journal of Palliative Nursing. 2004, 10: 502-506.CrossRefPubMed
35.
Zurück zum Zitat Gambles M, Stirzaker S, Jack BA, Ellershaw JE: The Liverpool Care Pathway in hospices: an exploratory study of doctor and nurse perceptions. International Journal of Palliative Nursing. 2006, 12 (9): 414-421.CrossRefPubMed Gambles M, Stirzaker S, Jack BA, Ellershaw JE: The Liverpool Care Pathway in hospices: an exploratory study of doctor and nurse perceptions. International Journal of Palliative Nursing. 2006, 12 (9): 414-421.CrossRefPubMed
36.
Zurück zum Zitat Veerbeek L, van der Heide A, de Vogel-Voogt E, de Bakker R, van der Rijt CC, Swart SJ, van der Maas PJ, van Zuylen L: Using the LCP: Bereaved Relatives' Assessment of Communication and Bereavement. Am J Hosp Palliat Care. 2008, 25 (3): 207-14. 10.1177/1049909108315515.CrossRefPubMed Veerbeek L, van der Heide A, de Vogel-Voogt E, de Bakker R, van der Rijt CC, Swart SJ, van der Maas PJ, van Zuylen L: Using the LCP: Bereaved Relatives' Assessment of Communication and Bereavement. Am J Hosp Palliat Care. 2008, 25 (3): 207-14. 10.1177/1049909108315515.CrossRefPubMed
37.
Zurück zum Zitat Veerbeek L, van Zuylen L, Swart SJ, van der Maas PJ, de Vogel-Voogt E, van der Rijt CC, van der Heide A: The effect of the Liverpool Care Pathway for the dying: a multi-centre study. Palliat Med. 2008, 22 (2): 145-51. 10.1177/0269216307087164.CrossRefPubMed Veerbeek L, van Zuylen L, Swart SJ, van der Maas PJ, de Vogel-Voogt E, van der Rijt CC, van der Heide A: The effect of the Liverpool Care Pathway for the dying: a multi-centre study. Palliat Med. 2008, 22 (2): 145-51. 10.1177/0269216307087164.CrossRefPubMed
38.
Zurück zum Zitat Chan R, Webster J: End-of-life care pathways for improving outcomes in caring for the dying. Cochrane Database Syst Rev. 2010, CD008006-1 Chan R, Webster J: End-of-life care pathways for improving outcomes in caring for the dying. Cochrane Database Syst Rev. 2010, CD008006-1
Metadaten
Titel
The effectiveness of the Liverpool care pathway in improving end of life care for dying cancer patients in hospital. A cluster randomised trial
verfasst von
Massimo Costantini
Simona Ottonelli
Laura Canavacci
Fabio Pellegrini
Monica Beccaro
the LCP Randomised Italian Cluster Trial Study Group
Publikationsdatum
01.12.2011
Verlag
BioMed Central
Erschienen in
BMC Health Services Research / Ausgabe 1/2011
Elektronische ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-13

Weitere Artikel der Ausgabe 1/2011

BMC Health Services Research 1/2011 Zur Ausgabe