The VenUS 6 parallel-group randomised controlled trial (RCT) will compare the clinical and cost-effectiveness of compression wraps, two-layer compression bandage and evidence-based compression therapy, comprising of two-layers of hosiery or four-layer bandages, for healing time of venous leg ulcers. We will conduct an embedded process evaluation to evaluate the implementation of the trial and the various compression therapies and to gain a more in-depth understanding of trial participant and nursing staff views and experiences of these therapies.
Methods
This process evaluation will be a mixed-method study, embedded into a wider RCT. Qualitative data will be collected through semi-structured individual in-depth interviews with trial participants and staff members. Quantitative data will be collected using patient questionnaires and case report forms that are part of the main trial data collection process. Interview transcripts will be analysed using the Framework Analysis and interview data will be integrated with quantitative RCT data using the RE-AIM framework and the Pillar Integration Process.
Discussion
We describe the protocol for a process evaluation, designed to assess the implementation of the various venous leg ulcer compression therapies as evaluated in VenUS6, and the experiences of trial participants and nursing staff using these. This protocol provides one example of how an embedded mixed-method process evaluation can be conducted.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
MRC
Medical Research Council
NIHR
National Institute for Health Research
PPI
Patient and Public Involvement
RCT
Randomised controlled trial
TMG
Trial Management Group
UK
United Kingdom
VLU
Venous leg ulcer
YTU
York Trials Unit
Background
Venous leg ulcers (VLU) are common, recurring open wounds on the lower leg, caused by impaired blood flow in diseased or damaged leg veins. Sluggish blood flow increases venous pressure, which can severely impair wound healing [1]. VLUs are a symptom of severe venous disease and are one of the most common complex wounds in the United Kingdom (UK) [2, 3].
Compression therapy is a guideline-recommended first-line treatment for VLUs, involving the application of tight bandages, stockings, or other systems around the leg [1]. The graduated pressure applied by these devices aims to improve blood flow up the leg veins, reduce venous hypertension and promote ulcer healing [4].
Anzeige
There is randomised controlled trial (RCT) evidence that compression therapy reduces time to healing compared with no compression in people with venous leg ulcers [5]. Further RCT evidence suggests that multi-layer compression therapy, using multiple bandages or stockings layered over each other on the leg, is more effective than those with a single layer [6‐8]. Two-layer compression bandages have been developed to deliver the same full compression of four-layer bandages but with reduced bulk. More recently, adjustable hook-and-loop fastened compression wraps have been introduced. While compression stockings and compression wraps can be given to patients for self-application, bandages must be applied by trained staff [9]. However, as of yet, there is a lack of evidence for the effectiveness of these treatments.
To generate further comparative evidence on the relative effects of compression therapies, the UK National Institute for Health and Care Research (NIHR) funded VenUS 6 [9, 10]. This three-arm parallel-group RCT will compare the clinical and cost-effectiveness of compression wraps and two-layer compression bandages with evidence-based compression, consisting of either four-layer bandages or two-layer compression stockings [9]. Figure 1 provides an overview of the data that will be collected as part of the main RCT. The primary outcome measure will be time to healing of the reference ulcer, while secondary outcomes include, amongst others, changes to allocated treatment and reasons for changes, health-related quality of life, adherence to treatment and ulcer-related pain [11].
Fig. 1
VenUS 6 SPIRIT figure
×
Compression therapy can be considered a complex intervention, involving both the devices themselves and the requirements of staff and patients, regarding application of the therapy. The UK Medical Research Council (MRC) recommends that relative effectiveness estimates from RCTs of complex interventions should be interpreted alongside process evaluation findings [12]. A process evaluation aims to better understand the reality of intervention implementation and further explore causal mechanisms and contextual factors that help shape RCT outcomes [12]. The process evaluation can help explain discrepancies between hypotheses and observed outcomes in the RCT, may shed light on the ‘black box’ of complex interventions, provide information to interpret outcome results and aid future implementation of research findings into practice. A process evaluation can thus help distinguish between interventions that are inherently faulty and those that are badly delivered [13]. Combining process evaluations with RCTs can enable the development of detailed understandings of causality that can support a policymaker or practitioner in interpreting effectiveness data [12]. Apart from explaining trial outcomes, a process evaluation can also shed light on trial processes, allowing researchers to intervene during data collection. For example, in a 2007 RCT regarding a computerised decision support tool for patients with atrial fibrillation, one of the trial arms was discontinued, after the process evaluation showed patients did not understand the exercise offered as part of the discontinued arm [14].
In this study, we aim to evaluate the implementation of the various compression therapies for the treatment of venous leg ulcers to gain a more in-depth understanding of trial participant and nursing staff views and experiences of various compression therapies, and to help consider how these views and experiences may explain VenUS6 outcomes. Additionally, we aim to learn more about the experiences of staff and participants regarding trial implementation. The process evaluation will be informed by the RE-AIM implementation framework [15].
Anzeige
Methods
This process evaluation is a mixed-method study nested within VenUS 6 [11]. Qualitative data will be collected through semi-structured individual in-depth interviews with trial participants and nursing staff at trial sites. Quantitative data will be collected using patient questionnaires and case report forms that are part of the main RCT data collection process, as explained in Fig. 1 [11]. As quantitative data collection and analyses are detailed in the trial protocol [9‐11]; this paper focuses on qualitative data collection, analysis and synthesis of qualitative and quantitative data. We used SPIRIT reporting guidelines for this manuscript, and a SPIRIT checklist is provided in supplementary materials (Additional file 1) [16]. Quantitative and qualitative findings will be integrated with the help of the Pillar Integration Process. Additionally, the RE-AIM framework [15] will be used to guide the synthesis of findings regarding the implementation of the trial and compression therapy.
Trial participant sampling and recruitment
We will contact VenUS6 participants who, at trial recruitment, consented to be approached about participation in interviews. Details of participants who have provided consent along with their contact details and information about the group they were randomised to will be transferred securely via encrypted email from York Trials Unit (YTU) to MK at The University of Manchester. A purposive sampling process will be used with the aim of including a sample with maximum variation regarding age, gender and pain experienced. We aim to conduct interviews until data saturation has been reached. As a previous study explored people’s experiences of, largely, compression bandages and hosiery use [17], we may consider oversampling of participants who have been randomised to compression wraps within this study, as less evidence is available regarding implementation of and experience with compression wraps.
Data will be reviewed regularly to determine if sufficient data has been collected to answer the research question. If there are gaps or topics that require additional exploration further interviews may be conducted accordingly.
Nursing staff sampling and recruitment
We will aim to include a variety of staff members involved in trial recruitment and providing compression treatment at VenUS6 sites. In the interviews with staff, we will aim to learn more about the context of providing compression treatment and the implementation of trial processes at participating sites, including recruitment, trial participants switching treatment after randomisation and trial participant withdrawal. We will recruit until we believe we have reached data saturation and are no longer identifying new themes.
Staff will be approached by their site principal investigator who will provide them with a brief description of the qualitative study and the participant information leaflet. If the nurses are willing to participate their contact details and consent will be collected by YTU and provided via secure encrypted email to The University of Manchester. Subsequently, potential participants will be called to arrange a date and time for the interview. Additionally, we will invite some site Principal Investigators and nurses based in the site study teams to participate in an interview, to learn more about trial processes at various sites.
In addition to the interviews, we will conduct a service evaluation with the help of an anonymous survey (Additional file 3), aimed to obtain wider information about the following: how easy staff find it to apply the various compression treatments that are part of VenUS6, how staff access compression therapies and how long it takes for the treatment to arrive. Finally, we will ask them how easy they think patients normally find applying compression wraps or two-layer hosiery themselves.
Data collection
Interviews will be primarily held via telephone, but videoconference interviews will also be offered if participants prefer this and have access to the appropriate technology.
With permission of participants, the semi-structured individual in-depth interviews will be recorded with an encrypted recording device. As participants will have provided written informed consent to be contacted for an interview previously, participants will be asked to reconfirm consent before the start of the interview. This will be documented in a separate recording, which will be saved in an encrypted file in a password-protected trusted and secure Research Storage Area at the University of Manchester. Interviews will be transcribed by one of the researchers.
Anzeige
Full topic guides are available in supplementary materials (Additional file 2). During trial participant interviews, we will aim to learn more about participants’ experiences with their leg ulcer, experiences with their assigned compression therapy and their views on trial participation. The following topics will be discussed:
Experiences of leg ulcer(s)
Experiences of study enrolment and involvement
Experiences with compression therapy
Reasons for non-adherence (if applicable)
Interviews with staff members will be aimed at learning more about staff experiences with providing compression therapy, including training provided. Additionally, we will discuss patient adherence to therapy. We will ask participating nurses about their experiences of trial recruitment and trial involvement as well as contextual factors that potentially impacted trial participation, adherence and compression therapy provided. The following topics will be discussed:
Perceptions and experience of compression therapy
Adherence to compression therapy
Education and training provided to staff members
Experiences of trial recruitment
Experiences of trial involvement
The survey will be developed in Qualtrics and distributed via YTU networks.
Data analysis
We will complete the process evaluation data analysis before the trial outcomes are known, as recommended by Moore et al. to avoid biased interpretation. Qualitative data will be analysed with the help of the Framework Method for analysis of qualitative data, as developed by Ritchie and Spencer [18] and applied to healthcare research by Gale et al. [19]. The method developed by Ritchie consists of five key stages: familiarisation, identification of thematic framework, indexing, charting and mapping and interpretation [18]. Gale et al. added two stages to better coordinate the process, including transcription and coding [19]. The framework method consists of clear steps to be followed during data analysis, which leads to highly structured outputs of summarised data, providing a starting point for the integration of qualitative and quantitative data [19].
Anzeige
An initial coding framework will be developed after the first four interviews have been conducted. Interview findings will be discussed with the Trial Management Group and where required actions will be undertaken with individual sites or across the trial as needed.
Staff and patient interview outcomes will be analysed according to the same analytical framework. The seven stages of the framework method are summarised in Table 1 [19].
Table 1
Overview of framework method as applied to the process evaluation in VenUS6
Stage
Description
Transcription
Audio recordings will be transcribed verbatim. To provide a contextual background of the interview process for telephone interviews notes regarding silences and interruptions will be taken
Familiarisation
Interview transcripts will be read and re-read, and notes regarding deviant cases or contrasting views of participants, including very strong opinions, will be taken. A short memo will be written about each interview transcript
Coding
Initially, four transcripts will be coded in NVivo. Two transcripts will be randomly selected to be independently coded by a second coder, to check for consistency. Coding will be discussed among the researchers and any discrepancies will be resolved
Developing framework
Codes for the first four transcripts will be integrated into categories, based on similarity, to develop an analytical framework. The developed framework will first be applied to the coded transcripts to assess fit or lack of fit. The fit will be discussed, and the analytical framework will be adapted based on the outcomes of the discussion. The developed framework will subsequently be presented to the Patient and Public Involvement (PPI) members and the Trial Management Group (TMG) and adapted according to discussion outcomes
Applying framework
The adapted analytical framework will be applied to index transcripts using the codes and categories as defined
Charting
Once all transcripts have been coded, the various codes will be charted into a matrix in Microsoft Excel. Each category will be listed as a column, with interview participants listed in the rows. Data from transcripts will be added to the matrix. The developed matrix will be discussed among the researchers and adapted according to the outcome of these discussions
Interpretation
Categories will be integrated into themes, based on similarity. Per theme, a memo will be developed, including a summary of data relevant to the theme, potential convergence and divergence among participants, as well as the categories and codes involved in the theme. The memo will contain some further points for consideration and potential gaps, and developed memos will be discussed among the researchers before they are presented to the TMG and PPI members for their comments. Memos will be adapted according to the outcomes of the discussions
The survey will be analysed with the help of descriptive statistics.
Data synthesis
Pillar Integration Process
The Pillar Integration Process (PIP) [20] will be used to integrate the quantitative and qualitative findings. PIP consists of four stages, as outlined in Table 2. We will use the RE-AIM framework to guide data synthesis for findings regarding the implementation of the various compression therapies as well as trial implementation [15].
Table 2
Pillar Integration Process stages as applied to the process evaluation in VenUS6 [20]
Stage
Description
Listing
Five columns will be developed in Microsoft Excel, two columns on the left for quantitative findings and quantitative categories (grouped data), a central column for the ‘pillars’ and two columns on the right for qualitative findings, including a column for themes and a column including quotes that illustrate the themes. In collaboration with the trial statistician, hypothesised quantitative data will be listed and, if possible, categorised based on similarity
Matching
Qualitative data will be matched to the listed quantitative data. Qualitative data, including quotes, will be added in the opposite qualitative column. In each row, the qualitative items will reflect patterns, parallels, similarities or differences with the quantitative findings. Quantitative and qualitative findings that do not have a match will be left blank, highlighting gaps in the data
Checking
Once all data are matched, the developed matrix will be checked for consistency and to ensure no appropriate match could be provided for unmatched quantitative and qualitative findings. The lists and matches will be refined and/or modified based on the discussion
Pillar Building
Findings developed in the previous stages will be compared to develop the pillars. Memos, describing inferences about patterns, insights and themes that have emerged will be developed and summarised into the ‘PILLAR’ column, which will contain the integrated findings from each row. Pillars will be discussed with researchers before they are presented to the TMG and PPI members for their input. Pillars will be finalised according to the outcomes of the discussions
Logic model development
Findings will be presented in a logic model as per Petersen et al. and Ebenso et al., shown in Fig. 2 [21, 22]. The logic model will contain important inputs, including staff and patient inputs, that feed into processes. These processes will subsequently lead to, or prevent, intermediate outcomes, also called outputs, and ultimate outcomes. All of this is influenced by contextual factors, which act at meso, macro and micro levels.
Fig. 2
Overview of logic model, based on Petersen et al. and Ebenso et al. [21, 22]
×
Discussion
We described the protocol for a process evaluation, designed to assess the implementation of the various compression therapies evaluated in VenUS 6, and experiences of trial participants and nursing staff with the various compression therapies. In this protocol, we described how the qualitative data will be collected and integrated with quantitative data using the Pillar Integration Process.
Anzeige
A strength of the presented process evaluation is the embedded mixed method approach, where qualitative data are collected within a wider, well-resourced RCT complemented with qualitative data. The qualitative data will help tell the story behind the quantitative data, explaining the trial processes and outcomes and potentially providing some insight into what helped shape RCT outcomes. An additional strength is our use of RE-AIM [15] to guide data synthesis and the PIP, which will provide a structured way of integrating qualitative and quantitative findings, for integration of qualitative process evaluation findings with quantitative RCT findings. Additionally, the Framework Analysis will support the integration of data in the data synthesis stage.
The process evaluation will allow us to identify reasons for the lack of recruitment or, for example, for large numbers of non-adherence to assigned compression treatments. The process evaluation will start when the recruitment of participants in the wider trial is still taking place, allowing us to intervene at some sites where recruitment may be lacking. A further strength of the study will be MK’s outsider status for the day-to-day running of the trial and treatment for participants. MK will not be involved in trial recruitment, assigning treatment or providing treatment. We hope this will encourage participants to share their experiences with MK, which is a strength of the study.
One limitation includes selection bias, as we will only be able to include those trial participants who have consented to be approached for participation; indeed, the number of each type of participant we intend to recruit precludes us from recruiting from every participating site. Furthermore, those who have consented may be more enthusiastic about trial participation than those who did not consent.
In conclusion, this process evaluation protocol provides one example of how an embedded mixed-method process evaluation can be conducted. We hope that the process evaluation will provide us with a more in-depth understanding of the implementation process of various compression therapies and trial participant and staff experiences with the compression therapies, as well as insight into potential issues relating to trial processes, such as recruitment, adherence and withdrawal.
Trial status
The trial is ongoing. Recruitment for the main trial commenced on 03 February 2021. The expected recruitment completion date is April 2024.
Acknowledgements
The research team would like to thank the study participants who have kindly agreed to take part in this study and our patient and public involvement representatives whose input has been indispensable in developing study documentation.
We would also like to thank the members of the Trial Management Group: Una Adderley, Ian Chetter, Nicky Cullum, Tom Davill, Catherine Hewitt, Charlotte Hirst, Julie Mullings, Gareth Roberts, Pedro Saramago, Brigid Smart, Marta Soares, Philip Stather, Luke Strachan, Nikki Stubbs, David Torgerson, Jude Watson, Charlie Welch and Sabeen Zahra.
Declarations
Ethics approval and consent to participate
Ethical approval for this trial has been granted by the West of Scotland 4 Research Ethics Committee—reference 20-WS-0121 (approval date: 15 September 2020). Participants are required to provide informed consent prior to participation.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
