Background
Methods
-
Familiarise participants with system thinking and system dynamics concepts (e.g. interconnections, feedback loops, time delays).
-
Develop a shared understanding of a complex issue (i.e. the commercial determinants of dietary behaviour associated with obesity in adolescence) and portray it in a system map that depicts the most important factors and how they interact at various levels.
-
Encourage participants to see the “big picture” and think about ways to intervene at the system level to achieve change.
-
Build a system map that depicts their views of the most important factors, shaped by the food and beverage industry, that influence what they choose to buy and eat.
-
Encourage them to think about policy / solution ideas to the problem to achieve a systemic change.
-
Share the system map and policy ideas created by adolescents and compare their views on how food and beverage industries influence what adolescents choose to buy and eat.
-
Discuss the most explored / and unexplored areas on the map in policymaking efforts.
-
Discuss barriers to implementation of policies that could have the highest impact on adolescent’s dietary behaviour and obesity.
-
Explore the possibility of using the system map as a communication tool to incorporate the commercial determinants of dietary behaviour into current public health thinking.
-
Explore the potential for the implementation of some of the policy ideas proposed at a local authority level.
Scriptapedia script name | Aim of script |
---|---|
Process mapping | This script is used at the beginning of the GMB planning. It helps in planning and developing a shared understanding of the GMB process, select the number of workshops needed, and identify the number of participants you would like to involve in each workshop and establish the inputs and outputs for each workshop |
Hopes and fears | This script is used at the beginning of the GMB workshop to determine group expectations |
Variable elicitation | This script is used at the start of the system building phase. It prompts group discussion about the problem, the elements the group believes causes or contributes to the problem, and helps to set the boundaries of the system |
Graphs Over Time | This script is used at the beginning of the GMB workshop as it aims to engage participants in a more detailed discussion about the problem. It is used to frame the problem, elicit potential influential variables, and decide the reference modes for the workshop |
Connection Circle | This script it used to visualise the variables and the interconnections between the variables participants believe to be important in causing or contributing to the problem |
CLD from Connection Circle | This script is used after visualising the variables in a connection circle. It helps to create a CLD by identifying the hypothesized causal relationships between variables and feedback loops |
Causal Mapping with Seed Structure | When there is an initial causal structure of the problem being discussed (from a review of the literature or previous workshops), this script helps to exemplify how the problem involves a system of interacting feedback loops |
Model Review | This script is used at the end of the workshop to recapitulate the story behind the variables and their connections, it helps to explain anything that was left unclear, include any additional information, and it prompts feedback from participants |
Action Ideas | This script is used after the system map (model) has been reviewed and developed to identify and prioritise potential actions (or policies) to intervene in the system |
Participant recruitment
Adaptation of face-to-face GMB workshops to an online format
Workshop 1: Introduction—Individual meeting with participant (30 min) Participants: Adolescent and modeler/facilitator | ||
---|---|---|
Activity script (time) | Aim and description (applications used) | Output |
Introduction to systems and defining terms (10 min) | Presentation of workshop agenda and objectives Introduction to systems thinking, defining system dynamic concepts (variables, connections, polarity, feedback loops) (BlueJeans, PowerPoint) | Individual CLDs representing, at high level, which activities and how commercial food and beverage industries influence adolescents’ dietary behaviour |
Hopes and fears (2 min) | To prompt and establish participant expectations for the workshop (BlueJeans, PowerPoint) | |
Variable elicitation (5 min) | Participants named factors that responded to the prompt: “WHAT do you think food and beverage companies (companies, shops, online platforms) do to have an impact on what you / your friends choose to buy and eat.” The factors mentioned were annotated into STICK-E, a system mapping platform (BlueJeans, PowerPoint, STICK-E) | |
Behaviour over-time graphs (3 min) | Participants were prompted to identify key factors around the problem and their development over time. Participants were prompted to draw the behaviour over-time graphs in a digital white board. This activity also helped in gathering insight in deciding the reference modes for the mapping exercise (BlueJeans digital white board, PowerPoint) | |
Connection circle (5 min) | The shared screen moved from PowerPoint to STICK-E. The factors mentioned during the variable elicitation exercise were annotated into STICK-E and participants were guided to identify the connections between the different factors that contribute to or are affected by the problem variable (BlueJeans, STICK-E) | |
Causal Loop Diagram from connection circles (5 min) | Using STICK-E, the connection circle can be transformed into a CLD and participants were guided to describe the causal structure and feedback relationships between the variables. Participants were prompted to think about the nature of the relationship between the variables and to visualize various interactive causal pathways affecting their dietary behaviour (BlueJeans, STICK-E) | |
Interlude 1: CLD synthesis—Modeller/facilitator | ||
Activity | Aim and description (applications used) | Output |
Causal map synthesis | Combine the CLDs produced in Workshop 1 into an overarching CLD containing mentioned factors/variables and connections (STICK-E) | Synthesised CLD with seed structure for Workshop 2 -Map 1 |
Workshop 2: Group Model Building workshop – Group participants (90 min) Participants: Adolescents, modeller/facilitator and note taker | ||
Activity script | Aim and description (applications used) | Output |
Causal mapping with seed structure | To develop further the CLD created in Workshop 1 | A raw overarching CLD that reflects the group views of the problem and represent it in a system of interacting feedback loops -Map 2 |
(10 min) | Modeller/facilitator explained the aims of the workshop and had a refresher of concepts | |
(15 min) | Participants were asked to review the synthesised CLD, prioritise variables and identified overarching themes | |
(15 min) | Participants were asked to share additional variables that came to mind between Workshop 1 and 2, explain causal connections between the variables. Recorder documented working definitions, variable connections, and key words | |
(30 min) | Participants were prompted to examine the structure of the CLD, encouraged to change, add, or correct any misrepresentations of variables and loops in the model | |
(20 min) | Participants identified and narrated the feedback loops in the CLD. As participants reviewed the model, the facilitator/modeller revised the causal structure and shared in-real time the latest version of the CLD (BlueJeans, PowerPoint, STICK-E) | |
Interlude 2: CLD synthesis—Modeller/facilitator | ||
Activity | Aim and description (applications used) | Output |
Analysis of recordings and narratives. Causal map refinement | The recording and the map created in Workshop 2 were analysed to make sure that the variables and connections narrated and mentioned in the workshop were reflected on the map (Workshop recording, STICK-E) | An overarching CLD created by the group -Map 3 |
Workshop 3: Causal map review, validation, and action ideas – Individual meeting with participant (30 min) Participants: Adolescent and modeller/facilitator | ||
Activity script | Aim and description (applications used) | Output |
Model review (15 min) | The modeller/facilitator showed the overarching CLD created by the group. Participants were prompted to validate if the refined map from Workshop 2 represented their ideas and how they meant for them to be represented Key feedback loops were articulated, and narratives and themes were clarified Modeller/facilitator confirmed participants’ understanding of the correspondence between model structure and system behaviour (BlueJeans, PowerPoint, STICK-E) | A CLD revised and validated by workshop participants -Map 4 |
Action ideas (15 min) | Participants were prompted to generate a list of intervention / policy ideas targeting the causal structure of the CLD (variables, connections, rules that govern the connections, goals in the system, mindset.) Each action included: -A description of the action -The place where it would impact the system map -Identify how hard or easy it would be to implement (easy – hard) -If successfully implemented, the level of impact it might have on the system (low – high impact) (BlueJeans, PowerPoint, STICK-E) | A list of intervention options targeting variables, connections or rules that govern the connections, goals in the system or mindset A description of how they might affect the system |
Post- workshop: Evaluation forms | ||
Activity | Aim and description (applications used) | Output |
Evaluation (5 min) | This was a brief questionnaire to evaluate strengths, weaknesses of the workshops and to assess participants’ enjoyment, engagement, satisfaction, and learning outcomes (Microsoft Forms) | An assessment of the workshops’ strengths, weaknesses, and participants’ experience in taking part in the GMB workshops |
Evaluation and validation
Results
Facilitation and delivery of online GMB workshops
-
Adolescents
-
Policymakers and public health practitioners
Practicalities of adapting GMB workshops to an online format
-
Technical issues
-
Costs
-
Participants
-
Workshop management
-
Evaluation and validation
The researcher was very friendly and listened well, giving everyone a chance to speak in group workshops and asking if there was anything you wanted to say in the 1-1 workshop! I am very positive about my experience.
Adolescent participant 1.
I think that the meetings were very relaxed and I really enjoyed them and I was made to feel like what I was saying was helpful which was encouraging.
Adolescent participant 2.
You did a brilliant job of running an engaging session! You kept slide content minimal and talked through everything very clearly - clearly a well-planned session. It's definitely hard to get the timing right for a session like this - I think that we could easily have gone in for another hour, but I know that time is always limited. I think for next time, may not need as much time on the introductions, and then you can maximise the time available to discuss your objectives. Top work :)
Public health practitioner/policymaker 1.
Discussion
Planning |
---|
1.Do a process mapping exercise to understand the overall GMB process, discuss the number of workshops, and select which and how many people would be involved in each one. Involve a manageable number of participants so that the online facilitator has capacity to monitor every participant videos simultaneously and engage with everyone, even with those that prefer to have their cameras off |
2.Pilot the workshop with the modelling team (at least involve two people rather than just one, we suggest having at least one modeller/facilitator and a note-taker) and volunteers to fine-tune the timings of each activity and test the software/platforms (e.g. STICK-E, MS Teams, Zoom, Miro) you will use during the workshop |
Facilitation and delivery |
3.Ensure the facilitator can ensure participant’s engagement throughout the workshop(s) and the team is able to adapt to participants’ requirements |
4.Guarantee a that the facilitator can create an inviting online environment for participants to share their thoughts as well as mediating conflicts that may arise between participants during the workshops |
5.In an online environment, make sure the facilitator/modeller is able to supervise participants’ videos whilst running the activities and able to engage participants that decide to have their cameras off. This role requires experience not only in conducting in-person workshops but also requires familiarity with an online environment and the platform (s) used (e.g. STICK-E, MS Teams, Zoom, Miro) |
6.To avoid screen fatigue, separate the GMB activities into multiple workshops, we suggest 60–90 min each a.Have an introductory workshop with participants to build rapport with the researcher, get them familiarised with the platform/software, introduce them to “system mapping” concepts and the problem you will be discussing during the GMB workshop, and have a practice workshop to build a system map in real-time (i.e. STICK-E) b.Doing workshops online allows to have follow-up sessions because participants do not need to travel. Having more than one online workshop allows to have time in-between (i.e. interlude). This enables participants to have some “reflective” time and incorporate the problem you discussed in the first workshop, expose themselves to their environment and think of any new variables or connections, which they can share in the following workshop c.When running the GMB workshop online, you can have a “refresher” to remind them of the problem, the system thinking concepts, and encourage them to share any new variables they thought about |
7.Once participants think there are enough variables and connections between variables during the GMB workshop, ask participants to examine the structure of the system map and add, change or correct any misrepresentation of variables or connections in the map. Since they will have time between workshops, this reflective time can allow them to be more critical when reviewing the system map in the following workshop |
8.Once the map seems to be “finalised”, narrate the story that the map tells (i.e. how variables are interconnected and the direction they influence each other). You will have time to revisit the narrative during the validation workshop and modify if needed |
9.Ask participants to confirm if the map reflects’ their thoughts of how they think the system behaves. Again, having an opportunity to revisit the map at a follow-up workshop can help participants to be critical when reviewing the system map |
10.Have a final “validation workshop” where participants’ analyse the system map and agree that the map reflects’ their thoughts of how the system behaves |
11.During the introductory workshop and the GMB, remind participants that at the end you will encourage them to think about policy ideas or interventions that target the causal structure of the system map (variables, connections, rules that govern the connections, goals in the system, mindset). This will allow them to reflect on the different policy ideas and share at the final workshop once the system map is finalised |
Evaluation |
12.Have an evaluation form where participants can share their experience of the workshop, evaluate the appropriateness of the method, and give feedback on how to improve in future workshops |
Validation |
13.Make sure you have validation methods in place (i.e. ensure internal consensus, validate the model with literature on the topic, mediation and structural equation modelling for more robust quantitative analysis) |