Background
Methods
Patient safety culture assessment
11 dimensions of patient safety culture are measured with the COMPaZ: • teamwork across departments • teamwork within departments • correct hospital handoffs and transitions • frequency of event reporting • non-punitive response to error • communication openness • feedback on and learning from errors • supervisor/manager expectations about safety • management support • sufficient staffing • general perceptions of patient safety |
The feedback report contained: • general information about the patient safety culture assessment • general information and the stages of development of patient safety culture • results on department and hospital level - table with absolute figures of respondents’ function - bar chart with reported number of errors - bar chart with patient safety grade - table with mean scores on the 11 patient safety culture dimensions - numeric tables with percentage of positive responses (score 4 and 5) for every item • general summary and recommendations • (optional) appendix with general examples of improvement strategies for patient safety culture (e.g. performing walk rounds, establishing a quality commission) |
The website contained: • a homepage with general information about the patient safety culture assessment and links to - general information and the stages of development of patient safety culture - general examples of improvement strategies for patient safety culture - a digital download of the feedback report (see above) • a menu (toolbar) with results on department level and benchmark options - table with absolute figures of respondents’ function (no benchmark options) - bar chart and table with reported number of errors (benchmark options) - bar chart and table with patient safety grade (benchmark options) - table with mean scores on the 11 patient safety culture dimensions (benchmark options) - bar chart and table with percentage of positive responses (score 4 and 5) for every item (benchmark options) • benchmark options for hospital departments on the website - results of their own hospital (hospital level) - results of the same type of specialism in other hospitals (14 different groups were developed) - results of different types of hospitals (general, teaching or categorical hospital) - results of all respondents of participating hospitals |
Feedback of results
Evaluation study
Part 1: evaluation of the feedback report
Report (n = 20) | Website (n = 13) | ||
---|---|---|---|
Item | Mean (CI) Scale 1–10 | Mean (CI) Scale 1–10 | |
1 | I think that the patient safety culture feedback report/website is… | ||
Understandable | 6.8 (5.9–7.6) | 7.3 (6.2–8.3) | |
Interesting | 7.6 (7.1–8.1) | 7.5 (6.9–8.2) | |
Useful | 7.0 (6.2–7.8) | 7.2 (6.3–8.1) | |
Relevant | 7.6 (7.2–8.0) | 7.2 (6.2–8.1) | |
Well-ordered | 7.1 (6.5–7.7) | 6.8 (5.9–7.8) | |
Complete | 7.2 (6.6–7.7) | 7.1 (6.3–7.9) | |
Attractive (lay-out) | 7.3 (6.8–7.7) | 7.3 (6.6–7.9) | |
Total | 7.2 (6.8–7.6) | 7.2 (6.4–7.9) | |
Report
| N (%) | ||
2 | Do you miss any information in this report? | ||
Yes | 12 (60 %) | ||
3 | Which statement reflects the patient safety culture report most: | ||
we now see suggestions to improve patient safety culture | 11 (55 %) | ||
we now have insight, but we do not know how to improve | 5 (25 %) | ||
this report has brought us little new information | 1 (5 %) | ||
different statementsa | 3 (15 %) | ||
4 | Do you recognise your department/hospital in the results of this report? | ||
no | 0 (0 %) | ||
partially | 9 (47 %) | ||
yes, absolutely | 10 (53 %) | ||
Website
| N (%) | ||
2 | Do you miss any information on this website? | ||
Yes | 3 (27 %) | ||
3 | General comments on the website [open-ended question] | - | |
4 | Why has your hospital performed a patient safety culture assessment (more options allowed) | ||
diagnose safety culture | 13 (100 %) | ||
evaluate patient safety interventions & track changes over time | 7 (54 %) | ||
conduct internal/external benchmark | 5 (38 %) | ||
fulfil directives or regulatory requirements | 1 (8 %) | ||
5 | Have departments taken action to improve the patient safety culture? | ||
no | 1 (8 %) | ||
action will be taken | 5 (42 %) | ||
yes | 6 (50 %) | ||
6 | Has the feedback on patient safety culture stimulated this action? | ||
no, not at all | 2 (17 %) | ||
partly | 5 (42 %) | ||
yes, absolutely | 5 (42 %) | ||
7 | How can this feedback contribute (more) to action being taken? [open-ended question] | - |
Part 2: evaluation of the website
Analyses
Results
Evaluation of the feedback report
The effect of additional examples of patient safety culture improvement strategies
Item | Group 1: feedback report (n = 9) | Group 2: feedback report with appendix (n = 11) | P-value | |
---|---|---|---|---|
Mean (CI) | Mean (CI) | |||
Scale 1–10 | Scale 1–10 | |||
1a | I think that the patient safety culture feedback report is…. | |||
Understandable | 6.1 (4.8–7.5) | 7.3 (6.0–8.6) | 0.04* | |
Interesting | 7.6 (7.0–8.1) | 7.6 (6.7–8.6) | 0.53 | |
Useful | 6.8 (3.0–7.5) | 7.2 (5.8–8.6) | 0.10 | |
Relevant | 7.3 (6.8–7.9) | 7.8 (7.3–8.3) | 0.20 | |
Well-ordered | 6.7 (5.9–7.4) | 7.5 (6.4–8.5) | 0.12 | |
Complete | 6.9 (6.2–7.6) | 7.4 (6.6–8.2) | 0.45 | |
Attractive (lay-out) | 6.8 (6.3–7.3) | 7.6 (7.0–8.3) | 0.04* | |
N (%) | N (%) | |||
2b | Do you miss any results in this report? | 5 (56 %) | 7 (64 %) | |
Yes | 1.000 | |||
3b | Which statement reflects the patient safety culture report best: | 6 (67 %) | 5 (46 %) | 0.49 |
we now see suggestions to improve patient safety culture | 1 (11 %) | 4 (36 %) | ||
we now have insight, but we do not know how to improve | 2 (22 %) | 1 (9 %) | ||
this report has brought us little new information different statements | - | 1 (9 %) |