Impacts on practice
-
A validated set of indicators is useful to measure pharmaceutical care in community pharmacies.
-
A set of practice indicators is best compiled in cooperation with pharmacists and external stakeholders e.g. healthcare inspectorate, patient organizations and health insurers.
-
Measurement of indicators in pharmacy practice and feedback of indicator scores results in overall score improvement.
-
Further research is needed to better understand and facilitate quality improvement in individual pharmacies.
Introduction
Quality indicators in healthcare address measurable aspects of relevant systems, processes and outcomes. They provide insight into the performance of care providers and are used to stimulate continuous improvement of patient care [1]. Various quality indicator sets have been introduced throughout the western world [2‐6]. Among others these sets are used to assess and improve the quality of medical practice [7, 8].
Anzeige
To assess pharmaceutical care as the pharmacist’s contribution to the care of individuals in order to optimize medicines use and improve health outcomes [9], in 2008 a national set of quality indicators has been established for community pharmacies in the Netherlands [10]. This was initiated by the Royal Dutch Pharmacists Association (KNMP) and the Netherlands Healthcare Inspectorate. The initial aims of the 2008 indicators were to gain insight into the quality of pharmaceutical services for supervision purposes, and to increase awareness among individual community pharmacists about their own performance. Since 2008, data on specific indicators have been collected from all community pharmacies in the Netherlands. All indicator scores were self-reported by pharmacists. To stimulate internal quality improvement, community pharmacists were annually given feedback reports with their own scores relative to those of the other pharmacists in the Netherlands.
As of 2010 other major stakeholders were involved in the quality measurement of community pharmacies. Beside community pharmacists and the Healthcare Inspectorate, this included representatives of patient and consumer organizations and health insurance companies. These parties were primarily interested in information that enabled patients to make a conscious choice of pharmacy based on performance. Thus beside internal quality assessment the set of quality indicators had to facilitate also external comparisons between pharmacies. Consequently under the supervision of a national steering body and with involvement of all major stakeholders an instrument was developed and used to validate the 2011 set for content validity, absence of selection or measurement bias, and statistical reliability [11]. This set of quality indicators was then thoroughly revised. Information for the resulting 2012 set was requested from all Dutch community pharmacies in 2013.
The comprehensive set of quality indicators for Dutch community pharmacies and it’s results may be useful for other countries and healthcare systems to increase awareness of individual community pharmacists about their own performance, improve supervision by the healthcare inspectorate and enable patients and health insurance companies to differentiate between pharmacies on the basis of performance.
Aim of the study
This study aimed to present a comprehensive quality indicator set for community pharmacies and to report the scores for these indicators as supplied by the majority of Dutch community pharmacies. In subanalyses the score development over 5 years was described for those indicators, that have been surveyed earlier, and the score consistency within one pharmacy over time was assessed.
Anzeige
Ethics approval
Data of pharmacists and patients were coded and anonymised prior to analysis. Use of observational data in descriptive retrospective studies in the Netherlands is not considered as an interventional trial according to Directive 2001/20/EC and to Dutch legislation, and therefore does not need to be submitted to a medical ethic committee for approval.
Methods
Study design
In this retrospective study information on the validated quality indicator set for the year 2012 was used. This information was requested in 2013 from all 1981 Dutch community pharmacies at that time [12]. Scores were calculated as a cross-sectional measurement of the quality of pharmaceutical care in the Netherlands.
For indicators that were measured as well in the prior 4 years and remained unchanged during the study period, in a longitudinal analysis the development of scores during the whole study period of 5 years was described and the score consistency within one pharmacy during time was assessed.
Setting for data collection
On average, each pharmacy served around 8000 clients in 2012 [12]. In the Netherlands clients mostly visit one particular community pharmacy [13]. All clients are registered in the pharmacy information system.
Community pharmacists in the Netherlands have a legal and professional responsibility to optimize the safe and effective use of medication, in cooperation with the prescribers. This implies that pharmacists can intervene if a prescribing does not follow the guidelines or does not seem suitable for an individual patient. According to their responsibility to ensure safe and effective medication use, pharmacists generally had high intrinsic motivation to explore their performance in providing pharmaceutical care.
Data have been collected using this national survey for 5 years, and annual participation is a condition for receiving a quality management certificate. The healthcare inspectorate specifically visits any non-responders. The process of data collection was widely announced in professional circles. Although reporting on indicators was voluntary, the relevance of providing data for both internal quality assessment and external accountability was emphasized in all communications [14‐17].
Quality indicator survey tool
All Dutch community pharmacies were invited to complete the online quality indicator survey on 2012 between April and May 2013. This included 66 indicators within ten categories: ‘Quality management’, ‘Continuity of care’, ‘Communication with the patient’, ‘Clinical risk management’, ‘Compounding’, ‘Dispensing’, ‘Follow up of pharmacotherapy guidelines’, ‘Counseling’, ‘Logistics’, and ‘Training of pharmaceutical staff’. Information on each aspect was provided by the responsible pharmacist.
The quality indicators measured the presence of quality systems (‘structures’) and the performance of processes. As information on the clinical consequences of pharmaceutical care for individual patients was not available, outcomes of dispensings for patient groups were used as ‘outcome’ indicators (e.g. the concomitant use of interacting drugs or the absence of concomitant preventive co-medication).
Anzeige
The online survey contained automated controls, for example to prevent reporting of percentages above 100 % and to alert for missing scores. It also provided pharmacists with background information about specific quality indicators when necessary. Pharmacists could also obtain support from technical and professional helpdesks by e-mail or telephone.
Concurrent source of dispensing outcomes for quality indicator score validation
Information for numerical indicators based on the outcomes from dispensing to individual patients could also be measured by routinely-collected data from the Dutch Foundation of Pharmaceutical Statistics (SFK). The SFK collects drug dispensing data for nearly all community pharmacies [12]. Using validated algorithms, the indicators were calculated for each community pharmacy from the dispensing data delivered to the SFK, and median (50th percentile), 10th and 90th percentiles were available as quality indicator scores from that source. For answering the online survey, pharmacists could use the information from their own pharmacy information system or they could retrieve their indicator scores as pre calculated by the SFK from their dispensing data through a secure website of SFK.
Data analysis
Scores on the 2012 set were either expressed as categorical variables (yes/no) or as numerical variables (either a number or a proportion). Scores of categorically-measured quality indicators were given as the percentage of pharmacies reporting the presence of a quality aspect. For numerical quality indicators, the mean of the scores was reported, and the variance in answers was expressed as the 5th and 95th percentile.
For the longitudinal analyses, data from the pharmacies responding to the 2012 set were linked to their corresponding scores from the previous 4 years. Ten quality indicators (five on structures, one on process and four on dispensing outcomes) were surveyed in the same way over all five study years. For these quality indicators, the scores were also calculated for the preceding years.
Anzeige
The intra-class correlation coefficient (ICC) was calculated to compare the variance of scores for individual pharmacies over time (indicating changes over time for a particular pharmacy) to the overall variation in scores over the same period. The ICC is an indication of the correlation of scores for a quality indicator reported over time from the same pharmacy. The ICC could be calculated from logistic (for categorical indicators) and linear (for continuous indicators) mixed model analysis [18]. In this analyses, the repeatedly measured scores for an indicator were clustered within individual pharmacies. For continuous variables, the ICC can be calculated by dividing the variance of scores between community pharmacies by the total variance, where the total variance is defined as the sum of the variance between and within pharmacies [18]. For dichotomous variables, the ICC can be calculated with an additional equation [18]. The ICC can take values between 0 and 1. A high ICC (close to 1) means that the scores changed little for an individual pharmacy over time compared with the total variance in scores of all community pharmacies.
Descriptive statistics were performed with PASW statistics 20.0 (IBM Corp., Chicago, IL, USA). Stata SE-2009 (StataCorp LP Statistics/Data Analysis StataCorp, Texas, USA) was used to assess the ICC.
Results
Information was provided by 1739 of the 1981 Dutch community pharmacies (88 %). Table 1 gives the characteristics of the community pharmacies providing information for the quality indicator set on 2012. On average, each employed 1.3 pharmacists and 6.4 pharmacy technicians. Most pharmacies had a separate room for counseling and participated in night and weekend services. Two-thirds of them cooperated with other healthcare providers in a structured way. One-third also supplied nursing homes. One-third compounded medication within their pharmacy and <5 % also supplied other pharmacies with such preparations.
Table 1
Characteristics of Dutch community pharmacies
Mean full time equivalent (38-h working week) pharmacists employed per pharmacy (5th and 95th percentile) | 1.36 (0.8; 2.4) |
Mean full time equivalents (36-h working week) pharmacy technicians employed per pharmacy (5th and 95th percentile) | 6.37 (2; 12) |
Percentage of community pharmacies with a separate room available for counselling | 96.4 |
Percentage of community pharmacies that supply nursing homes | 31.1 |
Percentage of community pharmacies that participate in night and weekend services | 99.2 |
Percentage of community pharmacies that cooperate with other pharmacists and healthcare providers for pharmaceutical care in a structured way | 70.2 |
Percentage of community pharmacies that compound medicines within the pharmacy | 30.9 |
Percentage of community pharmacies that supply of compounded medications to more than one other pharmacy | 4.1 |
Table 2 shows the 66 quality indicators across 10 categories, and their scores on the presence of quality structures, the degree to which pharmacies followed recommended procedures and outcomes from dispensing to individual patients. Within the set, 29 indicators measured the presence of structures, 24 focused on processes and 13 covered dispensing outcomes. Indicator scores showed high volumes for the presence of quality structures. For the presence of quality structures for instance, 84 % reported the presence of a validated quality certificate (QI 1.1), and 94 % responded that they had patients’ experiences within the past 3 years evaluated by a professional external party (QI 1.2). The presence of structures providing information about patients’ actual drug use (QI 2.1), contraindications (QI 4.3) and allergic reactions (QI 4.4) were reported by more than 95 % of those responding.
Table 2
Scores for the quality indicator set for community pharmacies in 2012
Scorea
| Type | |
|---|---|---|
1. Quality management | ||
1.1 Presence of a valid quality management certificateb
| 84.4 | S |
1.2 Evaluating patients’ experiences within the past 3 yearsb
| 93.9 | S |
1.3.1 Availability of a procedure for registration of errors (e.g. wrong dosage, wrong substance, wrong compounding) that occurred during the work process in the pharmacy and that were realized before the drug reached the patientb
| 73.2 | S |
1.3.2 Number of registered errors which occurred during the dispensing of medication and that occurred during the work process in the pharmacy and that were realized after the drug reached the patientc
| 42.2 (0; 205) | P |
1.4 Presence of a registration system for errors that occurred during the work process within the pharmacy and that did reach the patientb
| 98.8 | S |
1.5 Number of registered errors that did reach the patientc
| 18.0 (0; 64) | P |
1.6 Number of registered complaints made by patientsc
| 29.1 (0; 150) | P |
1.7 Number of registered errors reported to a national registration of errorsc
| 1.5 (0; 3) | P |
2. Continuity of care | ||
2.1 Attitude of the pharmacist to obtain information on patients’ actual drug use before dispensing and to register this information in the patients’ recordb
| 95.0 | S |
2.2.1 Participation in pharmacotherapy audit meetings with general practitioners (GPs)b
| 98.7 | S |
2.2.2 Participation in pharmacotherapy audit meetings on a regular basis and with specific agreementsb
| 84.6 | S |
2.3 Percentage of patients older than 70 years with at least 5 different drug classes in chronic concomitant use, for whom the pharmacist contributed to the exchange of actual drug use information between the general practitioner and the hospitalc
| 54.7 (0; 100) | P |
2.4 The pharmacy staff always informs the anticoagulation directly in case of dispensing co-trimoxazole to a coumarin userb
| 99.5 | S |
3. Communication with the patient | ||
3.1 Percentage of patients with a first dispensing of inhalation medication who had been offered information about its usec
| 70.0 (4; 100) | P |
3.2 Percentage of users of inhalation medication with subsequent use of oropharyngeal antimycoticsc
| 1.48 (0.5; 16) | O |
3.3 Presence of individual education programs and plans for every pharmaceutical staff memberb
| 94.6 | S |
4. Clinical risk management | ||
4.1 Parameters for clinical risk management in the pharmacy information system are implemented according to prevailing guidelinesb
| 98.8 | S |
4.2 In case of an interaction actions taken are electronically registered | 97.9 | S |
4.3 Availability of protocols for informing on contra indications for all patients, especially for new patientsb
| 98.6 | S |
4.4 Availability of protocols for informing on allergic reactions for all patients, especially for new patientsb
| 98.9 | S |
4.5 Availability of protocols to check on the dosage of active components for compounded medication for children up to 6 yearsb
| 97.5 | S |
4.6 Dosage in compounded mediation for children up to 6 years is checked by the pharmacist in at least 80 % of all compounding for children younger than 6 yearsb
| 83.9 | P |
4.7 Absolute number of coumarin users with concomitant use of co-trimoxazolec
| 0.69 (0; 2) | O |
5. Compounding | ||
5.1 Availability of written agreements on responsibilities for external compounding on checking the weight of capsules, analytical tests of samples and a final control by a pharmacistb
| 96.5 | S |
5.2 Availability of a standard operation procedure for the release of compounded medication before dispensing to the patientb
| 98.8 | S |
5.3.1 Percentage of medication compounded for individual patients for which a standardized procedure was followedc
| 75.4 (6; 100) | P |
5.3 2 Percentage of compounding of batches with a validated procedure followed of all batch compoundingc
| 87.9 (16; 100) | P |
6. Dispensing | ||
6.1.1 Availability of automated dose dispensing for eligible patientsb
| 92.0 | S |
6.1.2 If automated dose dispensing was used the actual guideline was followed by as well the pharmacist as the supplierb
| 98.9 | S |
6.2 For weekly dosed trays a system was available to control on drug use as prescribed | 97.5 | S |
7. Follow up of pharmacotherapy guidelines | ||
7.1.1 Percentage NSAID users >70 years with concomitant gastroprotectionc
| 84.7 (70; 96) | O |
7.1.2 Action was taken by the pharmacist in at least 80 % of the cases to add gastroprotection to NSAID users >70 years for whom this co-medication was lackingb
| 32.3 | P |
7.2.1 Percentage of patients using nitrates with concomitant antithrombotic medicationc
| 93.0 (86; 100) | O |
7.2. Action was taken by the pharmacist in at least 80 % of the cases to add antithrombotic medication to nitrate users for whom this co-medication was lackingb
| 18.0 | P |
7.3.1 Percentage of patients using opioids with concomitant laxativesc
| 54.1 (35; 76) | O |
7.3.2 Action was taken by the pharmacist in at least 80 % of the cases to add laxatives to opioid users in whom this co-medication was lackingb
| 14.3 | P |
7.4 Percentage of patients under 6 or above 70 years of age with asthma inhalers and an additional inhalation device dispensed during the previous 24 monthsc
| 69.0 (49; 86) | O |
7.5 Percentage of simvastatin as the first statin dispensedc
| 67.0 (34; 93) | O |
7.6 Percentage of cardiovascular patients with concomitant statin usec
| 75.7 (68; 83) | O |
7.7 Percentage of triptan users without overuse within all triptan usersc
| 93.3 (87; 99) | O |
7.8 Percentage of first dispensings of hypnotics with an amount for less than 15 days within all first hypnotic dispensingsc
| 69.9 (47; 91) | O |
7.9 Percentage of proton pump inhibitor (PPI) users with preferred PPIs according to national guidelines within all PPI usersc
| 82.2 (71; 91) | O |
7.10 Percentage of first dispensings of generic diclofenac, ibuprofen or naproxen within all first NSAID dispensingsc
| 84.7 (67; 96) | O |
7.11 Percentage of COXib users without co-medication related to ischemic cardiovascular diseases within all COXib usersc
| 83.4 (73; 94) | O |
7.12.1 The pharmacist followed additional courses for the performance of Medication Reviewsb
| 73.8 | P |
7.12.2 Medication Reviews are performed according to the professional guideline in cooperation with GPs and patientsb
| 92.6 | S |
7.12.3 Performance of at least 20 Medication Reviews according to the professional guideline in cooperation with GPs and patientsb
| 57.3 | P |
8. OTC counseling | ||
8.1 Medication surveillance is conducted according to professional protocolsb
| 99.6 | S |
8.2.1 Percentage of filled protocols for patient counseling within first dispensing of orlistatc
| 76.9 (0; 100) | P |
8.2.2 Percentage of filled protocols for patient counseling within first dispensing of dextromethorphanc
| 66.9 (0; 100) | P |
8.2.3 Percentage of filled protocols for patient counseling within first dispensing of hypericumc
| 64.6 (0; 100) | P |
8.2.4 Percentage of filled protocols for patient counseling within first dispensing of domperidonc
| 70.5 (0; 100) | P |
8.2.5 Percentage of filled protocols for patient counseling within first dispensing of hydrokininc
| 67.5 (0; 100) | P |
9. Logistics | ||
9.1 Suppliers of compounding material were assessed according to the professional guidelineb
| 99.4 | S |
9.2 Percentage of suppliers for compounding or package material that were assessed for their reliability as stated by the guideline for reliable supplier sc
| 74.6 (13;100) | S |
9.3 Availability of a valid system to check on expired drugsb
| 99.7 | S |
9.4 Official drug recalls were performedb
| 99.8 | S |
9.5.1 Number of relevant recalls received in calendar in questionc
| 8.0 (0;15) | P |
9.5.2 Number of not completely finished recallsc
| 0.9 (0; 8) | P |
9.5.3 Not completed drug recalls were due to a too high effort to address patientsb
| 3.7 | P |
9.6.1 Number of internally reported expired medication before the drug was dispensedc
| 1.8 (0; 7) | P |
9.6.2 Number of dispensed expired medication that was reported by the patient and thus was noticed after dispensingc
| 1.8 (0; 2) | P |
10. Training of pharmaceutical staff | ||
10.1.1 Percentage of pharmaceutical staff with a personal development planc
| 60.0 (0; 100) | S |
10.1.2 Percentage of pharmacy technicians who were registered in a central quality registration system for educationc
| 33.4 (0; 100) | S |
10.2 Participation in a national program for patient reported side effects drugs of the national pharmacovigilance centerb
| 87.5 | S |
10.3 Number of patient reported side effects announced to the national pharmacovigilance centerc
| 1.4 (0; 5) | P |
10.4 Percentage of employees involved in pharmaceutical care that followed an education in communication skillsc
| 32.2 (0; 100) | S |
Anzeige
Scores were lower for processes and dispensing outcomes, and the intervals
between the 5th and 95th percentile were broad for indicators measured on a numerical scale. For instance, the process indicator ‘Percentage of patients older than 70 years with at least five different drug classes in chronic concomitant use, for whom the pharmacist contributed to the exchange of actual drug use information between the general practitioner and the hospital’ (QI 2.3) had a mean of 55 % with a range between the 5th and 95th percentile between 0 and 100 %. The outcome of dispensing indicator ‘Percentage of patients using opioids with concomitant laxatives’ (QI 7.3.1) had a mean of 54 % with a range between the 5th and 95th percentile from 35 to 75 %.
For longitudinal subanalyses on the development of scores during time and trends in score development of individual pharmacies, ten quality indicators were available (Table 3). Overall, the scores for these indicators improved from 2008 to 2012. As an example for the score development of the categorical indicator, ‘Participation in pharmacotherapy audit meetings on a regular basis and with specific agreements’ improved from 78 % in 2008 to 85 % in 2012 (QI 2.2.2). An example for a categorical indicator is the ‘Mean percentage of patients with a first dispensing of inhalation medication who had been offered information about its use’ (QI 3.1). This score increased from 58 % in 2008 to 70 % in 2012 Scores of those quality indicators, which were measured repeatedly, but not in all years, generally also improved (data not shown). The ICCs for the quality indicators had a range between 0.01 for ‘number of coumarin users with concomitant use of co-trimoxazole’ (QI 4.7) and 0.90 for the ‘presence of a valid quality management certificate’ (QI 1.1) (Table 2).
Table 3
Trends in quality indicator scores over 5 years of measurement
Type | 2008 | 2009 | 2010 | 2011 | 2012 | ICCa
| |
|---|---|---|---|---|---|---|---|
Categorical quality indicators (percentage of community pharmacies with a positive answer within all given answers)
| |||||||
1.1 Presence of a valid quality management certificate | S |
63.3
|
67.6
|
75.2
|
83.0
|
84.4
|
0.90
|
1.2 Evaluation of patients’ experiences within the past three years | S |
86.7
|
81.6
|
84.4
|
92.8
|
93.9
|
0.48
|
2.2.2 Participation in pharmacotherapy audit meetings on a regular basis and with specific agreements | S |
77.7
|
78.8
|
80.6
|
86.2
|
84.6
|
0.18
|
4.3 Availability of protocols for informing on contra indications for all patients, especially new ones | S | 74.3 | 89.7 | 91.5 | 96.3 | 98.6 | 0.89 |
7.12.3 Medication Reviews are performed according to the professional guideline in cooperation with GPs and patients | S |
20.3
|
26.3
|
39.6
|
50.3
|
57.3
|
0.14
|
Numerical quality indicators (mean of numbers of percentages)
| |||||||
3.1 Percentage of patients with a first dispensing of inhalation medication who had been offered information about its use | P | 57.9 | 68.5 | 72.9 | 67.4 | 70.0 | 0.45 |
4.7 Absolute number of coumarin users with concomitant use of co-trimoxazole | O | 18.2 | 1.12 | 0.75 | 0.71 | 0.69 | 0.01 |
7.1.1 Percentage NSAID users >70 years with concomitant gastro protection | O | 70.8 | 76.8 | 81.8 | 84.0 | 84.7 | 0.54 |
7.2.1 Percentage of patients using nitrates with concomitant antithrombotic medication | O | 75.8 | 84.9 | 90.9 | 92.0 | 93.0 | 0.46 |
7.3.1 Percentage of patients using opioids with concomitant laxatives | O | 44.5 | 52.6 | 52.8 | 56.1 | 54.1 | 0.51 |
Comparison of the self reported indicator scores to the scores measured by the SFK as an independent third party from routinely-collected dispensing data showed a high agreement between the two sources “Appendix” section.
Discussion
A comprehensive set of 66 quality indicators across 10 categories was developed by pharmacists and major stakeholders to continuously improve pharmaceutical care and to compare indicator scores between community pharmacies. Existing quality sets have been developed for specific diseases, such as urinary tract infections [19,] vulnerable patients such as children and older people, and specific settings such as nursing homes [20‐26]. Other indicators on the quality of drug prescribing and dispensing mostly focused on drug use patterns [26‐28] or described to what extent specific guidelines and recommendations have been followed [28‐30].
The scores on this set of validated quality indicators supplied by 88 % of all community pharmacies provided insight into the pharmaceutical care performance of community pharmacies in the Netherlands. All indicators in the set assessed for 2012 and measured in the four preceding years showed a general improvement from 2008 to 2012. Small to moderate effects on professional practice have been previously described for audit and feedback [31]. A Cochrane review on the effects of audit and feedback reported a median change of 1.3 % in numeric outcomes, with an interquartile range of 1–29 % [32]. The changes in the indicator scores in our study were consistent with these results.
Structures to facilitate pharmaceutical care processes and dispensing outcomes for individual patients were present in at least 80 % of all Dutch community pharmacy. In this the presence of a valid quality certificate is the most meaningful, as this was acknowledged from a third, authorized party by national standards [33].
Scores for indicators for processes and dispensing outcomes were between 50 and 90 %. In principle, scores below 100 % suggest potential for improvement. Full compliance with treatment guidelines for all patients at risk is, however, unrealistic, and levels may also differ across indicators. For instance, the indicator ‘Percentage of patients using nitrates with concomitant antithrombotic medication’ (QI 7.2.1) had a score of 93 % in 2012, which had improved continuously from 76 % in 2008. Possibly this is the highest score to achieve in clinical practice for a patient population. The mean percentage of patients on opioids with concomitant use of laxatives (QI 7.3.1) remained between 45 and 56 % without a clear trend over time. The reasons for the deficient implementation of this recommendation should be studied in clinical practice.
Confidence intervals for the numerical indicators showed considerable variation and suggested differences in the performance of individual community pharmacies. Substantial changes in the scores of individual pharmacies were seen over time for users with the unfavorable combination of coumarin with co-trimoxazole (QI 4.7): in 2008, pharmacies had on average 18 coumarin users co-medicating with co-trimoxazole, but this had decreased dramatically by 2012, to an average of less than one per pharmacy. The low ICC of 0.01 shows that the absolute numbers reported by individual pharmacies for this interaction varied considerable over time, probably due to the huge decrease in numbers between 2008 and 2009 within all pharmacies. As the interaction of coumarin with co-trimoxazole should be avoided, this decrease means a substantial improvement in dispensing outcomes for patients [34]. This improvement might be due to increased awareness among community pharmacies resulting from the feedback reports on the first indicator assessment. It might also be due to extra alertness for this interaction by prescribers due to the new recommendations from literature [34].
The scores for the other quality indicators on the outcomes of dispensing processes (QI 7.11, QI 7.21, QI 7.3.1) measured percentages of patients co-medicated according to the guidelines. For these indicators, at least some consistency in the scores reported by individual pharmacies over time was suggested by ICCs between 0.46 and 0.54.The ICCs showed stable scores over time within individual pharmacies for the presence of systems such as a quality management certificate and the availability of protocols to provide information about contraindications (ICC for both aspects was 0.9).Further research should examine what factors might contribute to improvements in individual pharmacies and why some indicator scores improved more than others.
Strengths and limitations
A key strength of our study was that information was available from 88 % of all Dutch community pharmacies. Sub-analysis on the 12 % of non-responders in 2012 for their scores reported in previous years, however, showed lower scores on all quality indicators than the scores of the pharmacies included in our study. The scores presented here might therefore tend to overestimate the quality of care for community pharmacies in the Netherlands to some extent.
As all quality indicator scores were self-reported by community pharmacists, some of the indicators, especially on the presence of structures and processes, are too easy to claim without actually performing in the desired way. This attitude might be furthermore influenced by an increasing awareness of quality resulting from pay-for-performance policies of health insurance companies could have caused a bias in the scores towards the desired outcomes. Bias from inappropriate reporting of quality indicator scores was also assumed in the measurements of GP scores in the UK [35]. We therefore compared those scores that could be checked with scores calculated in a uniform way by a third party from routinely-collected dispensing data of SFK. These indicators on the outcomes of dispensing could thus not be claimed from self assessment by the pharmacists. The scores from the two sources were in agreement and there was no evidence of structural higher reported scores from self-assessment “Appendix” section. We therefore consider it unlikely that reporting bias influenced the scores presented here.
Conclusion
A set of quality indicators provided insight into the quality of pharmaceutical care at a national level for pharmacists, health care inspectorate, health insurance companies and patient organizations. Especially the presence of quality structures improved, and as of 2012 they were present in at least 80 % of the community pharmacies. Scores on care processes and on outcomes of dispensing varied between individual pharmacies and over time. These findings can be used in future research to understand the reasons for differences in quality improvement between individual pharmacies.
Acknowledgments
The authors thank all the Dutch community pharmacies who have made the effort to annually monitor and report on the quality of their pharmaceutical care management.
Funding
No funding was received for performing this research.
Conflicts of interest
The authors have no conflicts of interest to declare.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.