Psychometric evidence of a perception scale about covid-19 vaccination process in Peruvian dentists: a preliminary validation

An unexpected event such as the COVID-19 pandemic, which suddenly interrupted the “normality” of daily activities, has generated various effects on physical and mental health of the population due to uncertainty about various problems, including preventive measures to contain the spread, morbidity and mortality of the disease [1, 2].

In this context, according to the Occupational Safety and Health Administration [3] dental professionals are in the very high risk category for exposure to SARS-CoV-2 virus during care procedures that generate contaminated bioaerosols [3‐5]. The vaccine seems to be a hopeful strategy to reestablish normality, and the scope it may have depends on perception and acceptance of the immunization process established under the guidelines of each responsible entity, since its successful implementation would lead to greater receptivity and safety of general public, considering that there will be future calls for this purpose.

Another point to consider is infodemics on social networks and media about effectiveness of the vaccine [6‐8], and if the vaccination process is carried out in a disorganized manner, it would result in low levels of acceptance. Therefore, it is important to pay attention to administrative management, such as the dissemination of the list of those selected for vaccination, date, schedule, geographical location of the vaccination station, the conditions of the vaccination environment and the vaccinators. It is also important to take into account the perception of service by valuing the care provided by the staff in charge, the perception of healthcare procedures through the performance of health team, and to provide adequate information about benefits of the vaccine, as well as the occurrence of possible adverse reactions [9].

In Peru, the case fatality rate due to the second wave was 9.32% [10], the highest in the world, with an accumulated number of infections and deaths of 2,148,418 and 198,167 respectively up to August, making it even more important to have a vaccination process that guarantees good acceptance by health professionals and public in general.

To date, several studies have been carried out to assess the acceptance level of the vaccine [6, 11‐17] such as the ICPCovid questionnaire that collects data on vaccine acceptability at different levels of effectiveness, perceptions of COVID-19 vaccination, knowledge about the vaccine and vaccination in the population (Jaramillo-Monge). In the study by Jaramillo-Monge et al. it was found that 91% of participants were willing to be vaccinated with a COVID-19 Vaccine if it has at least 95% efficacy, 68.5% if it has at least 90% efficacy and 40.5% if it has at least 70% efficacy. Approximately 55.5% of the participants indicated that they feared unexpected side effects. Likewise, the study by Alvarado-Socarras et al. reported that between 77 and 90.7% would accept COVID-19 vaccination with a vaccine efficacy of 60 and 80%, respectively. On the other hand, Kabamba et al. indicated that only 28% of participants would agree to receive a COVID-19 vaccine when one became available. However, although these results show vaccine acceptance, no research has yet included the perception regarding immunization process, which is of vital importance for the relevant authorities in order to rethink their administrative and operational strategies in the search for greater receptivity and safety of public in general. Therefore, the aim of the present study was to develop and provide a preliminary validation of a scale to measure perception of the COVID-19 vaccination process in Peruvian dental professionals.

The majority of surveyed dentists were between 41 and 65 years of age (53.18%), being predominantly female with 59.55% of the total. 51.36% were married and 38.18% had no children. In addition, 70.45% of the dentists were from the capital city and 54.09% were only in private practice. The majority (65.45%) had 10 or more years of experience and 54.55% of the total had a master’s degree. Of these, 55.91% did not have a specialty. On the other hand, 79.09% did not report vulnerability to COVID-19 and 76.36% did not report a history of COVID-19. Finally, 85% received the Sinopharm vaccine and 86.82% reported having received two doses (Table 1).

According to Aiken’s V coefficient, from the scores obtained by the five expert judges, it was obtained that the eighteen items showed values ranging from 0.85 to 1.00 (V ≥ 0.70) for the criteria of clarity, objectivity, timeliness, organization, sufficiency, intentionality, consistency, coherence and methodology, this being very acceptable. In addition, the lower limit of all 95% confidence intervals were acceptable (Table 2).

According to descriptive analysis of the P-Vac-Cov19-DENT scale, it was noted that item 6 obtained the highest mean score with 4.14, while item Q15 obtained the lowest mean score with 2.40. Regarding response variability, item Q1 obtained the highest variance with 1.73, while item Q11 obtained the lowest variance with 0.64. Asymmetry values of the scale items did not exceed the acceptable range (± 1.5) [21] (Table 3).

On analyzing the item-total correlation and covariance of the P-Vac-Cov19-DENT scale, two items were found to be negatively correlated with respect to the total score. Therefore, we proceeded to invert the evaluation of responses according to the Likert scale, with 1 being strongly agree and 5 being strongly disagree. Finally, with this adjustment it was obtained that all the items correlated positively and significantly (> 0.35) with the total score (Table 4).

When analyzing the inter-item correlation matrix of the P-Vac-Cov19-DENT scale, it was observed that the determinant value was significant (p = 0.000). This being one of the requirements to perform the exploratory factor analysis (Table 5).

The pertinence of the exploratory factor analysis is justified by the sample adequacy indices. The Kaiser-Meyer-Olkin value (KMO = 0.864) and Bartlett’s test of sphericity (1847.93; gl = 153; p = 0.000) were very good. In addition, according to the sum of squared loadings extraction method, a four-dimensional structural model with eigenvalues greater than 1 was obtained, where the four factors obtained explain 64.156% of total variance of the test. However, according to the parallel analysis, the eighteen items of the P-Vac-Cov19-DENT scale were saturated in three factors that explained 62.82% of the total variance of the analysis (Table 6).

The factor analysis according to principal component analysis extraction method with Varimax rotation and Kaiser normalization grouped items Q1, Q2, Q3, Q6, Q7, Q8, Q9 and Q10 for the first dimension, with factor loadings ranging from 0.32 to 0.86. For the second dimension, items Q4, Q5, Q11, Q13i, Q14 and Q15i were grouped together, with factor loadings ranging from 0.34 to 0.87. Finally, for the third dimension, items Q12, Q16, Q17 and Q18 were grouped together, with factor loadings ranging from 0.47 to 0.89 (Table 7).

According to the grouping of items after performing the rotated loading matrix, Cronbach’s reliability analysis was performed for the first (0.87, 95% CI: 0.84–0.90), second (0.80, 95% CI: 0.75–0.84) and third dimension (0.82, 95% CI: 0.78–0.86). In addition, the total reliability of the P-Vac-Cov19-DENT scale was calculated (0.89, 95% CI: 0.86–0.91) obtaining optimal results. Finally, each dimension was nominated according to the content of grouped items (Table 8).

In the last 2 years, due to COVID-19, there has been a worldwide crisis in all areas, affecting the mental health and work environment of all citizens [22‐25]. The vaccine is considered a promising solution to restore normality. Its scope and acceptance depend on the organization of the immunization process at governmental level, which should include the dissemination of reliable information on efficacy of the vaccine, the provision of adequate health care services and the availability of trained personnel.

Currently, there is no psychometric instrument that that measures perception of the vaccination process in health professionals since those available in literature are limited exclusively to evaluation of vaccine acceptance [6, 11‐17]. Therefore, implications and consequences of the lack of comprehensive assessment of this process are unknown, and making these effects invisible could negatively affect the scope of immunization.

Due to the current epidemiological situation, dentists are at high risk of exposure to the COVID-19 virus when performing specific procedures that generate contaminated bioaerosols [3‐5]. In addition, dentistry can be considered a stressful profession due to the legal problems that can arise from human error, the interrelationship with patients, routine work, compliance with regulations, and the risk of care, among others [26, 27]. In addition, the psychological impact of COVID-19 pandemic may have increased stress levels in dentists [27]. In view of the above, it is imperative to create a scale to validate how these professionals perceive the vaccination process, since it is essential to encourage their greater predisposition to be vaccinated, as their immunization increases protection against cross-infection by SARS-CoV-2 variants [28]. Furthermore, as health professionals, they are responsible for promoting best health practices, since their example is fundamental to generate public awareness and motivation to accept the vaccine.27–29 [29‐31].

The P-Vac-Cov19-DENT items were constructed based on the literature and key words collected by previously conducting an in-depth interview with fifty dentists. This allowed us to recognize that excessive concern about becoming infected can produce different thoughts and behaviors in health professionals during the pandemic context, which could have an impact on public health [32]. It should be noted that the content of the scale was considered good when it was evaluated under nine aspects by five expert judges. On the other hand, by observing differences in correlations between items of the questionnaire, it is possible to review and address aspects of methodological structure of this strategy from a different contextual perspective [33]. However, thanks to the total item correlation, it was possible to identify items 13 and 15 as negative items, which made it possible to correct the direction of the score on the Likert scale. In addition, it may seem contradictory that item Q14 (I have constant concerns that my vaccine dose has been manipulated in some ways) did not show a negative correlation. This was probably due to reports in the press, including the broadcasting of a video, of some health personnel tampering with the vaccines by altering their dosage or administering them without any content in the syringe [34]. For all these reasons, item Q14 could have caused the dentists to agree or totally agree (4 or 5 points, respectively) with it. However, despite this concern, dentists went to get vaccinated en masse, which is understandable since it was a requirement for practicing dentistry. Many dentists also felt that they had no other choice since it was the only thing that existed at that time to deal with COVID-19. At the same time, it should be noted that due to the complaints, the authorities in charge of the vaccination process allowed, for the peace of mind of the subject to be vaccinated, that he/she or a companion could verify the dose administered, even allowing filming the moment of vaccination. For all of the above, it is also reasonable and concordant that the majority of dentists would disagree with items Q13 and Q15, so the answers had to be scored inversely according to what was observed in the correlation matrix.

Regarding the exploratory factor analysis and the sum of squared loadings extraction method, it was observed that all items were saturated in a four-dimensional structural model. However, according to the Parallel Analysis based on minimum rank factor analysis, three dimensions were obtained and this was justified by good sample adequacy indices. It should be noted that this analysis is currently the most widely accepted factor extraction method by the scientific community [35, 36]. It should be noted that in the early stage of the present study, a four-dimensional P-Vac-Cov19-DENT scale was designed to assess the “Perception about the organization” (Q1, Q2, Q3, Q7, Q8, Q9 and Q10), the “Perception about vaccine efficacy” (Q12, Q16, Q17 and Q18), the “General perception of the service” (Q4, Q5, Q6 and Q11) and the “Perception of the care procedure” (Q13, Q14 and Q15). However, according to the parallel analysis, the eighteen items of the P-Vac-Cov19-DENT scale were saturated in three factors that explained 62.82% of the total variance of the analysis, so it was decided to restructure the scale. For this reason, item Q6 was moved to the dimension “Perception about the organization”, while the dimension “Perception about vaccine efficacy” was maintained with the same items. Likewise, the two dimensions “General perception of the service” and “Perception of the care procedure” were merged into a single dimension that grouped together items Q4, Q5, Q11, Q13i, Q14 and Q15i, calling it the dimension “Perception about care received” given its content. On the other hand, the presence of the 18 items was supported by principal component analysis with varimax rotation, but the items had to be reordered according to the dimensions. Likewise, to guarantee the reliability of the internal consistency for each dimension and the total scale, Cronbach’s alpha was calculated, yielding optimal results.

The items considered in this P-Vac-Cov19-DENT scale addressed the dimension of perception about the organization, which included efficiency of the means of dissemination for vaccination process, impartiality for the selection of beneficiaries, coordination with the competent authority, adequate arrangement of the environments and their geographical location, suitability of the vaccination schedule and waiting time for the beginning of the process. These were considered in order to obtain the necessary information for governments to make decisions with the objective of improving the development of this process and facilitating access to all people to be vaccinated, avoiding unpleasant, uncomfortable or painful situations that would lead to low turnout in the next vaccinations [37‐39]. In addition, the scale proposed in the present study took into account the perception of vaccine efficacy, which considered the protection generated by the vaccine and the possibility of resuming health care work with minimal risk of contagion and complications. This is important to consider since adequate information regarding the vaccine offered must have appropriate scientific support and use appropriate channels of dissemination to prevent the user from feeling uncertainty or rejection of the immunization [9, 39]. The perception of the care received was also considered as a dimension, which included the empathy of the health care personnel, adequate information regarding adverse effects and the possibility of recommending the service. It is crucial to include in the vaccination process friendly health care personnel with adequate bidirectional communication to ensure the beneficiary’s peace of mind, also taking into account the transparency of the procedure and trust in the health care personnel. The vaccination process must have adequately trained health employees to ensure that the management is carried out with clarity, credibility and security [9, 39].

Success in the immunization process guarantees the eradication and control of diseases and is key to public health [40, 41]. Furthermore, considering that the decision to be vaccinated depends to a large extent on prior knowledge, experience and beliefs [42], this scale would help the competent authorities to obtain more information on the needs and expectations that dentists have about the COVID-19 vaccine, since these professionals are exposed to treating patients potentially infected by the COVID-19 virus because of the work they perform [43]. However, it should be recognized that the way in which the scale items have been written could be applied not only to dentists but to any health professional who performs health care work.

The importance of this P-Vac-Cov19-DENT scale is that it could allow government authorities to expand their knowledge about the vaccination process to generate changes in immunization readiness and improve the reach of immunization, which would help ensure its sustainability and accessibility over time for future requirements.

Among the limitations of the present study, it was not possible to perform a criterion analysis of this scale by external validation, because no scale measuring the perception of the vaccination process in dental professionals was found in the current available literature (February 2022), so the results obtained in this preliminary validation should be taken with caution. Therefore, testing convergent and discriminant validity is recommended as a future direction. On the other hand, it was not possible to interview the participants in person, because at the time the study was carried out the Peruvians were in mandatory social isolation [23]. We can also mention as a limitation that the present study was carried out only in a population of dental professionals working in two universities in the Peruvian capital. In addition, an analysis of instrument stability was not carried out. For this reason, we recommend testing and retesting this scale at two different times and evaluating the concordance of the scores [44]. However, the P-Vac-Cov19-DENT can be applied in several countries and in different health professions that perform health care work, since it has demonstrated good internal consistency. Therefore, it is also recommended to adapt this scale to other social realities and to future immunizations of highly contagious diseases, as this will make possible to recognize the shortcomings and strengths of the vaccination process, and thus make these results known to the competent authorities in order to improve planning and management of the process.

In conclusion, acknowledging the limitations of the present study, the scale for the perception of COVID-19 vaccination process in dental professionals proved preliminarily to be valid and reliable and can be used for research purposes. However, it is recommended to extend its application and evaluate its metric properties in other health professionals.