Background
The lack of effective referral systems and the uneven distribution of medical investment, resources and talent between rural and urban areas in China cause patients to crowd into larger hospitals. This has made the queue time for an outpatient appointment one of the biggest causes for complaint among the Chinese public. Nearly all of the country's highest regarded doctors and most advanced facilities are located in urban areas, causing patients to scramble for limited medical resources. Many patients are even forced to queue late at night. If they can afford it, some patients will pay others to wait in their place. Some even develop personal relationships with hospital staff in the hope of getting preferential treatment. These issues have caused the relationship between patients and doctors to deteriorate [
1]. There have even been incidents of knife attacks at hospitals in China, as people express their anger over the inadequacies of China's medical system [
2]. “Too difficult to see a doctor” has become one of the top issues in China’s opinion polls [
3,
4].
In recent years, China has been in the process of implementing reforms to the healthcare system [
5]. The aim of the reforms was to provide basic and convenient medical care, including easy access to a doctor. One of the proposals, posted on the Chinese Ministry of Health website on 2009, says that all the Chinese mainland's top state-owned hospitals should establish their own outpatient appointment-booking service and gradually broaden the service to include specialists. With the rapid development of the internet over the last few years, some hospitals tested the use of web-based appointment systems (WAS) for outpatients [
6], and all public tertiary hospitals, supported by the Ministry of Health, began to use WAS in 2009, hoping to alleviate the problem of long outpatient waiting times.
Compared with other methods for booking appointments, WAS provided by hospital, usually displaying the largest variety of information on a hospital’s website, such as disease categories and physician treatments, should be much more sufficient [
7,
8]. However, only a small number of outpatient appointments were actually made through this system. Even though knowledge of the system was widespread, most patients still chose walk-in registration, which makes WAS difficult to implement and limited in its effect [
9].
An important step in improving the responsiveness of hospitals to patients’ needs is to ask the patients themselves about their experiences and opinions. In addition, many physicians have opinions about the booking systems, which are not always considered, but in fact have huge impact on the way the policy is implemented. This pilot study therefore aimed to measure outpatients’ satisfaction and views about the WAS, using questionnaires collected from both outpatients and doctors from one large tertiary public hospital. We also wanted to find ideas for future reforms of the Chinese health system that would improve patients’ overall satisfaction with medical services and improve trust.
Methods
Using a structured questionnaire, we evaluated attitudes and experiences among outpatients at the Changhai Hospital in relation to WAS and the conventional walk-in process. The Changhai Hospital is a large tertiary public hospital located in Shanghai. The facility's outpatient center includes areas for registration, units for clinical consultation, medical examinations and imaging. It has an average of 10,000 daily outpatient visits including patients with Shanghai Cities and Towns’ medical insurance as well as patients who pay for themselves. The study was authorized and approved by the Ethics Committee of Changhai Hospital and carried out from October 2011 to January 2012.
Study population
Based on the average number of outpatient visits, and the number of outpatient doctors, the sample size was set at 1000 patients and 200 doctors according to the thought of target response precision. Considering the influence of different specialties as a hierarchical factor, the sample number of doctors from different specialties was in proportion to the numbers working in different outpatient specialties throughout the hospital.
Study design
We instructed trained research assistantsat each consulting unit in the outpatient service center to interview the current patients every 45 minutes to complete the questionnaire.If the patient is an old person, the assistants will help him/her to complete the questionnairewith his/her answer. The questionnaire, called the ‘Changhai Outpatient Experience Questionnaire’ (CHOEQ) (Additional file
1), was a 42-item previously validated questionnaire focusing on feedback from patients on what they experienced in the course of receiving outpatient care, derived from the Patient Satisfaction Questionnaire. This is a 55-item instrument that assesses patients’ attitudes toward physicians and medical care services [
10]. The physicians who provided outpatient service during the same period were asked to complete the ‘Changhai Doctor Experience Questionnaire’ (CHDEQ) (Additional file
2), which contained 24 items and focused on their views about outpatient appointments. All questionnaires were administered anonymously to discourage an acquiescent or socially-desirable response bias [
11].
The CHOEQ measured the main specific aspects of outpatient hospital experience: expected and actual waiting and consultation time, satisfaction with behavior of staff and, in particular doctors, preferred appointment booking system and suggestions about WAS, and an overall rating for the visit.The booking system can be divided into four main categories. Mode 1: On-the-spot appointment mode (registration desk); Mode 2: On-the-spot appointment mode (consulting room); Mode 3: WAS; Mode 4: Self-help booking on machine in outpatient department.About WAS, patients can select which consultant they prefer, with only a rough estimate of appointment time, or a particular appointment time. In addition, patient demographic information (age, gender, marital status, educational level) and other information, such as socioeconomic status, and payment mode of medical fee were included. The CHDEQ mainly focused on satisfaction with the general systems and layout used in the outpatient department, opinions about the treatment processes and assistance there, what they consider to be a reasonable consultation time per patient, and views about different appointment booking systems.
Analysis of data
SAS 9.2 was performed to process and analyze research data in this study. Measurement data were shown as mean ± standard deviation, median, and minimum–maximum.Depending on the normality and homogeneity of variance of the data, the t test, revised t test, or Wilcoxon rank-sum test were used for comparisons between two groups of independent samples, with variance analysis or the Wilcoxon rank-sum test used for larger groups. Counting categorical data were shown as a frequency (%). The chi-square test, revised chi-square test, or Fisher’s exact probability test were used for comparisons between groups. Ranked data were shown as frequency (%), and we applied the Mann–Whitney Wilcoxon rank-sum test and Kruskal-Wallis statistics testfor comparisons between two groups and larger groups, respectively. Comprehensive satisfaction values were calculated by rank analysis for ordinal data.It needs to be noticed that the satisfaction valueis an inverse scale. The higher the score the lower the satisfaction. A P-value < 0.05 was considered statistically significant.
Discussion
This study is among the first to measure outpatient satisfaction and views about online and other forms of appointment booking systems, using questionnaires collected from both outpatients and doctors. The satisfaction of Chinese patients with the current state of the healthcare service they receive, and particularly around doctor-patient interaction, treatment processes, waiting times in hospital, medical facilities and hospital environment, and medical costs, is dropping [
12]. According to the Chinese Ministry of Health’s “Governing Rules for the Management and Classification of Hospitals” in 1989 [
13], public hospitals in China are divided into three levels. Patients have the freedom to choose the medical institutions and access higher levels of service according to need, from the community hospital up to the higher specialty hospital [
14]. However, most Chinese patients in fact have no understanding of the concept of appointments and referrals, which causes problems for the tertiary public hospitals. These hospitals are supposed to provide high quality specialty medical and other healthcare services to participants in several areas, acting as high-level teaching hospitals and conduct sophisticated research. But, with demand increasing, these hospitals have had insufficient capacity to cope, resulting in serious drops in patient satisfaction [
12,
15]. Because outpatient services are more commonly used for effective and efficient interventions for many common health problems (especially some chronic diseases), the outpatient service center in tertiary public hospital are always overcrowded [
16]. The long waiting time for a drop-in outpatient appointment in a tertiary hospital has become one of the most frequent causes for complaint among the Chinese public [
17]. As patients often equate life satisfaction with their healthcare experience [
15,
18‐
20], it is not surprising that about 40% of the correspondents were not satisfied with outpatient services from the national household health survey [
21].
In our research, we found that patients were least satisfied with waiting times. In other studies, patient satisfaction ratings were affected by factors such as culture, expectations, and sense of entitlement, and responses to questions on general opinion and service expectations may be affected by the actual service received [
22]. However, patients always perceived the clinical staff as kinder and more compassionate if their waiting times had been shorter, and showed improved satisfaction with the care provided, even if the staff had done nothing to affect the wait [
23]. In our research, we found that most patients would not tolerate waiting longer than 30 minutes, with no significant differences between patients of different ages and occupations. As waiting time is a significant component of patient satisfaction, reducing it needs to be a priority. WAS has been showed to have the ability to reduce waiting times effectively [
24]. However, just as our results showed, despite the potential benefits of using the WAS, 65% of patients still chose to queue. Among patients who had used booking systems, over 70% preferred the walk-in system, with no differences depending on marital status, occupation, and way of paying and family income. One possible reason for patients not choosing the WAS was that many were unaware that they could book an appointment through the Internet. In a telephone interview survey carried out in Xijing Hospital, which is a large tertiary public hospital in Xi’an city in China, it was revealed that over half of the participants did not know that an appointment could be obtained through the Internet [
24]. And patients might not have sufficient confidence in using the Internet. These findings indicate that hospitals and health service providers should make more effort to promote and encourage the use of the WAS among potential patients. Patients could be reminded about the WAS when they arrive at the registration desk in the outpatient department.
Moreover, to attract more patients to use WAS system, operation should be made even easier and more user-friendly by enhancing system service quality (for instance, webpage uploadingspeed, user-friendliness of webpages and search for information) and information variety (for example, to provide informationabout health care and outpatient pre-register systems) with Cloud Computing and APP (Application software) [
8]. The current role of WAS is limited just as online appointment. If the WAS system can integrate personal health/medication records and provide patients with information related to their own health based on various curriculums (i.e. diabetes and high blood pressure) and categories (i.e. dieting and exercising) for self-control and management, disease-prevention, health remainders and checks, that would be tremendously encouraging for patients to use [
8].
The other reason for patients not willing to choose WAS is the possible failure of obtaining registration for some specific day of the week or time of the day according to different registration demand. Previous study showed that most Chinese patients prefer to see a doctor on Monday or Tuesday, especially in the morning [
24]. This makes it very difficult to obtain registration during these periods.How to distribute the registration demand evenly is an issue for the hospital and health providers to solve in the future. Method of computer simulation could be a good choice for medical practitioner to predict patient through put and waiting timewithout making potentially costly changes. And it has been proved to be helpful in analyzing the effects of re-organizing resources in hospital [
25]. We have tried using computer simulating in outpatients’ services with Matlab software and achieved great success. And further research work is still needed.
Earlier studies showed that patients’ trust in medical services or attitude towards health policy had a significant influence on their satisfaction with waiting times in hospital [
26]. However, as long waiting times have become a more general problem in China, patients’ trust in medical services and attitude towards health policy have declined, and also become a less important influence on their satisfaction with waiting times in hospital [
12]. Public perceptions of fairness and trust of the health-care system erode [
21]. This lack of trust may be part of the reason why patients are unwilling to use WAS. They preferred to queue for an appointment because they found this more real than the WAS, where they were just communicating with a computer. The concern that some might get preferential treatment because they knew hospital staff decreased patients’ trust still further. An increase in trust and an improvement in general attitudes towards health policy could improve patients’ attitude towards new health policies and processes, such as the WAS. The most effective way to increase patients’ trust in medical services was to improve their quality and reliability. Hospitals should therefore strengthen their management to end any unfair priority given to those who know hospital staff. The findings also suggest that more humanized hospital management might improve patients’ overall satisfaction with medical services and attitude towards health policy.
Higher physician emotional intelligence (EI) and a higher ratio of patient follow-up lead to increased patient trust [
27]. Doctors provide their time and skill to treat the patient, and in return receive the patient’s compliance in the form of either further appointments or word-of-mouth recommendations to other patients. For doctors, walk-in appointments, especially those allowing appointments to be made at consulting rooms, could help them to increase patient trust. In addition, physicians’ professional competence may be developmental in nature. That could be why about 80% of doctors other than associate professors would like to provide walk-in appointments for patients who visit their consulting rooms. They consider this a sort of real-time feedback on their key competencies, such as interpersonal skills and medical expertise. The other reason that physicians may not be recommending the WAS to patients was the worry that there might be too many patients who did not attend pre-booked appointments, because it is too easy to book then not cancel. In fact, the WAS could be considered to reflect confirmation and positive feedback by patients across a wider area, not just those who can attend a walk-in clinic. It can also help to prompt doctors to contemplate or initiate changes in their daily practices. To avoid too many patients not attending, hospitals could shorten the appointment interval to reflect the percentage of patients who are forecast not to attend [
28], or use an experimental computer simulation, which we have started to use in our hospital, to choose a slightly larger appointment interval so as to decrease mean patient waiting time at the expense of greater provider idle time.
Of those doctors who had used services as a patient or patient’s relative, only 43% had used the appointment booking systems provided by their own hospital, and 89% still preferred a walk-in appointment. We believe this is because doctors may have a kind of privilege not only in their knowledge of disease, but also in the way that they can access medical resources in their own hospital compared to ordinary patients. For them, walking into the hospital where they work, even without an appointment, is not difficult. These phenomena also reduce the satisfaction of ordinary patients because of unfair preferential treatment of others. So the hospital needs to improve its services to make them fairer and better. We also found that doctors were significantly more satisfied with the service currently provided than their patients were. Doctors may think that patients always exaggerate how long they wait, and they also sometimes tended to focus on the presenting symptoms, believing that patients’ other needs were less important. However, these beliefs may have poor or limited accuracy, which is important when assessing doctors’ behavior or ability in the social–psychological realm [
29]. In addition, a more active and autonomous role for the patient has recently been advocated that involves increased patient control, reduced physician dominance, and more mutual participation [
30]. The patient-centered approach has become the predominant model in clinical practice today. To improve patient satisfaction and the patient-physician relationship, we believe that we need to help doctors take account of others’ opinions or feedback in treating disease, to prevent them from being too disease-centered, and ignoring patients’ other needs.
However, our study had several limitations. First, we failed to collect data on the possible reasons for non-attendance and late attendance at pre-booked appointments, partly because the majority of people who failed to attend their appointments or were late declined to give an explanation. Late and non-attendance will disrupt the orderliness of medical care and wastes limited medical resources [
31]. It can further increase mean patient waiting times and so decrease patient satisfaction. Strategies that may increase patient punctuality, together with consideration of complexity of the patients’ symptoms, should be considered in a future study. Second, because our study participants were from a large tertiary hospital, and different hospitals may have a different WAS, our findings may not be generalizable to other hospitals. Different service volumes, a different hospital, or a different level of hospital could all contribute to different practices. It is also possible that recall bias is present, such that satisfaction with the overall visit to the hospital, or several hospitals, influenced the perception of time spent. We need to develop intervention strategies to further improve the usability of the WAS and increase convenience for patients. Furthermore, it needs to be mentioned that the survey was only delivered to patients who got care could really bias the sample. However, in China, most patients will choose to wait in line even the waiting was so long and bad. Few people will exit because of feeling poor or of urgent. So, we thought that the sampling bias caused by those situations must be minor to consider.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
The six authors are justifiably credited with authorship, according to the authorship criteria, and all have approved submission of this manuscript. YH was responsible for the conception, design, analysis and interpretation of data, and drafting of the manuscript; ZM was responsible for the conception, design, acquisition of data, analysis and interpretation of data, and drafting of the manuscript; ZC was responsible for the acquisition of data, and critical revision of the manuscript; SQ and CQ were responsible for analysis and interpretation of data, and critical revision of the manuscript; and ZY was responsible for acquisition of data, and critical revision of the manuscript.