Use of Patient-Reported Experience Measures in Pediatric Care: A Systematic Review
Sumedh Bele1,2,3 
Lorynn Teela4 
Muning Zhang5 
Sarah Rabi6 
Sadia Ahmed1,3 
Hedy Aline van Oers4 
Elizabeth Gibbons7 Nicole Dunnewold8 Lotte Haverman4 Maria J. Santana1,2,3*- 1Department of Pediatrics, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- 2Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- 3Patient Engagement Platform, Alberta Strategy for Patient-Oriented Research Support Unit, Calgary, AB, Canada
- 4Psychosocial Department, Emma Children's Hospital Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
- 5Bachelor of Health Sciences Program, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- 6Bachelor of Sciences Program, Queen's University, Kingston, ON, Canada
- 7Evidera, Oxford, United Kingdom
- 8Health Sciences Library, University of Calgary, Calgary, AB, Canada
Introduction: Patient-reported Experience Measures (PREMs) are validated questionnaires, that gather patients' and families' views of their experience receiving care and are commonly used to measure the quality of care, with the goal to make care more patient and family-centered. PREMs are increasingly being adopted in pediatric population, however knowledge gaps exist around understanding the use of PREMs in pediatrics.
Objective: To identify and synthesize evidence on the use of PREMs in pediatric healthcare settings and their characteristics.
Evidence Review: Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines governed the conduct and reporting of this review. An exhaustive search strategy was applied to MEDLINE, EMBASE, PsycINFO, Cochrane Library, and CINAHL databases to identify relevant peer-reviewed articles from high-income countries. Additionally, gray literature was searched to capture real-world implementation of PREMs. All the articles were screened independently by two reviewers in two steps. Data was extracted independently, synthesized, and tabulated. Findings from gray literature was synthesized and reported separately. Risk of bias for the studies identified through scientific databases was assessed independently by two reviewers using the National Institutes of Health Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies.
Results: The initial search identified 15,457 articles. After removing duplicates, the title and abstracts of 11,543 articles were screened. Seven hundred ten articles were eligible for full-text review. Finally, 83 articles met the criteria and were included in the analyses.
Of the 83 includes studies conducted in 14 countries, 48 were conducted in USA, 25 in European countries and 10 in other countries. These 83 studies reported on the use of 39 different PREMs in pediatric healthcare settings. The gray literature retrieved 10 additional PREMs. The number of items in these PREMs ranged from 7 to 89. Twenty-three PREMs were designed to be completed by proxy, 10 by either pediatric patients or family caregivers, and 6 by pediatric patients themselves.
Conclusion and Relevance: This comprehensive review is the first to systematically search evidence around the use of PREMs in pediatrics. The findings of this review can guide health administrators and researchers to use appropriate PREMs to implement patient and family-centered care in pediatrics.
Introduction
Pediatric healthcare systems around the world continue to evolve and are increasingly acknowledging the importance of delivering patient and family-centered care (PFCC) to improve all dimensions of quality, including patients' and families' experience with care received (1). Encouraged by the American Academy of Pediatrics, PFCC is key in the planning, delivery, and evaluation of healthcare that is grounded in mutually beneficial partnerships among healthcare providers, patients, and families. To improve and sustain the practice of PFCC, measuring patient and families' experience with the care received is necessary (2).
Patient-reported Experience Measures (PREMs) are validated questionnaires, that gather patients' and families' views of their experience receiving care. PREMs assess the impact of the process of care including communication between patient, their families and healthcare providers, information sharing, involvement of patients and their families in decision-making and are commonly used as indicators to evaluate the quality of care (2, 3). In the context of the Institute for Healthcare Improvement (IHI) Triple Aim Framework, the implementation of PREMs in healthcare leads to improved outcomes while lowering healthcare costs (4). In addition, it allows the voice of patients and their family to inform care improvement, an important concept included in the learning health system paradigm (5).
The growing adoption of PREMs in pediatric care requires the identification of appropriate PREMs and their subsequent use in healthcare settings. PREMs are centered around the experience while receiving care (e.g., hospital environment, ease of parking, call buttons near bed etc.) rather than clinical outcomes. Moreover, most of the validated PREMs are developed in high income countries which have comparable healthcare systems and services. Thus, the objective of this systematic review is to identify and synthesize evidence on the types of PREMs used in pediatric care, and their subsequent use in healthcare systems in high income countries to inform care improvement and support pediatric learning health systems paradigm.
Methods
Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines governed the conduct and reporting of this review (6). The protocol has been registered with OSF (DOI 10.17605/OSF.IO/3RMNC).
MeSH (Medical Subject Headings) terms, keywords and their variations were used to develop a search strategy, which was initially applied to MEDLINE database to randomly screen 100 abstracts to refine this strategy. The final search strategy was applied to MEDLINE, EMBASE, PsycINFO, Cochrane Library, and CINAHL databases. Gray literature was searched through the websites of health institutes, pediatric hospitals, conferences, professional agencies, and search engines manually, which provided an overview of real-world implementation of PREMs.
Covidence was used for article screening and selection against pre-defined inclusion and exclusion criteria (Box 1) (8). In the first step, two independent reviewers screened titles and abstracts. Then, two reviewers independently screened selected articles by going through their full text. In both the steps, conflicts were resolved by discussion and consensus or by involving a third reviewer.
BOX 1. Inclusion and exclusion criteria.
Inclusion Criteria
1. Population: Studies that focused only on pediatric populations (≤ 18 years).
2. Measure: Studies that implemented previously validated pediatric PREMs with explicit information regarding how the PREM was validated by mentioning either the validation process or referencing a previous article that described the validation and development process.
3. Geography: Included studies also needed to have been conducted in high-income countries, loosely defined by World Bank (7 ).
4. Articles published from January 2000 to April 2021.
Exclusion Criteria:
1. Population: Studies that focused on adult or general populations alongside pediatric populations.
2. Measure: Studies that utilized a non-validated PREM or a satisfaction survey. Editing a validated PREM threatens its validity, therefore we excluded studies where PREMs were either edited or researcher created their own questionnaires without conducting any validity testing.
3. PREM validation studies.
4. Study design: opinion pieces and reviews.
5. Language: Studies in languages other than English, French, Spanish, or Dutch.
Following screening, two reviewers independently extracted the data. Due to heterogeneity among the studies in both statistical and methodological domains, conducting a meta-analysis was neither warranted nor plausible. We instead synthesized the results inductively by tabulating identified PREMs in various geographic locations, their type, use and characteristics. Similarly, findings from gray literature are synthesized and reported separately.
Risk of bias for all the studies identified through scientific databases was assessed independently by two reviewers using the National Institutes of Health Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies (9).
Results
Search Results
The PRISMA flow diagram (Figure 1) summarizes the study selection process. The initial search identified 15,457 articles. After removing duplicates, the title and abstracts of 11,543 articles were screened. Of these, 710 were eligible for full-text review. In total, 83 articles met the inclusion criteria and were included in the analyses. These studies reported on the use of 39 different PREMs in pediatric healthcare settings (Table 1). The gray literature retrieved 10 additional PREMs that are used in clinical practice. Since many PREMs are usually copy-righted by the developers, so we did not contact authors or developer of the surveys for more information.
Figure 1. Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) flow diagram of identification and selection process of studies.
Table 1. Summary of the pediatric patient-reported experience measures.
Characteristics of Included Studies
The included studies were conducted in 14 countries, including 48 studies in the United States of America, 25 studies in European countries (Austria, Finland, Germany, Greece, Iceland, the Netherlands, Norway, Slovenia, Spain, and the United Kingdom), 8 studies in Canada, and 1 study each in Australia and Singapore. Figure 2 provides an overview of the number of different PREMs that are used per country. Regarding study design, 41 of the included studies used a cross-sectional study design. The remaining study designs include 13 cohort studies, 6 mixed-methods, 6 observational, 3 quasi-experimental, 2 randomized-control trials, 2 quality improvement studies, 2 secondary data analyses, 2 retrospective data studies, and 1 of each of the following study designs: program evaluation, descriptive, longitudinal, case study, and pilot/feasibility studies.
Figure 2. Geographic locations of pediatric PREMs identified through systematic review and gray literature.
The duration of studies ranged from 2 weeks to 5 years and study populations ranged from 0 to 25 years. Disease of interest varied across studies, although most studies addressed a general disease group. Disease-specific populations included epilepsy, diabetes, asthma, neurological conditions, and juvenile arthritis, among others. The identified studies also presented a diverse range of health care settings, including emergency rooms, NICU and PICUs, inpatient wards, and outpatient ambulatory clinic, among others Overall, paper-pencil was the most common mode of administering PREMs (60.2%), followed by electronic (26.5%), telephone (12.0%), and/or via interview (1.2%) modes. The PREMs were completed by proxy only in 60 studies (71.4%), by patient and/or the proxy in 14 studies (16.7%), by only the patient in 7 studies (8.3%), while 3 studies did not specify (3.6%) (one study used two different PREMs that had different methods of completion) (49).
Among the studies, the most commonly used PREMs were the various Press Ganey surveys (50) (n = 18), the Measure of Processes of Care (MPOC) (28) (n = 15), Child HCAHPS (10) (n = 10) and HCAHPS surveys (51) (n = 5). Among all the included studies, there was a high amount of variation in the purpose of using PREMs. PREMs were most commonly used to evaluate factors that affected overall patient experience and to assess the experiences after an intervention, most often an improvement in quality of care. A complete overview of the characteristics of the included studies can be found in the Supplement 1.
PREMs
This extensive review identified 39 previously validated pediatric PREMs (Table 1). These PREMs were developed in 7 countries. The greatest number of PREMs were developed in the United States of America (N = 21), followed by the United Kingdom (N = 9), Canada (N = 4), the Netherlands (N = 2), Finland (N = 1), Germany (N = 1), and Sweden (N = 1). Most of the included PREMs were generic (N = 34), aiming to measure general experiences of healthcare regardless of the disease or care sector. The included disease specific PREMs (N = 5) have been developed to capture the experience of healthcare from patients with inflammatory bowel disease, epilepsy, diabetes, cancer, and mental health conditions.
Of the identified PREMs, 23 were designed to be completed by proxy (59.0%), 10 PREMs (25.6%) could be completed by either or both of the pediatric patient and their caregiver(s), and 6 PREMs (13.4%) had been explicitly developed for completion by the pediatric patients themselves. The PREMs designed for completion by the pediatric patients were Disease-Specific Patient Satisfaction Questionnaire (18), Evaluation of the Quality of Diabetes Care (21), the Give Youth a Voice (25), the Inpatient Survey (26), the Press Ganey Patient Satisfaction Survey (40), and the National Cancer Patient Experience Survey (46).
Among the studies reporting questionnaire characteristics, the number of items ranged from 7 to 89, and the number of domains ranged from 3 to 10. The number of items was not provided for 5 PREMs, and the number of domains was not provided for 12 PREMs. Domains related to communication were most common, such as “communication with parent,” “communication with child,” “communication about care and treatment,” and “provider's communication skills.” Other examples of reported domains include “information,” “respect,” “coordination of care,” “patient and family engagement,” “respectful and supportive care,” and “overall experiences.”
Quality Assessment
The quality assessment of the included studies is presented in the Supplement 1. The quality of all studies was rated as either fair (40%) or good (60%). Overall, the risk of bias of the included studies was moderate.
Gray Literature
Ten additional PREMs were identified through the gray literature search (Supplement 2). These PREMs were used to evaluate the experiences of pediatric patients and/or caregivers with daily clinical healthcare in the United States of America, the United Kingdom, the Netherlands, Canada, and Australia. The majority of hospitals in these countries asked patients to share their experiences with the use of PREMs. The gray literature search showed that a variation of PREMs, often self-developed, were used in the hospitals. Some hospitals administered PREMs to all their patients/caregivers, though most hospitals randomly invited recently discharged patients/caregivers to complete PREMs. The modes of administering PREMs identified through gray literature were similar to the ones identified through scientific databases, as listed previously.
Discussion
In this review, we document the geographic distribution of pediatric PREMs used and quantify the different PREMs administered in clinical care. PREMs are often falsely synonymized with patient reported outcome measures (PROMs) and satisfaction questionnaires, but these three types of questionnaires have distinct purposes and target different elements of patient care. In contrast to PROMs, which assess the patient's health status and measures quality of life, PREMs focus on care processes and their perceived impact on overall patient experience (52). While dissimilar in outlook, PREMs and PROMs are often used in tandem to gather information related to the patient's care experience and outcome contentment. The terms patient satisfaction and patient experience despite being often used interchangeably, are different. Patient experience assesses whether something that should happen in a healthcare setting (such as clear communication with a provider) actually happened or how often it happened. On the other hand, Satisfaction is about whether a patient's expectations about a health encounter were met (52–54). PREMs also differ from patient satisfaction surveys, which relate to patient expectations and often involve a degree of subjectivity that is not seen in PREMs (52, 55–57).
The results of our review demonstrate an international uptake of pediatric PREMs in clinical care, totaling 49 different PREMs, 39 from peer-reviewed articles and 10 from gray literature that were used in 14 developed countries spanning four continents. While administered in 14 different countries, the development of these PREMs only occurred in seven, with the greatest heterogeneity in both pediatric PREM development and implementation occurring in the United States (21), followed by the United Kingdom (9). While primarily utilized for quality improvement purposes, various research groups implemented pediatric PREMs to gauge how the responses varied between patient populations or between the patients and their family caregivers.
Measuring patient and family experience has a critical role in informing PFCC. Previous studies have explored the development and psychometric evaluation of PREMs, assessed their validity and reliability, and compared different PREM instruments for their respective utilization (58–60). Studies have also noted differences between proxy ratings, usually coming from a family caregiver, and the ratings of a patient themselves, where the patient tends to provide lower rating regarding their own experiences of care (49, 61). Additionally, there exists a paucity of information regarding the use of pediatric PREMs, and their type (i.e., generic, disease-specific, health-setting-specific), as well as their purpose and impact on quality of care in clinical practice. These findings can be used to inform PFCC initiatives at a system-level, helping to achieve the Triple Aim and supporting the learning health system paradigm (62, 63).
Additionally, research has acknowledged the correlation between PREM-implementation, the establishment of the PFCC, and the promotion of quality improvement initiatives (64). While this information is accepted in the context of adult PREMs, much less research exists regarding the implementation and assessment of pediatric PREMs (65). This study will inform future work in the area of PREM implementation in pediatric care.
The identified PREMs feature important domains addressing PFCC concepts such as shared-decision making and respecting patient values. A main gap identified in our review suggests that the use of disease-specific PREMs warrants more attention, with only five of the validated PREMs being disease-specific. Even among studies conducted in disease-specific settings, generic PREMs were more often chosen over an appropriate disease-specific tool. This may be related to the versatility and applicability of generic PREMs in more healthcare settings compared to disease-specific PREMs. However, disease-specific PREMs issues more specific to the corresponding disease. For example, MPOC (28) is a validated PREM commonly used for children with variety of neurodevelopmental disabilities or maxillofacial disorders. MPOC assesses family caregiver's perception of the care that their children receive at rehabilitation treatment centers, and thus can provide a better contextual understanding of patient experience specifically related to those clinical conditions. Therefore, future research examining why disease-specific PREM use and development is lacking should be explored. Additionally, while all included studies discussed the utility of using these pediatric PREMs, few examined the practicality of implementing them (66–68). Future research examining the capacity of hospitals and physicians to incorporate these measures into clinical care is needed to pragmatically assess the likelihood of pediatric PREM administration.
A significant strength of this systematic review is the inclusion of gray literature. As this review aimed to explore the range of pediatric PREMs currently in use, gray literature sources provided an exploration of real-world PREM implementation in pediatric healthcare settings around the world. We also incorporated the perspectives of international researchers with expertise in the topics of PREMs and PROMs. This bolstered the knowledge and experience of the research team and allowed for the inclusion of different perspectives on PREM implementation from different countries.
Despite being successful in identifying the number of pediatric PREMs currently in use, this review was not without limitations. Regarding gray literature, the information about the PREMs and their implementation were often not explicitly described on hospital websites, meaning we could only provide a global description of these PREMs. PREMs created in or translated to different languages or cultural contexts may have not been available in a language that the reviewers could understand, and therefore those studies were excluded. Furthermore, the inclusion criteria of “high-income countries” potentially limited the scope of this study by geographically restricting the results. Lastly, because of the interchangeable use of the terms “experience” and “satisfaction,” it is possible that due to the phrasing of study surveys, some PREMs were inadvertently excluded. However, the likelihood of this occurring was minimized due to the continual implementation of dual reviewers and the inclusion of the terms “satisfaction” and “satisfaction survey” in our initial search strategy.
The objective of this systematic review was to identify pediatric PREMs and their use in care settings. Although there are tools like the COSMIN Checklist to critically appraise the validity and reliability of PROs (PROMs and PREMs), there are no such standard tools to evaluate the strengths and weaknesses of PREMs. Moreover, evaluating these measures for their strengths and weaknesses would be subjective and context specific. Therefore, this systematic review did not evaluate the strengths and weaknesses of the PREMs, but further studies focused on assessing the strengths and weaknesses of individual PREMs may be warranted in the future.
Conclusion
This systematic review details the international use of pediatric PREMs in different pediatric clinical settings and provides an overview of the current validated pediatric PREMs available for use. The findings of this review can guide health administrators and researchers to use appropriate PREMs to implement PFCC in pediatric settings. In most of the studies included in this review, the usefulness of pediatric PREMs was highlighted. However, future additional research into the views of implementing PREMs held by clinical practitioners and patients and their families is warranted to best gauge the practicality of widespread pediatric PREM implementation.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
MS, LH, SB, SA, EG, LT, and HO contributed to the overall rationale and design of the review. ND provided expert input on developing search strategy. SB, MZ, SR, SA, and LT assessed studies for eligibility against inclusion and exclusion criteria including gray literature and assessed risk of bias and also extracted the data and synthesized results. SB, MZ, SR, and SA led the drafting of the manuscript. MS, LH, SB, SA, EG, LT, HO, MZ, and SR contributed to the subsequent drafts of the manuscript. All authors contributed to the article and approved the submitted version.
Funding
SB received financial support in the form of graduate studentship from Alberta Children's Hospital Research Institute. MZ received financial support in the form of summer research studentship from Alberta Innovates.
Conflict of Interest
EG was employed by Evidera.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank these funding agencies for their financial support.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2021.753536/full#supplementary-material
Abbreviations
Child HCAHPS, The Child Hospital Consumer Assessment of Healthcare Providers and Systems; IHI, Institute for Healthcare Improvement; MeSH, Medical Subject Headings; MPOC, Measure of Process of Care; PFCC, Patient and Family-Centered Care; PREM, Patient-Reported Experience Measure; PRISMA, Preferred Reporting Items for Systematic Review and Meta-Analysis; PROM, Patient-Reported Outcome Measure.
References
1. Patient-and Family-Centered Care. Institute for Patient-and Family-Centered Care. (2021) Available online at: https://www.ipfcc.org/about/pfcc.html (accessed November 1, 2021).
2. Kingsley C, Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. (2017) 17:137–44. doi: 10.1093/bjaed/mkw060
3. Beattie M, Murphy DJ, Atherton I, Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: A systematic review. Syst Rev. (2015) 4:1–21. doi: 10.1186/s13643-015-0089-0
4. Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff. (2008) 27:759–69. doi: 10.1377/hlthaff.27.3.759
5. Nwaru BI, Friedman C, Halamka J, Sheikh A. Can learning health systems help organisations deliver personalised care? BMC Med. (2017) 15:1–8. doi: 10.1186/s12916-017-0935-0
6. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. (2021) 372:n71. doi: 10.1136/bmj.n71
7. High income | Data. Available online at: https://data.worldbank.org/country/XD (accessed June 18, 2021).
8. Covidence. Better Systematic Review Management. (2021). Available online at: https://www.covidence.org/ (accessed June 17, 2021).
9. Study, Quality Assessment Tools,. NHLBI, NIH. Available online at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (accessed June 18, 2021).
10. Toomey SL, Zaslavsky AM, Elliott MN, Gallagher PM, Fowler FJ, Klein DJ, et al. The development of a pediatric inpatient experience of care measure: child HCAHPS ® HHS public access. Pediatrics. (2015) 136:360–9. doi: 10.1542/peds.2015-0966
11. Care Quality Commission,. Children young peoples inpatient day case survey 2014: National results. (2015). (Newcastle Upon Tyne), 1–78. Available online at: https://www.cqc.org.uk/sites/default/files/20150626_cypsurvey_results_tables.pdf
12. Janhunen K, Kankkunen P, Kvist T. Quality of pediatric emergency care as assessed by children and their parents. J Nurs Care Qual. (2019) 34:180–4. doi: 10.1097/NCQ.0000000000000346
13. Development of the CAHPS Clinician & Group Survey | Agency for Healthcare Research Quality. Available online at: https://www.ahrq.gov/cahps/surveys-guidance/cg/about/Develop-CG-Surveys.html (accessed June 30, 2021).
14. Mercer SW, Maxwell M, Heaney D, Watt GCM. The consultation and relational empathy (CARE) measure: Development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract. (2004) 21:699–705. doi: 10.1093/fampra/cmh621
15. Kleinsorge CA, Roberts MC, Roy KM, Rapoff MA. The program evaluation of services in a primary care clinic: Attaining a medical home. Clin Pediatr (Phila). (2010) 49:548–59. doi: 10.1177/0009922809358615
16. Knapp C, Madden V, Sloyer P, Shenkman E. Effects of an integrated care system on quality of care and satisfaction for children with special health care needs. Matern Child Health J. (2012) 16:579–86. doi: 10.1007/s10995-011-0778-9
17. Family Experiences and Pediatric Health Services Use Associated With Family-Centered Rounds (2012).
18. Sadlo A, Altevers J, Peplies J, Ayis S, Direkze N, Lomer MC, et al. Measuring satisfaction with health care in young persons with inflammatory bowel disease -an instrument development and validation study. BMC Health Serv Res. (2014) 14:1–10. doi: 10.1186/1472-6963-14-97
19. Down C, Waldron B, Maini R, Colaco F, Bowyer K, Gilmore E, et al. Epilepsy12 - United Kingdom collaborative clinical audit of health care for children and young people with suspected epileptic seizures. Arch Dis Child. (2015) 100(Suppl. 3):A118.2–9. doi: 10.1136/archdischild-2015-308599.260
20. Latour JM, Van Goudoever JB, Duivenvoorden HJ, Albers MJ, van Dam NA, Dullaart E, et al. Construction and psychometric testing of the EMPATHIC questionnaire measuring parent satisfaction in the pediatric intensive care unit. Intensive Care Med. (2011) 37:310–8. doi: 10.1007/s00134-010-2042-y
21. Pouwer F, Snoek FJ. Patients' evaluation of the quality of diabetes care (PEQD): Development and validation of a new instrument. Qual Saf Heal Care. (2002) 11:131–6. doi: 10.1136/qhc.11.2.131
22. Barber AJ, Tischler VA, Healy E. Consumer satisfaction and child behaviour problems in child and adolescent mental health services. J Child Heal Care. (2006) 10:9–21. doi: 10.1177/1367493506060200
23. Van Riper M. Family-provider relationships and well-being in families with preterm infants in the NICU. Hear Lung J Acute Crit Care. (2001) 30:74–84. doi: 10.1067/mhl.2001.110625
24. Mah JK, Tough S, Fung T, Douglas-England K, Verhoef M. Parents' global rating of mental health correlates with SF-36 scores and health services satisfaction. Qual Life Res. (2006) 15:1395–401. doi: 10.1007/s11136-006-0014-z
25. Gan C, Campbell KA, Snider A, Cohen S, Hubbard J. Giving Youth a Voice (GYV): A measure of youths' perceptions of the client-centredness of rehabilitation services. Can J Occup Ther. (2008) 75:96–104. doi: 10.1177/000841740807500205
26. Hargreaves DS, McDonagh JE, Viner RM. Validation of you're welcome quality criteria for adolescent health services using data from national inpatient surveys in England. J Adolesc Heal. (2013) 52:50–57.e1. doi: 10.1016/j.jadohealth.2012.04.005
27. Eisen S V., Wilcox M, Idiculla T, Speredelozzi A, Dickey B. Assessing consumer perceptions of inpatient psychiatric treatment: the perceptions of care survey. Jt Comm J Qual Improv. (2002) 28:510–26. doi: 10.1016/S1070-3241(02)28056-6
28. King SM, Rosenbaum PL, King GA. Parents' perceptions of caregiving: Development and validation of a measure of processes. Dev Med Child Neurol. (1996) 38:757–72. doi: 10.1111/j.1469-8749.1996.tb15110.x
29. Shaw KL, Southwood TR, McDonagh JE. Development and preliminary validation of the “Mind the Gap” scale to assess satisfaction with transitional health care among adolescents with juvenile idiopathic arthritis. Child Care Health Dev. (2007) 33:380–8. doi: 10.1111/j.1365-2214.2006.00699.x
30. Mitchell-DiCenso A, Guyatt G, Paes B, Blatz S, Kirpalani H, Fryers M, et al. A new measure of parent satisfaction with medical care provided in the neonatal intensive care unit. J Clin Epidemiol. (1996) 49:313–8. doi: 10.1016/0895-4356(95)00531-5
31. Davis-Dao CA, Ehwerhemuepha L, Chamberlin JD, Feaster W, Khoury AE, Fortier MA, et al. Keys to improving patient satisfaction in the pediatric urology clinic: A starting point. J Pediatr Urol. (2020) 16:377–83. doi: 10.1016/j.jpurol.2020.03.013
32. Lewis CC, Scott DE, Pantell RH, Wolf MH. Parent satisfaction with children's medical care: Development, field test, and validation of a questionnaire. Med Care. (1986) 24:209–15. doi: 10.1097/00005650-198603000-00003
33. Seid M, Varni JW, Bermudez LO, Zivkovic M, Far MD, Nelson M, et al. Parents' perceptions of primary care: Measuring parents' experiences of pediatric primary care quality. Pediatrics. (2001) 108:264–70. doi: 10.1542/peds.108.2.264
34. Bragadóttir H, Reed D. Psychometric instrument evaluation: the pediatric family satisfaction questionnaire. Pediatr Nurs. (2002) 28:475–82. Available online at: https://pubmed.ncbi.nlm.nih.gov/12424983/
35. Hummel K, Presson AP, Millar MM, Larsen G, Kadish H, Olson LM. An assessment of clinical and system drivers of family satisfaction in the PICU*. Pediatr Crit Care Med. (2020) 21:E888–97. doi: 10.1097/PCC.0000000000002394
36. Sigurdardottir AO, Garwick AW, Svavarsdottir EK. The importance of family support in pediatrics and its impact on healthcare satisfaction. Scand J Caring Sci. (2017) 31:241–52. doi: 10.1111/scs.12336
37. Brousseau DC, Mukonje T, Brandow AM, Nimmer M, Panepinto JA. Dissatisfaction with hospital care for children with sickle cell disease not due only to race and chronic disease. Pediatr Blood Cancer. (2009) 53:174–8. doi: 10.1002/pbc.22039
38. Nagarajan N, Rahman S, Boss EF. Are there racial disparities in family-reported experiences of care in inpatient pediatrics? Clin Pediatr (Phila). (2017) 56:619–26. doi: 10.1177/0009922816668497
39. Boss EF, Thompson RE. Patient experience in outpatient pediatric otolaryngology. Laryngoscope. (2012) 122:2304–10. doi: 10.1002/lary.23364
40. Krugman SD, Suggs A, Photowala HY, Beck A. Redefining the community pediatric hospitalist: The combined pediatric ED/inpatient unit. Pediatr Emerg Care. (2007) 23:33–7. doi: 10.1097/01.pec.0000248685.94647.01
41. Allam SD, Mehta M, Ben Khallouq B, Burrows JF, Rosen P. Key drivers of patient experience in ambulatory paediatric cardiology. Cardiol Young. (2017) 27:1585–90. doi: 10.1017/S1047951117000841
42. Singh SC, Sheth RD, Burrows JF, Rosen P. Factors influencing patient experience in pediatric neurology. Pediatr Neurol. (2016) 60:37–41. doi: 10.1016/j.pediatrneurol.2016.04.002
43. Ygge BM, Arnetz JE. Quality of paediatric care: Application and validation of an instrument for measuring parent satisfaction with hospital care. Int J Qual Heal Care. (2001) 13:33–43. doi: 10.1093/intqhc/13.1.33
44. Conner JM, Nelson, EC,. Neonatal Intensive Care: Satisfaction Measured From a Parent's Perspective. (1999) Available online at: http://www.aappublications.org/news (accessed June 30, 2021).
45. Uhl T, Fisher K, Docherty SL, Brandon DH. Insights into patient and family-centered care through the hospital experiences of parents. JOGNN - J Obstet Gynecol Neonatal Nurs. (2013) 42:121–31. doi: 10.1111/1552-6909.12001
46. Furness CL, Smith L, Morris E, Brocklehurst C, Daly S, Hough RE. Cancer patient experience in the teenage young adult population- key issues and trends over time: an analysis of the united kingdom national cancer patient experience surveys 2010-2014. J Adolesc Young Adult Oncol. (2017) 6:450–8. doi: 10.1089/jayao.2016.0058
47. Patient Reported Experience Measure (PREM) for urgent emergency care | RCPCH. Available online at: https://www.rcpch.ac.uk/resources/patient-reported-experience-measure-prem-urgent-emergency-care (accessed July 1, 2021).
48. Viner RM. Do adolescent inpatient wards make a difference? Findings from a national young patient survey. Pediatrics. (2007) 120:749–55. doi: 10.1542/peds.2006-3293
49. Mah JK, Tough S, Fung T, Douglas-England K, Verhoef M. Adolescent quality of life and satisfaction with care. J Adolesc Heal. (2006) 38:607.e1-607.e7. doi: 10.1016/j.jadohealth.2005.08.004
50. Patient Experience | Press Ganey. Available online at: https://www.pressganey.com/solutions/patient-experience (accessed June 30, 2021).
51. Goldstein E, Farquhar M, Crofton C, Darby C, Garfinkel S. Measuring hospital care from the patients' perspective: An overview of the CAHPS® Hospital Survey development process. Health Serv Res. (2005) 40:1977–95. doi: 10.1111/j.1475-6773.2005.00477.x
52. Berkowitz B. The patient experience and patient satisfaction: Measurement of a complex dynamic. Online J Issues Nurs. (2016) 21:1. doi: 10.3912/OJIN.Vol21No01Man01
53. Patient experience or patient satisfaction: what should you measure? Available online at: https://www.essenburgh.com/en/blog/patient-experience-or-patient-satisfaction-what-should-you-measure-and-how-will-it-benefit-your-organization (accessed June 18, 2021).
54. What Is Patient Experience? | Agency for Healthcare Research and Quality. Available online at: https://www.ahrq.gov/cahps/about-cahps/patient-experience/index.html (accessed november 6, 2021).
55. Larson E, Sharma J, Bohren MA, Tunçalp Ö. When the patient is the expert: measuring patient experience and satisfaction with care. Bull World Health Organ. (2019) 97:563–9. doi: 10.2471/BLT.18.225201
56. Patient Satisfaction Surveys. Available online at: https://catalyst.nejm.org/doi/full/10.1056/CAT.18.0288 (accessed November 6, 2021).
57. 11 03 12 02 Patient experience is not patient satisfaction understanding the fundamental differ - YouTube. Available online at: https://www.youtube.com/watch?v=79iZv0GygPs (accessed June 18, 2021).
58. Bull C, Byrnes J, Hettiarachchi R, Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. (2019) 54:1023–35. doi: 10.1111/1475-6773.13187
59. Sizmur S, Graham C, Bos N. Psychometric evaluation of patient-reported experience measures: Is it valid? Int J Qual Heal Care. (2020) 32:219–20. doi: 10.1093/intqhc/mzaa006
60. Male L, Noble A, Atkinson J, Marson T. Measuring patient experience: A systematic review to evaluate psychometric properties of patient reported experience measures (PREMs) for emergency care service provision. Int J Qual Heal Care. (2017) 29:314–26. doi: 10.1093/intqhc/mzx027
61. Sonneveld HM, Strating MMH, van Staa AL, Nieboer AP. Gaps in transitional care: What are the perceptions of adolescents, parents and providers? Child Care Health Dev. (2013) 39:69–80. doi: 10.1111/j.1365-2214.2011.01354.x
62. Stiefel M, Nolan K. Measuring the triple aim: A call for action. Popul Health Manag. (2013) 16:219–20. doi: 10.1089/pop.2013.0025
63. Farmanova E, Kirvan C, Verma J. Triple aim in Canada: Developing capacity to lead to better health, care and cost. Int J Qual Heal Care. (2016) 28:830–7. doi: 10.1093/intqhc/mzw118
64. Price RA, Elliott MN, Zaslavsky AM, Hays RD, Lehrman WG, Rybowski L, et al. Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev. (2014) 71:522–54. doi: 10.1177/1077558714541480
65. Kemp KA, Ahmed S, Quan H, Johnson D, Santana MJ. Family Experiences of pediatric inpatient care in Alberta, Canada: results from the child HCAHPS Survey. Hosp Pediatr. (2018) 8:338–44. doi: 10.1542/hpeds.2017-0191
66. Hargreaves DS, Sizmur S, Pitchforth J. Children and young people's versus parents' responses in an English national inpatient survey. Arch Dis Child. (2018) 103:486–91. doi: 10.1136/archdischild-2017-313801
67. Tilly-Gratton A, Nadon MA, Houle A, Pelaez S, Ducharme FM. What convinces parents of children with asthma to adhere to maintenance inhaled corticosteroids? Can J Respir Crit Care, Sleep Med. (2018) 2:147–54. doi: 10.1080/24745332.2018.1450101
Keywords: patient-centered care, pediatrics, systematic review, routine clinical care, patient-reported experience measures (PREMs)
Citation: Bele S, Teela L, Zhang M, Rabi S, Ahmed S, van Oers HA, Gibbons E, Dunnewold N, Haverman L and Santana MJ (2021) Use of Patient-Reported Experience Measures in Pediatric Care: A Systematic Review. Front. Pediatr. 9:753536. doi: 10.3389/fped.2021.753536
Received: 05 August 2021; Accepted: 26 November 2021;
Published: 20 December 2021.
Edited by:
Margaret Anne Defeyter, Northumbria University, United KingdomReviewed by:
Andreas Gerber-Grote, Zurich University of Applied Sciences, SwitzerlandPei-Fen Poh, KK Women's and Children's Hospital, Singapore
Copyright © 2021 Bele, Teela, Zhang, Rabi, Ahmed, van Oers, Gibbons, Dunnewold, Haverman and Santana. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Maria J. Santana, mjsantan@ucalgary.ca