The online version of this article (doi:10.1007/s11136-017-1581-x) contains supplementary material, which is available to authorized users.
Since 2012, PCORI has been funding patient-centered comparative effectiveness research with a requirement for engaging patients and other stakeholders in the research, a requirement that is unique among the US funders of clinical research. This paper presents PCORI’s evaluation framework for assessing the short- and long-term impacts of engagement; describes engagement in PCORI projects (types of stakeholders engaged, when in the research process they are engaged and how they are engaged, contributions of their engagement); and identifies the effects of engagement on study design, processes, and outcomes selection, as reported by both PCORI-funded investigators and patient and other stakeholder research partners.
Detailed quantitative and qualitative information collected annually from investigators and their partners was analyzed via descriptive statistics and cross-sectional qualitative content and thematic analysis, and compared against the outcomes expected from the evaluation framework and its underlying conceptual model.
The data support the role of engaged research partners in refinements to the research questions, selection of interventions to compare, choice of study outcomes and how they are measured, contributions to strategies for recruitment, and ensuring studies are patient-centered.
The evaluation framework and the underlying conceptual model are supported by results to date. PCORI will continue to assess the effects of engagement as the funded projects progress toward completion, dissemination, and uptake into clinical decision making.
Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., et al. (2013). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22(8), 1889–1905. CrossRefPubMed
Kirwan, J. R., & Hewlett, S. (2007). Patient perspective: Reasons and methods for measuring fatigue in rheumatoid arthritis. Journal of Rheumatology, 34(5), 1171–1173. PubMed
Food and Drug Administration (FDA). (2009). Guidance for industry on patient-reported outcome measures: Use in medical product development to support labeling claims, federal register (Vol. 74, pp. 65132–65133). Washington, DC: U.S. Department of Health and Human Services.
Charlton, J. I. (1998). Nothing about us without us: Disability oppression and empowerment. Berkeley: University of California Press. CrossRef
Viswanathan, M., Ammerman, A., Eng, E., Garlehner, G., Lohr, K. N., Griffith, D., Rhodes, S., Samuel-Hodge, C., Maty, S., Lux, L., Webb, L., Sutton, S. F., Swinson, T., Jackman, A., & Whitener, L. (2004). Community-based participatory research: Assessing the evidence. Evidence Report Technology Assessment (Summ)(99), 1–8.
Jones, M. M., Kamenetzky, A., Manville, C., Ghiga, I., MacLure, C., Harte, E., et al. (2016). The National Institute for Health Research at 10 Years. Arlington, VA: RAND Corporation.
Canadian Institutes of Health Research. (2011). Canada’s strategy for patient-oriented research. Ottawa, Ontario. Retrieved March 16, 2017 from https://www.cihr-irsc.gc.ca/e/documents/P-O_Research_Strategy-eng.pdf.
Staley, K. (2009). Exploring impact: Public involvement in NHS, public health and social care research. Eastleigh: INVOLVE.
Ring, L. (2016, July). EMA review and qualification process. Paper presented at the ISOQOL Measuring What Matters Symposium, Washington, DC.
Innovative Medicines Initiative. European Patients’ Academy on Therapeutic Innovation. Retrieved March 17, 2017, from https://www.imi.europa.eu/content/eupati.
Postmus, D., Mavris, M., Hillege, H. L., Salmonson, T., Ryll, B., Plate, A., et al. (2016). Incorporating patient preferences into drug development and regulatory decision making: Results from a quantitative pilot study with cancer patients, carers, and regulators. Clinical Pharmacology and Therapeutics, 99(5), 548–554. CrossRefPubMed
Canadian Institutes of Health Research. (2015). Health research roadmap II: Capturing innovation to produce better health and health care for canadians strategic plan 2014-15 to 2018-19. Retrieved March 16, 2017 from http://www.cihr-irsc.gc.ca/e/48964.html#a7.
National Institutes for Health Research. (2016). Going the Extra Mile. Paper presented at the Patient and Public Involvement NIHR Impact Workshop.
Dudley, L., Gamble, C., Preston, J., Buck, D., The EPIC Patient Advisory Group, Hanley, B., et al. (2015). What difference does patient and public involvement make and what are its pathways to impact? Qualitative study of patients and researchers from a cohort of randomised clinical trials. PLoS ONE, 10(6), e0128817. CrossRefPubMedPubMedCentral
Patient-Centered Outcomes Research Institute (PCORI). (2015). Patient-Centered Outcomes Research Institute (PCORI) Evaluation Framework 2.0. Retrieved March 17, 2017 from http://www.pcori.org/sites/default/files/PCORI-Evaluation-Framework-2.0.pdf.
Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398–405. CrossRef
Guest, G., MacQueen, Kathleen M., & Emily, E. (2012). Applied thematic analysis. Thousand Oaks, California: Sage Publications Inc. CrossRef
Sandelowski, M. (2001). Real qualitative researchers do not count: the use of numbers in qualitative research. Research in Nursing & Health, 24(3), 230–240. CrossRef
Mercieca-Bebber, R., Palmer, M. J., Brundage, M., Calvert, M., Stockler, M. R., & King, M. T. (2016). Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome data: A systematic review. Quality of Life Research, 24(6), 81.
Forsythe, L., Anyanwu, C., Schneider, M., Brentzel, F., Kohler, P., Ritok, M., et al. (2016). Patient and stakeholder engagement in research: Identifying challenges and developing solutions. National Harbor, Maryland: PCORI Second Annual Meeting.
- Methods and impact of engagement in research, from theory to practice and back again: early findings from the Patient-Centered Outcomes Research Institute
Mary Kay Margolis
- Springer International Publishing