The online version of this article (https://doi.org/10.1007/s10488-018-0909-3) contains supplementary material, which is available to authorized users.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Pragmatic clinical trials of mental health services are increasingly being developed to establish comparative effectiveness, influence sustainable implementation, and address real world policy decisions. However, use of time and resource intensive qualitative methods in pragmatic trials may be inconsistent with the aims of efficiency and cost minimization. This paper introduces a qualitative method known as Rapid Assessment Procedure-Informed Clinical Ethnography (RAPICE) that combines the techniques of Rapid Assessment Procedures with clinical ethnography. A case study is presented to illustrate how RAPICE can be used to efficiently understand pragmatic trial implementation processes and associated real world policy implications.
Supplementary Data 1 (DOCX 131 KB)10488_2018_909_MOESM1_ESM.docx
Aakhus, E., Granlund, I., Odegaard-Jensen, J., Wensing, M., Oxman, A. D., & Flottorp, S. A. (2014). Tailored interventions to implement recommendations for elderly patients with depression in primary care: A study protocol for a pragmatic cluster randomized controlled trial. Trials, 15, 16. https://doi.org/10.1186/1745-6215-15-16. CrossRefPubMedPubMedCentral
Ackerman, S. L., Sarkar, U., Tieu, L., Handley, M. A., Schillinger, D., et al. (2017). Meaningful use in the safety net: A rapid ethnography of patient portal implementation at five community health centers in California. Journal of the American Medical Informatics Association, 24(5), 903–912. CrossRef
American College of Surgeons Committee on Trauma. (2006). Resources for optimal care of the injured patient. Washington, DC: American College of Surgeons.
American College of Surgeons Committee on Trauma. (2014). Resources for optimal care of the injured patient. Washington, DC: American College of Surgeons.
Beebe, J. (1995). Basic concepts and techniques of rapid appraisal. Human Organization, 54, 42–51. CrossRef
Bernard, H. R. (1988). Research methods in cultural anthropology. Newbury Park: Sage.
Brody, E. (1981). The clinician as ethnographer: A psychoanalytic perspective on the epistemology of fieldwork. Culture, Medicine and Psychiatry, 5(3), 273–301. CrossRef
Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59(9), 989–995. CrossRef
Calabrese, J. D. (2013). A different medicine: Postcolonial healing in a Native American church. New York: Oxford University Press. CrossRef
Charmaz, K. (2014). Constructing grounded theory (2nd ed.). Thousand Oaks: Sage.
Cohen, D., & Crabtree, B. J. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. Annals of Family Medicine, 6, 331–339. CrossRef
Coreil, J., Augustin, A., Holt, E., & Halsey, N. A. (1989). Use of ethnographic research for instrument development in a case-control study of immunization use in Haiti. Journal of Clinical Epidemiology, 18(4 Suppl 2), S33–S37.
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness- implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226. CrossRef
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.
Forman, J., Heisler, M., Damschroder, L. J., Kaselitz, E., & Kerr, E. A. (2017). Development and application of the RE-AIM QuEST mixed methods framework for program evaluation. Preventive Medicine Reports, 6, 322–328. https://doi.org/10.1016/j.pmedr.2017.04.002. CrossRefPubMedPubMedCentral
Geertz, C. (1976). From the native’s point of view: On the nature of anthropological understanding. In K. H. Basso & H. A. Selby (Eds.), Meaning in anthropology. Albuquerque: University of New Mexico Press.
Glasgow, R., & Riley, W. T. (2013). Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine, 45(2), 237–243. CrossRef
Glasgow, R. E., & Chambers, D. (2012). Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clinial and Translational Science, 5(1), 48–55. https://doi.org/10.1111/j.1752-8062.2011.00383.x. CrossRef
Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005). Practical clinical trials for translating research to practice: Design and measurement recommendations. Medical Care, 43, 551–557. CrossRef
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. CrossRef
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., et al. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98–113. CrossRef
Goepp, J. G., Meykler, S., Mooney, N. E., Lyon, C., Raso, R., & Julliard, K. (2008). Provider insights about palliative care barriers and facilitators: Results of a rapid ethnographic assessment. American Journal of Hospital and Palliative Care, 25, 309–314. CrossRef
Green, C. A., Duan, N., Gibbons, R., Palinkas, L. A., & Wisdom, J. (2015). Approaches to mixed methods dissemination and implementation research: Methods, strengths, caveats, and opportunities. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 508–523. https://doi.org/10.1007/s10488-014-0552-6. CrossRefPubMed
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629. CrossRef
Harris, K. J., Jerome, N. W., & Fawcett, S. B. (1997). Rapid assessment procedures: A review and critique. Human Organization, 56(3), 375–378. CrossRef
Herman, E., & Bentley, M. E. (1992). Manuals for ethnographic data collection. Experience and issues. Social Science and Medicine, 35(11), 1369–1378. CrossRef
Kleinman, A., & Benson, P. (2006). Anthropology in the clinic: The problem of cultural competency and how to fix it. PLoS Medicine, 3(10), e294. https://doi.org/10.1371/journal.pmed.0030294. CrossRefPubMedPubMedCentral
Levitt, H. M., Cressell, J. W., Josselson, R., Bamberg, M., Frost, D. M., & Suarez-Orozco, C. (2018). Journal article reporting standards for qualitative primary, qualitative meta-analytic and mixed methods research in psychology: The APA Publications and Communications Board Task Board Report. American Psychologist, 73, 26–46. CrossRef
Lie, D., Lee-Rey, E., Gomez, A., Bereknyei, S., & Braddock, C. H. 3rd. (2011). Does cultural competency training of health professionals improve patient outcomes? A systematic review and proposed algorithm for future research. Journal of General Internal Medicine, 26(3), 317–325. CrossRef
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills: Sage. CrossRef
Littlewood, E., Duarte, A., Hewitt, C., Knowles, S., Palmer, S., Walker, S., et al. (2015). A randomized controlled trial of computerized cognitive behaviour therapy for the treatment of depression in primary care: The Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Health Technology Assessment, 19, xxii–171. CrossRef
Love, J., & Zatzick, D. (2014). Screening and intervention for comorbid substance disorders, PTSD, depression, and suicide: A trauma center survey. Psychiatric Services, 65(7), 918–923. CrossRef
Luhrman, T. (1989). Persuasions of the witch’s craft: Ritual magic in Contemporary England. Cambridge: Harvard University Press.
Miles, M. B., & Huberman, A. M. (1994). Qualitative Data Analysis: An Expanded Sourcebook (2nd ed.). Thousand Oaks: Sage.
Miller, W. L., & Crabtree, B. F. (1992). Primary care research: A multimethod typology and qualitative road map. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research (pp. 3–30). Newbury Park: Sage.
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89(9), 1245–1251. CrossRef
Orgeta, V., Leung, P., Yates, L., Hoare, Z., Henderson, C., Whitaker, C., et al. (2015). Individual cognitive stimulation therapy for dementia: A clinical effectiveness and cost- effectiveness pragmatic, multicenter, randomized controlled trial. Health Technology Assessment, 19, 1–108. https://doi.org/10.3310/hta19640. CrossRefPubMed
Padgett, D. K. (2017). Qualitative methods in social work research (3rd ed.). Los Angeles: Sage.
Palinkas, L. A. (2014). Qualitative and mixed methods in mental health services and implementation research. Journal of Clinical Child and Adolescent Psychology, 43, 851–861. https://doi.org/10.1080/15374416.2014.910791. CrossRefPubMedPubMedCentral
Palinkas, L. A., & Cooper, B. R. (2018). Mixed methods evaluation in dissemination and implementation science. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 335–353). New York: Oxford University Press.
Palinkas, L. A., Aarons, G. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–53. CrossRef
Palinkas, L. A., Criado, V., Fuentes, D., Shepherd, S., Milian, H., Folsom, D., et al. (2007). Unmet needs for services for older adults with mental illness: Comparison of views of different stakeholder groups. American Journal of Geriatric Psychiatry, 15, 530–540. CrossRef
Palinkas, L. A., Prussing, E., Reznik, V. M., & Landsverk, J. A. (2004). The San Diego East County school shootings: A qualitative study of community-level post-traumatic stress. Prehospital and Disaster Medicine, 19(1), 113–121. CrossRef
Palinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J., Chorpita, B. F., Weisz, J. R., et al. (2008). An ethnographic study of implementation of evidence-based treatment in child mental health: First steps. Psychiatric Services, 59, 738–746. CrossRef
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks: Sage.
Pearson, R. (1989). Rapid assessment procedures are changing the way UNICEF evaluates its projects. Hygiene., 8, 23–25.
Priebe, S., Kelley, L., Omer, S., Golden, E., Walsh, S., Khanom, H., et al. (2015). The effectiveness of a patient-centred assessment with a solution-focused approach (DIALOG+) for patients with psychosis: A pragmatic cluster-randomized controlled trial in community care. Psychotherapy and Psychosomatics, 84(5), 304–313. CrossRef
Purtle, J., Dodson, E., & Brownson, R. C. (2018). Policy dissemination research. In R. C. Brownson, G. A. Colditz & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 433–448). New York: Oxford University Press.
Rosaldo, R. I. (1984). Grief and a headhunter’s rage: On the cultural force of emotions. In S. Plattner & E. M. Bruner (Eds.), Text, pay, and story: The construction and reconstruction of self and society (pp. 178–195). Washington, DC: American Ethnological Society.
Saldana, J. (2016). The coding manual for qualitative researchers (3rd ed.). Los Angeles: Sage.
Schensul, S. L., Schensul, J. J., & LeCompte, M. D. (1999). Essential ethnographic methods. Walnut Creek: Alta Mira Press.
Schwitters, A., Lederer, P., Zilversmit, L., Gudo, P. S., Ramiro, I., Cumba, L., et al. (2015). Barriers to health care in rural Mozambique: a rapid assessment of planned mobile health clinics for ART. Global Health Science & Practice, 3, 109–116. CrossRef
Scrimshaw, S. C., Carballo, M., Ramos, L., & Blair, B. A. (1991). The AIDS rapid assessment procedures: A tool for health education planning and evaluation. Health Education Quarterly, 18(1), 111–123. CrossRef
Scrimshaw, S. C. M., & Hurtado, E. (1987). Rapid assessment procedures for nutrition and primary health care: Anthropological approaches to improving programme effectiveness. Los Angeles: UCLA Latin American Center.
Strauss, A. L., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks: Sage.
Terrell, F., Zatzick, D. F., Jurkovich, G. J., Rivara, F. P., Donovan, D. M., Dunn, C. W., et al. (2008) Nationwide survey of alcohol screening and brief intervention practices at US Level I trauma centers. Journal of the American College of Surgeons, 207(5), 630–638. CrossRef
Thomas, S. A., Merkouris, S. S., Browning, C. J., Rademacher, H., Feldman, S., Enticott, J., et al. (2015). The PROblem Gambling RESearch Study (PROGRESS) research protocol: A pragmatic randomized controlled trial of psychological interventions for problem gambling. British Medical Journal Open, 5, e009385. https://doi.org/10.1136/bmjopen-2015-009385. CrossRef
Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., et al. (2009). A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. Journal of Clinical Epidemiology, 62, 464–475. CrossRef
Tong, A., Sainsbury, P., & Craig, I. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal of Qualitative Health Care, 19, 349–357. CrossRef
Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: The relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 353–364. CrossRef
Tunis, S. R., Stryer, D. B., & Clancy, C. M. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. Journal of the American Medical Association, 290(12), 1624–1632. PubMed
Vindrola-Padros, C., & Vindrola-Padros, B. (2018). Quick and dirty? A systematic review of the use of rapid ethnographies in healthcare organization and delivery. BMJ Quality & Safety., 27, 321–330. CrossRef
Ware, N. C., Dickey, B., Tugenberg, T., & McHorney, C. A. (2003). CONNECT: A measure of continuity of care in mental health services. Mental Health Services Research, 5(4), 209–221. CrossRef
Ware, N. C., Tugenberg, T., & Dickey, B. (2003). Ethnography and measurement in mental health: Qualitative validation of a measure of continuity of care (CONNECT). Qualitative Health Research, 13(10), 1393–1406. CrossRef
Ware, N. C., Tugenberg, T., Dickey, B., & McHorney, C. A. (1999). An ethnographic study of the meaning of continuity of care in mental health services. Psychiatric Services, 50(3), 395–400. CrossRef
Wenborn, J., Hynes, S., Moniz-Cook, E., Mountain, G., Poland, F., King, M., et al. (2016). Community occupational therapy for people with dementia and family carers (COTiD-UK) versus treatment as usual (Valuing Active Life in Dementia [VALID] programme): Study protocol for a randomized controlled trial. Trials, 17, 65. https://doi.org/10.1186/s13063-015-1150-y. CrossRefPubMedPubMedCentral
Willging, C., Waitzkin, H., & Lamphere, L. (2009). Transforming administrative and clinical practice in a public behavioral health system: An ethnographic assessment of the context of change. Journal of Health Care for the Poor and Underserved, 20(3), 866–883. CrossRef
Willging, C., Waitzkin, H., & Wagner, W. (2005). Medicaid managed care for mental health services in a rural state. Journal of Health Care for the Poor and Underserved, 16(3), 497–514. CrossRef
Wright, A., Sittig, D. F., Ash, J. S., Erikson, J. L., Hickman, T. T., et al. (2015). Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study. International Journal of Medical Informatics., 84, 901–911. CrossRef
Zatzick, D., & Johnson, F. A. (1997). Alternative psychotherapeutic practice among middle class Americans: I: Case studies and follow-up. Culture, Medicine and Psychiatry., 21(1), 53–88. CrossRef
Zatzick, D., Donovan, D., Jurkovich, G., Gentilello, L., Dunn, C., Russo, J., et al. (2014). Disseminating alcohol screening and brief intervention at trauma centers: A policy-relevant cluster randomized effectiveness trial. Addiction, 109(5), 754–765. https://doi.org/10.1111/add.12492. CrossRefPubMedPubMedCentral
Zatzick, D., Jurkovich, G., Rivara, F. P., Russo, J., Wagner, A., Wang, J., et al. (2013). A randomized stepped care intervention trial targeting posttraumatic stress disorder for surgically hospitalized injury survivors. Annals of Surgery, 257(3), 390–399. https://doi.org/10.1097/SLA.0b013e31826bc313. CrossRefPubMedPubMedCentral
Zatzick, D., Rivera, F., Jurkovich, G., Russo, J., Trusz, S. G., Wang, J., et al. (2011). Enhancing the population impact of collaborative care interventions: Mixed method development and implementation of stepped care targeting posttraumatic stress disorder and related comorbidities after acute trauma. General Hospital Psychiatry, 33, 123–134. CrossRef
Zatzick, D., Russo, J., Darnell, D., Chambers, D. A., Palinkas, L. A., Eaton, E. V., et al. (2016). An effectiveness-implementation hybrid trial study protocol targeting posttraumatic stress disorder and comorbidity. Implementation Science, 11, 58. https://doi.org/10.1186/s13012-016-0424-4. CrossRefPubMed
- Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) in Pragmatic Clinical Trials of Mental Health Services Implementation: Methods and Applied Case Study
Lawrence A. Palinkas
- Springer US
Administration and Policy in Mental Health and Mental Health Services Research
Print ISSN: 0894-587X
Elektronische ISSN: 1573-3289