Skip to main content
Erschienen in: Quality of Life Research 9/2016

10.03.2016

Refining a Web-based goal assessment interview: item reduction based on reliability and predictive validity

verfasst von: Carolyn E. Schwartz, Jei Li, Bruce D. Rapkin

Erschienen in: Quality of Life Research | Ausgabe 9/2016

Einloggen, um Zugang zu erhalten

Abstract

Background

Goals are an important basis for patients’ cognitive appraisal processes underlying quality-of-life (QOL) assessment because they are the foundation to one’s frame of reference. We sought to identify the best of six goal delineation items and relevant themes for two new versions of the QOL Appraisal Profile: an interview tool using a subset of the best open-ended goal delineation items, and a shorter close-ended version for use in survey research.

Methods

This is a secondary analysis of longitudinal data (n = 1126) of participants in the North American Research Committee on Multiple Sclerosis (MS) registry. The open-ended data were coded by at least two trained coders with moderately high inter-rater agreement. There were 31 themes reflecting goal content such as health, interpersonal, independence, mental health, and financial themes. Descriptive statistics identified most prevalent themes. Reliability analysis (alpha, item-total correlations) and hierarchical linear modeling identified the best goal items.

Results

Based on these qualitative and quantitative analyses, Solve (item 2) is the best single item because it is clear anchor for about a third of the goal themes, and explains the most variance in outcomes and demographic characteristics, suggesting that it taps into and reveals diversity in the sample. The next best items are Accomplish and Maintain (items 1 and 4), which are useful in tapping into and revealing diversity among people reporting cognitive deficits (Accomplish), and demographic factors (both Accomplish and Maintain items).

Conclusions

The goal delineation items identified as best performers in this study will be used to develop a shorter open-ended version of the QOL Appraisal Profile, and an entirely close-ended version of the QOL Appraisal Profile for use in more standard survey research settings. These tools will enable coaching patients in medical decision making as well as investigations of appraisal and response shift in QOL research.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Rapkin, B. D., & Fischer, K. (1992). Framing the construct of life satisfaction in terms of older adults’ personal goals. Psychology and Aging, 7(1), 138–149.CrossRefPubMed Rapkin, B. D., & Fischer, K. (1992). Framing the construct of life satisfaction in terms of older adults’ personal goals. Psychology and Aging, 7(1), 138–149.CrossRefPubMed
2.
Zurück zum Zitat Ryff, C. D. (1989). Beyond Ponce de Leon and life satisfaction: New directions in quest of successful ageing. International Journal of Behavioral Development, 12(1), 35–55.CrossRef Ryff, C. D. (1989). Beyond Ponce de Leon and life satisfaction: New directions in quest of successful ageing. International Journal of Behavioral Development, 12(1), 35–55.CrossRef
3.
Zurück zum Zitat Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51(5), 1058.CrossRef Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51(5), 1058.CrossRef
4.
Zurück zum Zitat Palys, T. S., & Little, B. R. (1983). Perceived life satisfaction and the organization of personal project systems. Journal of Personality and Social Psychology, 44(6), 1221.CrossRef Palys, T. S., & Little, B. R. (1983). Perceived life satisfaction and the organization of personal project systems. Journal of Personality and Social Psychology, 44(6), 1221.CrossRef
5.
Zurück zum Zitat Klinger, E., Barta, S. G., & Maxeiner, M. E. (1980). Motivational correlates of thought content frequency and commitment. Journal of Personality and Social Psychology, 39(6), 1222.CrossRef Klinger, E., Barta, S. G., & Maxeiner, M. E. (1980). Motivational correlates of thought content frequency and commitment. Journal of Personality and Social Psychology, 39(6), 1222.CrossRef
6.
Zurück zum Zitat Rapkin, B. D., & Fischer, K. (1992). Personal goals of older adults: issues in assessment and prediction. Psychology and Aging, 7(1), 127–137.CrossRefPubMed Rapkin, B. D., & Fischer, K. (1992). Personal goals of older adults: issues in assessment and prediction. Psychology and Aging, 7(1), 127–137.CrossRefPubMed
7.
Zurück zum Zitat Wolfe, J., et al. (2000). Understanding of prognosis among parents of children who died of cancer: Impact on treatment goals and integration of palliative care. Journal of the American Medical Association, 284(19), 2469–2475.CrossRefPubMed Wolfe, J., et al. (2000). Understanding of prognosis among parents of children who died of cancer: Impact on treatment goals and integration of palliative care. Journal of the American Medical Association, 284(19), 2469–2475.CrossRefPubMed
8.
Zurück zum Zitat Donovan, K. A., et al. (2002). Treatment preferences in recurrent ovarian cancer. Gynecologic Oncology, 86(2), 200–211.CrossRefPubMed Donovan, K. A., et al. (2002). Treatment preferences in recurrent ovarian cancer. Gynecologic Oncology, 86(2), 200–211.CrossRefPubMed
9.
Zurück zum Zitat Campbell, A., Converse, P. E., & Rodgers, W. L. (1976). The quality of American life. New York: Russell Sage Foundation. Campbell, A., Converse, P. E., & Rodgers, W. L. (1976). The quality of American life. New York: Russell Sage Foundation.
10.
Zurück zum Zitat Schwartz, C. E., et al. (2002). Early intervention in planning end-of-life care with ambulatory geriatric patients: results of a pilot trial. Archives of Internal Medicine, 162(14), 1611–1618.CrossRefPubMed Schwartz, C. E., et al. (2002). Early intervention in planning end-of-life care with ambulatory geriatric patients: results of a pilot trial. Archives of Internal Medicine, 162(14), 1611–1618.CrossRefPubMed
11.
Zurück zum Zitat Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioural and Cognitive Psychotherapy, 23(04), 325–334.CrossRef Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioural and Cognitive Psychotherapy, 23(04), 325–334.CrossRef
12.
Zurück zum Zitat Messer, S. B., & McWilliams, N. (2007). Insight in psychodynamic therapy: Theory and assessment. In L. G. Castonguay & C. Hill (Eds.), Insight in psychotherapy (pp. 9–29). American Psychological Association: Washington, DC.CrossRef Messer, S. B., & McWilliams, N. (2007). Insight in psychodynamic therapy: Theory and assessment. In L. G. Castonguay & C. Hill (Eds.), Insight in psychotherapy (pp. 9–29). American Psychological Association: Washington, DC.CrossRef
13.
Zurück zum Zitat Zimmerman, B. J., Bandura, A., & Martinez-Pons, M. (1992). Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. American Educational Research Journal, 29(3), 663–676.CrossRef Zimmerman, B. J., Bandura, A., & Martinez-Pons, M. (1992). Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. American Educational Research Journal, 29(3), 663–676.CrossRef
14.
Zurück zum Zitat Elliot, A. J., et al. (2001). A cross-cultural analysis of avoidance (relative to approach) personal goals. Psychological Science, 12(6), 505–510.CrossRefPubMed Elliot, A. J., et al. (2001). A cross-cultural analysis of avoidance (relative to approach) personal goals. Psychological Science, 12(6), 505–510.CrossRefPubMed
15.
Zurück zum Zitat Saajanaho, M., et al. (2016). Mobility limitation and changes in personal goals among older women. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 71(1), 1–10.CrossRef Saajanaho, M., et al. (2016). Mobility limitation and changes in personal goals among older women. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 71(1), 1–10.CrossRef
16.
Zurück zum Zitat Nie, Y., & Liem, G. A. D. (2013). Extending antecedents of achievement goals: The double-edged sword effect of social-oriented achievement motive and gender differences. Learning and Individual Differences, 23, 249–255.CrossRef Nie, Y., & Liem, G. A. D. (2013). Extending antecedents of achievement goals: The double-edged sword effect of social-oriented achievement motive and gender differences. Learning and Individual Differences, 23, 249–255.CrossRef
17.
Zurück zum Zitat Twenge, J. M., Campbell, W. K., & Freeman, E. C. (2012). Generational differences in young adults’ life goals, concern for others, and civic orientation, 1966–2009. Journal of Personality and Social Psychology, 102(5), 1045.CrossRefPubMed Twenge, J. M., Campbell, W. K., & Freeman, E. C. (2012). Generational differences in young adults’ life goals, concern for others, and civic orientation, 1966–2009. Journal of Personality and Social Psychology, 102(5), 1045.CrossRefPubMed
18.
Zurück zum Zitat Gushue, G. V., & Whitson, M. L. (2006). The relationship of ethnic identity and gender role attitudes to the development of career choice goals among black and Latina girls. Journal of counseling psychology, 53(3), 379.CrossRef Gushue, G. V., & Whitson, M. L. (2006). The relationship of ethnic identity and gender role attitudes to the development of career choice goals among black and Latina girls. Journal of counseling psychology, 53(3), 379.CrossRef
19.
Zurück zum Zitat Morganstern, B. A., et al. (2011). The psychological context of quality of life: a psychometric analysis of a novel idiographic measure of bladder cancer patients’ personal goals and concerns prior to surgery. Health and Quality of Life Outcomes, 9(10), 1. Morganstern, B. A., et al. (2011). The psychological context of quality of life: a psychometric analysis of a novel idiographic measure of bladder cancer patients’ personal goals and concerns prior to surgery. Health and Quality of Life Outcomes, 9(10), 1.
20.
Zurück zum Zitat Rapkin, B. D., Schwartz, C. E., & Sprangers, M. A. G. (2000). Personal goals and response shifts: understanding the impact of illness and events on the quality of life of people living with AIDS 8400. In C. E. Schwartz & M. A. G. Sprangers (Eds.), Adaptation to changing health: Response shift in quality-of-life research (pp. 53–71). Washington, DC: American Psychological Association.CrossRef Rapkin, B. D., Schwartz, C. E., & Sprangers, M. A. G. (2000). Personal goals and response shifts: understanding the impact of illness and events on the quality of life of people living with AIDS 8400. In C. E. Schwartz & M. A. G. Sprangers (Eds.), Adaptation to changing health: Response shift in quality-of-life research (pp. 53–71). Washington, DC: American Psychological Association.CrossRef
21.
Zurück zum Zitat Kiresuk, T. J., & Sherman, M. R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453.CrossRefPubMed Kiresuk, T. J., & Sherman, M. R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453.CrossRefPubMed
22.
Zurück zum Zitat Duda, J., & Whitehead, J. (1998). Measurement of goal perspectives in the physical domain. In: J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 21–48). Duda, J., & Whitehead, J. (1998). Measurement of goal perspectives in the physical domain. In: J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 21–48).
23.
Zurück zum Zitat Kiresuk, T. J., Smith, A., & Cardillo, J. E. (2014). Goal attainment scaling: Applications, theory, and measurement. New York: Psychology Press. Kiresuk, T. J., Smith, A., & Cardillo, J. E. (2014). Goal attainment scaling: Applications, theory, and measurement. New York: Psychology Press.
24.
Zurück zum Zitat Klein, H. J., et al. (2001). The assessment of goal commitment: A measurement model meta-analysis. Organizational Behavior and Human Decision Processes, 85(1), 32–55.CrossRefPubMed Klein, H. J., et al. (2001). The assessment of goal commitment: A measurement model meta-analysis. Organizational Behavior and Human Decision Processes, 85(1), 32–55.CrossRefPubMed
25.
Zurück zum Zitat Malec, J. F., Smigielski, J. S., & DePompolo, R. W. (1991). Goal attainment scaling and outcome measurement in postacute brain injury rehabilitation. Archives of Physical Medicine and Rehabilitation, 72(2), 138–143.PubMed Malec, J. F., Smigielski, J. S., & DePompolo, R. W. (1991). Goal attainment scaling and outcome measurement in postacute brain injury rehabilitation. Archives of Physical Medicine and Rehabilitation, 72(2), 138–143.PubMed
26.
Zurück zum Zitat O’Boyle, C. A. (1994). The schedule for the evaluation of individual quality of life (SEIQoL). International Journal of Mental Health, 23(3), 3–23.CrossRef O’Boyle, C. A. (1994). The schedule for the evaluation of individual quality of life (SEIQoL). International Journal of Mental Health, 23(3), 3–23.CrossRef
27.
Zurück zum Zitat Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14.CrossRefPubMedPubMedCentral Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14.CrossRefPubMedPubMedCentral
28.
Zurück zum Zitat Schwartz, C. E., & Rapkin, B. D. (2012). Understanding appraisal processes underlying the thentest: A mixed methods investigation. Quality of Life Research, 21(3), 381–388.CrossRefPubMed Schwartz, C. E., & Rapkin, B. D. (2012). Understanding appraisal processes underlying the thentest: A mixed methods investigation. Quality of Life Research, 21(3), 381–388.CrossRefPubMed
29.
Zurück zum Zitat Li, Y., & Rapkin, B. (2009). Classification and regression tree analysis to identify complex cognitive paths underlying quality of life response shifts: A study of individuals living with HIV/AIDS. Journal of Clinical Epidemiology, 62, 1138–1147.CrossRefPubMedPubMedCentral Li, Y., & Rapkin, B. (2009). Classification and regression tree analysis to identify complex cognitive paths underlying quality of life response shifts: A study of individuals living with HIV/AIDS. Journal of Clinical Epidemiology, 62, 1138–1147.CrossRefPubMedPubMedCentral
30.
Zurück zum Zitat Rapkin, B. D., et al. (1994). Development of the idiographic functional status assessment: A measure of the personal goals and goal attainment activities of people with AIDS. Psychology and Health., 9, 111–129.CrossRef Rapkin, B. D., et al. (1994). Development of the idiographic functional status assessment: A measure of the personal goals and goal attainment activities of people with AIDS. Psychology and Health., 9, 111–129.CrossRef
31.
Zurück zum Zitat Schwartz, C. E., et al. (2013). Cognitive reserve and appraisal in multiple sclerosis. Multiple Sclerosis and Related Disorders, 2(1), 36–44.CrossRefPubMed Schwartz, C. E., et al. (2013). Cognitive reserve and appraisal in multiple sclerosis. Multiple Sclerosis and Related Disorders, 2(1), 36–44.CrossRefPubMed
32.
Zurück zum Zitat NMSS. (2005). Multiple sclerosis information sourcebook. New York, NY: Information Resource Center and Library of the National Multiple Sclerosis Society. NMSS. (2005). Multiple sclerosis information sourcebook. New York, NY: Information Resource Center and Library of the National Multiple Sclerosis Society.
33.
Zurück zum Zitat Rammohan, K. W., & Shoemaker, J. (2010). Emerging multiple sclerosis oral therapies. Neurology, 74(Supplement 1), S47–S53.CrossRefPubMed Rammohan, K. W., & Shoemaker, J. (2010). Emerging multiple sclerosis oral therapies. Neurology, 74(Supplement 1), S47–S53.CrossRefPubMed
34.
Zurück zum Zitat Tremlett, H., et al. (2010). New perspectives in the natural history of multiple sclerosis. Neurology, 74, 2004–2015.CrossRefPubMed Tremlett, H., et al. (2010). New perspectives in the natural history of multiple sclerosis. Neurology, 74, 2004–2015.CrossRefPubMed
35.
Zurück zum Zitat Kurtzke, J. F. (1983). Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology, 33(11), 1444–1452.CrossRefPubMed Kurtzke, J. F. (1983). Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology, 33(11), 1444–1452.CrossRefPubMed
36.
Zurück zum Zitat Cutter, G. R., et al. (1999). Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain, 122, 101–112.CrossRef Cutter, G. R., et al. (1999). Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain, 122, 101–112.CrossRef
37.
Zurück zum Zitat Schwartz, C. E., Cole, B. F., & Gelber, R. D. (1995). Measuring patient-centered outcomes in neurologic disease. Extending the Q-TWiST method. Archives of Neurology, 52(8), 754–762.CrossRefPubMed Schwartz, C. E., Cole, B. F., & Gelber, R. D. (1995). Measuring patient-centered outcomes in neurologic disease. Extending the Q-TWiST method. Archives of Neurology, 52(8), 754–762.CrossRefPubMed
38.
Zurück zum Zitat Schwartz, C. E., & Patrick, D. L. (2014). Composite scores for PRO measures in comparative effectiveness research: Counterbalancing parsimony and dimensionality. Journal of Comparative Effectiveness Research, 3(4), 423–433.CrossRefPubMed Schwartz, C. E., & Patrick, D. L. (2014). Composite scores for PRO measures in comparative effectiveness research: Counterbalancing parsimony and dimensionality. Journal of Comparative Effectiveness Research, 3(4), 423–433.CrossRefPubMed
40.
Zurück zum Zitat Hays, R. D., Sherbourne, C. D., Mazel, R. M., & User’s Manual for the Medical Outcome Study (MOS). (1995). Core measures of health-related quality of life. Santa Monica, CA: RAND. Hays, R. D., Sherbourne, C. D., Mazel, R. M., & User’s Manual for the Medical Outcome Study (MOS). (1995). Core measures of health-related quality of life. Santa Monica, CA: RAND.
41.
Zurück zum Zitat Schwartz, C. E., Vollmer, T., & Lee, H. (1999). Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology, 52(1), 63–70.CrossRefPubMed Schwartz, C. E., Vollmer, T., & Lee, H. (1999). Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology, 52(1), 63–70.CrossRefPubMed
42.
Zurück zum Zitat Hohol, M. J., Orav, E. J., & Weiner, H. L. (1995). Disease steps in multiple sclerosis: A simple approach to evaluate disease progression. Neurology, 45, 251–255.CrossRefPubMed Hohol, M. J., Orav, E. J., & Weiner, H. L. (1995). Disease steps in multiple sclerosis: A simple approach to evaluate disease progression. Neurology, 45, 251–255.CrossRefPubMed
43.
Zurück zum Zitat Sullivan, J. J. L., Edgley, K., & Dehoux, E. (1990). A survey of multiple sclerosis. Part 1: Perceived cognitive problems and compensatory strategy use. Canadian Journal of Rehabilitation, 4, 99–105. Sullivan, J. J. L., Edgley, K., & Dehoux, E. (1990). A survey of multiple sclerosis. Part 1: Perceived cognitive problems and compensatory strategy use. Canadian Journal of Rehabilitation, 4, 99–105.
44.
Zurück zum Zitat Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57, 1069–1081.CrossRef Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57, 1069–1081.CrossRef
45.
46.
Zurück zum Zitat Rapkin, B. D., et al. (2011). User manual for the quality of life appraisal profile. Concord, MA: DeltaQuest Foundation Inc. Rapkin, B. D., et al. (2011). User manual for the quality of life appraisal profile. Concord, MA: DeltaQuest Foundation Inc.
47.
Zurück zum Zitat Bobinski, J., & Lipinski, M. (2009). EORTC risk tables—A new diagnostic tool in urology. Pol Merkur Lekarski, 27(162), 524–528.PubMed Bobinski, J., & Lipinski, M. (2009). EORTC risk tables—A new diagnostic tool in urology. Pol Merkur Lekarski, 27(162), 524–528.PubMed
48.
Zurück zum Zitat Corp., I., (2012). IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp. Corp., I., (2012). IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp.
49.
Zurück zum Zitat Stata 13, (2013). College Station, TX: StataCorp LP. Stata 13, (2013). College Station, TX: StataCorp LP.
50.
Zurück zum Zitat Matthews, W. B. (Ed.). (1991). McAlpine’s multiple sclerosis (2nd ed.). New York: Churchill Livingstone. Matthews, W. B. (Ed.). (1991). McAlpine’s multiple sclerosis (2nd ed.). New York: Churchill Livingstone.
51.
Zurück zum Zitat Ware, J. E, Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey. Medical Care, 34(3), 220–233.CrossRefPubMed Ware, J. E, Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey. Medical Care, 34(3), 220–233.CrossRefPubMed
Metadaten
Titel
Refining a Web-based goal assessment interview: item reduction based on reliability and predictive validity
verfasst von
Carolyn E. Schwartz
Jei Li
Bruce D. Rapkin
Publikationsdatum
10.03.2016
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 9/2016
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1258-x

Weitere Artikel der Ausgabe 9/2016

Quality of Life Research 9/2016 Zur Ausgabe