nach oben

Clinical Orthopaedics and Related Research®

Erschienen in:

01.11.2013 | Symposium: ABJS Carl T. Brighton Workshop on Outcome Measures

Validation of PROMIS^® Physical Function Computerized Adaptive Tests for Orthopaedic Foot and Ankle Outcome Research

verfasst von: Man Hung, PhD, MSTAT, MED, Judith F. Baumhauer, MD, MPH, L. Daniel Latt, MD, PhD, Charles L. Saltzman, MD, Nelson F. SooHoo, MD, Kenneth J. Hunt, MD, National Orthopaedic Foot & Ankle Outcomes Research Network

Erschienen in: Clinical Orthopaedics and Related Research® | Ausgabe 11/2013

Einloggen, um Zugang zu erhalten

Abstract

Background

In 2012, the American Orthopaedic Foot & Ankle Society^® established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network’s initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting.

Questions/purposes

We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System^® (PROMIS^®) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients’ physical function.

Methods

After informed consent, 288 patients with a mean age of 51 years (range, 18–81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS^® Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients’ physical function levels. Instrument coverage was based on a person-item map.

Results

Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of −0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach’s alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect.

Conclusions

The PROMIS^® PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS^® item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

Level of Evidence

Level III, diagnostic study. See Instructions for Authors for a complete description of levels of evidence.

Nur mit Berechtigung zugänglich

Amadio PC, Silverstein MD, Ilstrup MD, Schleck CK, Jensen LM. Outcome assessment for carpal tunnel surgery: the relative responsiveness of generic, arthritis-specific, disease-specific, and physical exam measures. J Hand Surg Am. 1996;21:338–346.PubMedCrossRef

Amtmann D, Cook KF, Jensen MP, Chen WH, Choi S, Revicki D, Cella D, Rothrock N, Keefe F, Callahan L. Development of a PROMIS item bank to measure pain interference. Pain. 2010;150:173–182.PubMedCrossRef

Bajaj JS, Thacker LR, Wade JB, Sanyal AJ, Heuman DM, Sterling RK, Gibson DP, Stravitz RT, Puri P, Fuchs M, Luketic V, Noble N, White M, Bell D, Revicki DA. PROMIS computerised adaptive tests are dynamic instruments to measure health-related quality of life in patients with cirrhosis. Aliment Pharmacol Ther. 2011;34:1123–1132.PubMedCrossRef

Beaton DE, Hogg-Johnson S, Bombardier C. Evaluating changes in health status: reliability and responsiveness of five generic health status measures in workers with musculoskeletal disorders. J Clin Epidemiol. 1997;50:79–93.PubMedCrossRef

Beaton DE, Richards RR. Assessing the reliability and responsiveness of 5 shoulder questionnaires. J Shoulder Elbow Surg. 1998;7:565–572.PubMedCrossRef

Beskin J, Brage M, Guyton G, Saltzman C, Sands A, SooHoo NF, Kadel N, Stroud C, Thordarson D, Sangeorzan B. Reproducibility of the Foot Function Index: a report of the AOFAS outcomes committee. Foot Ankle Int. 2005;26:962–967.PubMed

Bessette L, Sangha O, Kuntz KM, Keller RB, Lew RA, Fossel AH, Katz JN. Comparative responsiveness of generic vs. disease-specific and weighted vs. unweighted health status measures in carpal tunnel syndrome. Med Care. 1998;36:491–502.PubMedCrossRef

Bond TG, Fox CM. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Mahwah, NJ: Lawrence Erlbaum; 2001.

Budiman-Mak E, Conrad KJ, Roach KE. The Foot Function Index: a measure of foot pain and disability. J Clin Epidemiol. 1991;44:561–570.PubMedCrossRef

10.

Button G, Pinney S. A meta-analysis of outcome rating scales in foot and ankle surgery: is there a valid, reliable, and responsive system? Foot Ankle Int. 2004;25:521–525.PubMed

11.

Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, Ader D, Fries JF, Bruce B, Rose M; PROMIS Cooperative Group. The Patient Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care. 2007;45:S3–S11.PubMedCrossRef

12.

Davidshofer KR, Murphy CO. Psychological Testing: Principles and Applications. 6th ed. Upper Saddle River, NJ: Pearson/Prentice Hall; 2005.

13.

Glazebrook M, Daniels T, Younger A, Foote CJ, Penner M, Wing K, Lau J, Leighton R, Dunbar M. Comparison of health-related quality of life between patients with end-stage ankle and hip arthrosis. J Bone Joint Surg Am. 2008;90:499–505.PubMedCrossRef

14.

Hung M, Carter M, Hayden C, Dzierzon R, Morales J, Snow L, Butler J, Bateman K, Samore M. Psychometric assessment of the patient activation measure short form (PAM-13) in rural settings. Qual Life Res. 2013;22:521–529.PubMedCrossRef

15.

Hung M, Clegg DO, Greene T, Saltzman CL. Evaluation of the PROMIS physical function item bank in orthopaedic patients. J Orthop Res. 2011;29:947–953.PubMedCrossRef

16.

Hung M, Clegg DO, Greene T, Weir C, Saltzman CL. A lower extremity physical function computerized adaptive testing instrument. Foot Ankle Int. 2012;33:326–335.PubMedCrossRef

17.

Hung M, Nickisch F, Beals T, Greene T, Clegg DO, Saltzman CL. A new paradigm for patient-reported outcomes assessment in foot and ankle research: computerized adaptive testing. Foot Ankle Int. 2012;33:621–626.PubMedCrossRef

18.

Jette AM, Haley SM, Ni P, Olarsch S, Moed R. Creating a computer adaptive test version of the late-life function and disability instrument. J Gerontol A Biol Sci Med Sci. 2008;63:1246–1256.PubMedCrossRef

19.

Katz JN, Gelberman RH, Wright EA, Lew RA, Liang MH. Responsiveness of self-reported and objective measures of disease severity in carpal tunnel syndrome. Med Care. 1994;32:1127–1132.PubMedCrossRef

20.

Kitaoka HB, Alexander IJ, Adelaar RS, Nunley JA, Myerson MS, Sanders M. Clinical rating systems for the ankle-hindfoot, midfoot, hallux, and lesser toes. Foot Ankle Int. 1994;15:349–353.PubMedCrossRef

21.

Kocher MS, Horan MP, Briggs KK, Richardson TR, O’Holleran J, Hawkins RJ. Reliability, validity, and responsiveness of the American Shoulder and Elbow Surgeons Subjective Shoulder Scale in patients with shoulder instability, rotator cuff disease, and glenohumeral arthritis. J Bone Joint Surg Am. 2005;87:2006–2011.PubMedCrossRef

22.

Kuyvenhoven MM, Gorter KJ, Zuithoff P, Budiman-Mak E, Conrad KJ, Post MW. The Foot Function Index with Verbal Rating Scales (FFI-5pt): a clinimetric evaluation and comparison with the original FFI. J Rheumatol. 2002;29:1023–1028.PubMed

23.

Liang MH, Fossel AH, Larson MG. Comparison of five health status instruments for orthopedic evaluation. Med Care. 1990;28:632–642.PubMedCrossRef

24.

Lingard EA, Katz JN, Wright RJ, Wright EA, Sledge CB. Validity and responsiveness of the Knee Society Clinical Rating System in comparison with the SF-36 and WOMAC. J Bone Joint Surg Am. 2001;83:1856–1864.PubMed

25.

Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS. Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996;18:979–992.PubMedCrossRef

26.

Mangione CM, Goldman L, Orav EJ, Marcantonio ER, Pedan A, Ludwig LE, Donaldson MC, Sugarbaker DJ, Poss R, Lee TH. Health-related quality of life after elective surgery: measurement of longitudinal changes. J Gen Intern Med. 1997;12:686–697.PubMedCrossRef

27.

Martin DP, Engelberg R, Agel J, Swiontkowski MF. Comparison of the Musculoskeletal Function Assessment questionnaire with the Short Form-36, the Western Ontario and McMaster Universities Osteoarthritis Index, and the Sickness Impact Profile health-status measures. J Bone Joint Surg Am. 1997;79:1323–1335.PubMed

28.

Marx RG, Jones EC, Allen AA, Altchek DW, O’Brien SJ, Roeda SA, Williams RJ, Warren RF, Wickiewicz TZ. Reliability, validity, and responsiveness of four knee outcome scales for athletic patients. J Bone Joint Surg Am. 2001;83:1459–1469.PubMed

29.

Masters GN. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–174.CrossRef

30.

Masters GN. The analysis of partial credit scoring. Applied Measurement in Education. 1988;1:279–297.CrossRef

31.

McHorney CA, Ware JE, Raczek AE. The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–263.PubMedCrossRef

32.

Naal FD, Impellizzeri FM, Rippstein PF. Which are the most frequently used outcome instruments in studies on total ankle arthroplasty? Clin Orthop Relat Res. 2010;468:815–826.PubMedCrossRef

33.

Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Chicago, IL: The University of Chicago Press; 1980.

34.

Rose M, Bjorner JB, Becker J, Fries JF, Ware JE. Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol. 2008;61:17–33.PubMedCrossRef

35.

Saag KG, Saltzman CL, Brown K, Budiman-Mak E. The Foot Function Index for measuring rheumatoid arthritis pain: evaluating side-to-side reliability. Foot Ankle Int. 1996;17:506–510.PubMedCrossRef

36.

Salaffi F, Carotti M, Grassi W. Health-related quality of life in patients with hip or knee osteoarthritis: comparison of generic and disease-specific instruments. Clin Rheumatol. 2005;24:29–37.PubMedCrossRef

37.

Saltzman CL, Zimmerman MB, O’Rourke M, Brown TD, Buckwalter JA, Johnston R. Impact of comorbidities on the measurement of health in patients with ankle osteoarthritis. J Bone Joint Surg Am. 2006;88:2366–2372.PubMedCrossRef

38.

Soderman P, Malchau H. Validity and reliability of the Swedish WOMAC osteoarthritis index: a self-administered disease-specific questionnaire (WOMAC) versus generic instruments (SF-36 and NHP). Acta Orthop Scand. 2000;71:39–46.PubMedCrossRef

39.

SooHoo NF, Samimi D, Vyas R, Botzler T. Evaluation of the validity of the Foot Function Index in measuring outcomes in patients with foot and ankle disorders. Foot Ankle Int. 2006;27:38–42.PubMed

40.

SooHoo NF, Shuler MS, Fleming LL. Evaluation of the validity of the AOFAS Clinical Rating Systems by correlation to the SF-36. Foot Ankle Int. 2003;24:50–55.PubMed

41.

Suk M, Hanson B, Norvell D, Helfet DL. AO Handbook of Musculoskeletal Outcomes Measures and Instruments. New York, NY: Thieme; 2009.

42.

Tuttleman M, Pillemer SR, Tilley BC, Fowler SE, Buckley LM, Alaracon GS, Trentham DE, Neuner R, Clegg DO, Leisen JC, Heyse SP. A cross sectional assessment of health status instruments in patients with rheumatoid arthritis participating in a clinical trial. J Rheumatol. 1997;24:1910–1915.PubMed

43.

Wright BD, Masters GN. Rating Scale Analysis: Rasch Measurement. Chicago, IL: MESA Press; 1982.

Titel: Validation of PROMIS® Physical Function Computerized Adaptive Tests for Orthopaedic Foot and Ankle Outcome Research
verfasst von: Man Hung, PhD, MSTAT, MED
Judith F. Baumhauer, MD, MPH
L. Daniel Latt, MD, PhD
Charles L. Saltzman, MD
Nelson F. SooHoo, MD
Kenneth J. Hunt, MD
National Orthopaedic Foot & Ankle Outcomes Research Network
Publikationsdatum: 01.11.2013
Verlag: Springer US
Erschienen in: Clinical Orthopaedics and Related Research® / Ausgabe 11/2013
Print ISSN: 0009-921X
Elektronische ISSN: 1528-1132
DOI: https://doi.org/10.1007/s11999-013-3097-1

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen.
» Jetzt entdecken

Neu im Fachgebiet Orthopädie und Unfallchirurgie

Notfall-TEP der Hüfte ist auch bei 90-Jährigen machbar

26.04.2024 Hüft-TEP Nachrichten

Ob bei einer Notfalloperation nach Schenkelhalsfraktur eine Hemiarthroplastik oder eine totale Endoprothese (TEP) eingebaut wird, sollte nicht allein vom Alter der Patientinnen und Patienten abhängen. Auch über 90-Jährige können von der TEP profitieren.

Arthroskopie kann Knieprothese nicht hinauszögern

25.04.2024 Gonarthrose Nachrichten

Ein arthroskopischer Eingriff bei Kniearthrose macht im Hinblick darauf, ob und wann ein Gelenkersatz fällig wird, offenbar keinen Unterschied.

Therapiestart mit Blutdrucksenkern erhöht Frakturrisiko

25.04.2024 Hypertonie Nachrichten

Beginnen ältere Männer im Pflegeheim eine Antihypertensiva-Therapie, dann ist die Frakturrate in den folgenden 30 Tagen mehr als verdoppelt. Besonders häufig stürzen Demenzkranke und Männer, die erstmals Blutdrucksenker nehmen. Dafür spricht eine Analyse unter US-Veteranen.

Ärztliche Empathie hilft gegen Rückenschmerzen

23.04.2024 Leitsymptom Rückenschmerzen Nachrichten

Personen mit chronischen Rückenschmerzen, die von einfühlsamen Ärzten und Ärztinnen betreut werden, berichten über weniger Beschwerden und eine bessere Lebensqualität.

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

Newsletter bestellen

Springer Medizin

Abstract

Background

Questions/purposes

Methods

Results

Conclusions

Level of Evidence

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 11/2013

CORR Insights®: Trabecular Metal in Total Knee Arthroplasty Associated with Higher Knee Scores: A Randomized Controlled Trial

Erratum to: Is the Infection Rate in Primary THA Increased After Steroid Injection?

ACGME and ABOS Changes for the Orthopaedic Surgery PGY-1 (Intern) Year

Reply to the Letter to the Editor: Complications of Total Knee Arthroplasty: Standardized List and Definitions of The Knee Society

Advantages of Arthroscopic Transosseous Suture Repair of the Rotator Cuff without the Use of Anchors