Skip to main content
Erschienen in: Clinical Orthopaedics and Related Research® 6/2011

01.06.2011 | Clinical Research

Can the Toronto Extremity Salvage Score Produce Reliable Results When Used Online?

verfasst von: Mark Clayer, MD, Aileen Davis, PhD

Erschienen in: Clinical Orthopaedics and Related Research® | Ausgabe 6/2011

Einloggen, um Zugang zu erhalten

Abstract

Background

Web-based questionnaires have become popular, however, access to the Internet can be biased regarding age, gender, and education, among other factors. Therefore, it is unknown whether this is a reasonable avenue to administer a questionnaire to patients or whether Web-based can be a reliable alternative to paper-based.

Questions/purposes

We determined whether the Internet version of the Toronto Extremity Salvage Score is reproducible compared with the paper-based version and the compliance and completion rates.

Patients and Methods

The study population consisted of 81 adults who had had surgery for a musculoskeletal tumor of the lower extremity more than 12 months earlier. The Toronto Extremity Salvage Score was administered by paper at a baseline interview and then readministered via Internet 7 to 14 days later to those with access.

Results

Sixty of the 81 patients (74%) were able to use the Internet. Increasing age and lower education levels were correlated with a lower likelihood of using the Internet. Questionnaires were done online and on paper by 56 patients but 10 were excluded because of self-reported change in circumstances. The mean TESS was 85.7 (range, 41.1–100; SD, 17.26) for the paper-based questionnaire and 85.2 (range, 42.5–100; SD, 17.47) for the Internet-based questionnaire. The intraclass correlation coefficient was 0.97.

Conclusions

The questionnaire can be transferred successfully to the Internet and can be used reliably instead of a paper-based instrument. Recruitment to use an Internet-based questionnaire is limited only by the percentage of patients able to access and use the Internet.
Literatur
1.
Zurück zum Zitat Athale N, Sturley A, Skoczen S, Kavanaugh A, Lenert L. A web-compatible instrument for measuring self-reported disease activity in arthritis. J Rheumatol. 2004;31:223–228.PubMed Athale N, Sturley A, Skoczen S, Kavanaugh A, Lenert L. A web-compatible instrument for measuring self-reported disease activity in arthritis. J Rheumatol. 2004;31:223–228.PubMed
2.
Zurück zum Zitat Bälter KA, Bälter O, Fondell E, Lagerros YT. Web-based and mailed questionnaires: a comparison of response rates and compliance. Epidemiology. 2005;16:577–579.PubMedCrossRef Bälter KA, Bälter O, Fondell E, Lagerros YT. Web-based and mailed questionnaires: a comparison of response rates and compliance. Epidemiology. 2005;16:577–579.PubMedCrossRef
3.
Zurück zum Zitat Bliven BD, Kaufman SE, Spertus JA. Electronic collection of health-related quality of life data: validity, time benefits, and patient preference. Qual Life Res. 2001;10:15–22.PubMedCrossRef Bliven BD, Kaufman SE, Spertus JA. Electronic collection of health-related quality of life data: validity, time benefits, and patient preference. Qual Life Res. 2001;10:15–22.PubMedCrossRef
4.
Zurück zum Zitat Buchanan T, Smith JL. Using the Internet for psychological research: personality testing on the World Wide Web. Br J Psychol. 1999;90:125–144.PubMedCrossRef Buchanan T, Smith JL. Using the Internet for psychological research: personality testing on the World Wide Web. Br J Psychol. 1999;90:125–144.PubMedCrossRef
5.
Zurück zum Zitat Bush N, Donaldson G, Moinpour C, Haberman M, Milliken D, Markle V, Lauson J. Development, feasibility and compliance of a web-based system for very frequent QOL and symptom home self-assessment after hematopoietic stem cell transplantation. Qual Life Res. 2005;14:77–93.PubMedCrossRef Bush N, Donaldson G, Moinpour C, Haberman M, Milliken D, Markle V, Lauson J. Development, feasibility and compliance of a web-based system for very frequent QOL and symptom home self-assessment after hematopoietic stem cell transplantation. Qual Life Res. 2005;14:77–93.PubMedCrossRef
6.
Zurück zum Zitat Bushnell DM, Martin ML, Parasuraman B. Electronic versus paper questionnaires: a further comparison in persons with asthma. J Asthma. 2003;40:751–762.PubMedCrossRef Bushnell DM, Martin ML, Parasuraman B. Electronic versus paper questionnaires: a further comparison in persons with asthma. J Asthma. 2003;40:751–762.PubMedCrossRef
7.
Zurück zum Zitat Cals JW, Boumans D, Lardinois RJ, Gonzales R, Hopstaken RM, Butler CC, Dinant GJ. Public beliefs on antibiotics and respiratory tract infections: an internet-based questionnaire study. Br J Gen Pract. 2007;57:942–947.PubMedCrossRef Cals JW, Boumans D, Lardinois RJ, Gonzales R, Hopstaken RM, Butler CC, Dinant GJ. Public beliefs on antibiotics and respiratory tract infections: an internet-based questionnaire study. Br J Gen Pract. 2007;57:942–947.PubMedCrossRef
8.
Zurück zum Zitat Cantrell MA, Lupinacci P. Methodological issues in online data collection. J Adv Nurs. 2007;60:544–549.PubMedCrossRef Cantrell MA, Lupinacci P. Methodological issues in online data collection. J Adv Nurs. 2007;60:544–549.PubMedCrossRef
9.
Zurück zum Zitat Davis AM, Bell RS, Badley EM, Yoshida K, Williams JI. Evaluating functional outcome in patients with lower extremity sarcoma. Clin Orthop Relat Res. 1999;358:90–100.PubMedCrossRef Davis AM, Bell RS, Badley EM, Yoshida K, Williams JI. Evaluating functional outcome in patients with lower extremity sarcoma. Clin Orthop Relat Res. 1999;358:90–100.PubMedCrossRef
10.
Zurück zum Zitat Davis AM, Sennik S, Griffin AM, Wunder JS, O’Sullivan B, Catton CN, Bell RS. Predictors of functional outcomes following limb salvage surgery for lower-extremity soft tissue sarcoma. J Surg Oncol. 2000;73:206–211.PubMedCrossRef Davis AM, Sennik S, Griffin AM, Wunder JS, O’Sullivan B, Catton CN, Bell RS. Predictors of functional outcomes following limb salvage surgery for lower-extremity soft tissue sarcoma. J Surg Oncol. 2000;73:206–211.PubMedCrossRef
11.
Zurück zum Zitat Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.PubMedCrossRef Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.PubMedCrossRef
12.
Zurück zum Zitat Davis RN. Web-based administration of a personality questionnaire: comparison with traditional methods. Behav Res Methods Instrum Comput. 1999;31:572–577.PubMedCrossRef Davis RN. Web-based administration of a personality questionnaire: comparison with traditional methods. Behav Res Methods Instrum Comput. 1999;31:572–577.PubMedCrossRef
13.
Zurück zum Zitat Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183–1191.PubMedCrossRef Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183–1191.PubMedCrossRef
14.
Zurück zum Zitat Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using Web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol. 2006;21:103–111.PubMedCrossRef Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using Web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol. 2006;21:103–111.PubMedCrossRef
15.
Zurück zum Zitat Ekman A, Klint A, Dickman PW, Adami HO, Litton JE. Optimizing the design of Web-based questionnaires: experience from a population-based study among 50,000 women. Eur J Epidemiol. 2007;22:293–300.PubMedCrossRef Ekman A, Klint A, Dickman PW, Adami HO, Litton JE. Optimizing the design of Web-based questionnaires: experience from a population-based study among 50,000 women. Eur J Epidemiol. 2007;22:293–300.PubMedCrossRef
16.
Zurück zum Zitat Enneking W. Modification of the system for functional evaluation in the surgical management of musculoskeletal tumours. In: Enneking W, ed. Limb Salvage in Musculoskeletal Oncology. New York, NY: Churchill Livingstone; 1987;626–639. Enneking W. Modification of the system for functional evaluation in the surgical management of musculoskeletal tumours. In: Enneking W, ed. Limb Salvage in Musculoskeletal Oncology. New York, NY: Churchill Livingstone; 1987;626–639.
17.
Zurück zum Zitat Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241-246.PubMed Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241-246.PubMed
18.
Zurück zum Zitat Gerrand CH, Wunder JS, Kandel RA, O’Sullivan B, Catton CN, Bell RS, Griffin AM, Davis AM. The influence of anatomic location on functional outcome in lower-extremity soft-tissue sarcoma. Ann Surg Oncol. 2004;11:476–482.PubMedCrossRef Gerrand CH, Wunder JS, Kandel RA, O’Sullivan B, Catton CN, Bell RS, Griffin AM, Davis AM. The influence of anatomic location on functional outcome in lower-extremity soft-tissue sarcoma. Ann Surg Oncol. 2004;11:476–482.PubMedCrossRef
19.
Zurück zum Zitat Gilmour JA, Scott SD, Huntington N. Nurses and Internet health information: a questionnaire survey. J Adv Nurs. 2008;61:19–28.PubMed Gilmour JA, Scott SD, Huntington N. Nurses and Internet health information: a questionnaire survey. J Adv Nurs. 2008;61:19–28.PubMed
20.
Zurück zum Zitat Hanscom B, Lurie JD, Homa K, Weinstein JN. Computerized questionnaires and the quality of survey data. Spine (Phila Pa 1976). 2002;27:1797–1801. Hanscom B, Lurie JD, Homa K, Weinstein JN. Computerized questionnaires and the quality of survey data. Spine (Phila Pa 1976). 2002;27:1797–1801.
21.
Zurück zum Zitat Harewood GC, Yacavone RF, Locke GR 3rd, Wiersema MJ. Prospective comparison of endoscopy patient satisfaction surveys: e-mail versus standard mail versus telephone. Am J Gastroenterol. 2001;96:3312–3317.PubMedCrossRef Harewood GC, Yacavone RF, Locke GR 3rd, Wiersema MJ. Prospective comparison of endoscopy patient satisfaction surveys: e-mail versus standard mail versus telephone. Am J Gastroenterol. 2001;96:3312–3317.PubMedCrossRef
22.
Zurück zum Zitat Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999;31:433–438.PubMedCrossRef Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999;31:433–438.PubMedCrossRef
23.
Zurück zum Zitat Jones JB, Snyder CF, Wu AW. Issues in the design of Internet-based systems for collecting patient-reported outcomes. Qual Life Res. 2007;16:1407–1417.PubMedCrossRef Jones JB, Snyder CF, Wu AW. Issues in the design of Internet-based systems for collecting patient-reported outcomes. Qual Life Res. 2007;16:1407–1417.PubMedCrossRef
24.
Zurück zum Zitat Jones R, Pitt N. Health surveys in the workplace: comparison of postal, email and World Wide Web methods. Occup Med (Lond). 1999;49:556–558.CrossRef Jones R, Pitt N. Health surveys in the workplace: comparison of postal, email and World Wide Web methods. Occup Med (Lond). 1999;49:556–558.CrossRef
25.
Zurück zum Zitat Khalily C, Behnke S, Seligson D. Treatment of closed tibia shaft fractures: a survey from the 1997 Orthopaedic Trauma Association and Osteosynthesis International-Gerhard Kuntscher Kreis meeting. J Orthop Trauma. 2000;14:577–581.PubMedCrossRef Khalily C, Behnke S, Seligson D. Treatment of closed tibia shaft fractures: a survey from the 1997 Orthopaedic Trauma Association and Osteosynthesis International-Gerhard Kuntscher Kreis meeting. J Orthop Trauma. 2000;14:577–581.PubMedCrossRef
26.
Zurück zum Zitat Kim HL, Gerber GS, Patel RV, Hollowell CM, Bales GT. Practice patterns in the treatment of female urinary incontinence: a postal and internet survey. Urology. 2001;57:45–48.PubMedCrossRef Kim HL, Gerber GS, Patel RV, Hollowell CM, Bales GT. Practice patterns in the treatment of female urinary incontinence: a postal and internet survey. Urology. 2001;57:45–48.PubMedCrossRef
27.
Zurück zum Zitat Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of internet versus paper-and-pencil versions. J Med Internet Res. 2007;9:e25.PubMedCrossRef Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of internet versus paper-and-pencil versions. J Med Internet Res. 2007;9:e25.PubMedCrossRef
28.
Zurück zum Zitat Kumle M, Weiderpass E, Braaten T, Persson I, Adami H, Lund E. Use of oral contraceptives and breast cancer risk: The Norwegian-Swedish Women’s Lifestyle and Health Cohort Study. Cancer Epidemiol Biomarkers Prev. 2002;11:1375–1381.PubMed Kumle M, Weiderpass E, Braaten T, Persson I, Adami H, Lund E. Use of oral contraceptives and breast cancer risk: The Norwegian-Swedish Women’s Lifestyle and Health Cohort Study. Cancer Epidemiol Biomarkers Prev. 2002;11:1375–1381.PubMed
29.
Zurück zum Zitat Lampert MH, Gerber LH, Glatstein E, Rosenberg SA, Danoff JV. Soft tissue sarcoma: functional outcome after wide local excision and radiation therapy. Arch Phys Med Rehabil. 1984;65:477–480.PubMed Lampert MH, Gerber LH, Glatstein E, Rosenberg SA, Danoff JV. Soft tissue sarcoma: functional outcome after wide local excision and radiation therapy. Arch Phys Med Rehabil. 1984;65:477–480.PubMed
30.
Zurück zum Zitat Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, Devereaux PJ, Guyatt GH. Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res. 2004;6:e39.PubMedCrossRef Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, Devereaux PJ, Guyatt GH. Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res. 2004;6:e39.PubMedCrossRef
31.
Zurück zum Zitat Matarasso A, Elkwood A, Rankin M, Elkowitz M. National plastic surgery survey: face lift techniques and complications. Plastic Reconstr Surg. 2000;106:1185–1195; discussion 1196. Matarasso A, Elkwood A, Rankin M, Elkowitz M. National plastic surgery survey: face lift techniques and complications. Plastic Reconstr Surg. 2000;106:1185–1195; discussion 1196.
32.
Zurück zum Zitat Meropol NJ, Egleston BL, Buzaglo JS, Benson AB 3rd, Cegala DJ, Diefenbach MA, Fleisher L, Miller SM, Sulmasy DP, Weinfurt KP; CONNECT Study Research Group. Cancer patients’ preferences for quality and length of life. Cancer. 2008;113:3459–3466.PubMedCrossRef Meropol NJ, Egleston BL, Buzaglo JS, Benson AB 3rd, Cegala DJ, Diefenbach MA, Fleisher L, Miller SM, Sulmasy DP, Weinfurt KP; CONNECT Study Research Group. Cancer patients’ preferences for quality and length of life. Cancer. 2008;113:3459–3466.PubMedCrossRef
33.
Zurück zum Zitat O’Leary TE, Diller L, Recklitis CJ. The effects of response bias on self-reported quality of life among childhood cancer survivors. Qual Life Res. 2007;16:1211–1220.PubMedCrossRef O’Leary TE, Diller L, Recklitis CJ. The effects of response bias on self-reported quality of life among childhood cancer survivors. Qual Life Res. 2007;16:1211–1220.PubMedCrossRef
34.
Zurück zum Zitat Ritter P, Lorig K, Laurent D, Matthews K. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res. 2004;6:e29.PubMedCrossRef Ritter P, Lorig K, Laurent D, Matthews K. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res. 2004;6:e29.PubMedCrossRef
35.
Zurück zum Zitat Robinson MH, Spruce L, Eeles R, Fryatt I, Harmer CL, Thomas JM, Westbury G. Limb function following conservation treatment of adult soft tissue sarcoma. Eur J Cancer. 1991;27:1567–1574.PubMedCrossRef Robinson MH, Spruce L, Eeles R, Fryatt I, Harmer CL, Thomas JM, Westbury G. Limb function following conservation treatment of adult soft tissue sarcoma. Eur J Cancer. 1991;27:1567–1574.PubMedCrossRef
36.
Zurück zum Zitat Saleh KJ, Radosevich DM, Kassim RA, Moussa M, Dykes D, Bottolfson H, Gioe TJ, Robinson H. Comparison of commonly used orthopaedic outcome measures using palm-top computers and paper surveys. J Orthop Res. 2002;20:1146–1151.PubMedCrossRef Saleh KJ, Radosevich DM, Kassim RA, Moussa M, Dykes D, Bottolfson H, Gioe TJ, Robinson H. Comparison of commonly used orthopaedic outcome measures using palm-top computers and paper surveys. J Orthop Res. 2002;20:1146–1151.PubMedCrossRef
37.
Zurück zum Zitat Schreiber D, Bell RS, Wunder JS, O’Sullivan B, Turcotte R, Masri BA, Davis AM. Evaluating function and health related quality of life in patients treated for extremity soft tissue sarcoma. Qual Life Res. 2006;15:1439–1446.PubMedCrossRef Schreiber D, Bell RS, Wunder JS, O’Sullivan B, Turcotte R, Masri BA, Davis AM. Evaluating function and health related quality of life in patients treated for extremity soft tissue sarcoma. Qual Life Res. 2006;15:1439–1446.PubMedCrossRef
38.
Zurück zum Zitat Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psych Bull. 1979;86:420–428.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psych Bull. 1979;86:420–428.CrossRef
39.
Zurück zum Zitat Smith B, Smith TC, Gray GC, Ryan MA; Millennium Cohort Study Team. When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol. 2007;166:1345–1354.PubMedCrossRef Smith B, Smith TC, Gray GC, Ryan MA; Millennium Cohort Study Team. When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol. 2007;166:1345–1354.PubMedCrossRef
40.
Zurück zum Zitat Sugarbaker PH, Barofsky I, Rosenberg SA, Gianola FJ. Quality of life assessment of patients in extremity sarcoma clinical trials. Surgery. 1982;91:17–23.PubMed Sugarbaker PH, Barofsky I, Rosenberg SA, Gianola FJ. Quality of life assessment of patients in extremity sarcoma clinical trials. Surgery. 1982;91:17–23.PubMed
42.
Zurück zum Zitat World Health Organization. International Classification of Impairments, Disabilities and Handicaps. Geneva, Switzerland: World Health Organization; 1990. World Health Organization. International Classification of Impairments, Disabilities and Handicaps. Geneva, Switzerland: World Health Organization; 1990.
43.
Zurück zum Zitat Wilson AS, Kitas GD, Carruthers DM, Reay C, Skan J, Harris S, Treharne GJ, Young SP, Bacon PA. Computerized information-gathering in specialist rheumatology clinics: an initial evaluation of an electronic version of the Short Form 36. Rheumatology (Oxford). 2002;41:268–273.CrossRef Wilson AS, Kitas GD, Carruthers DM, Reay C, Skan J, Harris S, Treharne GJ, Young SP, Bacon PA. Computerized information-gathering in specialist rheumatology clinics: an initial evaluation of an electronic version of the Short Form 36. Rheumatology (Oxford). 2002;41:268–273.CrossRef
Metadaten
Titel
Can the Toronto Extremity Salvage Score Produce Reliable Results When Used Online?
verfasst von
Mark Clayer, MD
Aileen Davis, PhD
Publikationsdatum
01.06.2011
Verlag
Springer-Verlag
Erschienen in
Clinical Orthopaedics and Related Research® / Ausgabe 6/2011
Print ISSN: 0009-921X
Elektronische ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-010-1715-8

Weitere Artikel der Ausgabe 6/2011

Clinical Orthopaedics and Related Research® 6/2011 Zur Ausgabe

Symposium: Update on Hard-on-Hard Bearings in Hip Arthroplasty

Survival of Hard-on-Hard Bearings in Total Hip Arthroplasty: A Systematic Review

Symposium: Update on Hard-on-Hard Bearings in Hip Arthroplasty

Hip Resurfacing in Patients Who Have Osteonecrosis and are 25 Years or Under

Symposium: Update Hard-on-Hard Bearings in Hip Arthroplasty

Biographical Sketch: Themistocles Gluck (1853–1942)

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Notfall-TEP der Hüfte ist auch bei 90-Jährigen machbar

26.04.2024 Hüft-TEP Nachrichten

Ob bei einer Notfalloperation nach Schenkelhalsfraktur eine Hemiarthroplastik oder eine totale Endoprothese (TEP) eingebaut wird, sollte nicht allein vom Alter der Patientinnen und Patienten abhängen. Auch über 90-Jährige können von der TEP profitieren.

Arthroskopie kann Knieprothese nicht hinauszögern

25.04.2024 Gonarthrose Nachrichten

Ein arthroskopischer Eingriff bei Kniearthrose macht im Hinblick darauf, ob und wann ein Gelenkersatz fällig wird, offenbar keinen Unterschied.

Therapiestart mit Blutdrucksenkern erhöht Frakturrisiko

25.04.2024 Hypertonie Nachrichten

Beginnen ältere Männer im Pflegeheim eine Antihypertensiva-Therapie, dann ist die Frakturrate in den folgenden 30 Tagen mehr als verdoppelt. Besonders häufig stürzen Demenzkranke und Männer, die erstmals Blutdrucksenker nehmen. Dafür spricht eine Analyse unter US-Veteranen.

Ärztliche Empathie hilft gegen Rückenschmerzen

23.04.2024 Leitsymptom Rückenschmerzen Nachrichten

Personen mit chronischen Rückenschmerzen, die von einfühlsamen Ärzten und Ärztinnen betreut werden, berichten über weniger Beschwerden und eine bessere Lebensqualität.

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.