Skip to main content
Erschienen in: PharmacoEconomics 11/2007

01.11.2007 | Leading Article

It’s Time to Choose the Study Design!

Net Benefit Analysis of Alternative Study Designs to Acquire Information for Evaluation of Health Technologies

verfasst von: Oren Shavit, Moshe Leshno, Assaf Goldberger, Amir Shmueli, Dr Amnon Hoffman

Erschienen in: PharmacoEconomics | Ausgabe 11/2007

Einloggen, um Zugang zu erhalten

Abstract

Uncertainty in the decision-making process for reimbursement of health technologies could be reduced if additional information were available. Although methods to evaluate the monetary value of the uncertainty have been previously described, an economic evaluation of alternative methods to acquire additional information has not yet been thoroughly explored. Should resources be allocated to a retrospective study design or to a randomised controlled trial (RCT) when additional information is deemed justified?
We propose an approach for cost-effectiveness analysis of designs of future studies that are required to evaluate health technologies for reimbursement. Biases inherent in study designs are the main factor that differentiates the ability of the studies to predict the technology’s benefit. By quantifying this inherent-bias effect, the incremental effectiveness of future studies can be evaluated. Economic consequences of decisions regarding prioritisation of the technologies, along with the expected costs incurred by the study’s execution, account for the cost component of the equation. Deducting the result retrieved for the retrospective design from that of the RCT design gives the net information benefit.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Hunink M, Glasziou P, Siegel J, et al. Decision making in health and medicine, integrating evidence and values. Cambridge: Cambridge University Press, 2001 Hunink M, Glasziou P, Siegel J, et al. Decision making in health and medicine, integrating evidence and values. Cambridge: Cambridge University Press, 2001
2.
Zurück zum Zitat Ades AE, Lu G, Claxton K. Expected value of sample information calculations in medical decision modeling. Med Decis Making 2004; 24: 207–227PubMedCrossRef Ades AE, Lu G, Claxton K. Expected value of sample information calculations in medical decision modeling. Med Decis Making 2004; 24: 207–227PubMedCrossRef
3.
Zurück zum Zitat Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 1999; 18: 341–364PubMedCrossRef Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 1999; 18: 341–364PubMedCrossRef
4.
Zurück zum Zitat Claxton K. Bayesian approaches to the value of information: implications for the regulation of new pharmaceuticals. Health Econ 1999; 8: 269–274PubMedCrossRef Claxton K. Bayesian approaches to the value of information: implications for the regulation of new pharmaceuticals. Health Econ 1999; 8: 269–274PubMedCrossRef
5.
Zurück zum Zitat Stinnett AA, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making 1998; 18: s68–s80PubMedCrossRef Stinnett AA, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making 1998; 18: s68–s80PubMedCrossRef
6.
Zurück zum Zitat Drummond MF, Davies L. Economic analysis alongside clinical trials: revisiting the methodological issues. Int J Technol Assess Health Care 1991; 7 (4): 561–573PubMedCrossRef Drummond MF, Davies L. Economic analysis alongside clinical trials: revisiting the methodological issues. Int J Technol Assess Health Care 1991; 7 (4): 561–573PubMedCrossRef
7.
Zurück zum Zitat Kennedy WA, Laurier C, Ghezzo H, et al. Does clinical trial subject selection restrict the ability to generalize use and cost of health services to’ real life’ subjects? Int J Technol Assess Health Care 2003; 19 (1): 8–16PubMedCrossRef Kennedy WA, Laurier C, Ghezzo H, et al. Does clinical trial subject selection restrict the ability to generalize use and cost of health services to’ real life’ subjects? Int J Technol Assess Health Care 2003; 19 (1): 8–16PubMedCrossRef
8.
Zurück zum Zitat Chalmers TC, Celano P, Sacks HS, et al. Bias in treatment assignment in controlled clinical trials. N Engl J Med 1983; 309: 1358–1361PubMedCrossRef Chalmers TC, Celano P, Sacks HS, et al. Bias in treatment assignment in controlled clinical trials. N Engl J Med 1983; 309: 1358–1361PubMedCrossRef
9.
Zurück zum Zitat Chalmers TC, Matta RJ, Smith JR H, et al. Evidence favoring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med 1977; 219: 1091–1096CrossRef Chalmers TC, Matta RJ, Smith JR H, et al. Evidence favoring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med 1977; 219: 1091–1096CrossRef
10.
Zurück zum Zitat Sacks H, Chalmers TC, Smith JR H. Randomized versus historical controls for clinical trials. Am J Med 1982; 72 (233): 240 Sacks H, Chalmers TC, Smith JR H. Randomized versus historical controls for clinical trials. Am J Med 1982; 72 (233): 240
11.
Zurück zum Zitat Schulz KF, Chalmers I, Hayes RJ, et al. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408–412PubMedCrossRef Schulz KF, Chalmers I, Hayes RJ, et al. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408–412PubMedCrossRef
12.
Zurück zum Zitat Ho KKL, Thiessen J J, Bryson SM, et al. Challenges in comparing treatment outcome from a prospective with that of a retrospective study: assessing the merit of gentamicin therapeutic drug monitoring in pediatric oncology. Ther Drug Monit 1994; 16: 238–247PubMedCrossRef Ho KKL, Thiessen J J, Bryson SM, et al. Challenges in comparing treatment outcome from a prospective with that of a retrospective study: assessing the merit of gentamicin therapeutic drug monitoring in pediatric oncology. Ther Drug Monit 1994; 16: 238–247PubMedCrossRef
13.
Zurück zum Zitat Green SB, Byar DP. Using observational data from registries to compare treatments: the fallacy of omnimetrics. Stat Med 1984; 3: 361–370PubMedCrossRef Green SB, Byar DP. Using observational data from registries to compare treatments: the fallacy of omnimetrics. Stat Med 1984; 3: 361–370PubMedCrossRef
14.
Zurück zum Zitat Goldbourt U. Evaluating the association between dmg use and outcome: should the information from observational studies affect therapeutic use? Cardiology 1997; 88 Suppl. 3: 63–67PubMedCrossRef Goldbourt U. Evaluating the association between dmg use and outcome: should the information from observational studies affect therapeutic use? Cardiology 1997; 88 Suppl. 3: 63–67PubMedCrossRef
15.
Zurück zum Zitat Pocock SJ. The justification for randomized controlled trials: clinical trials. A practical approach. New York: John Wiley & Sons, 1983 Pocock SJ. The justification for randomized controlled trials: clinical trials. A practical approach. New York: John Wiley & Sons, 1983
16.
Zurück zum Zitat Pocock SJ, Elbourne DR. Randomized trials or observational tribulations? N Engl J Med 2000; 342 (25): 1907–1909PubMedCrossRef Pocock SJ, Elbourne DR. Randomized trials or observational tribulations? N Engl J Med 2000; 342 (25): 1907–1909PubMedCrossRef
17.
Zurück zum Zitat Horwitz RI. Complexity and contradiction in clinical trial research. Am J Med 1987; 82: 498–510PubMedCrossRef Horwitz RI. Complexity and contradiction in clinical trial research. Am J Med 1987; 82: 498–510PubMedCrossRef
18.
Zurück zum Zitat Horwitz RI, Viscoli CM, Clemens JD, et al. Developing improved observational methods for evaluating therapeutic effectiveness. Am J Med 1990; 89: 630–638PubMedCrossRef Horwitz RI, Viscoli CM, Clemens JD, et al. Developing improved observational methods for evaluating therapeutic effectiveness. Am J Med 1990; 89: 630–638PubMedCrossRef
19.
Zurück zum Zitat Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials. BMJ 1998; 317: 1185–1190PubMedCrossRef Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials. BMJ 1998; 317: 1185–1190PubMedCrossRef
20.
Zurück zum Zitat Nuijten MJC. The selection of data sources for use in modeling studies. Pharmacoeconomics 1998; 13 (3): 305–316PubMedCrossRef Nuijten MJC. The selection of data sources for use in modeling studies. Pharmacoeconomics 1998; 13 (3): 305–316PubMedCrossRef
21.
Zurück zum Zitat McKee M, Britton A, Black N, et al. Methods in health services research interpreting the evidence: choosing between randomized and non-randomized studies. BMJ 1999; 319: 312–315PubMedCrossRef McKee M, Britton A, Black N, et al. Methods in health services research interpreting the evidence: choosing between randomized and non-randomized studies. BMJ 1999; 319: 312–315PubMedCrossRef
22.
Zurück zum Zitat Zaric GS. The impact of ignoring population heterogeneity when markov models are used in cost-effectiveness analysis. Med Decis Making 2003; 23: 379–396PubMedCrossRef Zaric GS. The impact of ignoring population heterogeneity when markov models are used in cost-effectiveness analysis. Med Decis Making 2003; 23: 379–396PubMedCrossRef
23.
Zurück zum Zitat Caro JJ, Migliaccio-Walle K. Generalizing the results of clinical trial to actual practice: the example of clopidogrel therapy for the prevention of vascular events. Am J Med 1999; 107: 568–572PubMedCrossRef Caro JJ, Migliaccio-Walle K. Generalizing the results of clinical trial to actual practice: the example of clopidogrel therapy for the prevention of vascular events. Am J Med 1999; 107: 568–572PubMedCrossRef
24.
Zurück zum Zitat Britton A, McKee M, Black N, et al. Choosing between randomised and non-randomised studies: a systematic review. Health Technol Assess 1998; 2 (13): i–iv, 1-124PubMed Britton A, McKee M, Black N, et al. Choosing between randomised and non-randomised studies: a systematic review. Health Technol Assess 1998; 2 (13): i–iv, 1-124PubMed
25.
Zurück zum Zitat Coyle D, Davies L, Drummond MF. Trials and tribulations: emerging issues in designing economic evaluations alongside clinical trials. Int J Technol Assess Health Care 1998; 14 (1): 135–144PubMedCrossRef Coyle D, Davies L, Drummond MF. Trials and tribulations: emerging issues in designing economic evaluations alongside clinical trials. Int J Technol Assess Health Care 1998; 14 (1): 135–144PubMedCrossRef
26.
Zurück zum Zitat McClellan MB, Newhouse JP. Overview of the special supplement issue. Instrumental variables analysis applications in health services research: a special supplement to HSR. Health Serv Res 2000; 35 (5 Pt 2): 1061–1069PubMed McClellan MB, Newhouse JP. Overview of the special supplement issue. Instrumental variables analysis applications in health services research: a special supplement to HSR. Health Serv Res 2000; 35 (5 Pt 2): 1061–1069PubMed
27.
Zurück zum Zitat Newhouse JP, McClellan M. Econometrics in outcomes research: the use of instrumental variables. Annu Rev Public Health 1998; 19: 17–34PubMedCrossRef Newhouse JP, McClellan M. Econometrics in outcomes research: the use of instrumental variables. Annu Rev Public Health 1998; 19: 17–34PubMedCrossRef
28.
Zurück zum Zitat D’Agostino RBJ. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998; 17 (19): 2265–2281PubMedCrossRef D’Agostino RBJ. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998; 17 (19): 2265–2281PubMedCrossRef
29.
Zurück zum Zitat Delong ER, Nelson CL, Wong JB, et al. Using observational data to estimate prognosis: an example using a coronary artery disease registry. Stat Med 2001; 20 (16): 2505–2532PubMedCrossRef Delong ER, Nelson CL, Wong JB, et al. Using observational data to estimate prognosis: an example using a coronary artery disease registry. Stat Med 2001; 20 (16): 2505–2532PubMedCrossRef
30.
Zurück zum Zitat Weinstein MC, Toy EL, Sandberg EA, et al. Modeling for health care and other policy decisions: uses, roles and validity. Value Health 2001; 4 (5): 348–361PubMedCrossRef Weinstein MC, Toy EL, Sandberg EA, et al. Modeling for health care and other policy decisions: uses, roles and validity. Value Health 2001; 4 (5): 348–361PubMedCrossRef
31.
Zurück zum Zitat Claxton K, Sculpher M, Drummond M. A rational framework for decision making by the national institute for clinical excellence (NICE). Lancet 2002; 360: 711–715PubMedCrossRef Claxton K, Sculpher M, Drummond M. A rational framework for decision making by the national institute for clinical excellence (NICE). Lancet 2002; 360: 711–715PubMedCrossRef
32.
Zurück zum Zitat Moscarini G, Smith L. The optimal level of experimentation. Econometrica 2001; 69 (6): 1629–1644CrossRef Moscarini G, Smith L. The optimal level of experimentation. Econometrica 2001; 69 (6): 1629–1644CrossRef
Metadaten
Titel
It’s Time to Choose the Study Design!
Net Benefit Analysis of Alternative Study Designs to Acquire Information for Evaluation of Health Technologies
verfasst von
Oren Shavit
Moshe Leshno
Assaf Goldberger
Amir Shmueli
Dr Amnon Hoffman
Publikationsdatum
01.11.2007
Verlag
Springer International Publishing
Erschienen in
PharmacoEconomics / Ausgabe 11/2007
Print ISSN: 1170-7690
Elektronische ISSN: 1179-2027
DOI
https://doi.org/10.2165/00019053-200725110-00002

Weitere Artikel der Ausgabe 11/2007

PharmacoEconomics 11/2007 Zur Ausgabe