Skip to main content
Erschienen in: Clinical Pharmacokinetics 3/2007

01.03.2007 | Review Article

Are Population Pharmacokinetic and/ or Pharmacodynamic Models Adequately Evaluated?

A Survey of the Literature from 2002 to 2004

verfasst von: Dr Karl Brendel, Céline Dartois, Emmanuelle Comets, Annabelle Lemenuel-Diot, Christian Laveille, Brigitte Tranchand, Pascal Girard, Céline M. Laffont, France Mentré

Erschienen in: Clinical Pharmacokinetics | Ausgabe 3/2007

Einloggen, um Zugang zu erhalten

Abstract

Model evaluation is an important issue in population analyses. We aimed to perform a systematic review of all population pharmacokinetic and/or pharmacodynamic analyses published between 2002 and 2004 to survey the current methods used to evaluate models and to assess whether those models were adequately evaluated.
We selected 324 articles in MEDLINE using defined key words and built a data abstraction form composed of a checklist of items to extract the relevant information from these articles with respect to model evaluation. In the data abstraction form, evaluation methods were divided into three subsections: basic internal methods (goodness-of-fit [GOF] plots, uncertainty in parameter estimates and model sensitivity), advanced internal methods (data splitting, resampling techniques and Monte Carlo simulations) and external model evaluation.
Basic internal evaluation was the most frequently described method in the reports: 65% of the models involved GOF evaluation. Standard errors or confidence intervals were reported for 50% of fixed effects but only for 22% of random effects. Advanced internal methods were used in approximately 25% of models: data splitting was more often used than bootstrap and cross-validation; simulations were used in 6% of models to evaluate models by a visual predictive check or by a posterior predictive check. External evaluation was performed in only 7% of models.
Using the subjective synthesis of model evaluation for each article, we judged the models to be adequately evaluated in 28% of pharmacokinetic models and 26% of pharmacodynamic models. Basic internal evaluation was preferred to more advanced methods, probably because the former is performed easily with most software. We also noticed that when the aim of modelling was predictive, advanced internal methods or more stringent methods were more often used.
Literatur
1.
Zurück zum Zitat Sheiner LB, Steimer JL. Pharmacokinetic/pharmacodynamic modeling in drag development. Annu Rev Pharmacol Toxicol 2000; 40: 67–95PubMedCrossRef Sheiner LB, Steimer JL. Pharmacokinetic/pharmacodynamic modeling in drag development. Annu Rev Pharmacol Toxicol 2000; 40: 67–95PubMedCrossRef
2.
Zurück zum Zitat Aarons L, Karlsson MO, Mentre F, et al. Role of modelling and simulation in phase I drag development. Eur J Pharm Sci 2001; 13: 115–22PubMedCrossRef Aarons L, Karlsson MO, Mentre F, et al. Role of modelling and simulation in phase I drag development. Eur J Pharm Sci 2001; 13: 115–22PubMedCrossRef
3.
Zurück zum Zitat Jochemsen R, Laveille C, Breimer DD. Application of pharmacokinetic/pharmacodynamic modelling and population approaches to drug development. Int J Pharm Med 1999; 13: 243–51 Jochemsen R, Laveille C, Breimer DD. Application of pharmacokinetic/pharmacodynamic modelling and population approaches to drug development. Int J Pharm Med 1999; 13: 243–51
4.
Zurück zum Zitat Holford NH, Kimko HC, Monteleone JP, et al. Simulation of clinical trials. Annu Rev Pharmacol Toxicol 2000; 40: 209–34PubMedCrossRef Holford NH, Kimko HC, Monteleone JP, et al. Simulation of clinical trials. Annu Rev Pharmacol Toxicol 2000; 40: 209–34PubMedCrossRef
5.
Zurück zum Zitat Lesko LJ, Rowland M, Peck CC, et al. Optimizing the science of drug development: opportunities for better candidate selection and accelerated evaluation in humans. Pharm Res 2000; 17: 1335–44PubMedCrossRef Lesko LJ, Rowland M, Peck CC, et al. Optimizing the science of drug development: opportunities for better candidate selection and accelerated evaluation in humans. Pharm Res 2000; 17: 1335–44PubMedCrossRef
6.
Zurück zum Zitat Kimko HC, Duffull SB. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modeling prospective. New York: Marcel Dekker, 2003 Kimko HC, Duffull SB. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modeling prospective. New York: Marcel Dekker, 2003
7.
Zurück zum Zitat Girard P. Clinical trial simulation: a tool for understanding study failures and preventing them. Basic Clin Pharmacol Toxicol 2005; 96: 228–34PubMedCrossRef Girard P. Clinical trial simulation: a tool for understanding study failures and preventing them. Basic Clin Pharmacol Toxicol 2005; 96: 228–34PubMedCrossRef
8.
Zurück zum Zitat Girard P, Cucherat M, Guez D. Clinical trial simulation in drug development. Therapie 2004; 59: 287–95, 297-304PubMedCrossRef Girard P, Cucherat M, Guez D. Clinical trial simulation in drug development. Therapie 2004; 59: 287–95, 297-304PubMedCrossRef
9.
Zurück zum Zitat Mentré F, Ebelin ME. Validation of population pharmacokinetic/pharmacodynamic analyses: review of proposed approaches. In: Balant LP, Aarons L, Danhof M, et al., editors. European cooperation in the field of scientific and technical research. The population approach: measuring and managing variability in response concentration and dose. Brussels: Commission of the European Communities, 1997 Mentré F, Ebelin ME. Validation of population pharmacokinetic/pharmacodynamic analyses: review of proposed approaches. In: Balant LP, Aarons L, Danhof M, et al., editors. European cooperation in the field of scientific and technical research. The population approach: measuring and managing variability in response concentration and dose. Brussels: Commission of the European Communities, 1997
11.
Zurück zum Zitat Yano Y, Beal SL, Sheiner LB. Evaluating pharmacokinetic/pharmacodynamic models using the posterior predictive check. J Pharmacokinet Pharmacodyn 2001; 28: 171–92PubMedCrossRef Yano Y, Beal SL, Sheiner LB. Evaluating pharmacokinetic/pharmacodynamic models using the posterior predictive check. J Pharmacokinet Pharmacodyn 2001; 28: 171–92PubMedCrossRef
13.
Zurück zum Zitat Wade JR, Edholm M, Salmonson T. A guide for reporting the results of population pharmacokinetic analyses: a Swedish perspective. AAPS J 2005; 7: 456–60CrossRef Wade JR, Edholm M, Salmonson T. A guide for reporting the results of population pharmacokinetic analyses: a Swedish perspective. AAPS J 2005; 7: 456–60CrossRef
14.
Zurück zum Zitat Ette EI. Stability and performance of a population pharmacokinetic model. J Clin Pharmacol 1997; 37: 486–95PubMed Ette EI. Stability and performance of a population pharmacokinetic model. J Clin Pharmacol 1997; 37: 486–95PubMed
15.
Zurück zum Zitat Boutron I, Tubach F, Giraudeau B, et al. Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. J Am Stat Assoc 2003; 290: 1060–70 Boutron I, Tubach F, Giraudeau B, et al. Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. J Am Stat Assoc 2003; 290: 1060–70
17.
Zurück zum Zitat Sheiner LB. Analysis of pharmacokinetic data using parametric models. 3: hypothesis tests and confidence intervals. J Pharmacokinet Biopharm 1986; 14: 539–55PubMed Sheiner LB. Analysis of pharmacokinetic data using parametric models. 3: hypothesis tests and confidence intervals. J Pharmacokinet Biopharm 1986; 14: 539–55PubMed
18.
Zurück zum Zitat Efron B. Bootstrap methods: another look at the jackknife. Ann Stat 1979; 7: 1–26CrossRef Efron B. Bootstrap methods: another look at the jackknife. Ann Stat 1979; 7: 1–26CrossRef
19.
Zurück zum Zitat Efron B, Gong G. A leisurely look at the bootstrap, the jackknife and cross-validation. Am Stat 1983; 37: 36–48 Efron B, Gong G. A leisurely look at the bootstrap, the jackknife and cross-validation. Am Stat 1983; 37: 36–48
20.
Zurück zum Zitat Belin TR, Rubin DB. The analysis of repeated-measures data on schizophrenic reaction times using mixture models. Stat Med 1995; 14: 747–68PubMedCrossRef Belin TR, Rubin DB. The analysis of repeated-measures data on schizophrenic reaction times using mixture models. Stat Med 1995; 14: 747–68PubMedCrossRef
21.
Zurück zum Zitat Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian data analysis. London: Chapman and Hall, 2004 Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian data analysis. London: Chapman and Hall, 2004
22.
Zurück zum Zitat Girard P, Blaschke TF, Kastrissios H, et al. A Markov mixed effect regression model for drug compliance. Stat Med 1998; 17: 2313–33PubMedCrossRef Girard P, Blaschke TF, Kastrissios H, et al. A Markov mixed effect regression model for drug compliance. Stat Med 1998; 17: 2313–33PubMedCrossRef
23.
Zurück zum Zitat Cox EH, Veyrat-Follet C, Beal SL, et al. A population pharmacokinetic-pharmacodynamic analysis of repeated measures time-to-event pharmacodynamic responses: the antiemetic effect of ondansetron. J Pharmacokinet Biopharm 1999; 27: 625–44PubMed Cox EH, Veyrat-Follet C, Beal SL, et al. A population pharmacokinetic-pharmacodynamic analysis of repeated measures time-to-event pharmacodynamic responses: the antiemetic effect of ondansetron. J Pharmacokinet Biopharm 1999; 27: 625–44PubMed
24.
Zurück zum Zitat Duffull SB, Chabaud S, Nony P, et al. A pharmacokinetic simulation model for ivabradine in healthy volunteers. Eur J Pharm Sci 2000; 10: 285–94PubMedCrossRef Duffull SB, Chabaud S, Nony P, et al. A pharmacokinetic simulation model for ivabradine in healthy volunteers. Eur J Pharm Sci 2000; 10: 285–94PubMedCrossRef
25.
Zurück zum Zitat Friberg LE, Freijs A, Sandstrom M, et al. Semiphysiological model for the time course of leukocytes after varying schedules of 5-fluorouracil in rats. J Pharmacol Exp Ther 2000; 295: 734–40PubMed Friberg LE, Freijs A, Sandstrom M, et al. Semiphysiological model for the time course of leukocytes after varying schedules of 5-fluorouracil in rats. J Pharmacol Exp Ther 2000; 295: 734–40PubMed
26.
Zurück zum Zitat Chabaud S, Girard P, Nony P, et al. Clinical trial simulation using therapeutic effect modeling: application to ivabradine efficacy in patients with angina pectoris. J Pharmacokinet Pharmacodyn 2002; 29: 339–63PubMedCrossRef Chabaud S, Girard P, Nony P, et al. Clinical trial simulation using therapeutic effect modeling: application to ivabradine efficacy in patients with angina pectoris. J Pharmacokinet Pharmacodyn 2002; 29: 339–63PubMedCrossRef
27.
Zurück zum Zitat Duffull SB, Kirkpatrick CM, Green B, et al. Analysis of population pharmacokinetic data using NONMEM and WinBUGS. J Biopharm Stat 2005; 15: 53–73PubMedCrossRef Duffull SB, Kirkpatrick CM, Green B, et al. Analysis of population pharmacokinetic data using NONMEM and WinBUGS. J Biopharm Stat 2005; 15: 53–73PubMedCrossRef
28.
Zurück zum Zitat Jadhav PR, Gobburu JV. A new equivalence based metric for predictive check to qualify mixed-effects models. AAPS J 2005; 7: E523–31PubMedCrossRef Jadhav PR, Gobburu JV. A new equivalence based metric for predictive check to qualify mixed-effects models. AAPS J 2005; 7: E523–31PubMedCrossRef
29.
Zurück zum Zitat Shi J, Kovacs SJ, Wang Y, et al. Population pharmacokinetics of the active metabolite of leflunomide in pediatric subjects with polyarticular course juvenile rheumatoid arthritis. J Pharmacokinet Pharmacodyn 2005; 32: 419–39PubMedCrossRef Shi J, Kovacs SJ, Wang Y, et al. Population pharmacokinetics of the active metabolite of leflunomide in pediatric subjects with polyarticular course juvenile rheumatoid arthritis. J Pharmacokinet Pharmacodyn 2005; 32: 419–39PubMedCrossRef
30.
Zurück zum Zitat van Kesteren C, Zandvliet AS, Karlsson MO, et al. Semi-physiological model describing the hematological toxicity of the anti-cancer agent indisulam. Invest New Drugs 2005; 23: 225–34PubMedCrossRef van Kesteren C, Zandvliet AS, Karlsson MO, et al. Semi-physiological model describing the hematological toxicity of the anti-cancer agent indisulam. Invest New Drugs 2005; 23: 225–34PubMedCrossRef
31.
Zurück zum Zitat Zingmark PH, Kagedal M, Karlsson MO. Modelling a spontaneously reported side effect by use of a Markov mixed-effects model. J Pharmacokinet Pharmacodyn 2005; 32: 261–81PubMedCrossRef Zingmark PH, Kagedal M, Karlsson MO. Modelling a spontaneously reported side effect by use of a Markov mixed-effects model. J Pharmacokinet Pharmacodyn 2005; 32: 261–81PubMedCrossRef
32.
Zurück zum Zitat Williams PJ, Ette EI. Determination of model appropriateness. New York: Marcel Dekker, 2003 Williams PJ, Ette EI. Determination of model appropriateness. New York: Marcel Dekker, 2003
33.
Zurück zum Zitat Cohen L. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960: 37-46 Cohen L. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960: 37-46
34.
Zurück zum Zitat Fleiss J. Statistical methods for rates and proportions. 2nd ed. New York, 1981 Fleiss J. Statistical methods for rates and proportions. 2nd ed. New York, 1981
35.
Zurück zum Zitat Kloft C, Graefe EU, Tanswell P, et al. Population pharmacokinetics of sibrotuzumab, a novel therapeutic monoclonal antibody, in cancer patients. Invest New Drugs 2004; 22: 39–52PubMedCrossRef Kloft C, Graefe EU, Tanswell P, et al. Population pharmacokinetics of sibrotuzumab, a novel therapeutic monoclonal antibody, in cancer patients. Invest New Drugs 2004; 22: 39–52PubMedCrossRef
36.
Zurück zum Zitat Shen M, Schilder RJ, Obasaju C, et al. Population pharmacokinetic and limited sampling models for carboplatin administered in high-dose combination regimens with peripheral blood stem cell support. Cancer Chemother Pharmacol 2002; 50: 243–50PubMedCrossRef Shen M, Schilder RJ, Obasaju C, et al. Population pharmacokinetic and limited sampling models for carboplatin administered in high-dose combination regimens with peripheral blood stem cell support. Cancer Chemother Pharmacol 2002; 50: 243–50PubMedCrossRef
37.
Zurück zum Zitat Bonate PL, Floret S, Bentzen C. Population pharmacokinetics of APOMINE: a meta-analysis in cancer patients and healthy males. Br J Clin Pharmacol 2004; 58: 142–55PubMedCrossRef Bonate PL, Floret S, Bentzen C. Population pharmacokinetics of APOMINE: a meta-analysis in cancer patients and healthy males. Br J Clin Pharmacol 2004; 58: 142–55PubMedCrossRef
38.
Zurück zum Zitat Rajagopalan P, Gastonguay MR. Population pharmacokinetics of ciprofloxacin in pediatric patients. J Clin Pharmacol 2003; 43: 698–710PubMed Rajagopalan P, Gastonguay MR. Population pharmacokinetics of ciprofloxacin in pediatric patients. J Clin Pharmacol 2003; 43: 698–710PubMed
39.
Zurück zum Zitat Meagher AK, Forrest A, Rayner CR, et al. Population pharmacokinetics of linezolid in patients treated in a compassionate-use program. Antimicrob Agents Chemother 2003; 47: 548–53PubMedCrossRef Meagher AK, Forrest A, Rayner CR, et al. Population pharmacokinetics of linezolid in patients treated in a compassionate-use program. Antimicrob Agents Chemother 2003; 47: 548–53PubMedCrossRef
40.
Zurück zum Zitat Ishibashi T, Yano Y, Oguma T. Population pharmacokinetics of platinum after nedaplatin administration and model validation in adult patients. Br J Clin Pharmacol 2003; 56: 205–13PubMedCrossRef Ishibashi T, Yano Y, Oguma T. Population pharmacokinetics of platinum after nedaplatin administration and model validation in adult patients. Br J Clin Pharmacol 2003; 56: 205–13PubMedCrossRef
41.
Zurück zum Zitat El Desoky ES, Fuseau E, El Din Amry S, et al. Pharmacokinetic modelling of valproic acid from routine clinical data in Egyptian epileptic patients. Eur J Clin Pharmacol 2004; 59: 783–90PubMedCrossRef El Desoky ES, Fuseau E, El Din Amry S, et al. Pharmacokinetic modelling of valproic acid from routine clinical data in Egyptian epileptic patients. Eur J Clin Pharmacol 2004; 59: 783–90PubMedCrossRef
42.
Zurück zum Zitat Rajagopalan P, Pelz RK, Lipsett PA, et al. Enteral fluconazole population pharmacokinetics in patients in the surgical intensive care unit. Pharmacotherapy 2003; 23: 592–602PubMedCrossRef Rajagopalan P, Pelz RK, Lipsett PA, et al. Enteral fluconazole population pharmacokinetics in patients in the surgical intensive care unit. Pharmacotherapy 2003; 23: 592–602PubMedCrossRef
43.
Zurück zum Zitat Sale M, Salder BM, Stein DS. Pharmacokinetic modeling and simulations of interaction of amprenavir and ritonavir. Antimicrob Agents Chemother 2002; 46: 746–54PubMedCrossRef Sale M, Salder BM, Stein DS. Pharmacokinetic modeling and simulations of interaction of amprenavir and ritonavir. Antimicrob Agents Chemother 2002; 46: 746–54PubMedCrossRef
44.
Zurück zum Zitat Pfister M, Martin NE, Haskell LP, et al. Optimizing dose selection with modeling and simulation: application to the vasopeptidase inhibitor M100240. J Clin Pharmacol 2004; 44: 621–31PubMedCrossRef Pfister M, Martin NE, Haskell LP, et al. Optimizing dose selection with modeling and simulation: application to the vasopeptidase inhibitor M100240. J Clin Pharmacol 2004; 44: 621–31PubMedCrossRef
45.
Zurück zum Zitat Ambrose PG, Bhavnani SM, Cirincione BB, et al. Gatifloxacin and the elderly: pharmacokinetic-pharmacodynamic rationale for a potential age-related dose reduction. J Antimicrob Chemother 2003; 52: 435–40PubMedCrossRef Ambrose PG, Bhavnani SM, Cirincione BB, et al. Gatifloxacin and the elderly: pharmacokinetic-pharmacodynamic rationale for a potential age-related dose reduction. J Antimicrob Chemother 2003; 52: 435–40PubMedCrossRef
46.
Zurück zum Zitat Comets E, Ikeda K, Hoff P, et al. Comparison of the pharmacokinetics of S-1, an oral anticancer agent, in Western and Japanese patients. J Pharmacokinet Pharmacodyn 2003; 30: 257–83PubMedCrossRef Comets E, Ikeda K, Hoff P, et al. Comparison of the pharmacokinetics of S-1, an oral anticancer agent, in Western and Japanese patients. J Pharmacokinet Pharmacodyn 2003; 30: 257–83PubMedCrossRef
47.
Zurück zum Zitat Butterworth J, Lin YA, Prielipp R, et al. The pharmacokinetics and cardiovascular effects of a single intravenous dose of protamine in normal volunteers. Anesth Analg 2002; 94: 514–22PubMedCrossRef Butterworth J, Lin YA, Prielipp R, et al. The pharmacokinetics and cardiovascular effects of a single intravenous dose of protamine in normal volunteers. Anesth Analg 2002; 94: 514–22PubMedCrossRef
48.
Zurück zum Zitat Knibbe CA, Melenhorst-de Jong G, Mestrom M, et al. Pharmacokinetics and effects of propofol 6% for short-term sedation in paediatric patients following cardiac surgery. Br J Clin Pharmacol 2002; 54: 415–22PubMedCrossRef Knibbe CA, Melenhorst-de Jong G, Mestrom M, et al. Pharmacokinetics and effects of propofol 6% for short-term sedation in paediatric patients following cardiac surgery. Br J Clin Pharmacol 2002; 54: 415–22PubMedCrossRef
49.
Zurück zum Zitat Olofsen E, Sleigh JW, Dahan A. The influence of remifentanil on the dynamic relation between sevoflurane and surrogate anesthetic effect measures derived from the EEG. Anesthesiology 2002; 96: 555–64PubMedCrossRef Olofsen E, Sleigh JW, Dahan A. The influence of remifentanil on the dynamic relation between sevoflurane and surrogate anesthetic effect measures derived from the EEG. Anesthesiology 2002; 96: 555–64PubMedCrossRef
50.
Zurück zum Zitat Retout S, Mentré F, Bruno R. Fisher information matrix for non-linear mixed-effects models: evaluation and application for optimal design of enoxaparin population pharmacokinetics. Stat Med 2002; 21: 2623–39PubMedCrossRef Retout S, Mentré F, Bruno R. Fisher information matrix for non-linear mixed-effects models: evaluation and application for optimal design of enoxaparin population pharmacokinetics. Stat Med 2002; 21: 2623–39PubMedCrossRef
51.
Zurück zum Zitat Mallet A. A maximum likelihood estimation method for random coefficient regression models. Biometrika 1986; 73: 645–56CrossRef Mallet A. A maximum likelihood estimation method for random coefficient regression models. Biometrika 1986; 73: 645–56CrossRef
52.
Zurück zum Zitat Wakefield J. The Bayesian analysis of population pharmacokinetic models. J Am Stat Assoc 1996; 91: 62–75CrossRef Wakefield J. The Bayesian analysis of population pharmacokinetic models. J Am Stat Assoc 1996; 91: 62–75CrossRef
53.
Zurück zum Zitat Roecker EB. Prediction error and its estimation for subsetselected models. Technometrics 1991; 33: 316–31CrossRef Roecker EB. Prediction error and its estimation for subsetselected models. Technometrics 1991; 33: 316–31CrossRef
54.
Zurück zum Zitat Mentré F, Escolano S. Prediction discrepancies for the evaluation of nonlinear mixed-effects models. J Pharmacokinet Pharmacodyn 2005; 33: 345–67PubMedCrossRef Mentré F, Escolano S. Prediction discrepancies for the evaluation of nonlinear mixed-effects models. J Pharmacokinet Pharmacodyn 2005; 33: 345–67PubMedCrossRef
Metadaten
Titel
Are Population Pharmacokinetic and/ or Pharmacodynamic Models Adequately Evaluated?
A Survey of the Literature from 2002 to 2004
verfasst von
Dr Karl Brendel
Céline Dartois
Emmanuelle Comets
Annabelle Lemenuel-Diot
Christian Laveille
Brigitte Tranchand
Pascal Girard
Céline M. Laffont
France Mentré
Publikationsdatum
01.03.2007
Verlag
Springer International Publishing
Erschienen in
Clinical Pharmacokinetics / Ausgabe 3/2007
Print ISSN: 0312-5963
Elektronische ISSN: 1179-1926
DOI
https://doi.org/10.2165/00003088-200746030-00003

Weitere Artikel der Ausgabe 3/2007

Clinical Pharmacokinetics 3/2007 Zur Ausgabe