Skip to main content
Erschienen in: Implementation Science 1/2011

Open Access 01.12.2011 | Systematic review

Computerized clinical decision support systems for therapeutic drug monitoring and dosing: A decision-maker-researcher partnership systematic review

verfasst von: Robby Nieuwlaat, Stuart J Connolly, Jean A Mackay, Lorraine Weise-Kelly, Tamara Navarro, Nancy L Wilczynski, R Brian Haynes, the CCDSS Systematic Review Team

Erschienen in: Implementation Science | Ausgabe 1/2011

Abstract

Background

Some drugs have a narrow therapeutic range and require monitoring and dose adjustments to optimize their efficacy and safety. Computerized clinical decision support systems (CCDSSs) may improve the net benefit of these drugs. The objective of this review was to determine if CCDSSs improve processes of care or patient outcomes for therapeutic drug monitoring and dosing.

Methods

We conducted a decision-maker-researcher partnership systematic review. Studies from our previous review were included, and new studies were sought until January 2010 in MEDLINE, EMBASE, Evidence-Based Medicine Reviews, and Inspec databases. Randomized controlled trials assessing the effect of a CCDSS on process of care or patient outcomes were selected by pairs of independent reviewers. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive.

Results

Thirty-three randomized controlled trials were identified, assessing the effect of a CCDSS on management of vitamin K antagonists (14), insulin (6), theophylline/aminophylline (4), aminoglycosides (3), digoxin (2), lidocaine (1), or as part of a multifaceted approach (3). Cluster randomization was rarely used (18%) and CCDSSs were usually stand-alone systems (76%) primarily used by physicians (85%). Overall, 18 of 30 studies (60%) showed an improvement in the process of care and 4 of 19 (21%) an improvement in patient outcomes. All evaluable studies assessing insulin dosing for glycaemic control showed an improvement. In meta-analysis, CCDSSs for vitamin K antagonist dosing significantly improved time in therapeutic range.

Conclusions

CCDSSs have potential for improving process of care for therapeutic drug monitoring and dosing, specifically insulin and vitamin K antagonist dosing. However, studies were small and generally of modest quality, and effects on patient outcomes were uncertain, with no convincing benefit in the largest studies. At present, no firm recommendation for specific systems can be given. More potent CCDSSs need to be developed and should be evaluated by independent researchers using cluster randomization and primarily assess patient outcomes related to drug efficacy and safety.
Hinweise

Electronic supplementary material

The online version of this article (doi:10.​1186/​1748-5908-6-90) contains supplementary material, which is available to authorized users.

Competing interests

RBH, NLW, JAM, LWK, TN, RN, SJC received support through the Canadian Institutes of Health Research Synthesis Grant: Knowledge Translation KRS 91791 for the submitted work. RBH is acquainted with several CCDSS developers and researchers, including authors of papers included in this review.

Authors' contributions

RBH was responsible for study conception and design; acquisition, analysis, and interpretation of data; drafting and critical revision of the manuscript; obtaining funding; and study supervision. He is the guarantor. RN acquired, analyzed, and interpreted data; drafted the manuscript; and provided statistical analysis. SJC analyzed and interpreted the data; and critically revised the manuscript. JAM acquired, analyzed, and interpreted data; drafted the manuscript; critically revised the manuscript; and provided statistical analysis as well as administrative, technical, or material support. LWK and TN acquired data and drafted the manuscript. NLW acquired, analyzed, and interpreted data; drafted the manuscript; provided administrative, technical, or material support; and provided study supervision. All authors have read and approved the final manuscript.

Background

Healthcare policy makers and providers have already invested billions of dollars in information technology and systems to improve care effectiveness and efficiency, which will increase in the coming years. Optimization of the return on these investments requires that current best evidence be considered concerning the effects of information technology innovations on care processes and health outcomes.
Computerized clinical decision support systems (CCDSSs) may improve patient care by comparing individual patient features with a knowledge base to provide tailored clinical recommendations. One well-defined CCDSS clinical intervention area is therapeutic drug monitoring and dosing (TDMD). Certain drugs, such as warfarin or insulin, have variable effects depending on the plasma concentration in relation to individual patient-related factors. Managing such drugs is troublesome when they have a narrow therapeutic window--that is, a lower dose is ineffective and a somewhat higher dose is hazardous. To ensure an optimal net benefit, the drug effects need to be monitored with individually tailored dose adjustments accordingly. A CCDSS for TDMD could advise to monitor the drug effect within certain time intervals and advise specific dose adjustments based on this monitoring and the patient's characteristics.
Our 2005 review of 100 controlled trials of CCDSSs for all indications [1] included 24 studies assessing the effect of a CCDSS on TDMD: 13 for anticoagulants, four for theophylline, three for aminoglycosides, and four for other drugs. Practitioner performance improved in 15 (63%) of these studies and patient outcomes in 2 of 18 (11%) studies assessing this. Many CCDSS studies have been published since, with advancing information technology and, as we previously documented, increasingly strong research methods [1].
Our current systematic review, one of a series [2], aims to provide in-depth assessment of CCDSS effects on TDMD in randomized controlled trials (RCTs). In addition, the partnership of researchers and clinicians in the review process facilitated extraction and interpretation of details for practical implementation.

Methods

The complete systematic review methods have been described in detail elsewhere [2]. Key and supplementary details for TDMD are provided here.

Research question

Do CCDSSs improve process of care or patient outcomes for TDMD?

Partnering with decision makers

To optimize the clinical relevance and applicability of results and conclusions for CCDSS implementation decisions, regional and local decision makers were involved throughout the entire review process. Overall direction for the review was provided by senior health policy makers for a large academic health sciences centre and regional health authority. Specific guidance for the area of TDMD was provided by a clinical service decision maker (SJC), chief of the regional cardiology program, who determined the clinical relevance of reported outcomes, helped integrating results across CCDSSs for different drugs, and provided clinical guidance for data analysis and the manuscript. The Health Information Research Unit research staff searched and selected studies, and extracted and synthesised data.

Search strategy

We searched for RCTs with CCDSSs for all purposes until 6 January 2010 as cited in MEDLINE, EMBASE, Evidence-Based Medicine Reviews database, and the Inspec bibliographic database. We also reviewed reference lists of included studies and relevant review articles, and searched KT+ http://​plus.​mcmaster.​ca/​kt/​ and EvidenceUpdates http://​plus.​mcmaster.​ca/​EvidenceUpdates/​ [3]. The flow diagram of included and excluded articles for the overall review is shown in Figure 1. Pairs of reviewers independently evaluated the eligibility of all identified studies. Cohen's kappa for reviewer agreement on study eligibility for all clinical areas together was κ = 0.93 (95% confidence interval (CI), 0.91 to 0.94). Disagreements were adjudicated by a third observer. Of the 33 included studies, reported in 36 publications [439], 16 overlapped [614, 17, 21, 22, 24, 30, 38, 39] with the clinical area of 'acute care'; only their specific effect on TDMD will be reported here.

Study selection

We included RCTs that assessed the effect of a CCDSS on process of care measures or patient outcomes, whereby the CCDSS provided dosing recommendations based on individual patient data and was handled by a healthcare professional. In our previous review [1], randomized and nonrandomized trials assessing the effect of a CCDSS on TDMD were identified until September 2004, and these studies were included in the current review if they were truly RCTs. An extended search until 6 January 2010 was performed to identify recent RCTs. CCDSSs that provided guidance on multiple management issues were included if the specific effect on TDMD could be isolated

Data extraction

Pairs of reviewers independently extracted data. Disagreements were resolved by a third reviewer or by consensus. We attempted to contact primary authors via email to confirm accuracy of the extracted data and to provide missing data, and 25 of 33 (76%) replied. Researchers and clinical decision makers identified study variables relevant for each CCDSS intervention before evaluating intervention effects.

Assessment of study quality

All RCTs were scored for methodological quality on a 10-point scale, which is an extension of the Jadad scale [1] and includes 5 potential sources of bias (see Additional file 1, Table S1). Total scores range from 0 (lowest study quality) to 10.

Assessment of CCDSS intervention effects

CCDSS efficacy was assessed separately for process of care and patient outcomes based on variables relevant to the CCDSS intervention as judged by the researchers and clinical decision makers. A process of care outcome represents quality of care, such as the number of glucose measurements in the recommended therapeutic range. A patient outcome is directly measured patient's health, such as the number of symptomatic hypoglycaemic episodes. A CCDSS was considered effective when significantly (p < 0.05) improving the pre-specified primary endpoint. If no primary outcome was specified, then we based this determination on the endpoint used for study power calculation, or failing that, ≥50% of multiple pre-specified endpoints. When no endpoint was clearly pre-specified, we considered a CCDSS effective if it improved ≥50% of all reported outcomes. If the study compared more than one intervention with control, it was considered effective if any of the CCDSS study arms showed a benefit. These criteria are more specific than in our 2005 review [1], and the effect assignment was adjusted for some of the studies from that review.

Data synthesis and analysis

CCDSS effects were analyzed with the study as the unit of analysis. If study designs and settings were considered comparable, data reported in ≥2 studies were pooled for meta-analysis to assess the average effect size. Where studies did not report data in a suitable form for pooling, authors were contacted for additional information, and appropriate data were estimated [40] with advice from a statistician. Data were combined as risk ratios for dichotomous data (Mantel-Haenszel method) or mean differences for continuous data (inverse variance method) using a random-effects model in Review Manager [41]. We interpreted a two-sided p < 0.05 as statistically significant. A sensitivity analysis was conducted to assess the possibility of biased results in studies with a mismatch between the unit of allocation (e.g., clinicians) and the unit of analysis (e.g., individual patients without adjustment for clustering). Success rates comparing studies with matched and mismatched analyses were compared using chi-square for comparisons. No differences in reported success were found for either process of care outcomes (Pearson X2 = 1.12, 2p = 0.29) or patient outcomes (Pearson X2 = 1.35, 2p = 0.53). Accordingly, results have been reported without distinction for mismatch.

Results

From the previous 2005 review, 23 RCTs [426] for TDMD were included in the current review. An additional 10 RCTs, reported in 13 publications [2739], were identified since September 2004. Three other studies were initially included, but later excluded for confounding of the CCDSS effect [42, 43] or a quasi-randomized design [44]. Twenty included studies contribute outcomes to this review as well as other CCDSS interventions in the series; two studies [21, 31] to four reviews, two studies [5, 34] to three reviews, and 16 studies [614, 17, 22, 24, 30, 32, 38, 39] to two reviews; but we focused here on relevant outcomes for therapeutic drug monitoring and dosing.
Summary of trial quality is reported in Additional file 1, Table S1; system characteristics in Additional file 2, Table S2; study characteristics in Additional file 3, Table S3; outcome data in Additional file 4, Table S4 and Table 1, and other CCDSS-related outcomes in Additional file 5, Table S5.
Table 1
Results for CCDSS trials of therapeutic drug monitoring and dosinga
Study
Methods scoreb
Indication
No. of centres/providers/patients
Process of care outcomes
CCDSS effectc
Patient outcomes
CCDSS effectc
Vitamin K antagonist Dosing
Poller, 2008 [3537]
5
1 of 2 CCDSSs (DAWN-AC or PARMA) provided dosing for warfarin/acenocoumarol/phenprocoumon in outpatients with AF, DVT or PE, mechanical heart valves, or other indications.
32/69/13,219*
Time INR in range (clinic-determined).
+
Adjudicated clinical events.
0
Claes, 2005 [27, 28]
6
CCDSS (DAWN-AC) provided dosing for warfarin/acenocoumarol/phenprocoumon in outpatients with AF, DVT or PE, mechanical heart valves, or other indications.
66*/96/834
Duration of INR values within 0.5 or 0.75 INR-units of target range (2.5 or 3.5 depending on indication).
0
Thromboembolic complications and hemorrhagic events.
0
Mitra, 2005 [29]
5
CCDSS (DAWN-AC) provided dosing for warfarin in hospitalised rehabilitation patients,
1/.../30*
Time in therapeutic INR range (2.0 to 3.0) and number of blood draws during hospitalization.
+
Incident deep vein thrombosis or pulmonary embolism during hospitalization and length of hospital stay.
...
Manotti, 2001 [26]
4
CCDSS (PARMA) provided dosing for warfarin/acenocoumarol in outpatients with VTE, non-ischemic heart disease, heart-valve prosthesis, or other indications.
5/.../1,251*
Time long term therapy group spent in therapeutic INR range (2.0 to 3.0 or 3.0 to 4.5) and proportion of starting treatment group reaching a stable condition (three consecutive INRs within therapeutic range, 2.0 to 3.0, at least one week from each other].
+
...
...
Fitzmauric, 2000 [25]
6
CCDSS provided warfarin dosing for outpatients with venous or arterial thromboembolic disorders.
12*/.../367
Proportion of patients achieving therapeutic INR target, and time in target INR range (target range varied by clinical indication for treatment: 2.0 to 3.0 or 3.0 to 4.5).
0
Deaths, serious adverse events, and patient satisfaction.
0
Ageno, 1998 [23]
6
CCDSS (DAWN-AC) provided dosing for warfarin maintenance in outpatients with mechanical heart valves.
1/.../101*
INR within therapeutic range, >5.0, or <2.0;% dose adjustments; number of INR tests; time within INR range 2.5 to 3.5; mean INR; test interval; proportion interventions manually overridden in CCDSS group.
...
...
...
Poller, 1998 [24]
3
CCDSS (DAWN-AC) provided dosing for warfarin initiation and maintenance in outpatients.
5/.../285*
Time in INR target range (2 to 3 or 2.5 to 3.5, or 3 to -0.5).
+
...
...
Vadher, 1997 [22]
6
CCDSS provided dosing for warfarin initiation and maintenance in inpatients with venous or arterial thromboembolic disorders.
1/49/148*
Time to reach therapeutic range and stable dose, time to pseudoevent (INR ≤1.5 or ≥5 after therapeutic range is reached), and time within INR range 2 to 3.
0
Deaths, thrombotic events, and hemorrhagic events.
...
Fitzmauric, 1996 [20]
4
CCDSS provided dosing for warfarin maintenance in outpatients with venous or arterial thromboembolic disorders.
2/.../49*
INR control.
...
Deaths, thrombotic or hemorrhagic episodes, and patient satisfaction.
...
Fihn, 1994 [19]
3
CCDSS scheduled follow-up visits for outpatients receiving warfarin at anticoagulation clinics.
5/.../849*
Ability to increase visit intervals and deviation of measured prothrombin times and INRs from target values.
+
Deaths, clinically important bleeding, and thromboembolic complications.
0
Poller, 1993 [18]
5
CCDSS provided dosing for warfarin therapy in outpatients with venous or arterial thromboembolic disorders.
1/.../186*
Proportion of visits spent in or out of target range and time between visits.
0
Death, major bleeding events, and other clinical events
0
White, 1991 [15]
6
CCDSS predicted steady-state warfarin dosing in outpatients on long-term warfarin therapy.
1/.../50*
Difference between achieved and target PT, patients with final PT within 2 seconds of target, and follow-up interval.
0
...
...
Carter, 1987 [9]
2
CCDSS provided dosing for warfarin initiation in hospital inpatients.
1/.../54*
Time from administration of first warfarin dose to stabilization dosage in patients with stable PT ratio pre-discharge
0
...
...
White, 1987 [10]
6
CCDSS (Warfcalc) provided dosing for warfarin therapy in patients hospitalised with DVT, cerebrovascular accident, transient ischemic attack, PE, or AF.
2/.../75*
Time to reach stable therapeutic dose or therapeutic PR, patients with PR above therapeutic range during hospital stay, predicted vs observed PR, and absolute PR error.
+
Length of hospital stay and in-hospital bleeding complications.
+
Aminophylline and Theophylline Dosing
Tierney, 2005 [31]
9
CCDSS generated care suggestions for physicians and pharmacists managing asthma and chronic obstructive pulmonary disease in adults in primary care.
4/266*/706
Proportion of care suggestions to change theophylline dose adhered to by physicians and pharmacists; medication compliance; and patient satisfaction with physicians and pharmacists.
0
Short-form 36 (physical function, role physical, pain, general health, vitality, social function, role emotional, mental health), asthma-related and chronic respiratory disease-related quality of life, emergency department visits, and hospitalizations.
0
Casner, 1993 [17]
3
CCDSS predicted theophylline infusion rates for inpatients with asthma or chronic obstructive pulmonary disease.
1/.../47*
Mean serum theophylline levels, absolute and mean difference between final and target (15 mg/L) theophylline levels, patients with subtherapeutic (<10 mg/L) final theophylline levels, and patients with toxic (>20 mg/L) final theophylline levels.
0
Theophylline-associated toxicity (nausea, vomiting, tremor, tachycardia, and seizures), length of hospital stay, treatment duration.
0
Gonzalez, 1989 [12]
5
CCDSS estimated aminophylline loading and maintenance dosing for patients in the emergency department.
.../.../67*
Mean theophylline level.
+
Discharge from emergency department within 8 hours,
adverse effects in emergency department, and peak flow rate.
0
Hurley, 1986 [8]
8
CCDSS provided dosing for theophylline in inpatients with acute air-flow obstruction.
1/.../96*
Patients with theophylline levels above or below therapeutic range (10 to 20 μg/mL) on days 1 and 2 or trough theophylline levels in therapeutic range during oral therapy, mean serum theophylline levels, mean 1st serum level and trough levels during oral therapy.
0
In first 3 days: peak expiratory flow rate, air flow obstruction symptoms (severe breathlessness, wheeziness, night wheeze, or cough during hospitalization), side effects (severe palpitations, nausea, tremulousness, agitation, blurred vision, or diarrhoea during hospitalization), and deaths.
0
Insulin Dosing and Glucose Glycaemic Regulation
Cavalcanti
2009 [39]
8
CCDSS (computer assisted insulin protocol, [CAIP]) recommended insulin dosing and glucose monitoring to achieve glucose control in patients in intensive care units.
5/60/168*
Number of blood glucose measurements and proportion of time blood glucose controlled (60 to 140 mg/dL).
+
Blood glucose levels in ICU and rates of hypoglycaemia.
+/-
Saager, 2008 [38]
6
CCDSS (EndoTool Glucose Management System) recommended insulin dosing and glucose assessment frequency for diabetic patients in cardiothoracic intensive care units.
1/.../40*
Proportion of blood glucose measures in range and time in range in operating rooms or intensive care units.
+
Blood glucose levels and time to reach blood glucose level <150 mg/dL in operating rooms or intensive care units.
+
Albisser, 2007 [33]
8
CCDSS predicted glycaemia and risk for hypoglycaemia in insulin-dependent patients in primary care.
.../2/22*
Mean daily insulin dose.
+
Hypoglycaemia episodes.
+
Rood, 2005 [30]
8
CCDSS recommended timing for glucose measurements and administration of insulin in critically ill patients.
1/104/484*
Proportion of time that glucose measurements were early or late, proportion of time that glucose levels were within target range (4.0 to 7.0 mmol/L), adherence to guideline for timing of glucose measurement, and proportion of samples taken on time.
+
...
...
Ryff-de Léche, 1992 [16]
3
CCDSS (Camit S1) analyzed and summarized blood glucose data for Insulin dosing in outpatients with diabetes.
1/.../38*
Proportion of blood glucose levels in low range (<4.0 mmol/L), at <2.9 mmol/L level, and in target range (4.0 to 10.0 mmol/L).
...
Change in haemoglobin A1c levels.
...
McDonald, 1976 [5]
2
CCDSS generated recommendations for repeat laboratory tests to detect potential medication-related events and treatment changes in adults attending a diabetes clinic.
1/.../226*
Provider adherence to recommendations to change therapy or order tests for monitoring drug effects.
+
...
...
Aminoglycoside Dosing
Burton, 1991 [14]
6
CCDSS provided aminoglycoside dosing for inpatients with clinical infections.
1*/.../147
Proportion, of patients with peak aminoglycoside level >4 mg/L or trough levels ≥2 mg/L.
0
Deaths, cures, therapy response, treatment failure, indeterminate therapy response, nephrotoxicity, length of hospital stay overall and after start of antibiotics, and length of aminoglycoside therapy.
0
Begg, 1989 [11]
4
CCDSS provided individualised aminoglycoside dosing for inpatients receiving gentamicin or tobramycin.
.../.../50*
Number of patients achieving either or both peak (6 to 10 mg/L) and trough (1 to 2 mg/L) aminoglycoside levels.
+
Deaths and change in creatinine clearance during therapy.
0
Hickling, 1989 [13]
3
CCDSS provided dosing and dose intervals aminoglycoside in critically ill patients.
1/.../32*
Proportion of patients outside of therapeutic range (6 to 10 mg/L for peak and <2 mg/L for trough) or with peak plasma levels >6 mg/L., and mean peak and trough plasma aminoglycoside levels.
+
Increase in creatinine clearance during recovery.
0
Digoxin Dosing/Monitoring
White, 1984 [7]
4
CCDSS (Health Evaluation through Logical Processing [HELP]) identified concerns (drug interactions or signs of potential digoxin intoxication) in inpatients taking digoxin.
1/.../396*
Physician compliance with alerts.
+
...
...
Peck, 1973 [4]
6
CCDSS provided a digoxin dosing scheme for outpatients with congestive heart failure.
1/4/42*
Errors for prediction of serum digoxin level.
+
Digoxin toxicity and congestive heart failure index.
0
Lidocaine Dosing
Rodman, 1984 [6]
6
CCDSS recommended lidocaine dosing for patients in intensive or coronary care units.
1/.../20*
Plasma lidocaine levels in therapeutic range (1.5 to 5.0 μg/mL).
+
Toxic response requiring lidocaine discontinuation or dosage reduction.
0
Miscellaneous
Matheny, 2008 [34]
8
CCDSS generated reminders for routine laboratory testing in primary care patients taking specified medications.
20*/303/1,922
Physician compliance with reminders.
0
...
...
Judge, 2006 [32]
8
CCDSS provided real-time alerts when ordered drugs posed potential risks, required monitoring, or needed action to prevent adverse events in a long-term care setting.
1*/27/445
Physician compliance with alerts.
0
...
...
Overhage, 1997 [21]
8
CCDSS determined corollary orders for 87 target orders and displayed these on-line to physicians using the CPOE. CCDSS identified corollary orders to prevent errors of omission for any of 87 target tests and treatments in hospital inpatients.
1*/92/2,181
Compliance with corollary orders and pharmacists interventions with physicians for significant errors.
+
Hospital length of stay and maximum serum creatinine level during hospital stay.
0
Abbreviations: AF, atrial fibrillation; CCDSS, computerized clinical decision support system; CPOE, computerized order entry system; INR, international normalized ratio; IV, intravenous; N/A, not available; PE, pulmonary embolism; PR, prothrombin ratio; PT, prothrombin time; SE, systemic embolism; VTE, venous thromboembolism.
*Unit of allocation.
aEllipses (...) indicate item was not assessed or is not evaluable for effect.
bScore range 0 to 10, 10, higher quality score.
cOutcomes are evaluated for effect as positive (+) or negative (-) for CCDSS, or no effect (0), based on the following hierarchy. An effect is defined as ≥50% of relevant outcomes showing a statistically significant difference (2p < 0.05):
1. If a single primary outcome is reported, in which all components are applicable, this is the only outcome evaluated.
2. If > 1 primary outcome is reported, the ≥50% rule applies and only the primary outcomes are evaluated.
3. If no primary outcomes are reported (or only some of the primary outcome components are relevant) but overall analyses are provided, the overall analyses are evaluated as primary outcomes. Subgroup analyses are not considered.
4. If no primary outcomes or overall analyses are reported, or only some components of the primary outcome are relevant for the application, any reported prespecified outcomes are evaluated.
5. If no clearly prespecified outcomes are reported, any available outcomes are considered.
6. If statistical comparisons are not reported, 'effect' is designated as not evaluated (...).

Study quality

The quality score of studies generally improved over time, mainly due to better follow-up of patients (see Additional file 1, Table S1). However, no studies had a perfect score and concealed study group allocation before randomization and cluster randomization were infrequent.

CCDSS and study characteristics

CCDSSs were generally stand-alone computer systems (25/33, 76%) [4, 6, 820, 2225, 2729, 33, 3539] (Additional file 2, Table S2). Most were used by physicians for decision making, (28/33, 85%) [419, 21, 23, 24, 2637], the rest by other health professionals. Recommendations were usually delivered at the time of care (27/31, 87%) [47, 1014, 1619, 2126, 2932, 3439] on a desktop or laptop computer (16/25, 64%) [4, 10, 15, 16, 18, 21, 2326, 3034, 39]. Pilot testing was done in 48% (13/27) [6, 8, 9, 16, 20, 22, 2426, 30, 33, 34, 39], training was provided to users in 55% (17/31) [6, 7, 9, 10, 12, 17, 19, 20, 24, 25, 27, 28, 30, 31, 3337, 39], and the authors were the developers of the CCDSS in 59% (17/29) of studies [57, 10, 11, 13, 16, 19, 21, 22, 26, 3034, 39].
Additional file 3, Table S3 shows the characteristics of the 33 included RCTs [439]. A total of 24,627 patients were included, including one study with 13,219 patients and only six other studies [19, 21, 2628, 31, 3437] with more than 500 patients. The number of clinics within studies varied from 1 to 66, with the majority being performed at a single centre (63%) [49, 1318, 2123, 29, 30, 32, 38], and most involved academic centres (73%) [47, 9, 10, 12, 14, 15, 1824, 26, 29, 31, 32, 3439]. Financial support was provided by public funding in 16 studies [4, 6, 8, 9, 14, 19, 21, 22, 24, 25, 31, 32, 3439], private funding in eight studies [8, 12, 13, 16, 19, 27, 28, 3537, 39] (four had both), and 13 studies [5, 7, 10, 11, 15, 17, 18, 20, 23, 26, 29, 30, 33] did not report a funding source.

CCDSS effectiveness

Table 1 summarizes the effectiveness of all CCDSSs on TDMD and Additional file 4, Table S4 provides extensive outcome details. Overall, 60% of studies (18/30) [47, 1013, 19, 21, 24, 26, 29, 30, 33, 3539] showed an improvement for process of care, and 21% (4/19) for patient outcomes [10, 33, 38, 39]. It has to be noted that in Cavalcanti et al. the CCDSS scored positive on three of four patient outcomes and was therefore positive, but the proportion of patients with hypoglycaemia was actually worse than control [39]. Of seven cluster RCTs [14, 21, 25, 27, 28, 31, 32, 34] only one showed an effect on process of care [21], and none showed an effect on patient outcomes. Not all studies assessed both types of outcomes, and we could not determine an effect for either outcome in three [16, 20, 23] because data were insufficient or not directly compared for CCDSS and control.

Vitamin K antagonist dosing

Vitamin K antagonist (VKA) dosing RCTs (n = 14) [9, 10, 15, 1820, 2229, 3537] were generally of moderate quality (Table 1). Taking all VKA studies together, process of care was improved in 50% (6/12) [10, 19, 24, 26, 29, 3537] of studies with evaluable outcomes, and in meta-analysis the proportion of time in the therapeutic range for the blood International Normalized Ratio (INR) value was improved by CCDSSs (6.14%; 95% CI 0.46 to 11.83 increase; p = 0.03) (Figure 2). Patient outcomes were improved in 17% (1/6) of studies [10].
VKA initiation or inpatient therapy representing potentially unstable periods and assessed with a variety of outcomes in five RCTs [9, 10, 22, 26, 29] as shown in Additional file 4, Table S4, was improved in two studies (40%) [10, 29]. When combining inpatient data from Vadher et al. [22] and Mitra et al. [29] in meta-analysis (Figure 2), CCDSS significantly improved the proportion of time in the therapeutic INR range for initiation therapy (13.01%; 95% CI, 2.89 to 23.13 increase; p = 0.01), but the effects were heterogeneous (I2 = 71%) and the sample sizes small. White et al. [10] showed a shortened length of hospital stay with the CCDSS initiation therapy (see Additional file 4, Table S4).
VKA maintenance therapy was assessed in 10 RCTs [15, 18, 19, 2228, 3537] by means of the proportion of time in the therapeutic INR range, INR return interval, or ability to achieve the target prothrombin time (PT) value, and five (50%) [19, 22, 24, 26, 3537] showed an improvement (see Additional file 4, Table S4). When pooling five studies [22, 24, 25, 27, 28, 3537] with sufficient outpatient data on the proportion of time in the therapeutic INR range and its variability in meta-analysis (Figure 2), CCDSSs did not significantly improve anticoagulation quality compared with care as usual (3.46%; 95% CI, -1.76 to 8.68; p = 0.19), and the effects were heterogeneous (I2 = 81%). Of note, the time in therapeutic INR range improved with CCDSS only 1.2% in the large study by Poller et al. and was worse than control in the study by Claes et al. Of 5 studies [18, 25, 27, 28, 3537] assessing an effect on VKA maintenance therapy on patient outcomes, none found an improvement (see Additional file 4, Table S4). Combining major bleeding rates of 7 studies [10, 1820, 22, 27, 35] in meta-analysis showed no significant lower risk with CCDSS (risk ratio of 0.87; 95% CI, 0.68 to 1.10; p = 0.24) compared with control (Figure 3).

Theophylline/aminophylline dosing

Of four RCTs of theophylline or aminophylline dosing [8, 12, 17, 31], only Gonzalez et al. [12] showed an improvement in process of care by means of a higher plasma theophylline level with the CCDSS in the first hours of intravenous aminophylline therapy (Table 1). Tierney et al. [31] showed no effect on primary care provider adherence to theophylline dosing recommendations, and both Casner et al. [17] and Hurley et al. [8] showed no effect on achieving therapeutic theophylline levels. No CCDSS significantly improved patient outcomes, including pulmonary function and drug toxicity.

Insulin dosing/glycaemic regulation

Of six identified RCTs [5, 16, 30, 33, 38, 39] assessing the effect of CCDSS on insulin dosing for glycaemic regulation, the four most recent studies [30, 33, 38, 39] were of highest quality. All five evaluable studies [5, 30, 33, 38, 39] measuring process of care showed an improvement (Table 1). Among intensive care unit patients, Cavalcanti et al. [39] and Saager et al. [38] reported a higher proportion of time with glucose levels in the therapeutic target range. Albisser et al. [33] showed a decrease in the required insulin dose in primary care, Rood et al. [30] a better adherence to guideline recommendations for glucose measurement intervals and insulin dosing in critically ill patients, and McDonald [5] an increased adherence to a range of recommended laboratory tests and medication changes. Three studies assessed patient outcomes. Cavalcanti et al. [39] and Saager et al. [38] reported lower glucose levels but a higher rate of hypoglycaemia episodes with the CCDSS, and Saager et al. [38] found no change in admission duration. Albisser et al. [33] reported a decreased number of hypoglycaemia episodes, but no change in mean HbA1c levels.

Aminoglycoside dosing

Three older RCTs [11, 13, 14] assessed CCDSSs' effect on dosing of aminoglycosides among inpatients with clinical infections. Burton et al. [14] showed no effect of the CCDSS on achieving both therapeutic peak and trough aminoglycoside levels, while Begg et al. [11] and the qualitatively poorer Hickling et al. [13] study found an improvement (see Additional file 4, Table S4). No significant effects were found on patient outcomes, encompassing mortality, therapy success, nephrotoxicity, and creatinine clearance (see Additional file 4, Table S4).

Digoxin dosing

Two older RCTs [4, 7] compared CCDSS-guided digoxin dosing with usual care. White et al. [7] showed an increase in recommended test ordering and digoxin dosing with the CCDSS in hospitalised patients. Peck et al. [4] showed improved digoxin serum level prediction among outpatients with heart failure, but showed no effect on patient outcomes.

Lidocaine dosing

One RCT [6] tested a CCDSS for lidocaine dosing. Among patients admitted to the intensive care unit, the mean lidocaine plasma level achieved by the CCDSS was closer to the middle of the therapeutic target range than with usual care.

Multiple treatment issues

Three cluster-RCTs [21, 32, 34] assessed the effect of a CCDSS on multiple drug therapy issues, including TDMD. Matheny et al. [34] showed no effect on overdue laboratory test ordering to assess therapeutic drug levels in primary care. In a long-term care setting, Judge et al. [32] reported a higher number of actions taken in relation to identified concerns with warfarin management, but no other TDMD related effects. Overhage et al. [21] showed an improvement in immediate compliance with on-line displayed corollary orders on a general medicine ward, including insulin, warfarin, digoxin and aminoglycosides, but these separate areas were not statistically tested. This CCDSS did not alter length of hospital stay or the maximum serum creatinine level.

Costs and practical process related outcomes

Ageno et al. [23] reported that 4.9% of recommendations were overruled by the physician for vitamin K antagonist dosing, with rates of 10.9% for Poller et al. 2008 [3537] and <20% for Manotti et al. [26]. Claes et al. [27, 28] described that the CoaguCheck, a point-of-care INR monitoring tool, scored higher for implementation preference than the CCDSS and regular performance feedback. Rood et al. [30] reported that a majority of practitioners were satisfied with the CCDSS, but no numbers were given. Cavalcanti et al. [39] found that nurses perceived the CCDSS to be equally complex and time consuming as conventional care, and 56% preferred adoption of the CCDSS.
Costs related to CCDSS use were reported in several studies, but few provided details on data collection and calculation methods. Fitzmaurice et al. [20] indicated that the initial costs of their warfarin CCDSS could be offset after 92 patient visits and Fitzmaurice et al. [25] reported that their warfarin CCDSS was associated with increased costs due to the initiation phase and increased INR testing. Tierney et al. [31] reported that the costs of a CCDSS for asthma and COPD management were significantly elevated when handled by physicians, Burton et al. [14] that there was a 4.09:1.00 benefit:cost ratio in favour of their CCDSS for aminoglycoside dosing, and Overhage et al. [21] that there was no effect on costs.

Discussion

CCDSSs can improve the quality of insulin dosing for glycaemic control (improvement was based on at least 50% of the relevant study outcomes being statistically significantly positive), but longer term effects on patient outcomes are unknown. CCDSS improved the quality of vitamin K antagonist dosing as measured by time in therapeutic range, but effects were heterogeneous, RCTs were generally of modest size and quality, and a 13,000 patient study failed to show an effect on patient outcomes [3537]. Current evidence is too inconclusive to recommend specific systems for TDMD. More potent CCDSS interventions need to be developed. Future trials should be performed by independent researchers, randomize non-specialised clinics, and primarily assess patient outcomes related to drug efficacy and safety.

CCDSS effect on therapeutic drug monitoring and dosing

Overall, 60% of studies showed an improvement in process of care with the CCDSS, which is comparable to the 63% in the 2005 review [1]. Results were not consistent among studies, even when evaluating the same drug or the same CCDSS. This may relate to many factors, including variation in the study design, clinical setting, patient population, software specifications, and CCDSS workflow integration. Only 21% showed an improvement in patient outcomes, and although this is higher than the 11% in the 2005 review, most of these studies were still underpowered for this purpose [1]. A recently published review also summarized the evidence for the effect of CCDSSs on therapeutic drug dosing, but only reported studies until 2007, including three non-randomized controlled trials, and did not report the results of individual studies or drug classes but rather standardized effect measures [45]. Our report provides detailed information for RCT evidence per drug, while valuing the most relevant outcomes for decision-making.
The largest volume of RCT evidence was available for the effect of CCDSSs on vitamin K antagonist dosing, a group of oral anticoagulants widely used for thromboprophylaxis of which warfarin is the most common. The aim of a CCDSS for vitamin K antagonist dosing should be to establish a stable therapeutic INR in a timely manner, and to maintain INRs within the therapeutic range for the long term to minimize the risk for thromboembolism and bleeding. The improvement of 6% in time in therapeutic INR range among the studies in meta-analysis would theoretically mean a relative 6% reduced risk of stroke [46]. It could also mean the difference for a clinic of being above or below the threshold for a benefit of VKA over antiplatelet therapy [47]. However, most of these RCTs were small and of modest methodological quality, and the effect achieved statistical significance among inpatient but not outpatient studies. The CCDSS for vitamin K antagonist dosing with the most extensive RCT evidence, the DAWN AC program, improved process of care in three [24, 29, 3537] of five [23, 24, 2729, 3537] studies, but not patient outcomes in a large study designed to test this [3537].
CCDSSs for insulin dosing generally kept glucose levels better in the target range, with an inconsistent lower risk for hypoglycaemia. Improving glycaemic control while minimizing hypoglycaemia may be essential to improve long-term patient outcomes, but this cannot be assumed, given recent trials of intensified diabetes care [48], and none of the CCDSS studies assessed meaningful longer term patient benefits.
Remaining drugs had less extensive RCT evidence. CCDSSs hardly improved dosing and safety for theophylline, a drug used prophylactically and acutely for respiratory diseases. Aminoglycosides, a group of antibiotics, digoxin, a cardiac glycoside, and lidocaine, an antiarrhythmic drug, had some indication that a CCDSS can improve dosing, but RCTs were of moderate quality and no new evidence has been reported in the past 20 years. Three studies assessing CCDSS effects on appropriate blood test ordering for potentially toxic drugs did not consistently show an improvement. This might indicate that a CCDSS for TDMD might not improve care by reminding healthcare providers of test ordering, but primarily by assistance for dose adjustment.

Methodological aspects of CCDSSs and studies

Full intervention details were often incomplete, but are needed to understand how the CCDSS affects the clinical decision making process in order to advance the development and integration of effective systems. For example, we know that most CCDSSs were stand-alone systems, but to minimize the CCDSS burden on clinical workflow a shift from stand-alone systems requiring separate data entry to system integration with electronic medical records could be useful. Further, most CCDSSs were primarily handled by physicians, while a trained nurse handling the CCDSS with back up from a physician might further improve workflow in a cost-effective manner.
CCDSSs were often compared with specialists. This makes it harder to show an effect and it also limits the extrapolation of results because many patients taking vitamin K antagonists or insulin are being managed by non-specialised physicians, who will probably benefit most from a CCDSS. It will be essential to develop inexpensive and user-friendly systems to make CCDSSs attractive for non-specialists.
Although all studies were RCTs, many studies were of modest quality for remaining potential sources of bias. Few studies randomized clinical sites, rather than patients, which is an accepted method to minimize cross-over effects. The implementation of a CCDSS impacts care on an organizational level, and randomizing patients within the same clinic raises the concern of contaminating the control group with management effects from the CCDSS group, which could conceal a true effect. In contrast, finding an improvement while not using cluster randomization could indicate that there is surely a CCDSS effect. In our review, cluster RCTs less often showed an effect than patient randomized RCTs. However, considering that the latter were mostly single centre studies, this raises the concern that the local researcher might promote it to be a success, undermining the external validity of the positive result.
Another key methodological issue is the choice of outcome measures. A large variety of process measures were obtained, making it hard to compare or pool results of individual studies. TDMD should primarily be evaluated for rapidly achieving and adequately maintaining therapeutic serum levels of the monitored blood value. For example, one can report the mean maintenance dose for a vitamin K antagonist, but this provides little information because the main aim of the CCDSS should be to keep the INR within the therapeutic range, whichever dose this requires. CCDSS should also improve meaningful patient outcomes, and current research lacks this evidence. However, we do acknowledge that improving process measures that have previously improved outcomes is useful, because studies assessing patient outcomes typically require larger sample sizes and more funding.

Limitations

Several studies reported incomplete data for evaluation of the CCDSS effects. Further, we included a variety of drugs and healthcare settings. These factors combined made it problematic to pool results, except for some VKA dosing studies. We chose not to convert overall results to general effect estimates for pooling of results, because this could provide spurious conclusions. We used 'vote counting' to assess the number of studies that were positive, whereby a study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive. This approach does not give insight in the magnitude of effects and may have underestimated the overall efficacy. On the other hand, there is a risk for publication bias of positive RCTs, which could cause overestimation of CCDSS efficacy. We reported limited details on CCDSS implementation in the final paragraph of the Results, but more extensive data are being collected from the authors and will be reported in a future publication on determinants of CCDSS success among all 166 RCTs. Some of the drugs are not as frequently used as at the time of the study, but their inclusion still adds to the general notion of CCDSS effects on TDMD. Finally, the knowledge basis for CCDSS recommendations should be well established, and weaker evidence underlying certain CCDSSs might have prevented strong adherence and thereby success.

Clinical implications

Ideally, decision makers should consider a CCDSS that has shown a convincing effect on patient outcomes in more than one study, and value this against its burden on costs and workflow. Computer-assisted decision support for therapeutic drug monitoring and dosing is a promising area in development, especially for insulin and vitamin K antagonist dosing, but evaluations are unconvincing to date, and no specific system can be clearly recommended at this stage.

Conclusions

CCDSSs have potential for improving process of care for TDMD, specifically insulin and vitamin K antagonist dosing. However, studies were generally small and of modest quality, effects on patient outcomes were uncertain, with no convincing benefit in the largest studies. At present, no firm recommendation for specific systems can be given. More potent CCDSSs need to be developed and should be evaluated by independent researchers using cluster randomization and primarily assess patient outcomes related to drug efficacy and safety.

Acknowledgements

The research was funded by a Canadian Institutes of Health Research Synthesis Grant: Knowledge Translation KRS 91791. The members of the Computerized Clinical Decision Support System (CCDSS) Systematic Review Team included the Principal Investigator, Co-Investigators, Co-Applicants/Senior Management Decision-makers, Co-Applicants/Clinical Service Decision-Makers, and Research Staff. The following were involved in collection and/or organization of data: Jeanette Prorok, MSc, McMaster University; Nathan Souza, MD, MMEd, McMaster University; Brian Hemens, BScPhm, MSc, McMaster University; Shikha Misra, BHSc, McMaster University; Jasmine Dhaliwal, BHSc, McMaster University; Navdeep Sahota, BHSc, University of Saskatchewan; Anita Ramakrishna, BHSc McMaster University; Pavel Roshanov, BSc, McMaster University; and Tahany Awad, MD, McMaster University. Nicholas Hobson, Dip.T., Chris Cotoi, BEng, EMBA, and Rick Parrish, Dip.T, at McMaster University provided programming and information technology support.
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://​creativecommons.​org/​licenses/​by/​2.​0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Competing interests

RBH, NLW, JAM, LWK, TN, RN, SJC received support through the Canadian Institutes of Health Research Synthesis Grant: Knowledge Translation KRS 91791 for the submitted work. RBH is acquainted with several CCDSS developers and researchers, including authors of papers included in this review.

Authors' contributions

RBH was responsible for study conception and design; acquisition, analysis, and interpretation of data; drafting and critical revision of the manuscript; obtaining funding; and study supervision. He is the guarantor. RN acquired, analyzed, and interpreted data; drafted the manuscript; and provided statistical analysis. SJC analyzed and interpreted the data; and critically revised the manuscript. JAM acquired, analyzed, and interpreted data; drafted the manuscript; critically revised the manuscript; and provided statistical analysis as well as administrative, technical, or material support. LWK and TN acquired data and drafted the manuscript. NLW acquired, analyzed, and interpreted data; drafted the manuscript; provided administrative, technical, or material support; and provided study supervision. All authors have read and approved the final manuscript.
Literatur
1.
Zurück zum Zitat Garg AX, Adhikari NK, McDonald H, Rosas-Arellano M, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano M, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
2.
Zurück zum Zitat Haynes RB, Wilczynski NL, the Computerized Clinical Decision Support System (CCDSS) Systematic Review Team: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: methods of a decision-maker-research partnership systematic review. Implement Sci. 2010, 5: 12-CrossRefPubMedPubMedCentral Haynes RB, Wilczynski NL, the Computerized Clinical Decision Support System (CCDSS) Systematic Review Team: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: methods of a decision-maker-research partnership systematic review. Implement Sci. 2010, 5: 12-CrossRefPubMedPubMedCentral
3.
Zurück zum Zitat Haynes RB, Cotoi C, Holland J, Walters L, Wilczynski N, Jedraszewski D, McKinlay J, Parrish R, McKibbon KA, McMaster Premium Literature Service (PLUS) Project: Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006, 295 (15): 1801-1808. 10.1001/jama.295.15.1801.CrossRefPubMed Haynes RB, Cotoi C, Holland J, Walters L, Wilczynski N, Jedraszewski D, McKinlay J, Parrish R, McKibbon KA, McMaster Premium Literature Service (PLUS) Project: Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006, 295 (15): 1801-1808. 10.1001/jama.295.15.1801.CrossRefPubMed
4.
Zurück zum Zitat Peck CC, Sheiner LB, Martin CM, Combs DT, Melmon KL: Computer-assisted digoxin therapy. N Engl J Med. 1973, 289 (9): 441-446. 10.1056/NEJM197308302890902.CrossRefPubMed Peck CC, Sheiner LB, Martin CM, Combs DT, Melmon KL: Computer-assisted digoxin therapy. N Engl J Med. 1973, 289 (9): 441-446. 10.1056/NEJM197308302890902.CrossRefPubMed
5.
Zurück zum Zitat Mc Donald CJ: Use of a computer to detect and respond to clinical events: its effect on clinician behavior. Ann Intern Med. 1976, 84 (2): 162-167.CrossRefPubMed Mc Donald CJ: Use of a computer to detect and respond to clinical events: its effect on clinician behavior. Ann Intern Med. 1976, 84 (2): 162-167.CrossRefPubMed
6.
Zurück zum Zitat Rodman JH, Jelliffe RW, Kolb E, Tuey DB, de Guzman MF, Wagers PW, Haywood LJ: Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984, 144 (4): 703-709. 10.1001/archinte.144.4.703.CrossRefPubMed Rodman JH, Jelliffe RW, Kolb E, Tuey DB, de Guzman MF, Wagers PW, Haywood LJ: Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984, 144 (4): 703-709. 10.1001/archinte.144.4.703.CrossRefPubMed
7.
Zurück zum Zitat White KS, Lindsay A, Pryor TA, Brown WF, Walsh K: Application of a computerized medical decision-making process to the problem of digoxin intoxication. J Am Coll Cardiol. 1984, 4 (3): 571-576. 10.1016/S0735-1097(84)80104-7.CrossRefPubMed White KS, Lindsay A, Pryor TA, Brown WF, Walsh K: Application of a computerized medical decision-making process to the problem of digoxin intoxication. J Am Coll Cardiol. 1984, 4 (3): 571-576. 10.1016/S0735-1097(84)80104-7.CrossRefPubMed
8.
Zurück zum Zitat Hurley SF, Dziukas LJ, McNeil JJ, Brignell MJ: A randomized controlled clinical trial of pharmacokinetic theophylline dosing. Am Rev Respir Dis. 1986, 134 (6): 1219-1224.PubMed Hurley SF, Dziukas LJ, McNeil JJ, Brignell MJ: A randomized controlled clinical trial of pharmacokinetic theophylline dosing. Am Rev Respir Dis. 1986, 134 (6): 1219-1224.PubMed
9.
Zurück zum Zitat Carter BL, Taylor JW, Becker A: Evaluation of three dosage-prediction methods for initial in-hospital stabilization of warfarin therapy. Clin Pharm. 1987, 6 (1): 37-45.PubMed Carter BL, Taylor JW, Becker A: Evaluation of three dosage-prediction methods for initial in-hospital stabilization of warfarin therapy. Clin Pharm. 1987, 6 (1): 37-45.PubMed
10.
Zurück zum Zitat White RH, Hong R, Venook AP, Daschbach MM, Murray W, Mungall DR, Coleman RW: Initiation of warfarin therapy: comparison of physician dosing with computer-assisted dosing. J Gen Intern Med. 1987, 2 (3): 141-148. 10.1007/BF02596140.CrossRefPubMed White RH, Hong R, Venook AP, Daschbach MM, Murray W, Mungall DR, Coleman RW: Initiation of warfarin therapy: comparison of physician dosing with computer-assisted dosing. J Gen Intern Med. 1987, 2 (3): 141-148. 10.1007/BF02596140.CrossRefPubMed
11.
Zurück zum Zitat Begg EJ, Atkinson HC, Jeffery GM, Taylor NW: Individualised aminoglycoside dosage based on pharmacokinetic analysis is superior to dosage based on physician intuition at achieving target plasma drug concentrations. Br J Clin Pharmacol. 1989, 28 (2): 137-141.CrossRefPubMedPubMedCentral Begg EJ, Atkinson HC, Jeffery GM, Taylor NW: Individualised aminoglycoside dosage based on pharmacokinetic analysis is superior to dosage based on physician intuition at achieving target plasma drug concentrations. Br J Clin Pharmacol. 1989, 28 (2): 137-141.CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Gonzalez ER, Vanderheyden BA, Ornato JP, Comstock TG: Computer-assisted optimization of aminophylline therapy in the emergency department. Am J Emerg Med. 1989, 7 (4): 395-401. 10.1016/0735-6757(89)90046-6.CrossRefPubMed Gonzalez ER, Vanderheyden BA, Ornato JP, Comstock TG: Computer-assisted optimization of aminophylline therapy in the emergency department. Am J Emerg Med. 1989, 7 (4): 395-401. 10.1016/0735-6757(89)90046-6.CrossRefPubMed
13.
Zurück zum Zitat Hickling K, Begg E, Moore ML: A prospective randomised trial comparing individualised pharmacokinetic dosage prediction for aminoglycosides with prediction based on estimated creatinine clearance in critically ill patients. Intensive Care Med. 1989, 15 (4): 233-237. 10.1007/BF00271057.CrossRefPubMed Hickling K, Begg E, Moore ML: A prospective randomised trial comparing individualised pharmacokinetic dosage prediction for aminoglycosides with prediction based on estimated creatinine clearance in critically ill patients. Intensive Care Med. 1989, 15 (4): 233-237. 10.1007/BF00271057.CrossRefPubMed
14.
Zurück zum Zitat Burton ME, Ash CL, Hill DP, Handy T, Shepherd MD, Vasko MR: A controlled trial of the cost benefit of computerized bayesian aminoglycoside administration. Clin Pharmacol Ther. 1991, 49 (6): 685-694. 10.1038/clpt.1991.86.CrossRefPubMed Burton ME, Ash CL, Hill DP, Handy T, Shepherd MD, Vasko MR: A controlled trial of the cost benefit of computerized bayesian aminoglycoside administration. Clin Pharmacol Ther. 1991, 49 (6): 685-694. 10.1038/clpt.1991.86.CrossRefPubMed
15.
Zurück zum Zitat White RH, Mungall D: Outpatient management of warfarin therapy: comparison of computer-predicted dosage adjustment to skilled professional care. Ther Drug Monit. 1991, 13 (1): 46-50. 10.1097/00007691-199101000-00006.CrossRefPubMed White RH, Mungall D: Outpatient management of warfarin therapy: comparison of computer-predicted dosage adjustment to skilled professional care. Ther Drug Monit. 1991, 13 (1): 46-50. 10.1097/00007691-199101000-00006.CrossRefPubMed
16.
Zurück zum Zitat Ryff-de Leche A, Engler H, Nutzi E, Berger M, Berger W: Clinical application of two computerized diabetes management systems: comparison with the log-book method. Diabetes Res. 1992, 19 (3): 97-105.PubMed Ryff-de Leche A, Engler H, Nutzi E, Berger M, Berger W: Clinical application of two computerized diabetes management systems: comparison with the log-book method. Diabetes Res. 1992, 19 (3): 97-105.PubMed
17.
Zurück zum Zitat Casner PR, Reilly R, Ho H: A randomized controlled trial of computerized pharmacokinetic theophylline dosing versus empiric physician dosing. Clin Pharmacol Ther. 1993, 53 (6): 684-690. 10.1038/clpt.1993.90.CrossRefPubMed Casner PR, Reilly R, Ho H: A randomized controlled trial of computerized pharmacokinetic theophylline dosing versus empiric physician dosing. Clin Pharmacol Ther. 1993, 53 (6): 684-690. 10.1038/clpt.1993.90.CrossRefPubMed
18.
Zurück zum Zitat Poller L, Wright D, Rowlands M: Prospective comparative study of computer programs used for management of warfarin. J Clin Pathol. 1993, 46 (4): 299-303. 10.1136/jcp.46.4.299.CrossRefPubMedPubMedCentral Poller L, Wright D, Rowlands M: Prospective comparative study of computer programs used for management of warfarin. J Clin Pathol. 1993, 46 (4): 299-303. 10.1136/jcp.46.4.299.CrossRefPubMedPubMedCentral
19.
Zurück zum Zitat Fihn SD, McDonell MB, Vermes D, Henikoff JG, Martin DC, Callahan CM, Kent DL, White RH: A computerized intervention to improve timing of outpatient follow-up: a multicenter randomized trial in patients treated with warfarin. National Consortium of Anticoagulation Clinics. J Gen Intern Med. 1994, 9 (3): 131-139. 10.1007/BF02600026.CrossRefPubMed Fihn SD, McDonell MB, Vermes D, Henikoff JG, Martin DC, Callahan CM, Kent DL, White RH: A computerized intervention to improve timing of outpatient follow-up: a multicenter randomized trial in patients treated with warfarin. National Consortium of Anticoagulation Clinics. J Gen Intern Med. 1994, 9 (3): 131-139. 10.1007/BF02600026.CrossRefPubMed
20.
Zurück zum Zitat Fitzmaurice DA, Hobbs FD, Murray ET, Bradley CP, Holder R: Evaluation of computerized decision support for oral anticoagulation management based in primary care. Br J Gen Pract. 1996, 46 (410): 533-535.PubMedPubMedCentral Fitzmaurice DA, Hobbs FD, Murray ET, Bradley CP, Holder R: Evaluation of computerized decision support for oral anticoagulation management based in primary care. Br J Gen Pract. 1996, 46 (410): 533-535.PubMedPubMedCentral
21.
Zurück zum Zitat Overhage JM, Tierney WM, Zhou XH, McDonald CJ: A randomized trial of 'corollary orders' to prevent errors of omission. J Am Med Inform Assoc. 1997, 4 (5): 364-375. 10.1136/jamia.1997.0040364.CrossRefPubMedPubMedCentral Overhage JM, Tierney WM, Zhou XH, McDonald CJ: A randomized trial of 'corollary orders' to prevent errors of omission. J Am Med Inform Assoc. 1997, 4 (5): 364-375. 10.1136/jamia.1997.0040364.CrossRefPubMedPubMedCentral
22.
Zurück zum Zitat Vadher B, Patterson DL, Leaning M: Evaluation of a decision support system for initiation and control of oral anticoagulation in a randomised trial. BMJ. 1997, 314 (7089): 1252-1256.CrossRefPubMedPubMedCentral Vadher B, Patterson DL, Leaning M: Evaluation of a decision support system for initiation and control of oral anticoagulation in a randomised trial. BMJ. 1997, 314 (7089): 1252-1256.CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Ageno W, Turpie AG: A randomized comparison of a computer-based dosing program with a manual system to monitor oral anticoagulant therapy. Thromb Res. 1998, 91 (5): 237-240. 10.1016/S0049-3848(98)00092-9.CrossRefPubMed Ageno W, Turpie AG: A randomized comparison of a computer-based dosing program with a manual system to monitor oral anticoagulant therapy. Thromb Res. 1998, 91 (5): 237-240. 10.1016/S0049-3848(98)00092-9.CrossRefPubMed
24.
Zurück zum Zitat Poller L, Shiach CR, MacCallum PK, Johansen AM, Munster AM, Magalhaes A, Jespersen J: Multicentre randomised study of computerised anticoagulant dosage. European Concerted Action on Anticoagulation. Lancet. 1998, 352 (9139): 1505-1509. 10.1016/S0140-6736(98)04147-6.CrossRefPubMed Poller L, Shiach CR, MacCallum PK, Johansen AM, Munster AM, Magalhaes A, Jespersen J: Multicentre randomised study of computerised anticoagulant dosage. European Concerted Action on Anticoagulation. Lancet. 1998, 352 (9139): 1505-1509. 10.1016/S0140-6736(98)04147-6.CrossRefPubMed
25.
Zurück zum Zitat Fitzmaurice DA, Hobbs FD, Murray ET, Holder RL, Allan TF, Rose PE: Oral anticoagulation management in primary care with the use of computerized decision support and near-patient testing: a randomized, controlled trial. Arch Intern Med. 2000, 160 (15): 2343-2348. 10.1001/archinte.160.15.2343.CrossRefPubMed Fitzmaurice DA, Hobbs FD, Murray ET, Holder RL, Allan TF, Rose PE: Oral anticoagulation management in primary care with the use of computerized decision support and near-patient testing: a randomized, controlled trial. Arch Intern Med. 2000, 160 (15): 2343-2348. 10.1001/archinte.160.15.2343.CrossRefPubMed
26.
Zurück zum Zitat Manotti C, Moia M, Palareti G, Pengo V, Ria L, Dettori AG: Effect of computer-aided management on the quality of treatment in anticoagulated patients: a prospective, randomized, multicenter trial of APROAT (Automated PRogram for Oral Anticoagulant Treatment). Haematologica. 2001, 86 (10): 1060-1070.PubMed Manotti C, Moia M, Palareti G, Pengo V, Ria L, Dettori AG: Effect of computer-aided management on the quality of treatment in anticoagulated patients: a prospective, randomized, multicenter trial of APROAT (Automated PRogram for Oral Anticoagulant Treatment). Haematologica. 2001, 86 (10): 1060-1070.PubMed
27.
Zurück zum Zitat Claes N, Buntinx F, Vijgen J, Arnout J, Vermylen J, Fieuws S, Van Loon H: The Belgian Improvement Study on Oral Anticoagulation Therapy: a randomized clinical trial. Eur Heart J. 2005, 26 (20): 2159-2165. 10.1093/eurheartj/ehi327.CrossRefPubMed Claes N, Buntinx F, Vijgen J, Arnout J, Vermylen J, Fieuws S, Van Loon H: The Belgian Improvement Study on Oral Anticoagulation Therapy: a randomized clinical trial. Eur Heart J. 2005, 26 (20): 2159-2165. 10.1093/eurheartj/ehi327.CrossRefPubMed
28.
Zurück zum Zitat Claes N, Moeremans K, Frank B, Jef A, Jos V, Herman VL, Lieven A: Estimating the cost-effectiveness of quality-improving interventions in oral anticoagulation management within general practice. Value Health. 2006, 9 (6): 369-376. 10.1111/j.1524-4733.2006.00129.x.CrossRefPubMed Claes N, Moeremans K, Frank B, Jef A, Jos V, Herman VL, Lieven A: Estimating the cost-effectiveness of quality-improving interventions in oral anticoagulation management within general practice. Value Health. 2006, 9 (6): 369-376. 10.1111/j.1524-4733.2006.00129.x.CrossRefPubMed
29.
Zurück zum Zitat Mitra R, Marciello MA, Brain C, Ahangar B, Burke DT: Efficacy of computer-aided dosing of warfarin among patients in a rehabilitation hospital. Am J Phys Med Rehabil. 2005, 84 (6): 423-427. 10.1097/01.phm.0000163716.00164.23.CrossRefPubMed Mitra R, Marciello MA, Brain C, Ahangar B, Burke DT: Efficacy of computer-aided dosing of warfarin among patients in a rehabilitation hospital. Am J Phys Med Rehabil. 2005, 84 (6): 423-427. 10.1097/01.phm.0000163716.00164.23.CrossRefPubMed
30.
Zurück zum Zitat Rood E, Bosman RJ, van der Spoel JI, Taylor P, Zandstra DF: Use of a computerized guideline for glucose regulation in the intensive care unit improved both guideline adherence and glucose regulation. J Am Med Inform Assoc. 2005, 12 (2): 172-180.CrossRefPubMedPubMedCentral Rood E, Bosman RJ, van der Spoel JI, Taylor P, Zandstra DF: Use of a computerized guideline for glucose regulation in the intensive care unit improved both guideline adherence and glucose regulation. J Am Med Inform Assoc. 2005, 12 (2): 172-180.CrossRefPubMedPubMedCentral
31.
Zurück zum Zitat Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou XH, Eckert GJ, Smith FE, Nienaber N, McDonald CJ, Wolinsky FD: Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. Health Serv Res. 2005, 40 (2): 477-497. 10.1111/j.1475-6773.2005.0t369.x.CrossRefPubMedPubMedCentral Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou XH, Eckert GJ, Smith FE, Nienaber N, McDonald CJ, Wolinsky FD: Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. Health Serv Res. 2005, 40 (2): 477-497. 10.1111/j.1475-6773.2005.0t369.x.CrossRefPubMedPubMedCentral
32.
Zurück zum Zitat Judge J, Field TS, DeFlorio M, Laprino J, Auger J, Rochon P, Bates DW, Gurwitz JH: Prescribers' responses to alerts during medication ordering in the long term care setting. J Am Med Inform Assoc. 2006, 13 (4): 385-390. 10.1197/jamia.M1945.CrossRefPubMedPubMedCentral Judge J, Field TS, DeFlorio M, Laprino J, Auger J, Rochon P, Bates DW, Gurwitz JH: Prescribers' responses to alerts during medication ordering in the long term care setting. J Am Med Inform Assoc. 2006, 13 (4): 385-390. 10.1197/jamia.M1945.CrossRefPubMedPubMedCentral
33.
Zurück zum Zitat Albisser AM, Wright CE, Sakkal S: Averting iatrogenic hypoglycemia through glucose prediction in clinical practice: progress towards a new procedure in diabetes. Diabetes Res Clin Pract. 2007, 76 (2): 207-214. 10.1016/j.diabres.2006.09.007.CrossRefPubMed Albisser AM, Wright CE, Sakkal S: Averting iatrogenic hypoglycemia through glucose prediction in clinical practice: progress towards a new procedure in diabetes. Diabetes Res Clin Pract. 2007, 76 (2): 207-214. 10.1016/j.diabres.2006.09.007.CrossRefPubMed
34.
Zurück zum Zitat Matheny ME, Sequist TD, Seger AC, Fiskio JM, Sperling M, Bugbee D, Bates DW, Gandhi TK: A randomized trial of electronic clinical reminders to improve medication laboratory monitoring. J Am Med Inform Assoc. 2008, 15 (4): 424-429. 10.1197/jamia.M2602.CrossRefPubMedPubMedCentral Matheny ME, Sequist TD, Seger AC, Fiskio JM, Sperling M, Bugbee D, Bates DW, Gandhi TK: A randomized trial of electronic clinical reminders to improve medication laboratory monitoring. J Am Med Inform Assoc. 2008, 15 (4): 424-429. 10.1197/jamia.M2602.CrossRefPubMedPubMedCentral
35.
Zurück zum Zitat Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Shiach C, Bryan S, Samama M, Burgess-Wilson M, Heagerty A, Maccallum P, Wright D, Jespersen J: An international multicenter randomized study of computer-assisted oral anticoagulant dosage vs. medical staff dosage. J Thromb Haemost. 2008, 6 (6): 935-943. 10.1111/j.1538-7836.2008.02959.x.CrossRefPubMed Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Shiach C, Bryan S, Samama M, Burgess-Wilson M, Heagerty A, Maccallum P, Wright D, Jespersen J: An international multicenter randomized study of computer-assisted oral anticoagulant dosage vs. medical staff dosage. J Thromb Haemost. 2008, 6 (6): 935-943. 10.1111/j.1538-7836.2008.02959.x.CrossRefPubMed
36.
Zurück zum Zitat Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Jespersen J: A multicentre randomised clinical endpoint study of PARMA 5 computer-assisted oral anticoagulant dosage. Br J Haematol. 2008, 143 (2): 274-283. 10.1111/j.1365-2141.2008.07337.x.CrossRefPubMed Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Jespersen J: A multicentre randomised clinical endpoint study of PARMA 5 computer-assisted oral anticoagulant dosage. Br J Haematol. 2008, 143 (2): 274-283. 10.1111/j.1365-2141.2008.07337.x.CrossRefPubMed
37.
Zurück zum Zitat Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Shiach C, Bryan S, Samama M, Burgess-Wilson M, Heagerty A, Maccallum P, Wright D, Jespersen J, European Action on Anticoagulation (EAA): A multicentre randomised assessment of the DAWN AC computer-assisted oral anticoagulant dosage program. Thromb Haemost. 2009, 101 (3): 487-494.PubMed Poller L, Keown M, Ibrahim S, Lowe G, Moia M, Turpie AG, Roberts C, van den Besselaar AM, van der Meer FJ, Tripodi A, Palareti G, Shiach C, Bryan S, Samama M, Burgess-Wilson M, Heagerty A, Maccallum P, Wright D, Jespersen J, European Action on Anticoagulation (EAA): A multicentre randomised assessment of the DAWN AC computer-assisted oral anticoagulant dosage program. Thromb Haemost. 2009, 101 (3): 487-494.PubMed
38.
Zurück zum Zitat Saager L, Collins GL, Burnside B, Tymkew H, Zhang L, Jacobsohn E, Avidan M: A randomized study in diabetic patients undergoing cardiac surgery comparing computer-guided glucose management with a standard sliding scale protocol. J Cardiothorac Vasc Anesth. 2008, 22 (3): 377-382. 10.1053/j.jvca.2007.09.013.CrossRefPubMed Saager L, Collins GL, Burnside B, Tymkew H, Zhang L, Jacobsohn E, Avidan M: A randomized study in diabetic patients undergoing cardiac surgery comparing computer-guided glucose management with a standard sliding scale protocol. J Cardiothorac Vasc Anesth. 2008, 22 (3): 377-382. 10.1053/j.jvca.2007.09.013.CrossRefPubMed
39.
Zurück zum Zitat Cavalcanti AB, Silva E, Pereira AJ, Caldeira-Filho M, Almeida FP, Westphal GA, Beims R, Fernandes CC, Correa TD, Gouvea MR, Eluf-Neto J: A randomized controlled trial comparing a computer-assisted insulin infusion protocol with a strict and a conventional protocol for glucose control in critically ill patients. J Crit Care. 2009, 24 (3): 371-378. 10.1016/j.jcrc.2009.05.005.CrossRefPubMed Cavalcanti AB, Silva E, Pereira AJ, Caldeira-Filho M, Almeida FP, Westphal GA, Beims R, Fernandes CC, Correa TD, Gouvea MR, Eluf-Neto J: A randomized controlled trial comparing a computer-assisted insulin infusion protocol with a strict and a conventional protocol for glucose control in critically ill patients. J Crit Care. 2009, 24 (3): 371-378. 10.1016/j.jcrc.2009.05.005.CrossRefPubMed
40.
Zurück zum Zitat The Cochrane Collaboration: Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2 [updated September 2009]. 2009 The Cochrane Collaboration: Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2 [updated September 2009]. 2009
41.
Zurück zum Zitat The Cochrane Collaboration: Review Manager (RevMan). 2008, 5.0: The Cochrane Collaboration: Review Manager (RevMan). 2008, 5.0:
42.
Zurück zum Zitat Vadher BD, Patterson DL, Leaning M: Comparison of oral anticoagulant control by a nurse-practitioner using a computer decision-support system with that by clinicians. Clin Lab Haematol. 1997, 19 (3): 203-207. 10.1111/j.1365-2257.1997.tb00008.x.CrossRefPubMed Vadher BD, Patterson DL, Leaning M: Comparison of oral anticoagulant control by a nurse-practitioner using a computer decision-support system with that by clinicians. Clin Lab Haematol. 1997, 19 (3): 203-207. 10.1111/j.1365-2257.1997.tb00008.x.CrossRefPubMed
43.
Zurück zum Zitat Mungall DR, Anbe D, Forrester PL, Luoma T, Genovese R, Mahan J, LeBlanc S, Penney JB: A prospective randomized comparison of the accuracy of computer-assisted versus GUSTO nomogram--directed heparin therapy. Clin Pharmacol Ther. 1994, 55 (5): 591-596. 10.1038/clpt.1994.73.CrossRefPubMed Mungall DR, Anbe D, Forrester PL, Luoma T, Genovese R, Mahan J, LeBlanc S, Penney JB: A prospective randomized comparison of the accuracy of computer-assisted versus GUSTO nomogram--directed heparin therapy. Clin Pharmacol Ther. 1994, 55 (5): 591-596. 10.1038/clpt.1994.73.CrossRefPubMed
44.
Zurück zum Zitat Verner D, Seligmann H, Platt S, Dany S, Almog S, Zulty L, Halkin H, Ezra D: Computer assisted design of a theophylline dosing regimen in acute bronchospasm: serum concentrations and clinical outcome. Eur J Clin Pharmacol. 1992, 43 (1): 29-33. 10.1007/BF02280750.CrossRefPubMed Verner D, Seligmann H, Platt S, Dany S, Almog S, Zulty L, Halkin H, Ezra D: Computer assisted design of a theophylline dosing regimen in acute bronchospasm: serum concentrations and clinical outcome. Eur J Clin Pharmacol. 1992, 43 (1): 29-33. 10.1007/BF02280750.CrossRefPubMed
45.
Zurück zum Zitat Durieux P, Trinquart L, Colombet I, Nies J, Walton R, Rajeswaran A, Rege Walther M, Harvey E, Burnand B: Computerized advice on drug dosage to improve prescribing practice. Cochrane Database Syst Rev. 2008, 3: CD002894-PubMed Durieux P, Trinquart L, Colombet I, Nies J, Walton R, Rajeswaran A, Rege Walther M, Harvey E, Burnand B: Computerized advice on drug dosage to improve prescribing practice. Cochrane Database Syst Rev. 2008, 3: CD002894-PubMed
46.
Zurück zum Zitat Jones M, McEwan P, Morgan CL, Peters JR, Goodfellow J, Currie CJ: Evaluation of the pattern of treatment, level of anticoagulation control, and outcome of treatment with warfarin in patients with non-valvar atrial fibrillation: a record linkage study in a large British population. Heart. 2005, 91 (4): 472-477. 10.1136/hrt.2004.042465.CrossRefPubMedPubMedCentral Jones M, McEwan P, Morgan CL, Peters JR, Goodfellow J, Currie CJ: Evaluation of the pattern of treatment, level of anticoagulation control, and outcome of treatment with warfarin in patients with non-valvar atrial fibrillation: a record linkage study in a large British population. Heart. 2005, 91 (4): 472-477. 10.1136/hrt.2004.042465.CrossRefPubMedPubMedCentral
47.
Zurück zum Zitat Connolly SJ, Pogue J, Eikelboom J, Flaker G, Commerford P, Franzosi MG, Healey JS, Yusuf S, ACTIVE WI: Benefit of oral anticoagulant over antiplatelet therapy in atrial fibrillation depends on the quality of international normalized ratio control achieved by centers and countries as measured by time in therapeutic range. Circulation. 2008, 118 (20): 2029-2037. 10.1161/CIRCULATIONAHA.107.750000.CrossRefPubMed Connolly SJ, Pogue J, Eikelboom J, Flaker G, Commerford P, Franzosi MG, Healey JS, Yusuf S, ACTIVE WI: Benefit of oral anticoagulant over antiplatelet therapy in atrial fibrillation depends on the quality of international normalized ratio control achieved by centers and countries as measured by time in therapeutic range. Circulation. 2008, 118 (20): 2029-2037. 10.1161/CIRCULATIONAHA.107.750000.CrossRefPubMed
48.
Zurück zum Zitat Ray KK, Seshasai SR, Wijesuriya S, Sivakumaran R, Nethercott S, Preiss D, Erqou S, Sattar N: Effect of intensive control of glucose on cardiovascular outcomes and death in patients with diabetes mellitus: a meta-analysis of randomised controlled trials. Lancet. 2009, 373 (9677): 1765-1772. 10.1016/S0140-6736(09)60697-8.CrossRefPubMed Ray KK, Seshasai SR, Wijesuriya S, Sivakumaran R, Nethercott S, Preiss D, Erqou S, Sattar N: Effect of intensive control of glucose on cardiovascular outcomes and death in patients with diabetes mellitus: a meta-analysis of randomised controlled trials. Lancet. 2009, 373 (9677): 1765-1772. 10.1016/S0140-6736(09)60697-8.CrossRefPubMed
Metadaten
Titel
Computerized clinical decision support systems for therapeutic drug monitoring and dosing: A decision-maker-researcher partnership systematic review
verfasst von
Robby Nieuwlaat
Stuart J Connolly
Jean A Mackay
Lorraine Weise-Kelly
Tamara Navarro
Nancy L Wilczynski
R Brian Haynes
the CCDSS Systematic Review Team
Publikationsdatum
01.12.2011
Verlag
BioMed Central
Erschienen in
Implementation Science / Ausgabe 1/2011
Elektronische ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-6-90

Weitere Artikel der Ausgabe 1/2011

Implementation Science 1/2011 Zur Ausgabe