Randomized Controlled Trial of Contingency Management for Stimulant Use in Community Mental Health Patients With Serious Mental Illness
Abstract
Objective
The primary objective of this study was to determine whether contingency management was associated with increased abstinence from stimulant drug use in stimulant-dependent patients with serious mental illness treated in a community mental health center. Secondary objectives were to determine whether contingency management was associated with reductions in use of other substances, psychiatric symptoms, HIV risk behavior, and inpatient service utilization.
Method
A randomized controlled design was used to compare outcomes of 176 outpatients with serious mental illness and stimulant dependence. Participants were randomly assigned to receive 3 months of contingency management for stimulant abstinence plus treatment as usual or treatment as usual with reinforcement for study participation only. Urine drug tests and self-report, clinician-report, and service utilization outcomes were assessed during the 3-month treatment period and the 3-month follow-up period.
Results
Although participants in the contingency management condition were significantly less likely to complete the treatment period than those assigned to the control condition (42% compared with 65%), they were 2.4 times (95% CI=1.9–3.0) more likely to submit a stimulant-negative urine test during treatment. Compared with participants in the control condition, they had significantly lower levels of alcohol use, injection drug use, and psychiatric symptoms and were one-fifth as likely as those assigned to the control condition to be admitted for psychiatric hospitalization during treatment. They also reported significantly fewer days of stimulant drug use during the 3-month follow-up.
Conclusions
When added to treatment as usual, contingency management is associated with large reductions in stimulant, injection drug, and alcohol use. Reductions in psychiatric symptoms and hospitalizations are important secondary benefits.
Approximately 50% of adults with serious mental illness, such as schizophrenia spectrum, bipolar, and recurrent major depressive disorders, suffer from a substance use disorder at some point during their lives (1). Relative to people with only one of these conditions, individuals with co-occurring disorders have more severe substance use and psychiatric symptoms (2), poorer treatment adherence (3), and higher rates of homelessness (4), HIV infection (2), psychiatric hospitalization (5), emergency room use (6), and incarceration (7).
Despite the frequent co-occurrence of these disorders and associated detrimental outcomes, few individuals receive concurrent treatment for both conditions (8, 9). Integrated treatments delivered via individual (10, 11), group (12), case management (13), or multiple component (14) models have been associated with reductions in drug use. While these treatments have been associated with reduced psychiatric symptom severity in some studies, not all studies have obtained this result (15). Few individuals receive such treatments in community mental health centers, where most adults with co-occurring disorders receive care (8), for various reasons, including the cost of these interventions, organizational barriers, and the need for extensive training and adherence to these models (16–18).
Interventions that are less costly and easier to implement (e.g., do not require clinical staff, extensive training, supervision, and adherence ratings) are needed to improve outpatient treatment of co-occurring disorders. Contingency management is an evidence-based intervention in which individuals are provided with reinforcers (e.g., vouchers, prizes) based on abstinence from drugs. Contingency management is associated with the largest reductions in drug and alcohol use compared with all other psychosocial treatments (19). Contingency management has also demonstrated improved treatment retention and attendance (20, 21) and long-term efficacy (22, 23) in populations with psychiatric diagnoses below the threshold of serious mental illness. Initial evidence suggests similar improvements in treatment retention and abstinence for persons with serious mental illness (24, 25). Bellack and colleagues (14) observed reductions in drug use and hospitalizations, as well as increases in quality of life and financial management, in adults with co-occurring disorders who received a 6-month cognitive-behavioral group-based treatment that included contingencies for drug abstinence. These data suggest that contingency management may be an effective treatment approach for adults with co-occurring disorders. However, no adequately powered randomized controlled trial has been conducted to evaluate the efficacy of contingency management alone as an adjunct to treatment as usual for substance use disorders in seriously mentally ill outpatients.
Our primary aim in this study was to determine whether the addition of contingency management for psychostimulant drug abstinence would be successful in reducing stimulant use, as measured by urine drug tests and self-report, in persons with serious mental illness and stimulant dependence receiving treatment in a community mental health center. Our secondary aims were to determine whether contingency management was associated with reductions in use of other drugs and alcohol, drug use severity, psychiatric symptom severity, HIV risk behavior, and community problems (e.g., psychiatric hospitalizations and incarcerations). Stimulants were targeted because of the frequent abuse of these drugs by those with serious mental illness and the association between stimulant use and psychiatric symptom exacerbation (26).
Method
Participants
Participants were recruited from a multisite community mental health and addiction treatment agency in Seattle. To be eligible, participants had to have used stimulants during the past 30 days and had to meet Mini International Neuropsychiatric Interview criteria for methamphetamine, amphetamine, or cocaine dependence as well as criteria for schizophrenia, schizoaffective disorder, bipolar I or II disorder, or recurrent major depressive disorder. Exclusion criteria were presence of organic brain disorder, dementia, or medical disorders or psychiatric symptoms severe enough to compromise safe participation.
Overall, 205 individuals provided written informed consent for study participation. Of these, 201 completed the initial study assessment, and 197 met inclusion criteria (see the CONSORT diagram in the data supplement that accompanies the online edition of this article). Consistent with previous studies that used a noncontingent reinforcement control condition (27), the first five participants were assigned to the contingency management condition. Of the 192 individuals available for randomization, 176 returned for their second study visit, at which they were informed of their group assignment; these individuals are considered the intent-to-treat sample. Study procedures were approved by the University of Washington’s Human Subjects Division.
Design and Procedure
The study was a 3-month quasi-yoked randomized controlled trial of contingency management with a 3-month posttreatment follow-up period. Participants were randomly assigned to contingency management plus treatment as usual (N=91) or treatment as usual plus rewards for study participation only (noncontingent rewards; N=85). Randomization was conducted using the urn randomization procedure (28), balancing groups on gender, substance use severity, mood versus psychotic disorder, and psychiatric hospitalization in the past year.
Measures
Participants completed a structured psychiatric interview and study outcome measures. During the treatment phase, participants provided alcohol breath samples (Alco-Sensor III, Intoximeters, St. Louis) and urine samples for drug testing. Drugs were assessed using on-site immunoassays of amphetamine, methamphetamine, cocaine, marijuana, and opiate use (Integrated E-Z Split Key Cup, Innovacon, San Diego). Participants provided breath and urine samples three times a week (Monday, Wednesday, and Friday) and received prize draws as stipulated by their test results and experimental condition. During the follow-up period, participants provided breath and urine samples once a month. At weeks 4, 8, 12, 16, 20, and 24, participants completed other study outcome measures to assess days of substance use and substance use severity (the Addiction Severity Index–Lite Version [29]), psychiatric symptom severity (the Brief Symptom Inventory [30] and the Positive and Negative Syndrome Scale [31]), and HIV risk behavior (the HIV Risk Behavior Scale [32]). Participants were reimbursed for completing these interviews.
Community outcomes were gathered from administrative sources for the 3 months prior to randomization, the 3-month intervention period, and the 3-month follow-up period. Data included counts of outpatient mental health and chemical dependency visits, inpatient substance use and psychiatric treatment admissions and days, detoxification admissions, emergency department utilization, and incarcerations.
Treatment as Usual
Treatment as usual consisted of mental health, chemical dependency, housing, and vocational services. Most clients saw their case manager once a week, had access to psychiatric medication management, and could participate in various group treatments. Forty-six percent (N=42) and 54% (N=46) of individuals in the contingency management group and the noncontingent control group, respectively, received intensive outpatient group or individual substance abuse treatment during the study.
Treatment Conditions
Contingency management group.
Noncontingent control group.
Consistent with previous studies, participants assigned to the noncontingent control condition were quasi-yoked to participants in the contingency management condition (27) in order to equate the number of prize draws received between conditions while isolating the contingent nature of reinforcement for drug abstinence. To determine the number of prize draws received by individuals assigned to the noncontingent condition in the first week of the study, the first five individuals recruited to the study were assigned to the contingency management condition. These individuals were treated for 1 week, and their average number of prize draws was used to set the number of prize draws received by participants in the noncontingent group during their initial week of participation. For the remainder of the study, the number of prize draws of the noncontingent condition was equal (yoked) to the average number of draws earned by the contingency management group during the preceding week. The five individuals initially assigned to the contingency management condition were not included in the intent-to-treat sample.
Reinforcers and Earnings
Reinforcers were useful, supportive items, including shampoo, toothpaste, gift cards, microwave ovens, and electronics. The total average value of prizes earned was $150.30 (SD=130.94) for the contingency management condition and $201.48 (SD=343.32) for the noncontingent control condition (not statistically different).
Analysis
Chi-square tests for categorical variables and t tests for continuous variables (including outcome measures) revealed no significant differences between the groups in baseline demographic, clinical, or outcome variables. Analyses were conducted on data from the intent-to-treat sample. Generalized estimating equations were used for the analyses conducted on outcome measures that were assessed over time in conjunction with the robust maximum likelihood estimation procedure to protect against type I error (34). Analyses utilized bidirectional tests despite our hypotheses being unidirectional to further protect against type I error. Odds ratios with 95% confidence intervals (CIs) are presented for binary measures, and unstandardized regression coefficients with 95% CIs are presented for continuous measures. This method of analysis has been used in previous contingency management trials and is an effective and efficient method of analyzing outcomes across time nested within participants (20, 33). Generalized estimating equations were used to evaluate the significance of changes in outcomes over time by treatment condition.
Multiple imputation procedures were used to handle missing data in primary and secondary outcome analyses. This approach has significant advantages over single imputation or listwise deletion (35) or other techniques (36, 37) in conjunction with generalized estimation equation analyses and has frequently been used in psychiatric studies with similar levels of missing data (38, 39). Use of multiple imputations requires the assumption of “missing at random”—a more conservative approach compared with the default listwise deletion used in generalized estimating equation analysis, which assumes “missing completely at random.” Preliminary analyses identified 12 variables that predicted missingness due to treatment dropout. We used these variables during the imputation phase to help ensure that our “missing at random” assumption was tenable. While there is no test for whether missing data are truly “missing at random” as opposed to “missing not at random,” our inclusive strategy for auxiliary variables (i.e., variables used during the imputation but not the analysis phase) during the imputation phase made for a tenable assumption that data were “missing at random.” Multiple imputation procedures use a regression-based approach to fill in the missing values to produce multiple data sets. To maximize the efficiency of our standard errors, 50 data sets were analyzed for each analysis. Parameters and standard errors were combined using Rubin’s rules (35). Analyses were performed using Stata, version 11.2 (StataCorp, College Station, Tex.). We performed extensive sensitivity analyses to assess the relative stability of the effect of treatment on the primary outcome measure (simulant abstinence) across different missing data handling techniques. In addition to the multiple imputation analysis, we performed analyses that used listwise deletion and last observation carried forward on both the intent-to-treat sample and the treatment completers only. In addition, we performed latent growth curve modeling that utilized maximum likelihood using Diggle-Kenward selection and Wu-Carroll selection modeling. While we attempted to fit a basic pattern mixture model (36, 37), convergence proved difficult and we were not able to obtain parameter estimates.
Results
The demographic and clinical characteristics of the sample are summarized in Table 1. There were no statistically significant differences between groups.
Characteristic | Contingency Management Condition (N=91) | Noncontingent Control Condition (N=85) | ||
---|---|---|---|---|
N | % | N | % | |
Female | 31 | 34 | 30 | 35 |
Race/ethnicity | ||||
Caucasian | 46 | 50 | 49 | 57 |
African American | 31 | 34 | 22 | 26 |
Other | 14 | 15 | 14 | 16 |
Homeless or unstable housing | 59 | 56 | 56 | 66 |
Diagnosis | ||||
Major depressive disorder | 26 | 29 | 21 | 25 |
Bipolar disorder | 30 | 33 | 30 | 35 |
Schizoaffective-spectrum disorder | 35 | 39 | 34 | 40 |
Inpatient psychiatric care in the past year | 30 | 33 | 29 | 34 |
Current substance use disorders | ||||
Cocaine dependence | 88 | 96 | 80 | 94 |
Amphetamine or methamphetamine dependence | 32 | 35 | 36 | 42 |
Nonstimulant drug abuse or dependence | 52 | 57 | 59 | 58 |
Alcohol abuse or dependence | 43 | 47 | 37 | 44 |
Mean | SD | Mean | SD | |
Age | 43.01 | 9.27 | 42.45 | 9.97 |
Days of substance use in the 30 days prior to study entry | ||||
Cocaine | 6.00 | 7.28 | 6.53 | 7.65 |
Amphetamines | 0.65 | 1.84 | 0.80 | 2.86 |
Alcohol | 5.46 | 7.21 | 6.61 | 9.67 |
Cannabis | 3.55 | 7.95 | 2.99 | 7.37 |
Opioids | 1.72 | 5.45 | 0.89 | 3.04 |
Other drugs | 0.30 | 1.66 | 0.95 | 4.33 |
Participants were considered treatment dropouts if they were absent from nine consecutive study appointments (i.e., 3 weeks) during the treatment phase. Significantly fewer participants in the contingency management group were retained throughout treatment compared with those in the control group (N=38 [42%] and N=55 [65%], respectively; χ2=9.8, df=1, p<0.05). Contingency management participants were retained for fewer weeks (mean=7.25; SD=4.25) than participants in the noncontingent control group (mean=9.33; SD=3.98). Dropout typically occurred during the first 4 weeks (contingency management group: N=34 [64%]; control group, N=19 [63%]).
Analyses conducted on data from the intent-to-treat sample revealed that participants in the contingency management group were 2.4 times (95% CI=1.9–3.0, p<0.05) as likely as those in the noncontingent group to submit a stimulant-negative urine sample during the treatment period (three urine tests submitted per week, for 12 weeks). The proportion of stimulant-abstinent participants (assessed by urine tests) in each group across the 12 weeks of the treatment period is displayed in Figure 1. The sensitivity analyses conducted on the intent-to-treat and treatment completer samples revealed a similar statistically significant group effect on stimulant abstinence. During the follow-up period, participants in the contingency management group were more likely than those in the noncontingent group to submit a stimulant-negative urine test (N=42 [46%] compared with N=30 [35%]; odds ratio=1.4, 95% CI=1.0–1.9, p<0.05 using multiple imputation procedures). However, significant group differences during the follow-up period were inconsistently observed in the sensitivity analyses.
Participants assigned to the contingency management condition reported significantly fewer days of stimulant use during the treatment period (β=2.70, 95% CI=0.91–4.31, p<0.05) and the follow-up period (β=2.16, 95% CI=0.18–3.24, p<0.05) compared with those in the noncontingent control condition. Table 2 provides descriptive statistics for outcome measures that demonstrated statistically significant group differences. Participants in the contingency management group reported fewer days of alcohol use than those in the noncontingent group during treatment (β=2.44, 95% CI=0.60–4.29, p<0.05), but not during follow-up. All other measures of other drug use and Addiction Severity Index composite scores did not differ between groups.
During Treatment | During Follow-Upa | |||||||
---|---|---|---|---|---|---|---|---|
Measure | Contingency Management Condition (N=91) | Noncontingent Control Condition (N=85) | Contingency Management Condition (N=52) | Noncontingent Control Condition (N=55) | ||||
Mean | SD | Mean | SD | Mean | SD | Mean | SD | |
Days of stimulant useb,c | 0.91 | 2.40 | 4.67 | 7.69 | 1.83 | 4.94 | 3.65 | 7.15 |
Days of alcohol usec | 1.84 | 4.77 | 4.32 | 8.43 | 3.60 | 7.92 | 4.21 | 7.86 |
Brief Symptom Inventory scorec | 1.04 | 0.79 | 1.24 | 0.71 | 1.17 | 0.85 | 1.25 | 0.79 |
Positive and Negative Syndrome Scale, excitement subscorec | 10.60 | 2.58 | 11.69 | 3.42 | 11.17 | 3.18 | 11.57 | 3.01 |
N | % | N | % | N | % | N | % | |
Injection drug usec | 34 | 37 | 56 | 66 | 23 | 44 | 31 | 56 |
No group differences were observed in HIV risk-associated sexual behavior. Approximately 24% of the sample (contingency management group, N=21 [23%]; noncontingent control group, N=21 [25%]) reported injecting illicit drugs in the month prior to study entry. Participants in the contingency management group were less than one-third as likely (odds ratio=3.3, 95% CI=1.8–5.9, p<0.05) to report engaging in injection drug use during treatment compared with those in the noncontingent group; the groups did not differ significantly on this measure during the follow-up period.
Contingency management participants reported lower levels of psychiatric symptoms on the Brief Symptom Inventory compared with those in the noncontingent condition during treatment (β=0.25, 95% CI=0.08–0.43, p<0.05). They also had lower ratings on the excitement subscale of the Positive and Negative Syndrome Scale (β=0.86, 95% CI=0.11–1.60, p<0.05). The groups did not differ significantly on these measures during the follow-up period. One individual from each group was admitted for a psychiatric hospitalization during the 3 months preceding randomization (length of stay: contingency management group, 24 days; noncontingent control group, 6 days). During the 6 months following randomization, two participants (2%) in the contingency management condition and nine (10%) in the noncontingent condition were admitted for inpatient psychiatric care (χ2=5.4, df=1, p=0.02). The groups also differed in the total number of days hospitalized (contingency management group, 14 days; noncontingent control group, 152 days). The groups did not differ on other community outcomes.
Discussion
To our knowledge, this is the first large randomized controlled trial to investigate the efficacy of a contingency management intervention for drugs of abuse as an adjunct to treatment as usual in a typical outpatient setting. Participants who received the contingency management intervention were 2.4 times as likely as those in the control condition to submit a stimulant-negative urine sample during treatment. Contingency management also had a positive impact on substance use and psychiatric outcomes that were not the primary focus of the intervention.
Group differences in psychiatric symptoms were corroborated by differences in inpatient psychiatric utilization. Compared with participants in the control condition, those in the contingency management condition were one-fifth as likely to be admitted for a psychiatric hospitalization during treatment. Changes in substance use, psychiatric symptoms, and inpatient psychiatric care observed in this study were equivalent to those reported in previous studies of more comprehensive and costly psychosocial interventions that are currently the gold standard for evidence-based treatment for co-occurring disorders (10–13), suggesting that contingency management in combination with treatment as usual may be a viable alternative to these treatments.
Our data suggest that an effect of contingency management on stimulant abstinence persisted after treatment was discontinued. While results of multiple imputation analyses suggested higher levels of stimulant abstinence in the contingency management group relative to the noncontingent control group during the follow-up period, results of sensitivity analyses yielded inconsistent results (only the multiple imputations technique showed a statistically significant group difference). Lower levels of self-reported stimulant use were observed during the follow-up period by participants in the contingency management group relative to those in the control group. While these differences in self-reported stimulant use are consistent with previous studies in non-seriously mentally ill populations that demonstrated treatment effects up to 1 year after completion (22), this result should be interpreted with caution given the high level of missing data during follow-up.
Group differences in primary and secondary outcome measures were observed even though the contingency management dropout rate was somewhat higher (59%) than has been previously observed in stimulant-abusing populations (approximately 50%) (20). The higher dropout rate in this study likely reflects the psychiatric comorbidity in this sample and the fact that 66% of our sample was homeless. While the groups did not differ in psychiatric severity or homelessness, it is possible that lower-functioning individuals were more likely to consistently attend study sessions when provided with reinforcement for attendance, but not when the additional contingency of abstinence was added. Others have found that treatment completion is improved after patients are exposed to an initial period of noncontingent reinforcement (41). This and other approaches (e.g., providing higher-value rewards, such as housing [42], or adding contingency management to evidence-based treatments for mental illness) might improve treatment retention in this population.
Despite empirical support, potential cost savings, and characteristics that suggest that contingency management could be disseminated into clinical practice, it has not been fully utilized in clinical practice. The primary barriers to dissemination appear to be financial, rather than clinical or theoretical objections by clinicians (43). While the cost of delivering contingency management increases when individuals respond to the treatment (they receive more prizes), this increase is modest compared with savings in inpatient care demonstrated in this and other studies (14). While a number of innovative strategies have been explored to provide funding for contingency management reinforcers (e.g., use of donated funds/prizes, opportunities to work) (41), it is likely that contingency management will continue to be underutilized until payers provide funding for the costs of delivering this treatment. An example of this type of reform recently occurred within the Veterans Health Administration, where contingency management has been approved as a treatment for illicit drug use in veterans receiving intensive outpatient treatment (44).
The generalizability of our results may be limited because recruitment for the study occurred at one large treatment agency. Methodologically, the lower treatment completion rate in the contingency management condition relative to the noncontingent control condition resulted in group differences in rates of missing data. However, we used robust statistical methods (i.e., multiple imputation), which have been frequently used in psychiatric research where comparable levels of missing data were observed (38, 39), to account for missing data, and we conducted multiple sensitivity analyses to corroborate the findings of our multiple-imputation approach. Despite these consistent results, it is important to note that all imputation strategies bias study results, with some (e.g., single imputation) introducing more bias than others.
Despite these limitations, our results provide evidence that contingency management is an effective technique for reducing drug and alcohol use, HIV risk behavior, psychiatric symptoms, and rates of inpatient hospitalization in seriously mentally ill adults. If financial and other barriers to dissemination can be overcome, contingency management might be an effective adjunctive treatment for this population. Future research investigating the efficacy of contingency management in this population should focus on identifying strategies to improve treatment retention and exploring how contingency management might be optimally combined with other evidence-based interventions to further improve outcomes.
1 : Comorbidity of mental disorders with alcohol and other drug abuse: results from the Epidemiologic Catchment Area (ECA) Study. JAMA 1990; 264:2511–2518Crossref, Medline, Google Scholar
2 : Co-occurring severe mental illness and substance use disorders: a review of recent research. Psychiatr Serv 1999; 50:1427–1434Link, Google Scholar
3 : Treating substance abuse in schizophrenia: an initial report. J Subst Abuse Treat 2001; 20:163–175Crossref, Medline, Google Scholar
4 : Homelessness and mental illness in a professional- and peer-led cocaine treatment clinic. Psychiatr Serv 1998; 49:533–535Link, Google Scholar
5 : Predicting the “revolving door” phenomenon among patients with schizophrenic, schizoaffective, and affective disorders. Am J Psychiatry 1995; 152:856–861Link, Google Scholar
6 : Substance abuse in schizophrenia: service utilization and costs. J Nerv Ment Dis 1993; 181:227–232Crossref, Medline, Google Scholar
7 : Co-occurring disorders among mentally ill jail detainees: implications for public policy. Am Psychol 1991; 46:1036–1045Crossref, Medline, Google Scholar
8 : A national survey of care for persons with co-occurring mental and substance use disorders. Psychiatr Serv 2001; 52:1062–1068Link, Google Scholar
9 : Predictors of treatment receipt among adults with a drug use disorder. Am J Drug Alcohol Abuse 2004; 30:841–869Crossref, Medline, Google Scholar
10 : Integrated motivational interviewing and cognitive behavioural therapy for people with psychosis and comorbid substance misuse: randomised controlled trial. BMJ 2010; 341:c6325Crossref, Medline, Google Scholar
11 : Cognitive-behavioural therapy for substance use disorders in people with psychotic disorders: randomised controlled trial. Br J Psychiatry 2006; 188:439–448Crossref, Medline, Google Scholar
12 : A “community-friendly” version of integrated group therapy for patients with bipolar disorder and substance dependence: a randomized controlled trial. Drug Alcohol Depend 2009; 104:212–219Crossref, Medline, Google Scholar
13 : Assertive community treatment for patients with co-occurring severe mental illness and substance use disorder: a clinical trial. Am J Orthopsychiatry 1998; 68:201–215Crossref, Medline, Google Scholar
14 : A randomized clinical trial of a new behavioral treatment for drug abuse in people with severe and persistent mental illness. Arch Gen Psychiatry 2006; 63:426–432Crossref, Medline, Google Scholar
15 : A systematic review of psychosocial research on psychosocial interventions for people with co-occurring severe mental and substance use disorders. J Subst Abuse Treat 2008; 34:123–138Crossref, Medline, Google Scholar
16 : Datapoints: service availability for persons with co-occurring conditions. Psychiatr Serv 2004; 55:978Link, Google Scholar
17 : Identifying barriers to mental health system improvements: an examination of community participation in assertive community treatment programs. Int J Ment Health Syst 2011; 5:27Crossref, Medline, Google Scholar
18 : Implementation of integrated dual disorders treatment: a qualitative analysis of facilitators and barriers. Psychiatr Serv 2008; 59:989–995Link, Google Scholar
19 : A meta-analytic review of psychosocial interventions for substance use disorders. Am J Psychiatry 2008; 165:179–187Link, Google Scholar
20 : Effect of prize-based incentives on outcomes in stimulant abusers in outpatient psychosocial treatment programs: a national drug abuse treatment clinical trials network study. Arch Gen Psychiatry 2005; 62:1148–1156Crossref, Medline, Google Scholar
21 : Use of a low-cost incentive intervention to improve counseling attendance among methadone-maintained patients. J Subst Abuse Treat 2005; 29:253–258Crossref, Medline, Google Scholar
22 : A comparison of contingency management and cognitive-behavioral approaches for stimulant-dependent individuals. Addiction 2006; 101:267–274Crossref, Medline, Google Scholar
23 : A comparison of contingency management and cognitive-behavioral approaches during methadone maintenance treatment for cocaine dependence. Arch Gen Psychiatry 2002; 59:817–824Crossref, Medline, Google Scholar
24 : Investigating the use of contingency management in the treatment of cocaine abuse among individuals with schizophrenia: a feasibility study. Psychiatry Res 2004; 125:61–64Crossref, Medline, Google Scholar
25 : Outcomes of managing disability benefits among patients with substance dependence and severe mental illness. Psychiatr Serv 2004; 55:445–447Link, Google Scholar
26 : Predictors of psychosis severity in individuals with primary stimulant addictions. Addict Behav 2011; 36:137–139Crossref, Medline, Google Scholar
27 : Desipramine and contingency management for cocaine and opiate dependence in buprenorphine maintained patients. Drug Alcohol Depend 2003; 70:315–325Crossref, Medline, Google Scholar
28 : Ensuring balanced distribution of prognostic factors in treatment outcome research. J Stud Alcohol Suppl 1994; 12:70–75Crossref, Medline, Google Scholar
29 : An improved diagnostic evaluation instrument for substance abuse patients: the Addiction Severity Index. J Nerv Ment Dis 1980; 168:26–33Crossref, Medline, Google Scholar
30 : The Brief Symptom Inventory: an introductory report. Psychol Med 1983; 13:595–605Crossref, Medline, Google Scholar
31 : The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13:261–276Crossref, Medline, Google Scholar
32 : The reliability and validity of a scale to measure HIV risk-taking behaviour among intravenous drug users. AIDS 1991; 5:181–185Crossref, Medline, Google Scholar
33 : Effects of lower-cost incentives on stimulant abstinence in methadone maintenance treatment: a National Drug Abuse Treatment Clinical Trials Network study. Arch Gen Psychiatry 2006; 63:201–208Crossref, Medline, Google Scholar
34 : Models for longitudinal data: a generalized estimating equation approach. Biometrics 1988; 44:1049–1060Crossref, Medline, Google Scholar
35 : Missing data: our view of the state of the art. Psychol Methods 2002; 7:147–177Crossref, Medline, Google Scholar
36 : Missing not at random models for latent growth curve analyses. Psychol Methods 2011; 16:1–16Crossref, Medline, Google Scholar
37 : Growth modeling with nonignorable dropout: alternative analyses of the STAR*D antidepressant trial. Psychol Methods 2011; 16:17–33Crossref, Medline, Google Scholar
38 : Pharmacotherapy plus psychotherapy for treatment of depression in active injection drug users. Arch Gen Psychiatry 2004; 61:152–159Crossref, Medline, Google Scholar
39 : Persistence of addictive disorders in a first-offender driving while impaired population. Arch Gen Psychiatry 2011; 68:1151–1157Crossref, Medline, Google Scholar
40 : Ethnic differences in HIV risk behaviors among methadone-maintained women receiving contingency management for cocaine use disorders. Drug Alcohol Depend 2008; 98:144–153Crossref, Medline, Google Scholar
41 : Attendance rates in a workplace predict subsequent outcome of employment-based reinforcement of cocaine abstinence in methadone patients. J Appl Behav Anal 2008; 41:499–516Crossref, Medline, Google Scholar
42 : To house or not to house: the effects of providing housing to homeless substance abusers in treatment. Am J Public Health 2005; 95:1259–1265Crossref, Medline, Google Scholar
43 : Substance abuse treatment providers’ beliefs and objections regarding contingency management: implications for dissemination. Drug Alcohol Depend 2006; 85:19–27Crossref, Medline, Google Scholar
44 : VHA Programs for Veterans With Substance Use Disorders (SUD). Washington, DC, Department of Veterans Affairs, 2011Google Scholar